Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4679 originally caused by: Started by upstream project "master-osmo-trx" build number 4888 originally caused by: Started by upstream project "master-libusrp" build number 1827 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17673 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6687 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8709 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8955 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2977 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29293 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30076 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4679 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12983 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9251 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4707 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins835062279815496278.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-12 16:06:05 + trial_dir_prefix=trial- + rm -rf trial-2378 + trial_dir=trial-2379 + mkdir -p trial-2379 + mv open5gs.build-8.tgz osmo-bsc.build-17673.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6687.tgz osmo-hlr.build-8709.tgz osmo-hnbgw.build-2977.tgz osmo-mgw.build-8955.tgz osmo-msc.build-29293.tgz osmo-nitb.build-12983.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30076.tgz osmo-stp.build-9251.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4707.tgz srslte.build-19.tgz trial-2379 + cat open5gs.build-8.md5 osmo-bsc.build-17673.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8709.md5 osmo-hnbgw.build-2977.md5 osmo-mgw.build-8955.md5 osmo-msc.build-29293.md5 osmo-nitb.build-12983.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30076.md5 osmo-stp.build-9251.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17673.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8709.md5 osmo-hnbgw.build-2977.md5 osmo-mgw.build-8955.md5 osmo-msc.build-29293.md5 osmo-nitb.build-12983.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30076.md5 osmo-stp.build-9251.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2379 combinations: None trial: 'trial-2379' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2379 -------------------------------------------------------------------------------------------- 16:06:15.746322 tst trial-2379: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/log --------------------------------------------------------------------- trial-2379 nitb_sms:sysmo --------------------------------------------------------------------- 16:08:22.199288 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:08:22.202862 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 16:08:22.223447 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 16:08:22.230157 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 16:08:22.285282 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 16:08:22.305911 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 16:08:22.312456 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 16:08:22.849218 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 16:08:22.854043 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 16:08:22.864755 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 16:08:23.233647 tst mo_mt_sms.py: using LAC 29976 16:08:23.468135 tst mo_mt_sms.py: using RAC 141 16:08:23.584468 tst mo_mt_sms.py: using CellId 29976 16:08:23.699223 tst mo_mt_sms.py: using BVCI 29977 16:08:23.807184 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 16:08:23.987278 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 16:08:24.103977 tst mo_mt_sms.py:9: start nitb and bts... 16:08:24.302970 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:08:26.545502 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26363): Launched 16:08:26.847797 run osmo-nitb_10.42.42.2(pid=26364): Launched 16:08:27.012942 run osmo-nitb_10.42.42.2(pid=26364): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26364)] 16:08:27.136719 run osmo-nitb_10.42.42.2(pid=26364): stdout: | (launched: 2022-12-12_16:08:26.790817) 16:08:27.261670 run osmo-nitb_10.42.42.2(pid=26364): stderr: | (launched: 2022-12-12_16:08:26.835820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:08:27.387648 run osmo-nitb_10.42.42.2(pid=26364): stdout: | (launched: 2022-12-12_16:08:26.790817) 16:08:27.507197 run osmo-nitb_10.42.42.2(pid=26364): stderr: | (launched: 2022-12-12_16:08:26.835820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:08:27.650280 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26364): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26364) [trial-2379↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26364)] [trial-2379↪nitb_sms:sysmo↪mo_mt_sms.py:11] 16:08:27.658584 tst mo_mt_sms.py:11: Test FAILED (4.8 sec) 16:08:27.665231 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26363): Terminating (SIGTERM) 16:08:27.873748 --- ParallelTerminationStrategy: PID 26363 died... 16:08:27.894682 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26363): Terminated: ok {rc=0} 16:08:27.980395 bus /sierra_3: Setting Powered False 16:08:29.081505 bus /sierra_3: Setting Powered False 16:08:30.199093 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 sms:sysmo --------------------------------------------------------------------- 16:08:31.386562 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:08:31.391921 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 16:08:31.416330 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 16:08:31.447195 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 16:08:31.504337 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 16:08:31.534893 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 16:08:31.570778 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 16:08:32.098287 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 sms:sysmo mo_mt_sms.py ---------------------------------------------- 16:08:32.105505 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 16:08:32.117631 tst sms:sysmo: Using 1 x bts (candidates: 1) 16:08:32.154245 tst mo_mt_sms.py: using LAC 29977 16:08:32.285062 tst mo_mt_sms.py: using RAC 142 16:08:32.402498 tst mo_mt_sms.py: using CellId 29977 16:08:32.521362 tst mo_mt_sms.py: using BVCI 29978 16:08:32.630050 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 16:08:32.640545 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 16:08:32.651043 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 16:08:32.661423 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 16:08:32.672487 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 16:08:32.682916 tst sms:sysmo: Using 1 x modem (candidates: 2) 16:08:32.802248 tst sms:sysmo: Using 1 x modem (candidates: 2) 16:08:32.923113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:34.642784 run create_hlr_db(pid=26368): Launched 16:08:34.767504 bus /sierra_2: Setting Powered False 16:08:35.827369 run create_hlr_db(pid=26368): Terminated: ok {rc=0} 16:08:36.271141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26370): Launched 16:08:36.597408 run osmo-hlr_10.42.42.2(pid=26371): Launched 16:08:36.721282 run osmo-stp_10.42.42.5: Starting osmo-stp 16:08:39.314680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26373): Launched 16:08:39.641119 run osmo-stp_10.42.42.5(pid=26374): Launched 16:08:39.765545 run osmo-msc_10.42.42.6: Starting osmo-msc 16:08:45.241591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26376): Launched 16:08:45.568812 run osmo-msc_10.42.42.6(pid=26377): Launched 16:08:45.749284 run osmo-stp_10.42.42.5(pid=26374): ERR: Terminated: ERROR {rc=1} [trial-2379↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26374)] 16:08:45.980626 run osmo-stp_10.42.42.5(pid=26374): stdout: | (launched: 2022-12-12_16:08:39.580638) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:46.335966 run osmo-stp_10.42.42.5(pid=26374): stderr: | 20221212160839771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160839771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160839771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160839772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160839772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160839772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160839772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:46.529855 run osmo-stp_10.42.42.5(pid=26374): stdout: | (launched: 2022-12-12_16:08:39.580638) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:08:46.681362 run osmo-stp_10.42.42.5(pid=26374): stderr: | 20221212160839771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160839771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160839771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160839772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160839772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160839772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160839772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:08:46.884010 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26374): Process ended prematurely: osmo-stp_10.42.42.5(pid=26374) [trial-2379↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26374)] [trial-2379↪sms:sysmo↪mo_mt_sms.py:16] 16:08:46.899112 tst mo_mt_sms.py:16: Test FAILED (14.8 sec) 16:08:46.935897 run osmo-hlr_10.42.42.2(pid=26371): ERR: Terminated: ERROR {rc=237} [trial-2379↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26371)] 16:08:46.997738 run osmo-hlr_10.42.42.2(pid=26371): stdout: | (launched: 2022-12-12_16:08:36.537082) 16:08:47.074836 run osmo-hlr_10.42.42.2(pid=26371): stderr: | 20221212160836733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212160836733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212160836733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212160836733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212160836733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212160836733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212160836749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212160836758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212160836758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212160836758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:08:47.166283 run osmo-msc_10.42.42.6(pid=26377): ERR: Terminated: ERROR {rc=2} [trial-2379↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26377)] 16:08:47.232014 run osmo-msc_10.42.42.6(pid=26377): stdout: | (launched: 2022-12-12_16:08:45.508108) 16:08:47.302666 run osmo-msc_10.42.42.6(pid=26377): stderr: | 20221212160845916 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212160845916 DLGLOBAL DEBUG validating counter group 0x7fed8114ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212160845916 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212160845916 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212160845916 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212160845920 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212160845922 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212160845922 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212160845923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212160845923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:08:47.406601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26370): Terminating (SIGTERM) 16:08:47.460876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26373): Terminating (SIGTERM) 16:08:47.525463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26376): Terminating (SIGTERM) 16:08:47.588516 --- ParallelTerminationStrategy: PID 26370 died... 16:08:47.615225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26370): Terminated: ok {rc=0} 16:08:47.677262 --- ParallelTerminationStrategy: PID 26373 died... 16:08:47.708616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26373): Terminated: ok {rc=0} 16:08:47.771483 --- ParallelTerminationStrategy: PID 26376 died... 16:08:47.799252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26376): Terminated: ok {rc=0} 16:08:47.918736 bus /sierra_3: Setting Powered False 16:08:49.048885 bus /sierra_3: Setting Powered False 16:08:50.170144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_ussd:sysmo --------------------------------------------------------------------- 16:08:51.407275 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:08:51.412372 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 16:08:51.436929 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 16:08:51.447497 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 16:08:51.483395 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 16:08:51.505954 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 16:08:51.515318 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 16:08:52.033752 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 16:08:52.041114 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 16:08:52.053624 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 16:08:52.093419 tst assert_extension.py: using LAC 29978 16:08:52.226837 tst assert_extension.py: using RAC 143 16:08:52.356270 tst assert_extension.py: using CellId 29978 16:08:52.485449 tst assert_extension.py: using BVCI 29979 16:08:52.609252 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 16:08:52.732704 tst assert_extension.py:10: start nitb and bts... 16:08:52.957730 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:08:53.631506 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26653): Launched 16:08:53.975354 run osmo-nitb_10.42.42.2(pid=26654): Launched 16:08:54.179951 run osmo-nitb_10.42.42.2(pid=26654): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26654)] 16:08:54.330466 run osmo-nitb_10.42.42.2(pid=26654): stdout: | (launched: 2022-12-12_16:08:53.915126) 16:08:54.482380 run osmo-nitb_10.42.42.2(pid=26654): stderr: | (launched: 2022-12-12_16:08:53.963842) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:08:54.634273 run osmo-nitb_10.42.42.2(pid=26654): stdout: | (launched: 2022-12-12_16:08:53.915126) 16:08:54.780460 run osmo-nitb_10.42.42.2(pid=26654): stderr: | (launched: 2022-12-12_16:08:53.963842) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26654): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26654) [trial-2379↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26654)] 16:08:55.121856 tst osmo-nitb_10.42.42.2(pid=26654): stdout: | (launched: 2022-12-12_16:08:53.915126) 16:08:55.258626 tst osmo-nitb_10.42.42.2(pid=26654): stderr: | (launched: 2022-12-12_16:08:53.963842) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:08:55.418043 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26654): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26654) [trial-2379↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26654)] [trial-2379↪nitb_ussd:sysmo↪assert_extension.py:12] 16:08:55.428277 tst assert_extension.py:12: Test FAILED (3.4 sec) 16:08:55.437224 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26653): Terminating (SIGTERM) 16:08:55.653708 --- ParallelTerminationStrategy: PID 26653 died... 16:08:55.676813 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26653): Terminated: ok {rc=0} 16:08:55.770799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 ussd:sysmo --------------------------------------------------------------------- 16:08:56.964473 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:08:56.969976 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 16:08:56.996773 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 16:08:57.026543 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 16:08:57.065117 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 16:08:57.087709 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 16:08:57.117654 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 16:08:57.645260 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 ussd:sysmo assert_extension.py ---------------------------------------------- 16:08:57.652777 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 16:08:57.665894 tst ussd:sysmo: Using 1 x bts (candidates: 1) 16:08:57.707336 tst assert_extension.py: using LAC 29979 16:08:57.840514 tst assert_extension.py: using RAC 144 16:08:57.972348 tst assert_extension.py: using CellId 29979 16:08:58.104100 tst assert_extension.py: using BVCI 29980 16:08:58.229963 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 16:08:58.242472 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 16:08:58.255017 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 16:08:58.268317 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 16:08:58.281723 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 16:08:58.296452 tst ussd:sysmo: Using 1 x modem (candidates: 1) 16:08:58.421630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:08:58.947847 run create_hlr_db(pid=26658): Launched 16:08:59.115236 bus /sierra_2: Setting Powered False 16:09:00.179979 run create_hlr_db(pid=26658): Terminated: ok {rc=0} 16:09:00.649523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26660): Launched 16:09:01.064783 run osmo-hlr_10.42.42.2(pid=26661): Launched 16:09:01.348033 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:02.194879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26663): Launched 16:09:02.515640 run osmo-stp_10.42.42.5(pid=26664): Launched 16:09:02.757143 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:03.418641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26666): Launched 16:09:03.741316 run osmo-msc_10.42.42.6(pid=26667): Launched 16:09:04.086251 run osmo-stp_10.42.42.5(pid=26664): ERR: Terminated: ERROR {rc=1} [trial-2379↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26664)] 16:09:04.363420 run osmo-stp_10.42.42.5(pid=26664): stdout: | (launched: 2022-12-12_16:09:02.456720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:04.633817 run osmo-stp_10.42.42.5(pid=26664): stderr: | 20221212160902773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160902773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160902773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160902774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160902774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160902775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160902775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:04.802432 run osmo-stp_10.42.42.5(pid=26664): stdout: | (launched: 2022-12-12_16:09:02.456720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:04.926551 run osmo-stp_10.42.42.5(pid=26664): stderr: | 20221212160902773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160902773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160902773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160902774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160902774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160902775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160902775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:05.078275 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26664): Process ended prematurely: osmo-stp_10.42.42.5(pid=26664) [trial-2379↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26664)] [trial-2379↪ussd:sysmo↪assert_extension.py:17] 16:09:05.088013 tst assert_extension.py:17: Test FAILED (7.4 sec) 16:09:05.116455 run osmo-hlr_10.42.42.2(pid=26661): ERR: Terminated: ERROR {rc=237} [trial-2379↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26661)] 16:09:05.166967 run osmo-hlr_10.42.42.2(pid=26661): stdout: | (launched: 2022-12-12_16:09:00.995453) 16:09:05.224004 run osmo-hlr_10.42.42.2(pid=26661): stderr: | 20221212160901322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212160901322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212160901322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212160901322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212160901322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212160901323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212160901344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212160901357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212160901357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212160901357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:05.303031 run osmo-msc_10.42.42.6(pid=26667): ERR: Terminated: ERROR {rc=2} [trial-2379↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26667)] 16:09:05.359629 run osmo-msc_10.42.42.6(pid=26667): stdout: | (launched: 2022-12-12_16:09:03.682718) 16:09:05.411907 run osmo-msc_10.42.42.6(pid=26667): stderr: | 20221212160904267 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212160904267 DLGLOBAL DEBUG validating counter group 0x7f10b91a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212160904267 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212160904267 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212160904268 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212160904268 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212160904278 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212160904278 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212160904278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212160904278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:05.476849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26660): Terminating (SIGTERM) 16:09:05.520828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26663): Terminating (SIGTERM) 16:09:05.566076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26666): Terminating (SIGTERM) 16:09:05.611696 --- ParallelTerminationStrategy: PID 26660 died... 16:09:05.632289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26660): Terminated: ok {rc=0} 16:09:05.681675 --- ParallelTerminationStrategy: PID 26663 died... 16:09:05.702327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26663): Terminated: ok {rc=0} 16:09:05.749634 --- ParallelTerminationStrategy: PID 26666 died... 16:09:05.769711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26666): Terminated: ok {rc=0} 16:09:05.858836 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:09:07.057513 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:09:07.065125 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:09:07.087308 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:09:07.115931 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:09:07.168826 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:09:07.190577 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:09:07.219963 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:09:07.770710 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:09:07.825848 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:07.837819 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:09:07.895736 tst mo_mt_call.py: using LAC 29980 16:09:08.021795 tst mo_mt_call.py: using RAC 145 16:09:08.146338 tst mo_mt_call.py: using CellId 29980 16:09:08.273404 tst mo_mt_call.py: using BVCI 29981 16:09:08.390275 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:08.402706 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:08.416104 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:08.428653 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:08.441247 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:08.454162 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:09:08.576260 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:09:08.699178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:09.200003 run create_hlr_db(pid=26672): Launched 16:09:09.367209 bus /sierra_2: Setting Powered False 16:09:10.428559 run create_hlr_db(pid=26672): Terminated: ok {rc=0} 16:09:10.882044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26675): Launched 16:09:11.212746 run osmo-hlr_10.42.42.2(pid=26676): Launched 16:09:11.339735 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:11.910938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26678): Launched 16:09:12.241269 run osmo-stp_10.42.42.5(pid=26679): Launched 16:09:12.368891 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:12.966048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26681): Launched 16:09:13.298165 run osmo-msc_10.42.42.6(pid=26682): Launched 16:09:13.482415 run osmo-stp_10.42.42.5(pid=26679): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26679)] 16:09:13.621479 run osmo-stp_10.42.42.5(pid=26679): stdout: | (launched: 2022-12-12_16:09:12.179863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:13.761197 run osmo-stp_10.42.42.5(pid=26679): stderr: | 20221212160912371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160912372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160912372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160912372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160912373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160912373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160912373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:13.898914 run osmo-stp_10.42.42.5(pid=26679): stdout: | (launched: 2022-12-12_16:09:12.179863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:14.029693 run osmo-stp_10.42.42.5(pid=26679): stderr: | 20221212160912371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160912372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160912372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160912372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160912373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160912373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160912373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:14.187084 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26679): Process ended prematurely: osmo-stp_10.42.42.5(pid=26679) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26679)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:09:14.196621 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:09:14.224789 run osmo-hlr_10.42.42.2(pid=26676): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26676)] 16:09:14.275579 run osmo-hlr_10.42.42.2(pid=26676): stdout: | (launched: 2022-12-12_16:09:11.151367) 16:09:14.327898 run osmo-hlr_10.42.42.2(pid=26676): stderr: | 20221212160911350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212160911350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212160911350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212160911350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212160911350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212160911350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212160911364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212160911373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212160911373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212160911373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:14.400354 run osmo-msc_10.42.42.6(pid=26682): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26682)] 16:09:14.450707 run osmo-msc_10.42.42.6(pid=26682): stdout: | (launched: 2022-12-12_16:09:13.236477) 16:09:14.502757 run osmo-msc_10.42.42.6(pid=26682): stderr: | 20221212160913558 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212160913558 DLGLOBAL DEBUG validating counter group 0x7fa0eb183c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212160913559 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212160913559 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212160913559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212160913559 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212160913561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212160913561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212160913561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212160913561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:14.555187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26675): Terminating (SIGTERM) 16:09:14.597083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26678): Terminating (SIGTERM) 16:09:14.639253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26681): Terminating (SIGTERM) 16:09:14.681902 --- ParallelTerminationStrategy: PID 26675 died... 16:09:14.702519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26675): Terminated: ok {rc=0} 16:09:14.749356 --- ParallelTerminationStrategy: PID 26678 died... 16:09:14.768824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26678): Terminated: ok {rc=0} 16:09:14.815935 --- ParallelTerminationStrategy: PID 26681 died... 16:09:14.835549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26681): Terminated: ok {rc=0} 16:09:14.924651 bus /sierra_3: Setting Powered False 16:09:16.027521 bus /sierra_3: Setting Powered False 16:09:17.167984 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:09:18.314986 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:18.326852 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:09:18.386505 tst mo_mt_call_osmux.py: using LAC 29981 16:09:18.506555 tst mo_mt_call_osmux.py: using RAC 146 16:09:18.626313 tst mo_mt_call_osmux.py: using CellId 29981 16:09:18.747294 tst mo_mt_call_osmux.py: using BVCI 29982 16:09:18.860675 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:18.871858 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:18.882846 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:18.893768 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:18.904712 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:09:18.915719 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:09:19.029302 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:09:19.145116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:19.625718 run create_hlr_db(pid=26684): Launched 16:09:19.752940 bus /sierra_2: Setting Powered False 16:09:20.814268 run create_hlr_db(pid=26684): Terminated: ok {rc=0} 16:09:21.265990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26686): Launched 16:09:21.598465 run osmo-hlr_10.42.42.2(pid=26687): Launched 16:09:21.725295 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:22.297353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26689): Launched 16:09:22.630039 run osmo-stp_10.42.42.5(pid=26690): Launched 16:09:22.756027 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:23.356274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26692): Launched 16:09:23.672117 run osmo-msc_10.42.42.6(pid=26693): Launched 16:09:23.846520 run osmo-stp_10.42.42.5(pid=26690): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26690)] 16:09:23.976165 run osmo-stp_10.42.42.5(pid=26690): stdout: | (launched: 2022-12-12_16:09:22.568031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:24.106182 run osmo-stp_10.42.42.5(pid=26690): stderr: | 20221212160922760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160922760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160922760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160922761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160922761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160922761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160922761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:24.234172 run osmo-stp_10.42.42.5(pid=26690): stdout: | (launched: 2022-12-12_16:09:22.568031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:24.356450 run osmo-stp_10.42.42.5(pid=26690): stderr: | 20221212160922760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160922760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160922760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160922761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160922761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160922761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160922761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:24.503018 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26690): Process ended prematurely: osmo-stp_10.42.42.5(pid=26690) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26690)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:09:24.512026 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:09:24.538551 run osmo-hlr_10.42.42.2(pid=26687): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26687)] 16:09:24.586907 run osmo-hlr_10.42.42.2(pid=26687): stdout: | (launched: 2022-12-12_16:09:21.536518) 16:09:24.636889 run osmo-hlr_10.42.42.2(pid=26687): stderr: | 20221212160921740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212160921740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212160921740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212160921740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212160921740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212160921740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212160921751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212160921760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212160921760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212160921760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:24.706485 run osmo-msc_10.42.42.6(pid=26693): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26693)] 16:09:24.754753 run osmo-msc_10.42.42.6(pid=26693): stdout: | (launched: 2022-12-12_16:09:23.614392) 16:09:24.804717 run osmo-msc_10.42.42.6(pid=26693): stderr: | 20221212160923887 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212160923887 DLGLOBAL DEBUG validating counter group 0x7fd7efd20c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212160923887 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212160923887 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212160923888 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212160923888 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212160923890 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212160923890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212160923890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212160923890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:24.854865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26686): Terminating (SIGTERM) 16:09:24.894549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26689): Terminating (SIGTERM) 16:09:24.934954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26692): Terminating (SIGTERM) 16:09:24.975391 --- ParallelTerminationStrategy: PID 26686 died... 16:09:24.994846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26686): Terminated: ok {rc=0} 16:09:25.038865 --- ParallelTerminationStrategy: PID 26689 died... 16:09:25.057497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26689): Terminated: ok {rc=0} 16:09:25.102205 --- ParallelTerminationStrategy: PID 26692 died... 16:09:25.120810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26692): Terminated: ok {rc=0} 16:09:25.207873 bus /sierra_3: Setting Powered False 16:09:26.309981 bus /sierra_3: Setting Powered False 16:09:27.426794 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:09:28.666422 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:09:28.673509 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:09:28.695287 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:09:28.723867 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:09:28.779421 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:09:28.801122 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:09:28.829404 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:09:29.383130 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:09:29.436518 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:29.448086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:09:29.507145 tst mo_mt_call.py: using LAC 29982 16:09:29.635709 tst mo_mt_call.py: using RAC 147 16:09:29.763173 tst mo_mt_call.py: using CellId 29982 16:09:29.891647 tst mo_mt_call.py: using BVCI 29983 16:09:30.005656 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:30.016900 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:30.028374 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:30.039452 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:30.050350 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:30.061446 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:09:30.175853 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:09:30.294293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:30.836101 run create_hlr_db(pid=26698): Launched 16:09:30.995704 bus /sierra_2: Setting Powered False 16:09:32.067090 run create_hlr_db(pid=26698): Terminated: ok {rc=0} 16:09:32.530282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26700): Launched 16:09:32.863632 run osmo-hlr_10.42.42.2(pid=26701): Launched 16:09:32.991224 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:33.559269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26703): Launched 16:09:33.890947 run osmo-stp_10.42.42.5(pid=26704): Launched 16:09:34.019900 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:34.621928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26707): Launched 16:09:34.953992 run osmo-msc_10.42.42.6(pid=26708): Launched 16:09:35.136306 run osmo-stp_10.42.42.5(pid=26704): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26704)] 16:09:35.275137 run osmo-stp_10.42.42.5(pid=26704): stdout: | (launched: 2022-12-12_16:09:33.829408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:35.414589 run osmo-stp_10.42.42.5(pid=26704): stderr: | 20221212160934021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160934022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160934022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160934022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160934023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160934023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160934023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:35.551935 run osmo-stp_10.42.42.5(pid=26704): stdout: | (launched: 2022-12-12_16:09:33.829408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:35.683058 run osmo-stp_10.42.42.5(pid=26704): stderr: | 20221212160934021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160934022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160934022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160934022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160934023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160934023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160934023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:35.840520 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26704): Process ended prematurely: osmo-stp_10.42.42.5(pid=26704) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26704)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:09:35.850179 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:09:35.878078 run osmo-hlr_10.42.42.2(pid=26701): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26701)] 16:09:35.928751 run osmo-hlr_10.42.42.2(pid=26701): stdout: | (launched: 2022-12-12_16:09:32.801733) 16:09:35.980616 run osmo-hlr_10.42.42.2(pid=26701): stderr: | 20221212160933000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212160933000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212160933001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212160933001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212160933001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212160933001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212160933019 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212160933028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212160933029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212160933029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:36.052552 run osmo-msc_10.42.42.6(pid=26708): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26708)] 16:09:36.102684 run osmo-msc_10.42.42.6(pid=26708): stdout: | (launched: 2022-12-12_16:09:34.892451) 16:09:36.154833 run osmo-msc_10.42.42.6(pid=26708): stderr: | 20221212160935212 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212160935212 DLGLOBAL DEBUG validating counter group 0x7f04143b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212160935212 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212160935212 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212160935213 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212160935213 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212160935215 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212160935215 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212160935215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212160935215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:36.206861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26700): Terminating (SIGTERM) 16:09:36.248411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26703): Terminating (SIGTERM) 16:09:36.290110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26707): Terminating (SIGTERM) 16:09:36.332040 --- ParallelTerminationStrategy: PID 26700 died... 16:09:36.351967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26700): Terminated: ok {rc=0} 16:09:36.398515 --- ParallelTerminationStrategy: PID 26703 died... 16:09:36.417817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26703): Terminated: ok {rc=0} 16:09:36.464005 --- ParallelTerminationStrategy: PID 26707 died... 16:09:36.483339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26707): Terminated: ok {rc=0} 16:09:36.571042 bus /sierra_3: Setting Powered False 16:09:37.671683 bus /sierra_3: Setting Powered False 16:09:38.786924 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:09:39.937745 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:39.949947 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:09:40.011154 tst mo_mt_call_osmux.py: using LAC 29983 16:09:40.140654 tst mo_mt_call_osmux.py: using RAC 148 16:09:40.268828 tst mo_mt_call_osmux.py: using CellId 29983 16:09:40.397360 tst mo_mt_call_osmux.py: using BVCI 29984 16:09:40.517801 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:40.529403 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:40.540632 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:40.552320 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:40.564219 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:09:40.576074 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:09:40.693143 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:09:40.812324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:41.295824 run create_hlr_db(pid=26710): Launched 16:09:41.425179 bus /sierra_2: Setting Powered False 16:09:42.486679 run create_hlr_db(pid=26710): Terminated: ok {rc=0} 16:09:42.938689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26712): Launched 16:09:43.271179 run osmo-hlr_10.42.42.2(pid=26713): Launched 16:09:43.398522 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:43.969668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26715): Launched 16:09:44.301965 run osmo-stp_10.42.42.5(pid=26716): Launched 16:09:44.429468 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:45.027109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26718): Launched 16:09:45.358994 run osmo-msc_10.42.42.6(pid=26719): Launched 16:09:45.544612 run osmo-stp_10.42.42.5(pid=26716): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26716)] 16:09:45.684187 run osmo-stp_10.42.42.5(pid=26716): stdout: | (launched: 2022-12-12_16:09:44.240152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:45.844508 run osmo-stp_10.42.42.5(pid=26716): stderr: | 20221212160944433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160944434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160944434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160944434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160944435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160944435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160944435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:46.047117 run osmo-stp_10.42.42.5(pid=26716): stdout: | (launched: 2022-12-12_16:09:44.240152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:46.182080 run osmo-stp_10.42.42.5(pid=26716): stderr: | 20221212160944433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160944434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160944434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160944434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160944435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160944435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160944435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:46.344447 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26716): Process ended prematurely: osmo-stp_10.42.42.5(pid=26716) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26716)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:09:46.355294 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:09:46.386891 run osmo-hlr_10.42.42.2(pid=26713): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26713)] 16:09:46.440175 run osmo-hlr_10.42.42.2(pid=26713): stdout: | (launched: 2022-12-12_16:09:43.209687) 16:09:46.494944 run osmo-hlr_10.42.42.2(pid=26713): stderr: | 20221212160943407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212160943407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212160943407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212160943408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212160943408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212160943408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212160943420 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212160943430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212160943430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212160943430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:46.570677 run osmo-msc_10.42.42.6(pid=26719): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26719)] 16:09:46.623888 run osmo-msc_10.42.42.6(pid=26719): stdout: | (launched: 2022-12-12_16:09:45.297431) 16:09:46.678585 run osmo-msc_10.42.42.6(pid=26719): stderr: | 20221212160945619 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212160945620 DLGLOBAL DEBUG validating counter group 0x7f839b086c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212160945620 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212160945620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212160945620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212160945620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212160945622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212160945622 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212160945622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212160945623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:46.736092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26712): Terminating (SIGTERM) 16:09:46.787756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26715): Terminating (SIGTERM) 16:09:46.842424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26718): Terminating (SIGTERM) 16:09:46.896523 --- ParallelTerminationStrategy: PID 26712 died... 16:09:46.921274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26712): Terminated: ok {rc=0} 16:09:46.977430 --- ParallelTerminationStrategy: PID 26715 died... 16:09:47.001127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26715): Terminated: ok {rc=0} 16:09:47.057535 --- ParallelTerminationStrategy: PID 26718 died... 16:09:47.081354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26718): Terminated: ok {rc=0} 16:09:47.182262 bus /sierra_3: Setting Powered False 16:09:48.278483 bus /sierra_3: Setting Powered False 16:09:49.393355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:09:50.625715 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:09:50.632072 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:09:50.652713 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:09:50.679389 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:09:50.730664 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:09:50.751393 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:09:50.777806 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:09:51.327628 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:09:51.377112 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:09:51.388138 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:09:51.443829 tst mo_mt_call.py: using LAC 29984 16:09:51.575828 tst mo_mt_call.py: using RAC 149 16:09:51.705297 tst mo_mt_call.py: using CellId 29984 16:09:51.836817 tst mo_mt_call.py: using BVCI 29985 16:09:51.957416 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:09:51.969268 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:09:51.980687 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:09:51.992561 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:09:52.004481 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:09:52.016518 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:09:52.134068 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:09:52.252252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:09:52.735081 run create_hlr_db(pid=26724): Launched 16:09:52.863525 bus /sierra_2: Setting Powered False 16:09:53.924749 run create_hlr_db(pid=26724): Terminated: ok {rc=0} 16:09:54.377615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26726): Launched 16:09:54.709537 run osmo-hlr_10.42.42.2(pid=26727): Launched 16:09:54.835743 run osmo-stp_10.42.42.5: Starting osmo-stp 16:09:55.406220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26729): Launched 16:09:55.737644 run osmo-stp_10.42.42.5(pid=26730): Launched 16:09:55.864054 run osmo-msc_10.42.42.6: Starting osmo-msc 16:09:56.463811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26732): Launched 16:09:56.796790 run osmo-msc_10.42.42.6(pid=26733): Launched 16:09:56.983972 run osmo-stp_10.42.42.5(pid=26730): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26730)] 16:09:57.124271 run osmo-stp_10.42.42.5(pid=26730): stdout: | (launched: 2022-12-12_16:09:55.675784) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:57.263937 run osmo-stp_10.42.42.5(pid=26730): stderr: | 20221212160955869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160955869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160955869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160955870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160955870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160955870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160955870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:57.402903 run osmo-stp_10.42.42.5(pid=26730): stdout: | (launched: 2022-12-12_16:09:55.675784) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:09:57.534572 run osmo-stp_10.42.42.5(pid=26730): stderr: | 20221212160955869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212160955869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212160955869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212160955870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212160955870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212160955870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212160955870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:09:57.692775 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26730): Process ended prematurely: osmo-stp_10.42.42.5(pid=26730) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26730)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:09:57.702464 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:09:57.730812 run osmo-hlr_10.42.42.2(pid=26727): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26727)] 16:09:57.781390 run osmo-hlr_10.42.42.2(pid=26727): stdout: | (launched: 2022-12-12_16:09:54.647769) 16:09:57.834202 run osmo-hlr_10.42.42.2(pid=26727): stderr: | 20221212160954845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212160954845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212160954845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212160954845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212160954845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212160954845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212160954858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212160954867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212160954867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212160954867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:09:57.906870 run osmo-msc_10.42.42.6(pid=26733): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26733)] 16:09:57.957458 run osmo-msc_10.42.42.6(pid=26733): stdout: | (launched: 2022-12-12_16:09:56.735206) 16:09:58.009483 run osmo-msc_10.42.42.6(pid=26733): stderr: | 20221212160957058 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212160957059 DLGLOBAL DEBUG validating counter group 0x7f39f497ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212160957059 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212160957059 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212160957059 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212160957059 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212160957061 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212160957061 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212160957061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212160957062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:09:58.062175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26726): Terminating (SIGTERM) 16:09:58.104377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26729): Terminating (SIGTERM) 16:09:58.146535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26732): Terminating (SIGTERM) 16:09:58.188687 --- ParallelTerminationStrategy: PID 26726 died... 16:09:58.208651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26726): Terminated: ok {rc=0} 16:09:58.255854 --- ParallelTerminationStrategy: PID 26729 died... 16:09:58.275458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26729): Terminated: ok {rc=0} 16:09:58.323629 --- ParallelTerminationStrategy: PID 26732 died... 16:09:58.343399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26732): Terminated: ok {rc=0} 16:09:58.432719 bus /sierra_3: Setting Powered False 16:09:59.532387 bus /sierra_3: Setting Powered False 16:10:00.650341 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:10:01.801674 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:10:01.814721 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:10:01.872402 tst mo_mt_call_osmux.py: using LAC 29985 16:10:02.004701 tst mo_mt_call_osmux.py: using RAC 150 16:10:02.153128 tst mo_mt_call_osmux.py: using CellId 29985 16:10:02.283009 tst mo_mt_call_osmux.py: using BVCI 29986 16:10:02.395048 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:10:02.406216 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:10:02.417234 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:10:02.428135 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:10:02.439025 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:10:02.450091 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:10:02.569542 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:10:02.688578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:03.171807 run create_hlr_db(pid=26738): Launched 16:10:03.298846 bus /sierra_2: Setting Powered False 16:10:04.360084 run create_hlr_db(pid=26738): Terminated: ok {rc=0} 16:10:04.811100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26740): Launched 16:10:05.143149 run osmo-hlr_10.42.42.2(pid=26741): Launched 16:10:05.270690 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:05.842617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26743): Launched 16:10:06.176057 run osmo-stp_10.42.42.5(pid=26744): Launched 16:10:06.302782 run osmo-msc_10.42.42.6: Starting osmo-msc 16:10:06.902160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26746): Launched 16:10:07.235726 run osmo-msc_10.42.42.6(pid=26747): Launched 16:10:07.422861 run osmo-stp_10.42.42.5(pid=26744): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26744)] 16:10:07.562874 run osmo-stp_10.42.42.5(pid=26744): stdout: | (launched: 2022-12-12_16:10:06.114366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:07.703386 run osmo-stp_10.42.42.5(pid=26744): stderr: | 20221212161006308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161006308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161006308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161006309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161006309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161006309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161006309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:07.841925 run osmo-stp_10.42.42.5(pid=26744): stdout: | (launched: 2022-12-12_16:10:06.114366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:07.973732 run osmo-stp_10.42.42.5(pid=26744): stderr: | 20221212161006308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161006308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161006308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161006309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161006309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161006309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161006309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:08.131517 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26744): Process ended prematurely: osmo-stp_10.42.42.5(pid=26744) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26744)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:10:08.141543 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:10:08.169652 run osmo-hlr_10.42.42.2(pid=26741): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26741)] 16:10:08.220614 run osmo-hlr_10.42.42.2(pid=26741): stdout: | (launched: 2022-12-12_16:10:05.081465) 16:10:08.272868 run osmo-hlr_10.42.42.2(pid=26741): stderr: | 20221212161005279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161005279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161005279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161005280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161005280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161005280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161005292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161005301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161005302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161005302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:08.345396 run osmo-msc_10.42.42.6(pid=26747): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26747)] 16:10:08.396835 run osmo-msc_10.42.42.6(pid=26747): stdout: | (launched: 2022-12-12_16:10:07.173983) 16:10:08.450926 run osmo-msc_10.42.42.6(pid=26747): stderr: | 20221212161007495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161007495 DLGLOBAL DEBUG validating counter group 0x7fe950f97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161007495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161007495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161007495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161007496 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161007497 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161007498 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161007498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161007498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:10:08.505513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26740): Terminating (SIGTERM) 16:10:08.549664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26743): Terminating (SIGTERM) 16:10:08.593906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26746): Terminating (SIGTERM) 16:10:08.638336 --- ParallelTerminationStrategy: PID 26740 died... 16:10:08.659129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26740): Terminated: ok {rc=0} 16:10:08.708424 --- ParallelTerminationStrategy: PID 26743 died... 16:10:08.729080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26743): Terminated: ok {rc=0} 16:10:08.777873 --- ParallelTerminationStrategy: PID 26746 died... 16:10:08.798479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26746): Terminated: ok {rc=0} 16:10:08.888218 bus /sierra_3: Setting Powered False 16:10:09.987693 bus /sierra_3: Setting Powered False 16:10:11.102859 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:10:12.338739 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:10:12.345664 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:10:12.366129 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:10:12.392464 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:10:12.444619 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:10:12.465878 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:10:12.491942 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:10:13.040696 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:10:13.090915 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:13.102040 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:10:13.159099 tst mo_mt_call.py: using LAC 29986 16:10:13.282344 tst mo_mt_call.py: using RAC 151 16:10:13.406248 tst mo_mt_call.py: using CellId 29986 16:10:13.528570 tst mo_mt_call.py: using BVCI 29987 16:10:13.642761 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:13.653948 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:13.664721 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:13.676512 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:13.687910 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:13.699533 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:10:13.820569 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:10:13.938008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:14.420071 run create_hlr_db(pid=26752): Launched 16:10:14.549097 bus /sierra_2: Setting Powered False 16:10:15.614345 run create_hlr_db(pid=26752): Terminated: ok {rc=0} 16:10:16.097450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26754): Launched 16:10:16.428003 run osmo-hlr_10.42.42.2(pid=26755): Launched 16:10:16.675094 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:17.327607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26757): Launched 16:10:17.639184 run osmo-stp_10.42.42.5(pid=26758): Launched 16:10:17.757944 run osmo-msc_10.42.42.6: Starting osmo-msc 16:10:18.316622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26760): Launched 16:10:18.626377 run osmo-msc_10.42.42.6(pid=26761): Launched 16:10:18.800037 run osmo-stp_10.42.42.5(pid=26758): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26758)] 16:10:18.929904 run osmo-stp_10.42.42.5(pid=26758): stdout: | (launched: 2022-12-12_16:10:17.580915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:19.059612 run osmo-stp_10.42.42.5(pid=26758): stderr: | 20221212161017750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161017750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161017750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161017751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161017751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161017751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161017751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:19.187360 run osmo-stp_10.42.42.5(pid=26758): stdout: | (launched: 2022-12-12_16:10:17.580915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:19.309494 run osmo-stp_10.42.42.5(pid=26758): stderr: | 20221212161017750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161017750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161017750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161017751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161017751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161017751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161017751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:19.456043 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26758): Process ended prematurely: osmo-stp_10.42.42.5(pid=26758) [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26758)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:10:19.465029 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:10:19.491082 run osmo-hlr_10.42.42.2(pid=26755): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26755)] 16:10:19.538363 run osmo-hlr_10.42.42.2(pid=26755): stdout: | (launched: 2022-12-12_16:10:16.367945) 16:10:19.587310 run osmo-hlr_10.42.42.2(pid=26755): stderr: | 20221212161016645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161016645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161016645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161016645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161016645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161016646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161016662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161016684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161016684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161016684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:19.655674 run osmo-msc_10.42.42.6(pid=26761): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26761)] 16:10:19.702887 run osmo-msc_10.42.42.6(pid=26761): stdout: | (launched: 2022-12-12_16:10:18.568582) 16:10:19.751682 run osmo-msc_10.42.42.6(pid=26761): stderr: | 20221212161018841 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161018841 DLGLOBAL DEBUG validating counter group 0x7fb1205fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161018841 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161018841 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161018842 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161018842 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161018843 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161018844 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161018844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161018844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:10:19.800922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26754): Terminating (SIGTERM) 16:10:19.840246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26757): Terminating (SIGTERM) 16:10:19.879379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26760): Terminating (SIGTERM) 16:10:19.918983 --- ParallelTerminationStrategy: PID 26754 died... 16:10:19.937837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26754): Terminated: ok {rc=0} 16:10:19.981148 --- ParallelTerminationStrategy: PID 26757 died... 16:10:19.999282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26757): Terminated: ok {rc=0} 16:10:20.042861 --- ParallelTerminationStrategy: PID 26760 died... 16:10:20.061336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26760): Terminated: ok {rc=0} 16:10:20.147096 bus /sierra_3: Setting Powered False 16:10:21.246248 bus /sierra_3: Setting Powered False 16:10:22.359533 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:10:23.509632 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:23.522157 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:10:23.581661 tst mo_mt_call_osmux.py: using LAC 29987 16:10:23.712271 tst mo_mt_call_osmux.py: using RAC 152 16:10:23.841491 tst mo_mt_call_osmux.py: using CellId 29987 16:10:23.964162 tst mo_mt_call_osmux.py: using BVCI 29988 16:10:24.078262 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:24.089658 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:24.100798 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:24.112156 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:24.123550 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:10:24.134780 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:10:24.252301 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:10:24.374383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:24.890403 run create_hlr_db(pid=26763): Launched 16:10:25.018997 bus /sierra_2: Setting Powered False 16:10:26.084063 run create_hlr_db(pid=26763): Terminated: ok {rc=0} 16:10:26.546144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26765): Launched 16:10:26.880103 run osmo-hlr_10.42.42.2(pid=26766): Launched 16:10:27.008571 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:27.580297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26768): Launched 16:10:27.914959 run osmo-stp_10.42.42.5(pid=26769): Launched 16:10:28.043758 run osmo-msc_10.42.42.6: Starting osmo-msc 16:10:28.620902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26771): Launched 16:10:28.931732 run osmo-msc_10.42.42.6(pid=26772): Launched 16:10:29.105829 run osmo-stp_10.42.42.5(pid=26769): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26769)] 16:10:29.235761 run osmo-stp_10.42.42.5(pid=26769): stdout: | (launched: 2022-12-12_16:10:27.852578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:29.366138 run osmo-stp_10.42.42.5(pid=26769): stderr: | 20221212161028045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161028045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161028045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161028046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161028047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161028047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161028047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:29.494347 run osmo-stp_10.42.42.5(pid=26769): stdout: | (launched: 2022-12-12_16:10:27.852578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:29.616866 run osmo-stp_10.42.42.5(pid=26769): stderr: | 20221212161028045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161028045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161028045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161028046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161028047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161028047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161028047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:29.763434 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26769): Process ended prematurely: osmo-stp_10.42.42.5(pid=26769) [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26769)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:10:29.772800 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:10:29.799154 run osmo-hlr_10.42.42.2(pid=26766): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26766)] 16:10:29.846600 run osmo-hlr_10.42.42.2(pid=26766): stdout: | (launched: 2022-12-12_16:10:26.818316) 16:10:29.895589 run osmo-hlr_10.42.42.2(pid=26766): stderr: | 20221212161027016 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161027016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161027016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161027016 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161027017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161027017 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161027030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161027038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161027038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161027038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:29.964201 run osmo-msc_10.42.42.6(pid=26772): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26772)] 16:10:30.011617 run osmo-msc_10.42.42.6(pid=26772): stdout: | (launched: 2022-12-12_16:10:28.873485) 16:10:30.060752 run osmo-msc_10.42.42.6(pid=26772): stderr: | 20221212161029147 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161029147 DLGLOBAL DEBUG validating counter group 0x7f2dfaa60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161029147 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161029147 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161029148 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161029148 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161029150 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161029150 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161029150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161029150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:10:30.110257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26765): Terminating (SIGTERM) 16:10:30.149535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26768): Terminating (SIGTERM) 16:10:30.188853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26771): Terminating (SIGTERM) 16:10:30.228229 --- ParallelTerminationStrategy: PID 26765 died... 16:10:30.247455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26765): Terminated: ok {rc=0} 16:10:30.291187 --- ParallelTerminationStrategy: PID 26768 died... 16:10:30.309873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26768): Terminated: ok {rc=0} 16:10:30.354007 --- ParallelTerminationStrategy: PID 26771 died... 16:10:30.372732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26771): Terminated: ok {rc=0} 16:10:30.459077 bus /sierra_3: Setting Powered False 16:10:31.558549 bus /sierra_3: Setting Powered False 16:10:32.676748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:10:33.910317 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:10:33.916802 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:10:33.937503 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:10:33.964272 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:10:34.014304 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:10:34.034804 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:10:34.061084 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:10:34.613364 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:10:34.662613 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:34.674178 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:10:34.729119 tst mo_mt_call.py: using LAC 29988 16:10:34.848830 tst mo_mt_call.py: using RAC 153 16:10:34.968583 tst mo_mt_call.py: using CellId 29988 16:10:35.087844 tst mo_mt_call.py: using BVCI 29989 16:10:35.210798 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:35.222772 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:35.234437 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:35.246553 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:35.258863 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:35.270998 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:10:35.388487 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:10:35.505593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:35.987151 run create_hlr_db(pid=26777): Launched 16:10:36.115548 bus /sierra_2: Setting Powered False 16:10:37.176632 run create_hlr_db(pid=26777): Terminated: ok {rc=0} 16:10:37.607678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26779): Launched 16:10:37.919105 run osmo-hlr_10.42.42.2(pid=26780): Launched 16:10:38.038294 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:38.572506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26782): Launched 16:10:38.882659 run osmo-stp_10.42.42.5(pid=26783): Launched 16:10:39.004698 run osmo-msc_10.42.42.6: Starting osmo-msc 16:10:39.563436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26785): Launched 16:10:39.874698 run osmo-msc_10.42.42.6(pid=26786): Launched 16:10:40.049243 run osmo-stp_10.42.42.5(pid=26783): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26783)] 16:10:40.179620 run osmo-stp_10.42.42.5(pid=26783): stdout: | (launched: 2022-12-12_16:10:38.824331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:40.309763 run osmo-stp_10.42.42.5(pid=26783): stderr: | 20221212161038993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161038993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161038993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161038993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161038994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161038994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161038994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:40.438327 run osmo-stp_10.42.42.5(pid=26783): stdout: | (launched: 2022-12-12_16:10:38.824331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:40.560651 run osmo-stp_10.42.42.5(pid=26783): stderr: | 20221212161038993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161038993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161038993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161038993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161038994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161038994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161038994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:40.707643 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26783): Process ended prematurely: osmo-stp_10.42.42.5(pid=26783) [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26783)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:10:40.716618 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:10:40.742818 run osmo-hlr_10.42.42.2(pid=26780): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26780)] 16:10:40.790078 run osmo-hlr_10.42.42.2(pid=26780): stdout: | (launched: 2022-12-12_16:10:37.860790) 16:10:40.839232 run osmo-hlr_10.42.42.2(pid=26780): stderr: | 20221212161038038 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161038038 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161038038 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161038038 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161038038 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161038038 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161038050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161038058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161038059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161038059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:40.907428 run osmo-msc_10.42.42.6(pid=26786): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26786)] 16:10:40.954640 run osmo-msc_10.42.42.6(pid=26786): stdout: | (launched: 2022-12-12_16:10:39.816313) 16:10:41.003524 run osmo-msc_10.42.42.6(pid=26786): stderr: | 20221212161040088 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161040088 DLGLOBAL DEBUG validating counter group 0x7f9b5f5fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161040088 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161040088 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161040088 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161040088 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161040090 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161040091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161040091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161040091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:10:41.052765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26779): Terminating (SIGTERM) 16:10:41.092387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26782): Terminating (SIGTERM) 16:10:41.131982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26785): Terminating (SIGTERM) 16:10:41.171671 --- ParallelTerminationStrategy: PID 26779 died... 16:10:41.190725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26779): Terminated: ok {rc=0} 16:10:41.234564 --- ParallelTerminationStrategy: PID 26782 died... 16:10:41.253072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26782): Terminated: ok {rc=0} 16:10:41.296679 --- ParallelTerminationStrategy: PID 26785 died... 16:10:41.315198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26785): Terminated: ok {rc=0} 16:10:41.401321 bus /sierra_3: Setting Powered False 16:10:42.503235 bus /sierra_3: Setting Powered False 16:10:43.621224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:10:44.771793 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:44.784307 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:10:44.847604 tst mo_mt_call_osmux.py: using LAC 29989 16:10:44.969287 tst mo_mt_call_osmux.py: using RAC 154 16:10:45.088714 tst mo_mt_call_osmux.py: using CellId 29989 16:10:45.208415 tst mo_mt_call_osmux.py: using BVCI 29990 16:10:45.320348 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:45.331761 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:45.343052 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:45.354766 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:45.365952 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:10:45.377147 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:10:45.497929 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:10:45.619629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:46.113267 run create_hlr_db(pid=26788): Launched 16:10:46.254696 bus /sierra_2: Setting Powered False 16:10:47.319432 run create_hlr_db(pid=26788): Terminated: ok {rc=0} 16:10:47.761918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26790): Launched 16:10:48.073350 run osmo-hlr_10.42.42.2(pid=26791): Launched 16:10:48.190962 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:48.723349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26793): Launched 16:10:49.034839 run osmo-stp_10.42.42.5(pid=26794): Launched 16:10:49.153437 run osmo-msc_10.42.42.6: Starting osmo-msc 16:10:49.711761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26796): Launched 16:10:50.023495 run osmo-msc_10.42.42.6(pid=26797): Launched 16:10:50.195728 run osmo-stp_10.42.42.5(pid=26794): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26794)] 16:10:50.326796 run osmo-stp_10.42.42.5(pid=26794): stdout: | (launched: 2022-12-12_16:10:48.976467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:50.456410 run osmo-stp_10.42.42.5(pid=26794): stderr: | 20221212161049146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161049146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161049146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161049147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161049147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161049147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161049147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:50.584896 run osmo-stp_10.42.42.5(pid=26794): stdout: | (launched: 2022-12-12_16:10:48.976467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:10:50.707225 run osmo-stp_10.42.42.5(pid=26794): stderr: | 20221212161049146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161049146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161049146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161049147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161049147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161049147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161049147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:10:50.853620 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26794): Process ended prematurely: osmo-stp_10.42.42.5(pid=26794) [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26794)] [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:10:50.862603 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:10:50.888541 run osmo-hlr_10.42.42.2(pid=26791): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26791)] 16:10:50.935813 run osmo-hlr_10.42.42.2(pid=26791): stdout: | (launched: 2022-12-12_16:10:48.015347) 16:10:50.984676 run osmo-hlr_10.42.42.2(pid=26791): stderr: | 20221212161048191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161048191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161048191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161048191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161048191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161048191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161048226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161048236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161048236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161048236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:10:51.052735 run osmo-msc_10.42.42.6(pid=26797): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26797)] 16:10:51.100032 run osmo-msc_10.42.42.6(pid=26797): stdout: | (launched: 2022-12-12_16:10:49.965374) 16:10:51.149057 run osmo-msc_10.42.42.6(pid=26797): stderr: | 20221212161050235 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161050236 DLGLOBAL DEBUG validating counter group 0x7fa2b8b2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161050236 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161050236 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161050236 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161050236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161050238 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161050238 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161050238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161050239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:10:51.198053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26790): Terminating (SIGTERM) 16:10:51.237219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26793): Terminating (SIGTERM) 16:10:51.276443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26796): Terminating (SIGTERM) 16:10:51.315902 --- ParallelTerminationStrategy: PID 26790 died... 16:10:51.334783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26790): Terminated: ok {rc=0} 16:10:51.378183 --- ParallelTerminationStrategy: PID 26793 died... 16:10:51.396497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26793): Terminated: ok {rc=0} 16:10:51.439850 --- ParallelTerminationStrategy: PID 26796 died... 16:10:51.458253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26796): Terminated: ok {rc=0} 16:10:51.544088 bus /sierra_3: Setting Powered False 16:10:52.645327 bus /sierra_3: Setting Powered False 16:10:53.764431 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:10:55.003108 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:10:55.010482 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:10:55.032671 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:10:55.061207 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:10:55.112645 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:10:55.133536 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:10:55.159781 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:10:55.711096 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:10:55.760249 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:10:55.771387 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:10:55.828189 tst mo_mt_call.py: using LAC 29990 16:10:55.953965 tst mo_mt_call.py: using RAC 155 16:10:56.074422 tst mo_mt_call.py: using CellId 29990 16:10:56.204781 tst mo_mt_call.py: using BVCI 29991 16:10:56.325776 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:10:56.337569 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:10:56.349211 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:10:56.361221 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:10:56.373271 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:10:56.385359 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:10:56.502139 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:10:56.622614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:10:57.138383 run create_hlr_db(pid=26802): Launched 16:10:57.264304 bus /sierra_2: Setting Powered False 16:10:58.330166 run create_hlr_db(pid=26802): Terminated: ok {rc=0} 16:10:58.791687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26804): Launched 16:10:59.124907 run osmo-hlr_10.42.42.2(pid=26805): Launched 16:10:59.252455 run osmo-stp_10.42.42.5: Starting osmo-stp 16:10:59.825415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26807): Launched 16:11:00.160613 run osmo-stp_10.42.42.5(pid=26808): Launched 16:11:00.287586 run osmo-msc_10.42.42.6: Starting osmo-msc 16:11:00.905685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26810): Launched 16:11:01.271667 run osmo-msc_10.42.42.6(pid=26811): Launched 16:11:01.738839 run osmo-stp_10.42.42.5(pid=26808): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26808)] 16:11:01.896852 run osmo-stp_10.42.42.5(pid=26808): stdout: | (launched: 2022-12-12_16:11:00.098731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:02.039514 run osmo-stp_10.42.42.5(pid=26808): stderr: | 20221212161100292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161100292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161100292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161100293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161100293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161100293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161100293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:02.182156 run osmo-stp_10.42.42.5(pid=26808): stdout: | (launched: 2022-12-12_16:11:00.098731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:02.317543 run osmo-stp_10.42.42.5(pid=26808): stderr: | 20221212161100292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161100292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161100292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161100293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161100293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161100293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161100293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:02.477130 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26808): Process ended prematurely: osmo-stp_10.42.42.5(pid=26808) [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26808)] [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:11:02.487175 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 16:11:02.517189 run osmo-hlr_10.42.42.2(pid=26805): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26805)] 16:11:02.568917 run osmo-hlr_10.42.42.2(pid=26805): stdout: | (launched: 2022-12-12_16:10:59.063272) 16:11:02.622297 run osmo-hlr_10.42.42.2(pid=26805): stderr: | 20221212161059262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161059262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161059262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161059262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161059262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161059262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161059275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161059284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161059284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161059284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:02.696161 run osmo-msc_10.42.42.6(pid=26811): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26811)] 16:11:02.747810 run osmo-msc_10.42.42.6(pid=26811): stdout: | (launched: 2022-12-12_16:11:01.209106) 16:11:02.801170 run osmo-msc_10.42.42.6(pid=26811): stderr: | 20221212161101541 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161101541 DLGLOBAL DEBUG validating counter group 0x7f7662949c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161101541 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161101541 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161101541 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161101542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161101545 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161101547 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161101548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161101548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:11:02.854443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26804): Terminating (SIGTERM) 16:11:02.897847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26807): Terminating (SIGTERM) 16:11:02.941111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26810): Terminating (SIGTERM) 16:11:02.984298 --- ParallelTerminationStrategy: PID 26804 died... 16:11:03.004614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26804): Terminated: ok {rc=0} 16:11:03.053151 --- ParallelTerminationStrategy: PID 26807 died... 16:11:03.072998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26807): Terminated: ok {rc=0} 16:11:03.121590 --- ParallelTerminationStrategy: PID 26810 died... 16:11:03.141259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26810): Terminated: ok {rc=0} 16:11:03.231610 bus /sierra_3: Setting Powered False 16:11:04.331513 bus /sierra_3: Setting Powered False 16:11:05.449232 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:11:06.595559 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:11:06.607606 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:11:06.665103 tst mo_mt_call_osmux.py: using LAC 29991 16:11:06.788149 tst mo_mt_call_osmux.py: using RAC 156 16:11:06.911379 tst mo_mt_call_osmux.py: using CellId 29991 16:11:07.035943 tst mo_mt_call_osmux.py: using BVCI 29992 16:11:07.148843 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:11:07.160132 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:11:07.171138 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:11:07.182159 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:11:07.193195 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:11:07.204333 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:11:07.323812 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:11:07.443663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:07.959993 run create_hlr_db(pid=26813): Launched 16:11:08.089328 bus /sierra_2: Setting Powered False 16:11:09.153837 run create_hlr_db(pid=26813): Terminated: ok {rc=0} 16:11:09.595302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26815): Launched 16:11:09.907204 run osmo-hlr_10.42.42.2(pid=26816): Launched 16:11:10.025747 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:10.600528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26818): Launched 16:11:10.934585 run osmo-stp_10.42.42.5(pid=26819): Launched 16:11:11.061754 run osmo-msc_10.42.42.6: Starting osmo-msc 16:11:11.660125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26821): Launched 16:11:11.992170 run osmo-msc_10.42.42.6(pid=26822): Launched 16:11:12.177455 run osmo-stp_10.42.42.5(pid=26819): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26819)] 16:11:12.316904 run osmo-stp_10.42.42.5(pid=26819): stdout: | (launched: 2022-12-12_16:11:10.872896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:12.456861 run osmo-stp_10.42.42.5(pid=26819): stderr: | 20221212161111066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161111067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161111067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161111067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161111068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161111068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161111068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:12.595689 run osmo-stp_10.42.42.5(pid=26819): stdout: | (launched: 2022-12-12_16:11:10.872896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:12.727735 run osmo-stp_10.42.42.5(pid=26819): stderr: | 20221212161111066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161111067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161111067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161111067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161111068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161111068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161111068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:12.885896 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26819): Process ended prematurely: osmo-stp_10.42.42.5(pid=26819) [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26819)] [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:11:12.895850 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:11:12.924256 run osmo-hlr_10.42.42.2(pid=26816): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26816)] 16:11:12.974759 run osmo-hlr_10.42.42.2(pid=26816): stdout: | (launched: 2022-12-12_16:11:09.849100) 16:11:13.026797 run osmo-hlr_10.42.42.2(pid=26816): stderr: | 20221212161110026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161110026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161110026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161110026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161110026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161110026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161110039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161110047 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161110047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161110048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:13.099465 run osmo-msc_10.42.42.6(pid=26822): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26822)] 16:11:13.149578 run osmo-msc_10.42.42.6(pid=26822): stdout: | (launched: 2022-12-12_16:11:11.930576) 16:11:13.201449 run osmo-msc_10.42.42.6(pid=26822): stderr: | 20221212161112254 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161112254 DLGLOBAL DEBUG validating counter group 0x7fc687135c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161112254 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161112254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161112254 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161112255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161112256 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161112257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161112257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161112257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:11:13.253619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26815): Terminating (SIGTERM) 16:11:13.295605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26818): Terminating (SIGTERM) 16:11:13.337854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26821): Terminating (SIGTERM) 16:11:13.380100 --- ParallelTerminationStrategy: PID 26815 died... 16:11:13.400101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26815): Terminated: ok {rc=0} 16:11:13.447087 --- ParallelTerminationStrategy: PID 26818 died... 16:11:13.466690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26818): Terminated: ok {rc=0} 16:11:13.513036 --- ParallelTerminationStrategy: PID 26821 died... 16:11:13.532477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26821): Terminated: ok {rc=0} 16:11:13.619949 bus /sierra_3: Setting Powered False 16:11:14.718757 bus /sierra_3: Setting Powered False 16:11:15.847237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:11:17.125447 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:11:17.132694 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:11:17.163682 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:11:17.193164 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:11:17.248749 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:11:17.271253 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:11:17.300806 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:11:17.850046 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:11:17.904729 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:17.916288 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:17.975333 tst mo_mt_call.py: using LAC 29992 16:11:18.109691 tst mo_mt_call.py: using RAC 157 16:11:18.239303 tst mo_mt_call.py: using CellId 29992 16:11:18.367920 tst mo_mt_call.py: using BVCI 29993 16:11:18.481302 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:18.492209 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:18.502879 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:18.514441 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:18.525753 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:18.536926 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:11:18.653067 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:11:18.778366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:19.296289 run create_hlr_db(pid=26827): Launched 16:11:19.425230 bus /sierra_2: Setting Powered False 16:11:20.490167 run create_hlr_db(pid=26827): Terminated: ok {rc=0} 16:11:20.953243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26829): Launched 16:11:21.285445 run osmo-hlr_10.42.42.2(pid=26830): Launched 16:11:21.413748 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:21.990268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26832): Launched 16:11:22.323664 run osmo-stp_10.42.42.5(pid=26833): Launched 16:11:22.452221 run osmo-msc_10.42.42.6: Starting osmo-msc 16:11:23.053912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26835): Launched 16:11:23.386494 run osmo-msc_10.42.42.6(pid=26836): Launched 16:11:23.573361 run osmo-stp_10.42.42.5(pid=26833): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26833)] 16:11:23.713432 run osmo-stp_10.42.42.5(pid=26833): stdout: | (launched: 2022-12-12_16:11:22.262046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:23.853963 run osmo-stp_10.42.42.5(pid=26833): stderr: | 20221212161122452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161122452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161122453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161122453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161122454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161122454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161122454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:23.993356 run osmo-stp_10.42.42.5(pid=26833): stdout: | (launched: 2022-12-12_16:11:22.262046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:24.125517 run osmo-stp_10.42.42.5(pid=26833): stderr: | 20221212161122452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161122452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161122453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161122453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161122454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161122454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161122454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:24.283710 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26833): Process ended prematurely: osmo-stp_10.42.42.5(pid=26833) [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26833)] [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:11:24.293754 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:11:24.322851 run osmo-hlr_10.42.42.2(pid=26830): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26830)] 16:11:24.373695 run osmo-hlr_10.42.42.2(pid=26830): stdout: | (launched: 2022-12-12_16:11:21.223715) 16:11:24.426575 run osmo-hlr_10.42.42.2(pid=26830): stderr: | 20221212161121419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161121419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161121420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161121420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161121420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161121420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161121433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161121441 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161121441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161121442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:24.499719 run osmo-msc_10.42.42.6(pid=26836): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26836)] 16:11:24.550200 run osmo-msc_10.42.42.6(pid=26836): stdout: | (launched: 2022-12-12_16:11:23.324496) 16:11:24.602583 run osmo-msc_10.42.42.6(pid=26836): stderr: | 20221212161123647 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161123647 DLGLOBAL DEBUG validating counter group 0x7f764a50cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161123647 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161123647 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161123648 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161123648 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161123650 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161123650 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161123650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161123650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:11:24.655284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26829): Terminating (SIGTERM) 16:11:24.697805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26832): Terminating (SIGTERM) 16:11:24.740211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26835): Terminating (SIGTERM) 16:11:24.783138 --- ParallelTerminationStrategy: PID 26829 died... 16:11:24.803527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26829): Terminated: ok {rc=0} 16:11:24.851516 --- ParallelTerminationStrategy: PID 26832 died... 16:11:24.871206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26832): Terminated: ok {rc=0} 16:11:24.918881 --- ParallelTerminationStrategy: PID 26835 died... 16:11:24.938750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26835): Terminated: ok {rc=0} 16:11:25.028225 bus /sierra_3: Setting Powered False 16:11:26.128112 bus /sierra_3: Setting Powered False 16:11:27.245909 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:11:28.398485 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:28.410783 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:11:28.470590 tst mo_mt_call_osmux.py: using LAC 29993 16:11:28.601217 tst mo_mt_call_osmux.py: using RAC 158 16:11:28.727156 tst mo_mt_call_osmux.py: using CellId 29993 16:11:28.852555 tst mo_mt_call_osmux.py: using BVCI 29994 16:11:28.965667 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:28.976773 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:28.987756 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:28.999124 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:29.010554 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:11:29.022016 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:11:29.143327 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:11:29.267006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:29.783838 run create_hlr_db(pid=26838): Launched 16:11:29.912568 bus /sierra_2: Setting Powered False 16:11:30.976216 run create_hlr_db(pid=26838): Terminated: ok {rc=0} 16:11:31.441220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26840): Launched 16:11:31.857231 run osmo-hlr_10.42.42.2(pid=26841): Launched 16:11:32.005974 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:32.709273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26843): Launched 16:11:33.020912 run osmo-stp_10.42.42.5(pid=26844): Launched 16:11:33.138199 run osmo-msc_10.42.42.6: Starting osmo-msc 16:11:33.695820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26846): Launched 16:11:34.006277 run osmo-msc_10.42.42.6(pid=26847): Launched 16:11:34.179526 run osmo-stp_10.42.42.5(pid=26844): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26844)] 16:11:34.308566 run osmo-stp_10.42.42.5(pid=26844): stdout: | (launched: 2022-12-12_16:11:32.962990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:34.438658 run osmo-stp_10.42.42.5(pid=26844): stderr: | 20221212161133133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161133134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161133134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161133134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161133135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161133135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161133135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:34.566431 run osmo-stp_10.42.42.5(pid=26844): stdout: | (launched: 2022-12-12_16:11:32.962990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:34.688450 run osmo-stp_10.42.42.5(pid=26844): stderr: | 20221212161133133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161133134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161133134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161133134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161133135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161133135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161133135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:34.834903 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26844): Process ended prematurely: osmo-stp_10.42.42.5(pid=26844) [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26844)] [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:11:34.843897 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:11:34.870599 run osmo-hlr_10.42.42.2(pid=26841): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26841)] 16:11:34.918452 run osmo-hlr_10.42.42.2(pid=26841): stdout: | (launched: 2022-12-12_16:11:31.789997) 16:11:34.967738 run osmo-hlr_10.42.42.2(pid=26841): stderr: | 20221212161132214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161132214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161132214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161132214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161132214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161132215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161132238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161132260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161132260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161132261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:35.036375 run osmo-msc_10.42.42.6(pid=26847): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26847)] 16:11:35.083978 run osmo-msc_10.42.42.6(pid=26847): stdout: | (launched: 2022-12-12_16:11:33.948301) 16:11:35.132819 run osmo-msc_10.42.42.6(pid=26847): stderr: | 20221212161134220 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161134220 DLGLOBAL DEBUG validating counter group 0x7efc1212ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161134221 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161134221 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161134221 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161134221 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161134223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161134223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161134223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161134223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:11:35.182061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26840): Terminating (SIGTERM) 16:11:35.221328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26843): Terminating (SIGTERM) 16:11:35.260501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26846): Terminating (SIGTERM) 16:11:35.299942 --- ParallelTerminationStrategy: PID 26840 died... 16:11:35.318956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26840): Terminated: ok {rc=0} 16:11:35.362383 --- ParallelTerminationStrategy: PID 26843 died... 16:11:35.380729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26843): Terminated: ok {rc=0} 16:11:35.424302 --- ParallelTerminationStrategy: PID 26846 died... 16:11:35.442874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26846): Terminated: ok {rc=0} 16:11:35.529398 bus /sierra_3: Setting Powered False 16:11:36.628713 bus /sierra_3: Setting Powered False 16:11:37.741840 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 emergency:sysmo --------------------------------------------------------------------- 16:11:38.974092 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:11:38.978238 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 16:11:38.999146 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 16:11:39.025811 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 16:11:39.110142 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 16:11:39.130736 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 16:11:39.157048 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 16:11:39.740810 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2379 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 16:11:39.745807 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:39.756357 tst emergency:sysmo: Using 1 x bts (candidates: 1) 16:11:39.792634 tst emergency_mo_mt_call.py: using LAC 29994 16:11:39.915917 tst emergency_mo_mt_call.py: using RAC 159 16:11:40.045277 tst emergency_mo_mt_call.py: using CellId 29994 16:11:40.171377 tst emergency_mo_mt_call.py: using BVCI 29995 16:11:40.290138 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:40.301546 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:40.312752 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:40.324457 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:40.336136 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:40.347860 tst emergency:sysmo: Using 1 x modem (candidates: 4) 16:11:40.463914 tst emergency:sysmo: Using 1 x modem (candidates: 4) 16:11:40.584360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:41.092495 run create_hlr_db(pid=26853): Launched 16:11:41.218043 bus /sierra_2: Setting Powered False 16:11:42.282652 run create_hlr_db(pid=26853): Terminated: ok {rc=0} 16:11:42.719003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26855): Launched 16:11:43.026445 run osmo-hlr_10.42.42.2(pid=26856): Launched 16:11:43.144544 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:43.685976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26858): Launched 16:11:43.992712 run osmo-stp_10.42.42.5(pid=26859): Launched 16:11:44.118340 tst emergency_mo_mt_call.py: using MSISDN 7860 16:11:44.272668 run osmo-msc_10.42.42.6: Starting osmo-msc 16:11:44.819362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26861): Launched 16:11:45.126929 run osmo-msc_10.42.42.6(pid=26862): Launched 16:11:45.297923 run osmo-stp_10.42.42.5(pid=26859): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26859)] 16:11:45.426340 run osmo-stp_10.42.42.5(pid=26859): stdout: | (launched: 2022-12-12_16:11:43.935409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:45.554339 run osmo-stp_10.42.42.5(pid=26859): stderr: | 20221212161144108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161144108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161144108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161144109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161144109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161144109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161144109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:45.680522 run osmo-stp_10.42.42.5(pid=26859): stdout: | (launched: 2022-12-12_16:11:43.935409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:45.807897 run osmo-stp_10.42.42.5(pid=26859): stderr: | 20221212161144108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161144108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161144108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161144109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161144109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161144109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161144109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:45.973766 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26859): Process ended prematurely: osmo-stp_10.42.42.5(pid=26859) [trial-2379↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26859)] [trial-2379↪emergency:sysmo↪emergency_mo_mt_call.py:19] 16:11:45.984387 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 16:11:46.016099 run osmo-hlr_10.42.42.2(pid=26856): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26856)] 16:11:46.071569 run osmo-hlr_10.42.42.2(pid=26856): stdout: | (launched: 2022-12-12_16:11:42.968760) 16:11:46.127716 run osmo-hlr_10.42.42.2(pid=26856): stderr: | 20221212161143144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161143144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161143144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161143144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161143144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161143144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161143156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161143166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161143166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161143167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:46.204915 run osmo-msc_10.42.42.6(pid=26862): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26862)] 16:11:46.260106 run osmo-msc_10.42.42.6(pid=26862): stdout: | (launched: 2022-12-12_16:11:45.068931) 16:11:46.315686 run osmo-msc_10.42.42.6(pid=26862): stderr: | 20221212161145340 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161145340 DLGLOBAL DEBUG validating counter group 0x7efe9e686c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161145340 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161145340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161145341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161145341 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161145343 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161145343 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161145344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161145344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:11:46.372549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26855): Terminating (SIGTERM) 16:11:46.456043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26858): Terminating (SIGTERM) 16:11:46.503839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26861): Terminating (SIGTERM) 16:11:46.551924 --- ParallelTerminationStrategy: PID 26855 died... 16:11:46.573590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26855): Terminated: ok {rc=0} 16:11:46.625941 --- ParallelTerminationStrategy: PID 26858 died... 16:11:46.647998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26858): Terminated: ok {rc=0} 16:11:46.699038 --- ParallelTerminationStrategy: PID 26861 died... 16:11:46.719825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26861): Terminated: ok {rc=0} 16:11:46.812846 bus /sierra_3: Setting Powered False 16:11:47.913845 bus /sierra_3: Setting Powered False 16:11:49.029493 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 16:11:50.119364 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:50.131144 tst emergency:sysmo: Using 1 x bts (candidates: 1) 16:11:50.169172 tst emergency_preemptive_call.py: using LAC 29995 16:11:50.288310 tst emergency_preemptive_call.py: using RAC 160 16:11:50.405726 tst emergency_preemptive_call.py: using CellId 29995 16:11:50.534694 tst emergency_preemptive_call.py: using BVCI 29996 16:11:50.650899 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:50.662532 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:50.674140 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:50.685278 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:50.695854 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 16:11:50.706600 tst emergency:sysmo: Using 1 x modem (candidates: 4) 16:11:50.825440 tst emergency:sysmo: Using 1 x modem (candidates: 4) 16:11:50.944283 tst emergency:sysmo: Using 1 x modem (candidates: 4) 16:11:51.065100 tst emergency:sysmo: Using 1 x modem (candidates: 4) 16:11:51.187507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:11:51.692903 run create_hlr_db(pid=26864): Launched 16:11:51.818606 bus /sierra_2: Setting Powered False 16:11:52.882210 run create_hlr_db(pid=26864): Terminated: ok {rc=0} 16:11:53.333814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26866): Launched 16:11:53.663561 run osmo-hlr_10.42.42.2(pid=26867): Launched 16:11:53.789331 run osmo-stp_10.42.42.5: Starting osmo-stp 16:11:54.352521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26869): Launched 16:11:54.680754 run osmo-stp_10.42.42.5(pid=26870): Launched 16:11:54.817362 tst emergency_preemptive_call.py: using MSISDN 7861 16:11:54.985904 run osmo-msc_10.42.42.6: Starting osmo-msc 16:11:55.572278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26872): Launched 16:11:55.900174 run osmo-msc_10.42.42.6(pid=26873): Launched 16:11:56.090526 run osmo-stp_10.42.42.5(pid=26870): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26870)] 16:11:56.228231 run osmo-stp_10.42.42.5(pid=26870): stdout: | (launched: 2022-12-12_16:11:54.619705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:56.367324 run osmo-stp_10.42.42.5(pid=26870): stderr: | 20221212161154810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161154810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161154811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161154811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161154812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161154812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161154812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:56.503928 run osmo-stp_10.42.42.5(pid=26870): stdout: | (launched: 2022-12-12_16:11:54.619705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:11:56.634202 run osmo-stp_10.42.42.5(pid=26870): stderr: | 20221212161154810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161154810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161154811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161154811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161154812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161154812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161154812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:11:56.789498 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26870): Process ended prematurely: osmo-stp_10.42.42.5(pid=26870) [trial-2379↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26870)] [trial-2379↪emergency:sysmo↪emergency_preemptive_call.py:32] 16:11:56.798743 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 16:11:56.826851 run osmo-hlr_10.42.42.2(pid=26867): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26867)] 16:11:56.877172 run osmo-hlr_10.42.42.2(pid=26867): stdout: | (launched: 2022-12-12_16:11:53.602703) 16:11:56.929724 run osmo-hlr_10.42.42.2(pid=26867): stderr: | 20221212161153798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161153798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161153798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161153798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161153798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161153798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161153810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161153819 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161153819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161153820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:11:57.001705 run osmo-msc_10.42.42.6(pid=26873): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26873)] 16:11:57.052081 run osmo-msc_10.42.42.6(pid=26873): stdout: | (launched: 2022-12-12_16:11:55.839181) 16:11:57.103729 run osmo-msc_10.42.42.6(pid=26873): stderr: | 20221212161156159 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161156160 DLGLOBAL DEBUG validating counter group 0x7fed46154c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161156160 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161156160 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161156160 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161156160 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161156162 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161156163 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161156163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161156163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:11:57.155794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26866): Terminating (SIGTERM) 16:11:57.197491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26869): Terminating (SIGTERM) 16:11:57.239090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26872): Terminating (SIGTERM) 16:11:57.281008 --- ParallelTerminationStrategy: PID 26866 died... 16:11:57.300828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26866): Terminated: ok {rc=0} 16:11:57.347192 --- ParallelTerminationStrategy: PID 26869 died... 16:11:57.366657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26869): Terminated: ok {rc=0} 16:11:57.412775 --- ParallelTerminationStrategy: PID 26872 died... 16:11:57.432111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26872): Terminated: ok {rc=0} 16:11:57.520274 bus /sierra_9: Setting Powered False 16:11:58.616623 bus /sierra_9: Setting Powered False 16:11:59.730648 bus /sierra_8: Setting Powered False 16:12:00.834580 bus /sierra_8: Setting Powered False 16:12:01.965883 bus /sierra_3: Setting Powered False 16:12:03.075462 bus /sierra_3: Setting Powered False 16:12:04.194815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:sysmo --------------------------------------------------------------------- 16:12:05.460456 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:12:05.465183 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 16:12:05.487008 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 16:12:05.527045 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 16:12:05.615735 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 16:12:05.636705 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 16:12:05.676306 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 16:12:06.268143 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 16:12:06.322653 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:06.333246 tst gprs:sysmo: Using 1 x bts (candidates: 1) 16:12:06.374275 tst cs_paging_gprs_active.py: using LAC 29996 16:12:06.505397 tst cs_paging_gprs_active.py: using RAC 161 16:12:06.634534 tst cs_paging_gprs_active.py: using CellId 29996 16:12:06.762422 tst cs_paging_gprs_active.py: using BVCI 29997 16:12:06.883043 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:06.894306 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:06.905612 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:06.916778 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:06.927861 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:06.939069 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:06.950497 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:06.961691 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:06.973082 tst gprs:sysmo: Using 1 x modem (candidates: 4) 16:12:07.095517 tst gprs:sysmo: Using 1 x modem (candidates: 4) 16:12:07.212896 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:12:07.421722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:07.736062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26878): Launched 16:12:08.006474 run iperf3-srv_10.42.42.10(pid=26879): Launched 16:12:08.124773 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:12:08.332341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:08.644165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26880): Launched 16:12:08.917605 run iperf3-srv_10.42.42.10(pid=26881): Launched 16:12:09.033382 tst cs_paging_gprs_active.py:38: start network... 16:12:09.241353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:09.722640 run create_hlr_db(pid=26882): Launched 16:12:09.851476 bus /sierra_2: Setting Powered False 16:12:10.912740 run create_hlr_db(pid=26882): Terminated: ok {rc=0} 16:12:11.345920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26884): Launched 16:12:11.658011 run osmo-hlr_10.42.42.2(pid=26885): Launched 16:12:11.777622 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:12.309883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26887): Launched 16:12:12.620350 run osmo-stp_10.42.42.5(pid=26888): Launched 16:12:12.740402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:14.263000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26890): Launched 16:12:14.382557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:14.645620 run patchelf(pid=26891): Launched 16:12:14.818498 run osmo-stp_10.42.42.5(pid=26888): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26888)] 16:12:14.949073 run osmo-stp_10.42.42.5(pid=26888): stdout: | (launched: 2022-12-12_16:12:12.562052) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:15.081353 run osmo-stp_10.42.42.5(pid=26888): stderr: | 20221212161212734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161212734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161212734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161212735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161212735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161212735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161212735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:15.214364 run osmo-stp_10.42.42.5(pid=26888): stdout: | (launched: 2022-12-12_16:12:12.562052) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:15.341141 run osmo-stp_10.42.42.5(pid=26888): stderr: | 20221212161212734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161212734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161212734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161212735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161212735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161212735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161212735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:15.491236 run patchelf(pid=26891): Terminating (SIGINT) 16:12:15.664155 run patchelf(pid=26891): Terminated: ok {rc=0} 16:12:15.795277 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26888): Process ended prematurely: osmo-stp_10.42.42.5(pid=26888) [trial-2379↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26888)] [trial-2379↪gprs:sysmo↪cs_paging_gprs_active.py:38] 16:12:15.810302 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 16:12:15.842264 run osmo-hlr_10.42.42.2(pid=26885): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26885)] 16:12:15.900227 run osmo-hlr_10.42.42.2(pid=26885): stdout: | (launched: 2022-12-12_16:12:11.599616) 16:12:15.955576 run osmo-hlr_10.42.42.2(pid=26885): stderr: | 20221212161211776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161211776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161211776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161211776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161211776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161211776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161211789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161211797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161211797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161211797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:16.012356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26878): Terminating (SIGTERM) 16:12:16.060323 run iperf3-srv_10.42.42.10(pid=26879): Terminating (SIGTERM) 16:12:16.108108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26880): Terminating (SIGTERM) 16:12:16.153608 run iperf3-srv_10.42.42.10(pid=26881): Terminating (SIGTERM) 16:12:16.201824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26884): Terminating (SIGTERM) 16:12:16.248509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26887): Terminating (SIGTERM) 16:12:16.295870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26890): Terminating (SIGTERM) 16:12:16.342986 --- ParallelTerminationStrategy: PID 26878 died... 16:12:16.364407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26878): Terminated: ok {rc=0} 16:12:16.416643 --- ParallelTerminationStrategy: PID 26879 died... 16:12:16.438513 run iperf3-srv_10.42.42.10(pid=26879): Terminated {rc=256} 16:12:16.489332 --- ParallelTerminationStrategy: PID 26880 died... 16:12:16.510198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26880): Terminated: ok {rc=0} 16:12:16.561475 --- ParallelTerminationStrategy: PID 26881 died... 16:12:16.582719 run iperf3-srv_10.42.42.10(pid=26881): Terminated {rc=256} 16:12:16.634142 --- ParallelTerminationStrategy: PID 26884 died... 16:12:16.655037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26884): Terminated: ok {rc=0} 16:12:16.705950 --- ParallelTerminationStrategy: PID 26887 died... 16:12:16.726872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26887): Terminated: ok {rc=0} 16:12:16.777886 --- ParallelTerminationStrategy: PID 26890 died... 16:12:16.807540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26890): Terminated: ok {rc=0} 16:12:16.920313 bus /gobi_0: Setting Powered False 16:12:18.022700 bus /gobi_0: Setting Powered False 16:12:19.140486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo iperf3.py ---------------------------------------------- 16:12:20.291755 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:20.303711 tst gprs:sysmo: Using 1 x bts (candidates: 1) 16:12:20.341306 tst iperf3.py: using LAC 29997 16:12:20.472790 tst iperf3.py: using RAC 162 16:12:20.606403 tst iperf3.py: using CellId 29997 16:12:20.735784 tst iperf3.py: using BVCI 29998 16:12:20.856086 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:20.867112 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:20.878110 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:20.889426 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:20.900374 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:20.911961 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:20.923274 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:20.934584 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:20.945891 tst gprs:sysmo: Using 1 x modem (candidates: 4) 16:12:21.065117 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:12:21.290153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:21.625130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26892): Launched 16:12:21.915968 run iperf3-srv_10.42.42.10(pid=26893): Launched 16:12:22.041979 tst iperf3.py:8: start network... 16:12:22.265290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:22.780824 run create_hlr_db(pid=26894): Launched 16:12:22.908530 bus /gobi_6: Setting Powered False 16:12:23.973099 run create_hlr_db(pid=26894): Terminated: ok {rc=0} 16:12:24.415507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26896): Launched 16:12:24.728214 run osmo-hlr_10.42.42.2(pid=26897): Launched 16:12:24.848377 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:25.383182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26899): Launched 16:12:25.693697 run osmo-stp_10.42.42.5(pid=26900): Launched 16:12:25.813521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:26.348659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26902): Launched 16:12:26.468713 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:26.731294 run patchelf(pid=26903): Launched 16:12:26.904363 run osmo-stp_10.42.42.5(pid=26900): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26900)] 16:12:27.034908 run osmo-stp_10.42.42.5(pid=26900): stdout: | (launched: 2022-12-12_16:12:25.635269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:27.167306 run osmo-stp_10.42.42.5(pid=26900): stderr: | 20221212161225804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161225804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161225805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161225805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161225806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161225806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161225806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:27.299898 run osmo-stp_10.42.42.5(pid=26900): stdout: | (launched: 2022-12-12_16:12:25.635269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:27.426180 run osmo-stp_10.42.42.5(pid=26900): stderr: | 20221212161225804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161225804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161225805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161225805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161225806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161225806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161225806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:27.575584 run patchelf(pid=26903): Terminating (SIGINT) 16:12:27.747611 run patchelf(pid=26903): Terminated: ok {rc=0} 16:12:27.871638 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26900): Process ended prematurely: osmo-stp_10.42.42.5(pid=26900) [trial-2379↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26900)] [trial-2379↪gprs:sysmo↪iperf3.py:8] 16:12:27.881317 tst iperf3.py:8: Test FAILED (7.6 sec) 16:12:27.908292 run osmo-hlr_10.42.42.2(pid=26897): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26897)] 16:12:27.955626 run osmo-hlr_10.42.42.2(pid=26897): stdout: | (launched: 2022-12-12_16:12:24.670335) 16:12:28.004739 run osmo-hlr_10.42.42.2(pid=26897): stderr: | 20221212161224846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161224846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161224846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161224846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161224846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161224846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161224858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161224867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161224867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161224867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:28.053843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26892): Terminating (SIGTERM) 16:12:28.093647 run iperf3-srv_10.42.42.10(pid=26893): Terminating (SIGTERM) 16:12:28.133474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26896): Terminating (SIGTERM) 16:12:28.173336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26899): Terminating (SIGTERM) 16:12:28.212931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26902): Terminating (SIGTERM) 16:12:28.252796 --- ParallelTerminationStrategy: PID 26892 died... 16:12:28.271954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26892): Terminated: ok {rc=0} 16:12:28.316249 --- ParallelTerminationStrategy: PID 26893 died... 16:12:28.335105 run iperf3-srv_10.42.42.10(pid=26893): Terminated {rc=256} 16:12:28.379101 --- ParallelTerminationStrategy: PID 26896 died... 16:12:28.397956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26896): Terminated: ok {rc=0} 16:12:28.441970 --- ParallelTerminationStrategy: PID 26899 died... 16:12:28.460719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26899): Terminated: ok {rc=0} 16:12:28.504773 --- ParallelTerminationStrategy: PID 26902 died... 16:12:28.523598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26902): Terminated: ok {rc=0} 16:12:28.607824 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo iperf3m4.py ---------------------------------------------- 16:12:29.759943 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:29.771862 tst gprs:sysmo: Using 1 x bts (candidates: 1) 16:12:29.810012 tst iperf3m4.py: using LAC 29998 16:12:29.941303 tst iperf3m4.py: using RAC 163 16:12:30.072302 tst iperf3m4.py: using CellId 29998 16:12:30.200651 tst iperf3m4.py: using BVCI 29999 16:12:30.321872 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:30.332896 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:30.344037 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:30.355303 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:30.366490 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:30.377611 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:30.389060 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:30.400285 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:30.411617 tst gprs:sysmo: Using 1 x modem (candidates: 4) 16:12:30.529298 tst gprs:sysmo: Using 1 x modem (candidates: 4) 16:12:30.652101 tst gprs:sysmo: Using 1 x modem (candidates: 4) 16:12:30.769301 tst gprs:sysmo: Using 1 x modem (candidates: 4) 16:12:30.900724 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:12:31.138417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:31.460819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26904): Launched 16:12:31.750310 run iperf3-srv_10.42.42.10(pid=26905): Launched 16:12:31.885505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:12:32.100066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:32.415487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26906): Launched 16:12:32.688474 run iperf3-srv_10.42.42.10(pid=26907): Launched 16:12:32.806699 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:12:33.014539 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:33.327552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26908): Launched 16:12:33.600362 run iperf3-srv_10.42.42.10(pid=26909): Launched 16:12:33.718375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:12:33.924822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:12:34.236772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26910): Launched 16:12:34.522826 run iperf3-srv_10.42.42.10(pid=26911): Launched 16:12:34.640158 tst iperf3m4.py:8: start network... 16:12:34.846881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:35.329697 run create_hlr_db(pid=26912): Launched 16:12:35.456165 bus /gobi_6: Setting Powered False 16:12:36.518089 run create_hlr_db(pid=26912): Terminated: ok {rc=0} 16:12:36.949384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26914): Launched 16:12:37.259810 run osmo-hlr_10.42.42.2(pid=26915): Launched 16:12:37.379380 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:37.926281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26917): Launched 16:12:38.238397 run osmo-stp_10.42.42.5(pid=26918): Launched 16:12:38.356519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:38.890352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26920): Launched 16:12:39.008048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:39.271481 run patchelf(pid=26921): Launched 16:12:39.444058 run osmo-stp_10.42.42.5(pid=26918): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26918)] 16:12:39.574807 run osmo-stp_10.42.42.5(pid=26918): stdout: | (launched: 2022-12-12_16:12:38.179187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:39.707228 run osmo-stp_10.42.42.5(pid=26918): stderr: | 20221212161238349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161238349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161238349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161238350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161238350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161238350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161238350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:39.839714 run osmo-stp_10.42.42.5(pid=26918): stdout: | (launched: 2022-12-12_16:12:38.179187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:39.966648 run osmo-stp_10.42.42.5(pid=26918): stderr: | 20221212161238349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161238349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161238349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161238350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161238350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161238350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161238350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:40.116301 run patchelf(pid=26921): Terminating (SIGINT) 16:12:40.288292 run patchelf(pid=26921): Terminated: ok {rc=0} 16:12:40.412283 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26918): Process ended prematurely: osmo-stp_10.42.42.5(pid=26918) [trial-2379↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26918)] [trial-2379↪gprs:sysmo↪iperf3m4.py:8] 16:12:40.422038 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:12:40.449849 run osmo-hlr_10.42.42.2(pid=26915): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26915)] 16:12:40.497664 run osmo-hlr_10.42.42.2(pid=26915): stdout: | (launched: 2022-12-12_16:12:37.201264) 16:12:40.547354 run osmo-hlr_10.42.42.2(pid=26915): stderr: | 20221212161237376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161237376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161237376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161237376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161237376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161237376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161237388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161237397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161237397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161237397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:40.597530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26904): Terminating (SIGTERM) 16:12:40.637561 run iperf3-srv_10.42.42.10(pid=26905): Terminating (SIGTERM) 16:12:40.677507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26906): Terminating (SIGTERM) 16:12:40.717550 run iperf3-srv_10.42.42.10(pid=26907): Terminating (SIGTERM) 16:12:40.757608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26908): Terminating (SIGTERM) 16:12:40.797583 run iperf3-srv_10.42.42.10(pid=26909): Terminating (SIGTERM) 16:12:40.837763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26910): Terminating (SIGTERM) 16:12:40.877719 run iperf3-srv_10.42.42.10(pid=26911): Terminating (SIGTERM) 16:12:40.917645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26914): Terminating (SIGTERM) 16:12:40.957849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26917): Terminating (SIGTERM) 16:12:40.997922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26920): Terminating (SIGTERM) 16:12:41.038702 --- ParallelTerminationStrategy: PID 26904 died... 16:12:41.057967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26904): Terminated: ok {rc=0} 16:12:41.102683 --- ParallelTerminationStrategy: PID 26905 died... 16:12:41.121598 run iperf3-srv_10.42.42.10(pid=26905): Terminated {rc=256} 16:12:41.166066 --- ParallelTerminationStrategy: PID 26906 died... 16:12:41.184455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26906): Terminated: ok {rc=0} 16:12:41.229541 --- ParallelTerminationStrategy: PID 26907 died... 16:12:41.248219 run iperf3-srv_10.42.42.10(pid=26907): Terminated {rc=256} 16:12:41.293070 --- ParallelTerminationStrategy: PID 26908 died... 16:12:41.311901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26908): Terminated: ok {rc=0} 16:12:41.356186 --- ParallelTerminationStrategy: PID 26909 died... 16:12:41.374960 run iperf3-srv_10.42.42.10(pid=26909): Terminated {rc=256} 16:12:41.419513 --- ParallelTerminationStrategy: PID 26910 died... 16:12:41.438376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26910): Terminated: ok {rc=0} 16:12:41.482378 --- ParallelTerminationStrategy: PID 26911 died... 16:12:41.501140 run iperf3-srv_10.42.42.10(pid=26911): Terminated {rc=256} 16:12:41.545077 --- ParallelTerminationStrategy: PID 26914 died... 16:12:41.563844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26914): Terminated: ok {rc=0} 16:12:41.607910 --- ParallelTerminationStrategy: PID 26917 died... 16:12:41.626817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26917): Terminated: ok {rc=0} 16:12:41.670910 --- ParallelTerminationStrategy: PID 26920 died... 16:12:41.689656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26920): Terminated: ok {rc=0} 16:12:41.775936 bus /gobi_4: Setting Powered False 16:12:42.876315 bus /gobi_4: Setting Powered False 16:12:43.992289 bus /gobi_1: Setting Powered False 16:12:45.092044 bus /gobi_1: Setting Powered False 16:12:46.212581 bus /gobi_0: Setting Powered False 16:12:47.327649 bus /gobi_0: Setting Powered False 16:12:48.444213 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo ping.py ---------------------------------------------- 16:12:49.549047 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:49.560624 tst gprs:sysmo: Using 1 x bts (candidates: 1) 16:12:49.596680 tst ping.py: using LAC 29999 16:12:49.717745 tst ping.py: using RAC 164 16:12:49.838927 tst ping.py: using CellId 29999 16:12:49.958612 tst ping.py: using BVCI 30000 16:12:50.069134 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:50.079841 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:50.090796 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:50.101552 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:50.111769 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:50.122374 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:50.132923 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:50.143599 tst gprs:sysmo: Using 1 x modem (candidates: 4) 16:12:50.262839 tst ping.py:19: start network... 16:12:50.482522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:50.991587 run create_hlr_db(pid=26922): Launched 16:12:51.115893 bus /gobi_6: Setting Powered False 16:12:52.179543 run create_hlr_db(pid=26922): Terminated: ok {rc=0} 16:12:52.616123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26924): Launched 16:12:52.921606 run osmo-hlr_10.42.42.2(pid=26925): Launched 16:12:53.037153 run osmo-stp_10.42.42.5: Starting osmo-stp 16:12:53.562067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26927): Launched 16:12:53.866573 run osmo-stp_10.42.42.5(pid=26928): Launched 16:12:53.981484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:12:54.503990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26930): Launched 16:12:54.620066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:12:54.878445 run patchelf(pid=26931): Launched 16:12:55.047542 run osmo-stp_10.42.42.5(pid=26928): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26928)] 16:12:55.176030 run osmo-stp_10.42.42.5(pid=26928): stdout: | (launched: 2022-12-12_16:12:53.808687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:55.306298 run osmo-stp_10.42.42.5(pid=26928): stderr: | 20221212161253978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161253978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161253978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161253979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161253980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161253980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161253980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:55.436733 run osmo-stp_10.42.42.5(pid=26928): stdout: | (launched: 2022-12-12_16:12:53.808687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:12:55.562642 run osmo-stp_10.42.42.5(pid=26928): stderr: | 20221212161253978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161253978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161253978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161253979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161253980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161253980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161253980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:12:55.710005 run patchelf(pid=26931): Terminating (SIGINT) 16:12:55.879492 run patchelf(pid=26931): Terminated: ok {rc=0} 16:12:56.001554 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26928): Process ended prematurely: osmo-stp_10.42.42.5(pid=26928) [trial-2379↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26928)] [trial-2379↪gprs:sysmo↪ping.py:22] 16:12:56.010689 tst ping.py:22: Test FAILED (6.5 sec) 16:12:56.037984 run osmo-hlr_10.42.42.2(pid=26925): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26925)] 16:12:56.086174 run osmo-hlr_10.42.42.2(pid=26925): stdout: | (launched: 2022-12-12_16:12:52.863730) 16:12:56.136214 run osmo-hlr_10.42.42.2(pid=26925): stderr: | 20221212161253039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161253039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161253039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161253039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161253039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161253039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161253052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161253060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161253060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161253060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:12:56.186769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26924): Terminating (SIGTERM) 16:12:56.227321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26927): Terminating (SIGTERM) 16:12:56.268015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26930): Terminating (SIGTERM) 16:12:56.308539 --- ParallelTerminationStrategy: PID 26924 died... 16:12:56.327647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26924): Terminated: ok {rc=0} 16:12:56.372497 --- ParallelTerminationStrategy: PID 26927 died... 16:12:56.391520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26927): Terminated: ok {rc=0} 16:12:56.436227 --- ParallelTerminationStrategy: PID 26930 died... 16:12:56.455220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26930): Terminated: ok {rc=0} 16:12:56.542377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 16:12:57.632072 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:57.643951 tst gprs:sysmo: Using 1 x bts (candidates: 1) 16:12:57.681337 tst ping_idle_ping.py: using LAC 30000 16:12:57.802728 tst ping_idle_ping.py: using RAC 165 16:12:57.924601 tst ping_idle_ping.py: using CellId 30000 16:12:58.054403 tst ping_idle_ping.py: using BVCI 30001 16:12:58.175587 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:58.186721 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:58.197766 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:58.209596 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:58.221249 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:58.232712 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:58.244566 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 16:12:58.256426 tst gprs:sysmo: Using 1 x modem (candidates: 4) 16:12:58.384913 tst ping_idle_ping.py:24: start network... 16:12:58.606099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:12:59.113603 run create_hlr_db(pid=26932): Launched 16:12:59.237693 bus /gobi_6: Setting Powered False 16:13:00.301661 run create_hlr_db(pid=26932): Terminated: ok {rc=0} 16:13:00.756233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26934): Launched 16:13:01.127040 run osmo-hlr_10.42.42.2(pid=26935): Launched 16:13:01.412231 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:02.161609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26937): Launched 16:13:02.498398 run osmo-stp_10.42.42.5(pid=26938): Launched 16:13:02.622762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:03.187661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26940): Launched 16:13:03.313600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:03.591418 run patchelf(pid=26941): Launched 16:13:03.774540 run osmo-stp_10.42.42.5(pid=26938): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26938)] 16:13:03.912403 run osmo-stp_10.42.42.5(pid=26938): stdout: | (launched: 2022-12-12_16:13:02.437347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:04.052646 run osmo-stp_10.42.42.5(pid=26938): stderr: | 20221212161302627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161302628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161302628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161302628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161302629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161302629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161302629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:04.192627 run osmo-stp_10.42.42.5(pid=26938): stdout: | (launched: 2022-12-12_16:13:02.437347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:04.326622 run osmo-stp_10.42.42.5(pid=26938): stderr: | 20221212161302627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161302628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161302628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161302628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161302629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161302629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161302629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:04.485923 run patchelf(pid=26941): Terminating (SIGINT) 16:13:04.667431 run patchelf(pid=26941): Terminated: ok {rc=0} 16:13:04.798487 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26938): Process ended prematurely: osmo-stp_10.42.42.5(pid=26938) [trial-2379↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26938)] [trial-2379↪gprs:sysmo↪ping_idle_ping.py:27] 16:13:04.807978 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 16:13:04.836446 run osmo-hlr_10.42.42.2(pid=26935): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26935)] 16:13:04.887029 run osmo-hlr_10.42.42.2(pid=26935): stdout: | (launched: 2022-12-12_16:13:01.067091) 16:13:04.939200 run osmo-hlr_10.42.42.2(pid=26935): stderr: | 20221212161301385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161301385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161301385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161301385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161301385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161301385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161301404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161301422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161301423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161301423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:04.991688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26934): Terminating (SIGTERM) 16:13:05.033730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26937): Terminating (SIGTERM) 16:13:05.075776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26940): Terminating (SIGTERM) 16:13:05.118068 --- ParallelTerminationStrategy: PID 26934 died... 16:13:05.138012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26934): Terminated: ok {rc=0} 16:13:05.184511 --- ParallelTerminationStrategy: PID 26937 died... 16:13:05.204089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26937): Terminated: ok {rc=0} 16:13:05.250570 --- ParallelTerminationStrategy: PID 26940 died... 16:13:05.270048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26940): Terminated: ok {rc=0} 16:13:05.358605 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 16:13:06.641333 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:13:06.647661 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:13:06.669679 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:13:06.710213 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:13:06.798284 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:13:06.819142 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:13:06.857651 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:13:07.450838 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:13:07.501575 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:07.512446 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:13:07.547824 tst cs_paging_gprs_active.py: using LAC 30001 16:13:07.678094 tst cs_paging_gprs_active.py: using RAC 166 16:13:07.806292 tst cs_paging_gprs_active.py: using CellId 30001 16:13:07.935181 tst cs_paging_gprs_active.py: using BVCI 30002 16:13:08.049808 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:08.060937 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:08.071915 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:08.083037 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:08.094643 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:08.105607 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:08.116407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:08.127091 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:08.138175 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:13:08.257817 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:13:08.379899 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:13:08.606226 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:08.942888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26946): Launched 16:13:09.234790 run iperf3-srv_10.42.42.10(pid=26947): Launched 16:13:09.360493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:13:09.586549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:09.923260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26948): Launched 16:13:10.215268 run iperf3-srv_10.42.42.10(pid=26949): Launched 16:13:10.341223 tst cs_paging_gprs_active.py:38: start network... 16:13:10.567333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:11.087369 run create_hlr_db(pid=26950): Launched 16:13:11.215361 bus /gobi_6: Setting Powered False 16:13:12.280716 run create_hlr_db(pid=26950): Terminated: ok {rc=0} 16:13:12.724470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26952): Launched 16:13:13.039165 run osmo-hlr_10.42.42.2(pid=26953): Launched 16:13:13.159395 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:13.695193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26955): Launched 16:13:14.009163 run osmo-stp_10.42.42.5(pid=26956): Launched 16:13:14.127448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:14.662869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26958): Launched 16:13:14.781246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:15.044758 run patchelf(pid=26959): Launched 16:13:15.218844 run osmo-stp_10.42.42.5(pid=26956): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26956)] 16:13:15.350370 run osmo-stp_10.42.42.5(pid=26956): stdout: | (launched: 2022-12-12_16:13:13.950561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:15.482552 run osmo-stp_10.42.42.5(pid=26956): stderr: | 20221212161314123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161314123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161314123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161314124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161314124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161314124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161314124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:15.615069 run osmo-stp_10.42.42.5(pid=26956): stdout: | (launched: 2022-12-12_16:13:13.950561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:15.743137 run osmo-stp_10.42.42.5(pid=26956): stderr: | 20221212161314123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161314123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161314123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161314124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161314124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161314124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161314124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:15.921969 run patchelf(pid=26959): Terminating (SIGINT) 16:13:16.114822 run patchelf(pid=26959): Terminated: ok {rc=0} 16:13:16.254264 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26956): Process ended prematurely: osmo-stp_10.42.42.5(pid=26956) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26956)] [trial-2379↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:13:16.266075 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:13:16.298931 run osmo-hlr_10.42.42.2(pid=26953): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26953)] 16:13:16.353357 run osmo-hlr_10.42.42.2(pid=26953): stdout: | (launched: 2022-12-12_16:13:12.980000) 16:13:16.409342 run osmo-hlr_10.42.42.2(pid=26953): stderr: | 20221212161313156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161313156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161313156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161313156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161313156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161313157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161313173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161313183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161313183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161313183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:16.466385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26946): Terminating (SIGTERM) 16:13:16.512556 run iperf3-srv_10.42.42.10(pid=26947): Terminating (SIGTERM) 16:13:16.561478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26948): Terminating (SIGTERM) 16:13:16.607197 run iperf3-srv_10.42.42.10(pid=26949): Terminating (SIGTERM) 16:13:16.659435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26952): Terminating (SIGTERM) 16:13:16.705700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26955): Terminating (SIGTERM) 16:13:16.753187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26958): Terminating (SIGTERM) 16:13:16.800501 --- ParallelTerminationStrategy: PID 26946 died... 16:13:16.822010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26946): Terminated: ok {rc=0} 16:13:16.875511 --- ParallelTerminationStrategy: PID 26947 died... 16:13:16.896683 run iperf3-srv_10.42.42.10(pid=26947): Terminated {rc=256} 16:13:16.947353 --- ParallelTerminationStrategy: PID 26948 died... 16:13:16.968535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26948): Terminated: ok {rc=0} 16:13:17.019161 --- ParallelTerminationStrategy: PID 26949 died... 16:13:17.041021 run iperf3-srv_10.42.42.10(pid=26949): Terminated {rc=256} 16:13:17.092135 --- ParallelTerminationStrategy: PID 26952 died... 16:13:17.113117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26952): Terminated: ok {rc=0} 16:13:17.164142 --- ParallelTerminationStrategy: PID 26955 died... 16:13:17.184416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26955): Terminated: ok {rc=0} 16:13:17.233334 --- ParallelTerminationStrategy: PID 26958 died... 16:13:17.253244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26958): Terminated: ok {rc=0} 16:13:17.343619 bus /gobi_0: Setting Powered False 16:13:18.443104 bus /gobi_0: Setting Powered False 16:13:19.561033 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:13:20.712351 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:20.724437 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:13:20.764495 tst iperf3.py: using LAC 30002 16:13:20.895422 tst iperf3.py: using RAC 167 16:13:21.025372 tst iperf3.py: using CellId 30002 16:13:21.155004 tst iperf3.py: using BVCI 30003 16:13:21.276095 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:21.287511 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:21.298793 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:21.310443 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:21.322534 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:21.334857 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:21.346481 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:21.358839 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:21.370528 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:13:21.490806 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:13:21.699520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:22.012749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26960): Launched 16:13:22.286094 run iperf3-srv_10.42.42.10(pid=26961): Launched 16:13:22.405879 tst iperf3.py:8: start network... 16:13:22.613156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:23.094880 run create_hlr_db(pid=26962): Launched 16:13:23.225123 bus /gobi_6: Setting Powered False 16:13:24.290137 run create_hlr_db(pid=26962): Terminated: ok {rc=0} 16:13:24.752076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26964): Launched 16:13:25.086821 run osmo-hlr_10.42.42.2(pid=26965): Launched 16:13:25.215509 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:25.789624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26967): Launched 16:13:26.124503 run osmo-stp_10.42.42.5(pid=26968): Launched 16:13:26.253663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:26.830055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26970): Launched 16:13:26.958656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:27.241609 run patchelf(pid=26971): Launched 16:13:27.427524 run osmo-stp_10.42.42.5(pid=26968): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26968)] 16:13:27.568185 run osmo-stp_10.42.42.5(pid=26968): stdout: | (launched: 2022-12-12_16:13:26.062726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:27.710461 run osmo-stp_10.42.42.5(pid=26968): stderr: | 20221212161326253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161326253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161326253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161326253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161326254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161326254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161326254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:27.852854 run osmo-stp_10.42.42.5(pid=26968): stdout: | (launched: 2022-12-12_16:13:26.062726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:27.989357 run osmo-stp_10.42.42.5(pid=26968): stderr: | 20221212161326253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161326253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161326253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161326253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161326254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161326254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161326254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:28.150455 run patchelf(pid=26971): Terminating (SIGINT) 16:13:28.335515 run patchelf(pid=26971): Terminated: ok {rc=0} 16:13:28.468908 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26968): Process ended prematurely: osmo-stp_10.42.42.5(pid=26968) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26968)] [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 16:13:28.479285 tst iperf3.py:8: Test FAILED (7.8 sec) 16:13:28.508664 run osmo-hlr_10.42.42.2(pid=26965): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26965)] 16:13:28.559317 run osmo-hlr_10.42.42.2(pid=26965): stdout: | (launched: 2022-12-12_16:13:25.025061) 16:13:28.611613 run osmo-hlr_10.42.42.2(pid=26965): stderr: | 20221212161325223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161325223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161325223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161325223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161325223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161325223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161325235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161325243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161325244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161325244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:28.664387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26960): Terminating (SIGTERM) 16:13:28.706900 run iperf3-srv_10.42.42.10(pid=26961): Terminating (SIGTERM) 16:13:28.749732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26964): Terminating (SIGTERM) 16:13:28.792632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26967): Terminating (SIGTERM) 16:13:28.834982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26970): Terminating (SIGTERM) 16:13:28.877529 --- ParallelTerminationStrategy: PID 26960 died... 16:13:28.897843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26960): Terminated: ok {rc=0} 16:13:28.945249 --- ParallelTerminationStrategy: PID 26961 died... 16:13:28.964754 run iperf3-srv_10.42.42.10(pid=26961): Terminated {rc=256} 16:13:29.011778 --- ParallelTerminationStrategy: PID 26964 died... 16:13:29.031400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26964): Terminated: ok {rc=0} 16:13:29.078217 --- ParallelTerminationStrategy: PID 26967 died... 16:13:29.097910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26967): Terminated: ok {rc=0} 16:13:29.144624 --- ParallelTerminationStrategy: PID 26970 died... 16:13:29.164260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26970): Terminated: ok {rc=0} 16:13:29.252095 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:13:30.403961 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:30.416005 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:13:30.453402 tst iperf3m4.py: using LAC 30003 16:13:30.583032 tst iperf3m4.py: using RAC 168 16:13:30.711395 tst iperf3m4.py: using CellId 30003 16:13:30.844526 tst iperf3m4.py: using BVCI 30004 16:13:30.968354 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:30.980678 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:30.992936 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:31.005679 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:31.018399 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:31.032734 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:31.045145 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:31.058034 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:31.072587 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:13:31.197299 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:13:31.369295 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:13:31.487214 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:13:31.623598 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:13:31.854665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:32.198555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26972): Launched 16:13:32.500813 run iperf3-srv_10.42.42.10(pid=26973): Launched 16:13:32.627291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:13:32.851314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:33.187628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26974): Launched 16:13:33.479772 run iperf3-srv_10.42.42.10(pid=26975): Launched 16:13:33.605917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:13:33.830119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:34.167198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26976): Launched 16:13:34.457621 run iperf3-srv_10.42.42.10(pid=26977): Launched 16:13:34.582338 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:13:34.806926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:13:35.143863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26978): Launched 16:13:35.434571 run iperf3-srv_10.42.42.10(pid=26979): Launched 16:13:35.561306 tst iperf3m4.py:8: start network... 16:13:35.785370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:36.307592 run create_hlr_db(pid=26980): Launched 16:13:36.434567 bus /gobi_6: Setting Powered False 16:13:37.500501 run create_hlr_db(pid=26980): Terminated: ok {rc=0} 16:13:37.947178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26982): Launched 16:13:38.259544 run osmo-hlr_10.42.42.2(pid=26983): Launched 16:13:38.377915 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:38.929787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26985): Launched 16:13:39.242029 run osmo-stp_10.42.42.5(pid=26986): Launched 16:13:39.360700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:39.896358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26988): Launched 16:13:40.014689 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:40.278632 run patchelf(pid=26989): Launched 16:13:40.450979 run osmo-stp_10.42.42.5(pid=26986): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26986)] 16:13:40.581753 run osmo-stp_10.42.42.5(pid=26986): stdout: | (launched: 2022-12-12_16:13:39.182290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:40.713986 run osmo-stp_10.42.42.5(pid=26986): stderr: | 20221212161339352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161339352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161339352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161339353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161339353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161339353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161339354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:40.846271 run osmo-stp_10.42.42.5(pid=26986): stdout: | (launched: 2022-12-12_16:13:39.182290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:40.973356 run osmo-stp_10.42.42.5(pid=26986): stderr: | 20221212161339352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161339352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161339352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161339353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161339353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161339353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161339354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:41.123221 run patchelf(pid=26989): Terminating (SIGINT) 16:13:41.296021 run patchelf(pid=26989): Terminated: ok {rc=0} 16:13:41.420531 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26986): Process ended prematurely: osmo-stp_10.42.42.5(pid=26986) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26986)] [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 16:13:41.430536 tst iperf3m4.py:8: Test FAILED (11.1 sec) 16:13:41.458541 run osmo-hlr_10.42.42.2(pid=26983): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26983)] 16:13:41.506897 run osmo-hlr_10.42.42.2(pid=26983): stdout: | (launched: 2022-12-12_16:13:38.200702) 16:13:41.556623 run osmo-hlr_10.42.42.2(pid=26983): stderr: | 20221212161338376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161338376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161338376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161338376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161338376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161338376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161338390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161338398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161338398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161338398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:41.607065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26972): Terminating (SIGTERM) 16:13:41.647193 run iperf3-srv_10.42.42.10(pid=26973): Terminating (SIGTERM) 16:13:41.687246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26974): Terminating (SIGTERM) 16:13:41.727367 run iperf3-srv_10.42.42.10(pid=26975): Terminating (SIGTERM) 16:13:41.767197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26976): Terminating (SIGTERM) 16:13:41.807767 run iperf3-srv_10.42.42.10(pid=26977): Terminating (SIGTERM) 16:13:41.847514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26978): Terminating (SIGTERM) 16:13:41.887880 run iperf3-srv_10.42.42.10(pid=26979): Terminating (SIGTERM) 16:13:41.927781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26982): Terminating (SIGTERM) 16:13:41.967961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26985): Terminating (SIGTERM) 16:13:42.007707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26988): Terminating (SIGTERM) 16:13:42.047702 --- ParallelTerminationStrategy: PID 26972 died... 16:13:42.066439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26972): Terminated: ok {rc=0} 16:13:42.110558 --- ParallelTerminationStrategy: PID 26973 died... 16:13:42.129180 run iperf3-srv_10.42.42.10(pid=26973): Terminated {rc=256} 16:13:42.173110 --- ParallelTerminationStrategy: PID 26974 died... 16:13:42.191777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26974): Terminated: ok {rc=0} 16:13:42.236117 --- ParallelTerminationStrategy: PID 26975 died... 16:13:42.254616 run iperf3-srv_10.42.42.10(pid=26975): Terminated {rc=256} 16:13:42.298166 --- ParallelTerminationStrategy: PID 26976 died... 16:13:42.316573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26976): Terminated: ok {rc=0} 16:13:42.361011 --- ParallelTerminationStrategy: PID 26977 died... 16:13:42.379590 run iperf3-srv_10.42.42.10(pid=26977): Terminated {rc=256} 16:13:42.423585 --- ParallelTerminationStrategy: PID 26978 died... 16:13:42.442432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26978): Terminated: ok {rc=0} 16:13:42.486229 --- ParallelTerminationStrategy: PID 26979 died... 16:13:42.504917 run iperf3-srv_10.42.42.10(pid=26979): Terminated {rc=256} 16:13:42.548687 --- ParallelTerminationStrategy: PID 26982 died... 16:13:42.567360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26982): Terminated: ok {rc=0} 16:13:42.611400 --- ParallelTerminationStrategy: PID 26985 died... 16:13:42.630185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26985): Terminated: ok {rc=0} 16:13:42.675234 --- ParallelTerminationStrategy: PID 26988 died... 16:13:42.693823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26988): Terminated: ok {rc=0} 16:13:42.779672 bus /gobi_4: Setting Powered False 16:13:43.880871 bus /gobi_4: Setting Powered False 16:13:44.998794 bus /gobi_1: Setting Powered False 16:13:46.105338 bus /gobi_1: Setting Powered False 16:13:47.224414 bus /gobi_0: Setting Powered False 16:13:48.324832 bus /gobi_0: Setting Powered False 16:13:49.439063 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 16:13:50.543021 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:50.555382 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:13:50.595455 tst ping.py: using LAC 30004 16:13:50.725323 tst ping.py: using RAC 169 16:13:50.854568 tst ping.py: using CellId 30004 16:13:50.983000 tst ping.py: using BVCI 30005 16:13:51.102354 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:51.113834 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:51.125236 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:51.136937 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:51.148566 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:51.160161 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:51.172136 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:51.183883 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:13:51.303020 tst ping.py:19: start network... 16:13:51.509494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:13:51.986501 run create_hlr_db(pid=26991): Launched 16:13:52.112121 bus /gobi_6: Setting Powered False 16:13:53.172366 run create_hlr_db(pid=26991): Terminated: ok {rc=0} 16:13:53.620335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26993): Launched 16:13:53.948466 run osmo-hlr_10.42.42.2(pid=26994): Launched 16:13:54.073198 run osmo-stp_10.42.42.5: Starting osmo-stp 16:13:54.637630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26996): Launched 16:13:54.969744 run osmo-stp_10.42.42.5(pid=26997): Launched 16:13:55.099921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:13:55.662615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26999): Launched 16:13:55.787303 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:13:56.065257 run patchelf(pid=27000): Launched 16:13:56.246903 run osmo-stp_10.42.42.5(pid=26997): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26997)] 16:13:56.384904 run osmo-stp_10.42.42.5(pid=26997): stdout: | (launched: 2022-12-12_16:13:54.904092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:56.524222 run osmo-stp_10.42.42.5(pid=26997): stderr: | 20221212161355100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161355100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161355100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161355100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161355101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161355101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161355101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:56.663997 run osmo-stp_10.42.42.5(pid=26997): stdout: | (launched: 2022-12-12_16:13:54.904092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:13:56.798236 run osmo-stp_10.42.42.5(pid=26997): stderr: | 20221212161355100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161355100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161355100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161355100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161355101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161355101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161355101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:13:56.957262 run patchelf(pid=27000): Terminating (SIGINT) 16:13:57.138367 run patchelf(pid=27000): Terminated: ok {rc=0} 16:13:57.268881 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26997): Process ended prematurely: osmo-stp_10.42.42.5(pid=26997) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26997)] [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 16:13:57.278655 tst ping.py:22: Test FAILED (6.7 sec) 16:13:57.307440 run osmo-hlr_10.42.42.2(pid=26994): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26994)] 16:13:57.357994 run osmo-hlr_10.42.42.2(pid=26994): stdout: | (launched: 2022-12-12_16:13:53.887217) 16:13:57.410130 run osmo-hlr_10.42.42.2(pid=26994): stderr: | 20221212161354084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161354084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161354084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161354085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161354085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161354085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161354095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161354104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161354104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161354105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:13:57.462713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26993): Terminating (SIGTERM) 16:13:57.505265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26996): Terminating (SIGTERM) 16:13:57.547649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26999): Terminating (SIGTERM) 16:13:57.590359 --- ParallelTerminationStrategy: PID 26993 died... 16:13:57.610729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26993): Terminated: ok {rc=0} 16:13:57.658035 --- ParallelTerminationStrategy: PID 26996 died... 16:13:57.677942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26996): Terminated: ok {rc=0} 16:13:57.724933 --- ParallelTerminationStrategy: PID 26999 died... 16:13:57.744706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26999): Terminated: ok {rc=0} 16:13:57.833513 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:13:58.922610 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:58.934604 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:13:58.973995 tst ping_idle_ping.py: using LAC 30005 16:13:59.103100 tst ping_idle_ping.py: using RAC 170 16:13:59.230722 tst ping_idle_ping.py: using CellId 30005 16:13:59.359854 tst ping_idle_ping.py: using BVCI 30006 16:13:59.478758 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:59.490158 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:59.501437 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:59.512894 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:59.524314 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:59.535656 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:59.547185 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:13:59.558687 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:13:59.687098 tst ping_idle_ping.py:24: start network... 16:13:59.907041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:00.414293 run create_hlr_db(pid=27001): Launched 16:14:00.540482 bus /gobi_6: Setting Powered False 16:14:01.604312 run create_hlr_db(pid=27001): Terminated: ok {rc=0} 16:14:02.069691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27003): Launched 16:14:02.409714 run osmo-hlr_10.42.42.2(pid=27004): Launched 16:14:02.536131 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:03.102957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27006): Launched 16:14:03.431094 run osmo-stp_10.42.42.5(pid=27007): Launched 16:14:03.557677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:14:04.125336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27009): Launched 16:14:04.250565 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:14:04.528447 run patchelf(pid=27010): Launched 16:14:04.711434 run osmo-stp_10.42.42.5(pid=27007): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27007)] 16:14:04.849647 run osmo-stp_10.42.42.5(pid=27007): stdout: | (launched: 2022-12-12_16:14:03.370200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:04.989470 run osmo-stp_10.42.42.5(pid=27007): stderr: | 20221212161403561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161403561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161403562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161403562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161403563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161403563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161403563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:05.129638 run osmo-stp_10.42.42.5(pid=27007): stdout: | (launched: 2022-12-12_16:14:03.370200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:05.263988 run osmo-stp_10.42.42.5(pid=27007): stderr: | 20221212161403561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161403561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161403562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161403562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161403563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161403563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161403563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:05.422887 run patchelf(pid=27010): Terminating (SIGINT) 16:14:05.605224 run patchelf(pid=27010): Terminated: ok {rc=0} 16:14:05.736438 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27007): Process ended prematurely: osmo-stp_10.42.42.5(pid=27007) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27007)] [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 16:14:05.746371 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:14:05.774934 run osmo-hlr_10.42.42.2(pid=27004): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27004)] 16:14:05.825105 run osmo-hlr_10.42.42.2(pid=27004): stdout: | (launched: 2022-12-12_16:14:02.348405) 16:14:05.877870 run osmo-hlr_10.42.42.2(pid=27004): stderr: | 20221212161402544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161402544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161402544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161402544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161402545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161402545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161402556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161402565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161402565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161402565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:05.930409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27003): Terminating (SIGTERM) 16:14:05.972942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27006): Terminating (SIGTERM) 16:14:06.015622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27009): Terminating (SIGTERM) 16:14:06.058272 --- ParallelTerminationStrategy: PID 27003 died... 16:14:06.078887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27003): Terminated: ok {rc=0} 16:14:06.126309 --- ParallelTerminationStrategy: PID 27006 died... 16:14:06.145916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27006): Terminated: ok {rc=0} 16:14:06.193623 --- ParallelTerminationStrategy: PID 27009 died... 16:14:06.213429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27009): Terminated: ok {rc=0} 16:14:06.302366 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:14:07.593570 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:14:07.600191 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:14:07.621626 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:14:07.661546 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:14:07.753116 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:14:07.774434 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:14:07.813476 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:14:08.401890 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:14:08.458529 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:08.470211 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:14:08.527650 tst cs_paging_gprs_active.py: using LAC 30006 16:14:08.655842 tst cs_paging_gprs_active.py: using RAC 171 16:14:08.785813 tst cs_paging_gprs_active.py: using CellId 30006 16:14:08.908453 tst cs_paging_gprs_active.py: using BVCI 30007 16:14:09.021271 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:09.032315 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:09.043219 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:09.054711 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:09.066078 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:09.077372 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:09.088724 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:09.099991 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:09.111453 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:14:09.228433 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:14:09.350756 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:14:09.576186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:14:09.911617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27014): Launched 16:14:10.202914 run iperf3-srv_10.42.42.10(pid=27015): Launched 16:14:10.328150 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:14:10.553286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:14:10.888929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27016): Launched 16:14:11.182112 run iperf3-srv_10.42.42.10(pid=27017): Launched 16:14:11.309185 tst cs_paging_gprs_active.py:38: start network... 16:14:11.533866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:12.051282 run create_hlr_db(pid=27018): Launched 16:14:12.178550 bus /gobi_6: Setting Powered False 16:14:13.243571 run create_hlr_db(pid=27018): Terminated: ok {rc=0} 16:14:13.706145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27021): Launched 16:14:14.043434 run osmo-hlr_10.42.42.2(pid=27022): Launched 16:14:14.174231 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:14.747535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27024): Launched 16:14:15.084238 run osmo-stp_10.42.42.5(pid=27025): Launched 16:14:15.213229 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:14:15.797145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27027): Launched 16:14:15.944054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:14:16.223198 run patchelf(pid=27028): Launched 16:14:16.412625 run osmo-stp_10.42.42.5(pid=27025): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27025)] 16:14:16.549217 run osmo-stp_10.42.42.5(pid=27025): stdout: | (launched: 2022-12-12_16:14:15.021939) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:16.688389 run osmo-stp_10.42.42.5(pid=27025): stderr: | 20221212161415215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161415215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161415215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161415215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161415216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161415216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161415216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:16.825675 run osmo-stp_10.42.42.5(pid=27025): stdout: | (launched: 2022-12-12_16:14:15.021939) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:16.958866 run osmo-stp_10.42.42.5(pid=27025): stderr: | 20221212161415215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161415215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161415215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161415215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161415216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161415216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161415216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:17.115037 run patchelf(pid=27028): Terminating (SIGINT) 16:14:17.290681 run patchelf(pid=27028): Terminated: ok {rc=0} 16:14:17.417128 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27025): Process ended prematurely: osmo-stp_10.42.42.5(pid=27025) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27025)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:14:17.426895 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:14:17.454609 run osmo-hlr_10.42.42.2(pid=27022): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27022)] 16:14:17.503009 run osmo-hlr_10.42.42.2(pid=27022): stdout: | (launched: 2022-12-12_16:14:13.979761) 16:14:17.552921 run osmo-hlr_10.42.42.2(pid=27022): stderr: | 20221212161414179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161414179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161414179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161414179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161414179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161414179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161414190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161414199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161414199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161414199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:17.603322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27014): Terminating (SIGTERM) 16:14:17.643631 run iperf3-srv_10.42.42.10(pid=27015): Terminating (SIGTERM) 16:14:17.683743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27016): Terminating (SIGTERM) 16:14:17.723933 run iperf3-srv_10.42.42.10(pid=27017): Terminating (SIGTERM) 16:14:17.764109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27021): Terminating (SIGTERM) 16:14:17.804146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27024): Terminating (SIGTERM) 16:14:17.843980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27027): Terminating (SIGTERM) 16:14:17.884157 --- ParallelTerminationStrategy: PID 27014 died... 16:14:17.903505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27014): Terminated: ok {rc=0} 16:14:17.947981 --- ParallelTerminationStrategy: PID 27015 died... 16:14:17.966915 run iperf3-srv_10.42.42.10(pid=27015): Terminated {rc=256} 16:14:18.011275 --- ParallelTerminationStrategy: PID 27016 died... 16:14:18.030120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27016): Terminated: ok {rc=0} 16:14:18.074307 --- ParallelTerminationStrategy: PID 27017 died... 16:14:18.093108 run iperf3-srv_10.42.42.10(pid=27017): Terminated {rc=256} 16:14:18.137469 --- ParallelTerminationStrategy: PID 27021 died... 16:14:18.156747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27021): Terminated: ok {rc=0} 16:14:18.201344 --- ParallelTerminationStrategy: PID 27024 died... 16:14:18.220168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27024): Terminated: ok {rc=0} 16:14:18.264749 --- ParallelTerminationStrategy: PID 27027 died... 16:14:18.283671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27027): Terminated: ok {rc=0} 16:14:18.370331 bus /gobi_0: Setting Powered False 16:14:19.471558 bus /gobi_0: Setting Powered False 16:14:20.588324 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:14:21.738576 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:21.750364 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:14:21.810090 tst iperf3.py: using LAC 30007 16:14:21.931748 tst iperf3.py: using RAC 172 16:14:22.055427 tst iperf3.py: using CellId 30007 16:14:22.182074 tst iperf3.py: using BVCI 30008 16:14:22.296498 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:22.307605 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:22.318446 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:22.329403 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:22.340184 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:22.351122 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:22.362167 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:22.372687 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:22.383707 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:14:22.503581 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:14:22.729420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:14:23.064780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27029): Launched 16:14:23.357366 run iperf3-srv_10.42.42.10(pid=27030): Launched 16:14:23.483736 tst iperf3.py:8: start network... 16:14:23.708543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:24.227182 run create_hlr_db(pid=27031): Launched 16:14:24.355115 bus /gobi_6: Setting Powered False 16:14:25.420234 run create_hlr_db(pid=27031): Terminated: ok {rc=0} 16:14:25.863818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27033): Launched 16:14:26.177588 run osmo-hlr_10.42.42.2(pid=27034): Launched 16:14:26.297831 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:26.833034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27036): Launched 16:14:27.145427 run osmo-stp_10.42.42.5(pid=27037): Launched 16:14:27.263665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:14:27.797902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27039): Launched 16:14:27.916151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:14:28.180612 run patchelf(pid=27040): Launched 16:14:28.354093 run osmo-stp_10.42.42.5(pid=27037): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27037)] 16:14:28.485227 run osmo-stp_10.42.42.5(pid=27037): stdout: | (launched: 2022-12-12_16:14:27.086909) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:28.618184 run osmo-stp_10.42.42.5(pid=27037): stderr: | 20221212161427258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161427258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161427258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161427258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161427259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161427259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161427259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:28.751239 run osmo-stp_10.42.42.5(pid=27037): stdout: | (launched: 2022-12-12_16:14:27.086909) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:28.878324 run osmo-stp_10.42.42.5(pid=27037): stderr: | 20221212161427258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161427258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161427258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161427258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161427259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161427259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161427259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:29.028736 run patchelf(pid=27040): Terminating (SIGINT) 16:14:29.201653 run patchelf(pid=27040): Terminated: ok {rc=0} 16:14:29.326348 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27037): Process ended prematurely: osmo-stp_10.42.42.5(pid=27037) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27037)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 16:14:29.335891 tst iperf3.py:8: Test FAILED (7.6 sec) 16:14:29.363506 run osmo-hlr_10.42.42.2(pid=27034): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27034)] 16:14:29.411347 run osmo-hlr_10.42.42.2(pid=27034): stdout: | (launched: 2022-12-12_16:14:26.118969) 16:14:29.461139 run osmo-hlr_10.42.42.2(pid=27034): stderr: | 20221212161426296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161426296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161426296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161426296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161426296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161426296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161426309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161426319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161426319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161426319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:29.511226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27029): Terminating (SIGTERM) 16:14:29.551350 run iperf3-srv_10.42.42.10(pid=27030): Terminating (SIGTERM) 16:14:29.591553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27033): Terminating (SIGTERM) 16:14:29.631953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27036): Terminating (SIGTERM) 16:14:29.672156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27039): Terminating (SIGTERM) 16:14:29.712468 --- ParallelTerminationStrategy: PID 27029 died... 16:14:29.732188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27029): Terminated: ok {rc=0} 16:14:29.776762 --- ParallelTerminationStrategy: PID 27030 died... 16:14:29.795637 run iperf3-srv_10.42.42.10(pid=27030): Terminated {rc=256} 16:14:29.839924 --- ParallelTerminationStrategy: PID 27033 died... 16:14:29.858832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27033): Terminated: ok {rc=0} 16:14:29.903096 --- ParallelTerminationStrategy: PID 27036 died... 16:14:29.921854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27036): Terminated: ok {rc=0} 16:14:29.966022 --- ParallelTerminationStrategy: PID 27039 died... 16:14:29.984925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27039): Terminated: ok {rc=0} 16:14:30.070579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:14:31.242100 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:31.257143 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:14:31.329407 tst iperf3m4.py: using LAC 30008 16:14:31.494593 tst iperf3m4.py: using RAC 173 16:14:31.628138 tst iperf3m4.py: using CellId 30008 16:14:31.766230 tst iperf3m4.py: using BVCI 30009 16:14:31.919018 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:31.934276 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:31.948477 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:31.962886 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:31.976930 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:31.991527 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:32.003997 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:32.018412 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:32.033407 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:14:32.165781 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:14:32.301327 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:14:32.423435 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:14:32.544796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:14:32.770538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:14:33.108003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27041): Launched 16:14:33.399478 run iperf3-srv_10.42.42.10(pid=27042): Launched 16:14:33.524457 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:14:33.749126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:14:34.085880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27043): Launched 16:14:34.383113 run iperf3-srv_10.42.42.10(pid=27044): Launched 16:14:34.500685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:14:34.708287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:14:35.021998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27045): Launched 16:14:35.293911 run iperf3-srv_10.42.42.10(pid=27046): Launched 16:14:35.409911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:14:35.617282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:14:35.931266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27047): Launched 16:14:36.203463 run iperf3-srv_10.42.42.10(pid=27048): Launched 16:14:36.319754 tst iperf3m4.py:8: start network... 16:14:36.526473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:37.009613 run create_hlr_db(pid=27049): Launched 16:14:37.135603 bus /gobi_6: Setting Powered False 16:14:38.196715 run create_hlr_db(pid=27049): Terminated: ok {rc=0} 16:14:38.629840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27051): Launched 16:14:38.940205 run osmo-hlr_10.42.42.2(pid=27052): Launched 16:14:39.056889 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:39.605701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27054): Launched 16:14:39.915837 run osmo-stp_10.42.42.5(pid=27055): Launched 16:14:40.032695 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:14:40.567328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27057): Launched 16:14:40.684848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:14:40.947606 run patchelf(pid=27058): Launched 16:14:41.119110 run osmo-stp_10.42.42.5(pid=27055): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27055)] 16:14:41.249425 run osmo-stp_10.42.42.5(pid=27055): stdout: | (launched: 2022-12-12_16:14:39.856893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:41.381533 run osmo-stp_10.42.42.5(pid=27055): stderr: | 20221212161440027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161440027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161440027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161440028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161440028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161440028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161440028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:41.513343 run osmo-stp_10.42.42.5(pid=27055): stdout: | (launched: 2022-12-12_16:14:39.856893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:41.639412 run osmo-stp_10.42.42.5(pid=27055): stderr: | 20221212161440027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161440027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161440027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161440028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161440028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161440028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161440028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:41.788759 run patchelf(pid=27058): Terminating (SIGINT) 16:14:41.961364 run patchelf(pid=27058): Terminated: ok {rc=0} 16:14:42.085619 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27055): Process ended prematurely: osmo-stp_10.42.42.5(pid=27055) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27055)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:14:42.095156 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:14:42.122611 run osmo-hlr_10.42.42.2(pid=27052): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27052)] 16:14:42.170173 run osmo-hlr_10.42.42.2(pid=27052): stdout: | (launched: 2022-12-12_16:14:38.881409) 16:14:42.219641 run osmo-hlr_10.42.42.2(pid=27052): stderr: | 20221212161439056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161439057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161439057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161439057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161439057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161439057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161439069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161439077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161439077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161439077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:42.269301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27041): Terminating (SIGTERM) 16:14:42.309107 run iperf3-srv_10.42.42.10(pid=27042): Terminating (SIGTERM) 16:14:42.349328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27043): Terminating (SIGTERM) 16:14:42.389607 run iperf3-srv_10.42.42.10(pid=27044): Terminating (SIGTERM) 16:14:42.429531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27045): Terminating (SIGTERM) 16:14:42.469200 run iperf3-srv_10.42.42.10(pid=27046): Terminating (SIGTERM) 16:14:42.508876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27047): Terminating (SIGTERM) 16:14:42.548580 run iperf3-srv_10.42.42.10(pid=27048): Terminating (SIGTERM) 16:14:42.588045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27051): Terminating (SIGTERM) 16:14:42.627806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27054): Terminating (SIGTERM) 16:14:42.667569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27057): Terminating (SIGTERM) 16:14:42.707448 --- ParallelTerminationStrategy: PID 27041 died... 16:14:42.726807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27041): Terminated: ok {rc=0} 16:14:42.771105 --- ParallelTerminationStrategy: PID 27042 died... 16:14:42.789877 run iperf3-srv_10.42.42.10(pid=27042): Terminated {rc=256} 16:14:42.833779 --- ParallelTerminationStrategy: PID 27043 died... 16:14:42.852505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27043): Terminated: ok {rc=0} 16:14:42.896623 --- ParallelTerminationStrategy: PID 27044 died... 16:14:42.915378 run iperf3-srv_10.42.42.10(pid=27044): Terminated {rc=256} 16:14:42.959162 --- ParallelTerminationStrategy: PID 27045 died... 16:14:42.977943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27045): Terminated: ok {rc=0} 16:14:43.021968 --- ParallelTerminationStrategy: PID 27046 died... 16:14:43.040694 run iperf3-srv_10.42.42.10(pid=27046): Terminated {rc=256} 16:14:43.084641 --- ParallelTerminationStrategy: PID 27047 died... 16:14:43.103522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27047): Terminated: ok {rc=0} 16:14:43.147665 --- ParallelTerminationStrategy: PID 27048 died... 16:14:43.166530 run iperf3-srv_10.42.42.10(pid=27048): Terminated {rc=256} 16:14:43.211102 --- ParallelTerminationStrategy: PID 27051 died... 16:14:43.229995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27051): Terminated: ok {rc=0} 16:14:43.274001 --- ParallelTerminationStrategy: PID 27054 died... 16:14:43.292591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27054): Terminated: ok {rc=0} 16:14:43.336558 --- ParallelTerminationStrategy: PID 27057 died... 16:14:43.355532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27057): Terminated: ok {rc=0} 16:14:43.439021 bus /gobi_4: Setting Powered False 16:14:44.534899 bus /gobi_4: Setting Powered False 16:14:45.647598 bus /gobi_1: Setting Powered False 16:14:46.744015 bus /gobi_1: Setting Powered False 16:14:47.866821 bus /gobi_0: Setting Powered False 16:14:48.966143 bus /gobi_0: Setting Powered False 16:14:50.084636 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:14:51.186939 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:51.198804 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:14:51.256916 tst ping.py: using LAC 30009 16:14:51.377891 tst ping.py: using RAC 174 16:14:51.497741 tst ping.py: using CellId 30009 16:14:51.617426 tst ping.py: using BVCI 30010 16:14:51.728088 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:51.739286 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:51.750058 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:51.761047 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:51.771861 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:51.782515 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:51.793396 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:51.804076 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:14:51.918745 tst ping.py:19: start network... 16:14:52.123336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:14:52.600478 run create_hlr_db(pid=27059): Launched 16:14:52.724867 bus /gobi_6: Setting Powered False 16:14:53.786278 run create_hlr_db(pid=27059): Terminated: ok {rc=0} 16:14:54.235273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27061): Launched 16:14:54.567354 run osmo-hlr_10.42.42.2(pid=27062): Launched 16:14:54.693646 run osmo-stp_10.42.42.5: Starting osmo-stp 16:14:55.268275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27064): Launched 16:14:55.597465 run osmo-stp_10.42.42.5(pid=27065): Launched 16:14:55.722841 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:14:56.288081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27067): Launched 16:14:56.412825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:14:56.691159 run patchelf(pid=27068): Launched 16:14:56.874360 run osmo-stp_10.42.42.5(pid=27065): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27065)] 16:14:57.012673 run osmo-stp_10.42.42.5(pid=27065): stdout: | (launched: 2022-12-12_16:14:55.536099) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:57.153094 run osmo-stp_10.42.42.5(pid=27065): stderr: | 20221212161455727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161455727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161455727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161455728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161455728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161455728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161455728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:57.292926 run osmo-stp_10.42.42.5(pid=27065): stdout: | (launched: 2022-12-12_16:14:55.536099) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:14:57.426588 run osmo-stp_10.42.42.5(pid=27065): stderr: | 20221212161455727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161455727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161455727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161455728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161455728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161455728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161455728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:14:57.585078 run patchelf(pid=27068): Terminating (SIGINT) 16:14:57.766635 run patchelf(pid=27068): Terminated: ok {rc=0} 16:14:57.897669 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27065): Process ended prematurely: osmo-stp_10.42.42.5(pid=27065) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27065)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 16:14:57.907256 tst ping.py:22: Test FAILED (6.7 sec) 16:14:57.935835 run osmo-hlr_10.42.42.2(pid=27062): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27062)] 16:14:57.986998 run osmo-hlr_10.42.42.2(pid=27062): stdout: | (launched: 2022-12-12_16:14:54.505892) 16:14:58.039224 run osmo-hlr_10.42.42.2(pid=27062): stderr: | 20221212161454701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161454701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161454701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161454701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161454701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161454701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161454715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161454725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161454725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161454725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:14:58.091811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27061): Terminating (SIGTERM) 16:14:58.134331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27064): Terminating (SIGTERM) 16:14:58.176794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27067): Terminating (SIGTERM) 16:14:58.219413 --- ParallelTerminationStrategy: PID 27061 died... 16:14:58.239791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27061): Terminated: ok {rc=0} 16:14:58.287181 --- ParallelTerminationStrategy: PID 27064 died... 16:14:58.306866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27064): Terminated: ok {rc=0} 16:14:58.354042 --- ParallelTerminationStrategy: PID 27067 died... 16:14:58.373858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27067): Terminated: ok {rc=0} 16:14:58.462723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:14:59.551317 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:14:59.563996 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:14:59.627595 tst ping_idle_ping.py: using LAC 30010 16:14:59.755259 tst ping_idle_ping.py: using RAC 175 16:14:59.883347 tst ping_idle_ping.py: using CellId 30010 16:15:00.013678 tst ping_idle_ping.py: using BVCI 30011 16:15:00.134861 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:15:00.146308 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:15:00.157625 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:15:00.168656 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:15:00.180374 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:15:00.191696 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:15:00.203314 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:15:00.214765 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:15:00.331420 tst ping_idle_ping.py:24: start network... 16:15:00.553417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:01.070442 run create_hlr_db(pid=27069): Launched 16:15:01.223521 bus /gobi_6: Setting Powered False 16:15:02.295183 run create_hlr_db(pid=27069): Terminated: ok {rc=0} 16:15:02.747215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27074): Launched 16:15:03.079213 run osmo-hlr_10.42.42.2(pid=27075): Launched 16:15:03.205505 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:03.776638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27077): Launched 16:15:04.108565 run osmo-stp_10.42.42.5(pid=27078): Launched 16:15:04.234709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:15:04.808003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27080): Launched 16:15:04.934261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:15:05.214538 run patchelf(pid=27081): Launched 16:15:05.399425 run osmo-stp_10.42.42.5(pid=27078): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27078)] 16:15:05.538693 run osmo-stp_10.42.42.5(pid=27078): stdout: | (launched: 2022-12-12_16:15:04.046756) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:05.679475 run osmo-stp_10.42.42.5(pid=27078): stderr: | 20221212161504237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161504237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161504237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161504237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161504238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161504238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161504238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:05.819998 run osmo-stp_10.42.42.5(pid=27078): stdout: | (launched: 2022-12-12_16:15:04.046756) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:05.954679 run osmo-stp_10.42.42.5(pid=27078): stderr: | 20221212161504237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161504237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161504237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161504237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161504238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161504238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161504238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:06.114971 run patchelf(pid=27081): Terminating (SIGINT) 16:15:06.297140 run patchelf(pid=27081): Terminated: ok {rc=0} 16:15:06.428850 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27078): Process ended prematurely: osmo-stp_10.42.42.5(pid=27078) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27078)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:15:06.438695 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 16:15:06.467284 run osmo-hlr_10.42.42.2(pid=27075): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27075)] 16:15:06.517960 run osmo-hlr_10.42.42.2(pid=27075): stdout: | (launched: 2022-12-12_16:15:03.017326) 16:15:06.570759 run osmo-hlr_10.42.42.2(pid=27075): stderr: | 20221212161503214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161503214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161503214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161503214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161503214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161503214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161503226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161503235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161503235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161503235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:06.623693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27074): Terminating (SIGTERM) 16:15:06.666165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27077): Terminating (SIGTERM) 16:15:06.708854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27080): Terminating (SIGTERM) 16:15:06.751904 --- ParallelTerminationStrategy: PID 27074 died... 16:15:06.772223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27074): Terminated: ok {rc=0} 16:15:06.819552 --- ParallelTerminationStrategy: PID 27077 died... 16:15:06.839287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27077): Terminated: ok {rc=0} 16:15:06.886530 --- ParallelTerminationStrategy: PID 27080 died... 16:15:06.906333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27080): Terminated: ok {rc=0} 16:15:06.996566 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:15:08.290249 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:15:08.296902 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:15:08.318452 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:15:08.358223 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:15:08.445217 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:15:08.466332 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:15:08.505543 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:15:09.097215 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:15:09.148341 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:09.159431 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:15:09.216911 tst cs_paging_gprs_active.py: using LAC 30011 16:15:09.339421 tst cs_paging_gprs_active.py: using RAC 176 16:15:09.466106 tst cs_paging_gprs_active.py: using CellId 30011 16:15:09.587284 tst cs_paging_gprs_active.py: using BVCI 30012 16:15:09.699877 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:09.710906 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:09.721668 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:09.732367 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:09.742980 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:09.753754 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:09.764503 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:09.775109 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:09.785937 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:15:09.908735 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:15:10.025225 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:15:10.233915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:15:10.547346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27085): Launched 16:15:10.820662 run iperf3-srv_10.42.42.10(pid=27086): Launched 16:15:10.939366 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:15:11.147081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:15:11.460231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27087): Launched 16:15:11.733764 run iperf3-srv_10.42.42.10(pid=27088): Launched 16:15:11.852398 tst cs_paging_gprs_active.py:38: start network... 16:15:12.059693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:12.541271 run create_hlr_db(pid=27089): Launched 16:15:12.669493 bus /gobi_6: Setting Powered False 16:15:13.730462 run create_hlr_db(pid=27089): Terminated: ok {rc=0} 16:15:14.184108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27091): Launched 16:15:14.519176 run osmo-hlr_10.42.42.2(pid=27092): Launched 16:15:14.648736 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:15.225669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27094): Launched 16:15:15.560066 run osmo-stp_10.42.42.5(pid=27095): Launched 16:15:15.689257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:15:16.303056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27097): Launched 16:15:16.443569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:15:16.732500 run patchelf(pid=27098): Launched 16:15:16.932410 run osmo-stp_10.42.42.5(pid=27095): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27095)] 16:15:17.077415 run osmo-stp_10.42.42.5(pid=27095): stdout: | (launched: 2022-12-12_16:15:15.497806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:17.223630 run osmo-stp_10.42.42.5(pid=27095): stderr: | 20221212161515688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161515688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161515688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161515689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161515689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161515690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161515690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:17.365985 run osmo-stp_10.42.42.5(pid=27095): stdout: | (launched: 2022-12-12_16:15:15.497806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:17.502881 run osmo-stp_10.42.42.5(pid=27095): stderr: | 20221212161515688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161515688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161515688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161515689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161515689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161515690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161515690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:17.664912 run patchelf(pid=27098): Terminating (SIGINT) 16:15:17.850705 run patchelf(pid=27098): Terminated: ok {rc=0} 16:15:17.984687 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27095): Process ended prematurely: osmo-stp_10.42.42.5(pid=27095) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27095)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:15:17.995572 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:15:18.025234 run osmo-hlr_10.42.42.2(pid=27092): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27092)] 16:15:18.075827 run osmo-hlr_10.42.42.2(pid=27092): stdout: | (launched: 2022-12-12_16:15:14.456485) 16:15:18.128129 run osmo-hlr_10.42.42.2(pid=27092): stderr: | 20221212161514654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161514654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161514654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161514654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161514654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161514654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161514666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161514674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161514675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161514675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:18.180870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27085): Terminating (SIGTERM) 16:15:18.223348 run iperf3-srv_10.42.42.10(pid=27086): Terminating (SIGTERM) 16:15:18.265481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27087): Terminating (SIGTERM) 16:15:18.307885 run iperf3-srv_10.42.42.10(pid=27088): Terminating (SIGTERM) 16:15:18.350144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27091): Terminating (SIGTERM) 16:15:18.392313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27094): Terminating (SIGTERM) 16:15:18.434415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27097): Terminating (SIGTERM) 16:15:18.476809 --- ParallelTerminationStrategy: PID 27085 died... 16:15:18.496918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27085): Terminated: ok {rc=0} 16:15:18.543974 --- ParallelTerminationStrategy: PID 27086 died... 16:15:18.563531 run iperf3-srv_10.42.42.10(pid=27086): Terminated {rc=256} 16:15:18.610261 --- ParallelTerminationStrategy: PID 27087 died... 16:15:18.629752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27087): Terminated: ok {rc=0} 16:15:18.676617 --- ParallelTerminationStrategy: PID 27088 died... 16:15:18.696157 run iperf3-srv_10.42.42.10(pid=27088): Terminated {rc=256} 16:15:18.742857 --- ParallelTerminationStrategy: PID 27091 died... 16:15:18.762469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27091): Terminated: ok {rc=0} 16:15:18.809282 --- ParallelTerminationStrategy: PID 27094 died... 16:15:18.828759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27094): Terminated: ok {rc=0} 16:15:18.875619 --- ParallelTerminationStrategy: PID 27097 died... 16:15:18.895290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27097): Terminated: ok {rc=0} 16:15:18.983617 bus /gobi_0: Setting Powered False 16:15:20.082944 bus /gobi_0: Setting Powered False 16:15:21.198820 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:15:22.341438 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:22.353058 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:15:22.413496 tst iperf3.py: using LAC 30012 16:15:22.536313 tst iperf3.py: using RAC 177 16:15:22.660635 tst iperf3.py: using CellId 30012 16:15:22.784543 tst iperf3.py: using BVCI 30013 16:15:22.898525 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:22.909614 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:22.920324 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:22.931164 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:22.941926 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:22.952519 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:22.963331 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:22.973987 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:22.984775 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:15:23.100334 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:15:23.309193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:15:23.623348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27099): Launched 16:15:23.896529 run iperf3-srv_10.42.42.10(pid=27100): Launched 16:15:24.014617 tst iperf3.py:8: start network... 16:15:24.222532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:24.707057 run create_hlr_db(pid=27101): Launched 16:15:24.834945 bus /gobi_6: Setting Powered False 16:15:25.896653 run create_hlr_db(pid=27101): Terminated: ok {rc=0} 16:15:26.330117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27103): Launched 16:15:26.643689 run osmo-hlr_10.42.42.2(pid=27104): Launched 16:15:26.762977 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:27.312874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27106): Launched 16:15:27.626231 run osmo-stp_10.42.42.5(pid=27107): Launched 16:15:27.745095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:15:28.280634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27109): Launched 16:15:28.400399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:15:28.665241 run patchelf(pid=27110): Launched 16:15:28.837677 run osmo-stp_10.42.42.5(pid=27107): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27107)] 16:15:28.968894 run osmo-stp_10.42.42.5(pid=27107): stdout: | (launched: 2022-12-12_16:15:27.567416) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:29.102981 run osmo-stp_10.42.42.5(pid=27107): stderr: | 20221212161527739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161527739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161527739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161527740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161527740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161527741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161527741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:29.236196 run osmo-stp_10.42.42.5(pid=27107): stdout: | (launched: 2022-12-12_16:15:27.567416) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:29.363322 run osmo-stp_10.42.42.5(pid=27107): stderr: | 20221212161527739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161527739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161527739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161527740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161527740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161527741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161527741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:29.514047 run patchelf(pid=27110): Terminating (SIGINT) 16:15:29.687810 run patchelf(pid=27110): Terminated: ok {rc=0} 16:15:29.812652 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27107): Process ended prematurely: osmo-stp_10.42.42.5(pid=27107) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27107)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 16:15:29.822478 tst iperf3.py:8: Test FAILED (7.5 sec) 16:15:29.849724 run osmo-hlr_10.42.42.2(pid=27104): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27104)] 16:15:29.897330 run osmo-hlr_10.42.42.2(pid=27104): stdout: | (launched: 2022-12-12_16:15:26.584702) 16:15:29.946904 run osmo-hlr_10.42.42.2(pid=27104): stderr: | 20221212161526762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161526762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161526762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161526762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161526762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161526763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161526774 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161526783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161526783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161526783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:29.996806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27099): Terminating (SIGTERM) 16:15:30.036860 run iperf3-srv_10.42.42.10(pid=27100): Terminating (SIGTERM) 16:15:30.077567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27103): Terminating (SIGTERM) 16:15:30.117644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27106): Terminating (SIGTERM) 16:15:30.157464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27109): Terminating (SIGTERM) 16:15:30.197398 --- ParallelTerminationStrategy: PID 27099 died... 16:15:30.216684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27099): Terminated: ok {rc=0} 16:15:30.261078 --- ParallelTerminationStrategy: PID 27100 died... 16:15:30.279813 run iperf3-srv_10.42.42.10(pid=27100): Terminated {rc=256} 16:15:30.323559 --- ParallelTerminationStrategy: PID 27103 died... 16:15:30.342141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27103): Terminated: ok {rc=0} 16:15:30.386610 --- ParallelTerminationStrategy: PID 27106 died... 16:15:30.405463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27106): Terminated: ok {rc=0} 16:15:30.449293 --- ParallelTerminationStrategy: PID 27109 died... 16:15:30.468279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27109): Terminated: ok {rc=0} 16:15:30.552333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:15:31.735338 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:31.748075 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:15:31.812274 tst iperf3m4.py: using LAC 30013 16:15:31.945868 tst iperf3m4.py: using RAC 178 16:15:32.068600 tst iperf3m4.py: using CellId 30013 16:15:32.207417 tst iperf3m4.py: using BVCI 30014 16:15:32.331529 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:32.343077 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:32.354574 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:32.366216 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:32.377729 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:32.389220 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:32.400773 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:32.412247 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:32.423977 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:15:32.540910 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:15:32.664468 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:15:32.785869 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:15:32.907681 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:15:33.132482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:15:33.467255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27111): Launched 16:15:33.758013 run iperf3-srv_10.42.42.10(pid=27112): Launched 16:15:33.884074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:15:34.108836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:15:34.443849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27113): Launched 16:15:34.734458 run iperf3-srv_10.42.42.10(pid=27114): Launched 16:15:34.861382 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:15:35.085769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:15:35.421492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27115): Launched 16:15:35.713394 run iperf3-srv_10.42.42.10(pid=27116): Launched 16:15:35.837568 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:15:36.062228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:15:36.396825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27117): Launched 16:15:36.687362 run iperf3-srv_10.42.42.10(pid=27118): Launched 16:15:36.811522 tst iperf3m4.py:8: start network... 16:15:37.035537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:37.552173 run create_hlr_db(pid=27119): Launched 16:15:37.680421 bus /gobi_6: Setting Powered False 16:15:38.742288 run create_hlr_db(pid=27119): Terminated: ok {rc=0} 16:15:39.204659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27121): Launched 16:15:39.538479 run osmo-hlr_10.42.42.2(pid=27122): Launched 16:15:39.666069 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:40.245560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27124): Launched 16:15:40.558436 run osmo-stp_10.42.42.5(pid=27125): Launched 16:15:40.679809 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:15:41.218107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27127): Launched 16:15:41.338391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:15:41.603853 run patchelf(pid=27128): Launched 16:15:41.778026 run osmo-stp_10.42.42.5(pid=27125): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27125)] 16:15:41.909125 run osmo-stp_10.42.42.5(pid=27125): stdout: | (launched: 2022-12-12_16:15:40.499362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:42.042253 run osmo-stp_10.42.42.5(pid=27125): stderr: | 20221212161540671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161540671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161540671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161540671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161540672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161540672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161540672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:42.175482 run osmo-stp_10.42.42.5(pid=27125): stdout: | (launched: 2022-12-12_16:15:40.499362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:42.302371 run osmo-stp_10.42.42.5(pid=27125): stderr: | 20221212161540671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161540671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161540671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161540671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161540672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161540672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161540672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:42.452699 run patchelf(pid=27128): Terminating (SIGINT) 16:15:42.625549 run patchelf(pid=27128): Terminated: ok {rc=0} 16:15:42.750568 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27125): Process ended prematurely: osmo-stp_10.42.42.5(pid=27125) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27125)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:15:42.760295 tst iperf3m4.py:8: Test FAILED (11.1 sec) 16:15:42.788007 run osmo-hlr_10.42.42.2(pid=27122): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27122)] 16:15:42.836297 run osmo-hlr_10.42.42.2(pid=27122): stdout: | (launched: 2022-12-12_16:15:39.476020) 16:15:42.886328 run osmo-hlr_10.42.42.2(pid=27122): stderr: | 20221212161539674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161539674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161539674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161539674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161539674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161539674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161539687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161539697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161539697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161539697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:42.936583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27111): Terminating (SIGTERM) 16:15:42.976227 run iperf3-srv_10.42.42.10(pid=27112): Terminating (SIGTERM) 16:15:43.016082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27113): Terminating (SIGTERM) 16:15:43.055974 run iperf3-srv_10.42.42.10(pid=27114): Terminating (SIGTERM) 16:15:43.095756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27115): Terminating (SIGTERM) 16:15:43.135352 run iperf3-srv_10.42.42.10(pid=27116): Terminating (SIGTERM) 16:15:43.175106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27117): Terminating (SIGTERM) 16:15:43.215072 run iperf3-srv_10.42.42.10(pid=27118): Terminating (SIGTERM) 16:15:43.254770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27121): Terminating (SIGTERM) 16:15:43.294678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27124): Terminating (SIGTERM) 16:15:43.334378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27127): Terminating (SIGTERM) 16:15:43.374588 --- ParallelTerminationStrategy: PID 27111 died... 16:15:43.393857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27111): Terminated: ok {rc=0} 16:15:43.438129 --- ParallelTerminationStrategy: PID 27112 died... 16:15:43.456643 run iperf3-srv_10.42.42.10(pid=27112): Terminated {rc=256} 16:15:43.500406 --- ParallelTerminationStrategy: PID 27113 died... 16:15:43.519244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27113): Terminated: ok {rc=0} 16:15:43.563137 --- ParallelTerminationStrategy: PID 27114 died... 16:15:43.581771 run iperf3-srv_10.42.42.10(pid=27114): Terminated {rc=256} 16:15:43.625467 --- ParallelTerminationStrategy: PID 27115 died... 16:15:43.644082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27115): Terminated: ok {rc=0} 16:15:43.688127 --- ParallelTerminationStrategy: PID 27116 died... 16:15:43.706855 run iperf3-srv_10.42.42.10(pid=27116): Terminated {rc=256} 16:15:43.750798 --- ParallelTerminationStrategy: PID 27117 died... 16:15:43.769575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27117): Terminated: ok {rc=0} 16:15:43.819086 --- ParallelTerminationStrategy: PID 27118 died... 16:15:43.838725 run iperf3-srv_10.42.42.10(pid=27118): Terminated {rc=256} 16:15:43.886558 --- ParallelTerminationStrategy: PID 27121 died... 16:15:43.906440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27121): Terminated: ok {rc=0} 16:15:43.954677 --- ParallelTerminationStrategy: PID 27124 died... 16:15:43.974353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27124): Terminated: ok {rc=0} 16:15:44.022475 --- ParallelTerminationStrategy: PID 27127 died... 16:15:44.042086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27127): Terminated: ok {rc=0} 16:15:44.132723 bus /gobi_4: Setting Powered False 16:15:45.232070 bus /gobi_4: Setting Powered False 16:15:46.359242 bus /gobi_1: Setting Powered False 16:15:47.460056 bus /gobi_1: Setting Powered False 16:15:48.576382 bus /gobi_0: Setting Powered False 16:15:49.674321 bus /gobi_0: Setting Powered False 16:15:50.791374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:15:51.895209 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:51.907442 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:15:51.971656 tst ping.py: using LAC 30014 16:15:52.099908 tst ping.py: using RAC 179 16:15:52.225869 tst ping.py: using CellId 30014 16:15:52.351617 tst ping.py: using BVCI 30015 16:15:52.470354 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:52.481973 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:52.493245 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:52.504815 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:52.516312 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:52.527774 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:52.539484 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:15:52.551032 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:15:52.667100 tst ping.py:19: start network... 16:15:52.870271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:15:53.343602 run create_hlr_db(pid=27130): Launched 16:15:53.468162 bus /gobi_6: Setting Powered False 16:15:54.533211 run create_hlr_db(pid=27130): Terminated: ok {rc=0} 16:15:54.988319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27132): Launched 16:15:55.316811 run osmo-hlr_10.42.42.2(pid=27133): Launched 16:15:55.441893 run osmo-stp_10.42.42.5: Starting osmo-stp 16:15:56.010519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27135): Launched 16:15:56.340475 run osmo-stp_10.42.42.5(pid=27136): Launched 16:15:56.466227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:15:57.031680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27138): Launched 16:15:57.156689 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:15:57.434770 run patchelf(pid=27139): Launched 16:15:57.617114 run osmo-stp_10.42.42.5(pid=27136): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27136)] 16:15:57.755425 run osmo-stp_10.42.42.5(pid=27136): stdout: | (launched: 2022-12-12_16:15:56.279049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:57.895720 run osmo-stp_10.42.42.5(pid=27136): stderr: | 20221212161556470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161556470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161556470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161556471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161556471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161556471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161556471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:58.035934 run osmo-stp_10.42.42.5(pid=27136): stdout: | (launched: 2022-12-12_16:15:56.279049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:15:58.170676 run osmo-stp_10.42.42.5(pid=27136): stderr: | 20221212161556470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161556470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161556470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161556471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161556471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161556471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161556471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:15:58.329720 run patchelf(pid=27139): Terminating (SIGINT) 16:15:58.511474 run patchelf(pid=27139): Terminated: ok {rc=0} 16:15:58.643070 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27136): Process ended prematurely: osmo-stp_10.42.42.5(pid=27136) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27136)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 16:15:58.652806 tst ping.py:22: Test FAILED (6.7 sec) 16:15:58.681934 run osmo-hlr_10.42.42.2(pid=27133): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27133)] 16:15:58.733058 run osmo-hlr_10.42.42.2(pid=27133): stdout: | (launched: 2022-12-12_16:15:55.255362) 16:15:58.785750 run osmo-hlr_10.42.42.2(pid=27133): stderr: | 20221212161555451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161555451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161555451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161555451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161555451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161555451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161555467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161555477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161555477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161555477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:15:58.838962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27132): Terminating (SIGTERM) 16:15:58.881939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27135): Terminating (SIGTERM) 16:15:58.924709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27138): Terminating (SIGTERM) 16:15:58.967790 --- ParallelTerminationStrategy: PID 27132 died... 16:15:58.988003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27132): Terminated: ok {rc=0} 16:15:59.035903 --- ParallelTerminationStrategy: PID 27135 died... 16:15:59.055767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27135): Terminated: ok {rc=0} 16:15:59.103014 --- ParallelTerminationStrategy: PID 27138 died... 16:15:59.122648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27138): Terminated: ok {rc=0} 16:15:59.211469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:16:00.299434 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:16:00.312274 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:16:00.373186 tst ping_idle_ping.py: using LAC 30015 16:16:00.502889 tst ping_idle_ping.py: using RAC 180 16:16:00.631216 tst ping_idle_ping.py: using CellId 30015 16:16:00.758876 tst ping_idle_ping.py: using BVCI 30016 16:16:00.894221 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:16:00.906406 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:16:00.918341 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:16:00.930489 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:16:00.942660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:16:00.954967 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:16:00.967596 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:16:00.979941 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:16:01.104590 tst ping_idle_ping.py:24: start network... 16:16:01.329880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:01.847966 run create_hlr_db(pid=27140): Launched 16:16:02.007003 bus /gobi_6: Setting Powered False 16:16:03.072194 run create_hlr_db(pid=27140): Terminated: ok {rc=0} 16:16:03.529609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27142): Launched 16:16:03.859535 run osmo-hlr_10.42.42.2(pid=27143): Launched 16:16:03.990937 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:04.561808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27145): Launched 16:16:04.869345 run osmo-stp_10.42.42.5(pid=27146): Launched 16:16:04.985386 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:16:05.515643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27148): Launched 16:16:05.633258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:16:05.892888 run patchelf(pid=27149): Launched 16:16:06.064225 run osmo-stp_10.42.42.5(pid=27146): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27146)] 16:16:06.193585 run osmo-stp_10.42.42.5(pid=27146): stdout: | (launched: 2022-12-12_16:16:04.811349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:06.324457 run osmo-stp_10.42.42.5(pid=27146): stderr: | 20221212161604982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161604982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161604982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161604983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161604983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161604983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161604983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:06.455346 run osmo-stp_10.42.42.5(pid=27146): stdout: | (launched: 2022-12-12_16:16:04.811349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:06.580625 run osmo-stp_10.42.42.5(pid=27146): stderr: | 20221212161604982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161604982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161604982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161604983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161604983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161604983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161604983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:06.728671 run patchelf(pid=27149): Terminating (SIGINT) 16:16:06.899121 run patchelf(pid=27149): Terminated: ok {rc=0} 16:16:07.022301 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27146): Process ended prematurely: osmo-stp_10.42.42.5(pid=27146) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27146)] [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:16:07.031546 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:16:07.058586 run osmo-hlr_10.42.42.2(pid=27143): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27143)] 16:16:07.106023 run osmo-hlr_10.42.42.2(pid=27143): stdout: | (launched: 2022-12-12_16:16:03.798100) 16:16:07.155300 run osmo-hlr_10.42.42.2(pid=27143): stderr: | 20221212161603993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161603993 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161603993 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161603993 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161603993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161603993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161604005 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161604019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161604019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161604019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:07.205189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27142): Terminating (SIGTERM) 16:16:07.244835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27145): Terminating (SIGTERM) 16:16:07.284557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27148): Terminating (SIGTERM) 16:16:07.324616 --- ParallelTerminationStrategy: PID 27142 died... 16:16:07.343922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27142): Terminated: ok {rc=0} 16:16:07.394632 --- ParallelTerminationStrategy: PID 27145 died... 16:16:07.413637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27145): Terminated: ok {rc=0} 16:16:07.458519 --- ParallelTerminationStrategy: PID 27148 died... 16:16:07.477581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27148): Terminated: ok {rc=0} 16:16:07.562944 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:16:08.853226 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:08.860316 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:16:08.881931 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:16:08.916470 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:16:08.972277 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:16:08.994761 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:16:09.031012 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:16:09.581741 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:16:09.587039 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:16:09.598317 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:16:09.657200 tst switch_tch_pdch.py: using LAC 30016 16:16:09.783157 tst switch_tch_pdch.py: using RAC 181 16:16:09.902428 tst switch_tch_pdch.py: using CellId 30016 16:16:10.020672 tst switch_tch_pdch.py: using BVCI 30017 16:16:10.130732 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:16:10.142128 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:16:10.153193 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:16:10.164282 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:16:10.175221 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:16:10.186197 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:16:10.197410 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:16:10.208381 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:16:10.328881 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:16:10.450457 tst switch_tch_pdch.py:51: start network... 16:16:10.670923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:11.180351 run create_hlr_db(pid=27154): Launched 16:16:11.304744 bus /gobi_6: Setting Powered False 16:16:12.369626 run create_hlr_db(pid=27154): Terminated: ok {rc=0} 16:16:12.807897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27156): Launched 16:16:13.117370 run osmo-hlr_10.42.42.2(pid=27157): Launched 16:16:13.233947 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:13.775821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27159): Launched 16:16:14.083014 run osmo-stp_10.42.42.5(pid=27160): Launched 16:16:14.200023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:16:14.726276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27162): Launched 16:16:14.842186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:16:15.101216 run patchelf(pid=27163): Launched 16:16:15.271719 run osmo-stp_10.42.42.5(pid=27160): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27160)] 16:16:15.400603 run osmo-stp_10.42.42.5(pid=27160): stdout: | (launched: 2022-12-12_16:16:14.024801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:15.530730 run osmo-stp_10.42.42.5(pid=27160): stderr: | 20221212161614196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161614196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161614196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161614197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161614197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161614197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161614197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:15.660811 run osmo-stp_10.42.42.5(pid=27160): stdout: | (launched: 2022-12-12_16:16:14.024801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:15.787444 run osmo-stp_10.42.42.5(pid=27160): stderr: | 20221212161614196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161614196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161614196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161614197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161614197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161614197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161614197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:15.965933 run patchelf(pid=27163): Terminating (SIGINT) 16:16:16.156640 run patchelf(pid=27163): Terminated: ok {rc=0} 16:16:16.294682 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27160): Process ended prematurely: osmo-stp_10.42.42.5(pid=27160) [trial-2379↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27160)] [trial-2379↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:16:16.305577 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:16:16.338390 run osmo-hlr_10.42.42.2(pid=27157): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27157)] 16:16:16.392630 run osmo-hlr_10.42.42.2(pid=27157): stdout: | (launched: 2022-12-12_16:16:13.058029) 16:16:16.449594 run osmo-hlr_10.42.42.2(pid=27157): stderr: | 20221212161613237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161613237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161613237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161613237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161613237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161613237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161613249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161613258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161613259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161613259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:16.505952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27156): Terminating (SIGTERM) 16:16:16.552466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27159): Terminating (SIGTERM) 16:16:16.599731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27162): Terminating (SIGTERM) 16:16:16.647849 --- ParallelTerminationStrategy: PID 27156 died... 16:16:16.669608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27156): Terminated: ok {rc=0} 16:16:16.720874 --- ParallelTerminationStrategy: PID 27159 died... 16:16:16.741802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27159): Terminated: ok {rc=0} 16:16:16.792427 --- ParallelTerminationStrategy: PID 27162 died... 16:16:16.813234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27162): Terminated: ok {rc=0} 16:16:16.907562 bus /gobi_0: Setting Powered False 16:16:18.009187 bus /gobi_0: Setting Powered False 16:16:19.127208 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:16:20.367091 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:20.374032 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:16:20.396577 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:16:20.432436 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:16:20.487416 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:16:20.508809 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:16:20.544800 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:16:21.099244 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:16:21.105051 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:16:21.116574 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:16:21.174991 tst switch_tch_pdch.py: using LAC 30017 16:16:21.311011 tst switch_tch_pdch.py: using RAC 182 16:16:21.439380 tst switch_tch_pdch.py: using CellId 30017 16:16:21.566770 tst switch_tch_pdch.py: using BVCI 30018 16:16:21.685778 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:16:21.697262 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:16:21.708524 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:16:21.720172 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:16:21.731657 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:16:21.743062 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:16:21.754826 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:16:21.766415 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:16:21.882501 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:16:21.998213 tst switch_tch_pdch.py:51: start network... 16:16:22.201415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:22.649889 run create_hlr_db(pid=27174): Launched 16:16:22.775479 bus /gobi_6: Setting Powered False 16:16:23.834946 run create_hlr_db(pid=27174): Terminated: ok {rc=0} 16:16:24.253162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27176): Launched 16:16:24.582895 run osmo-hlr_10.42.42.2(pid=27177): Launched 16:16:24.708118 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:25.248307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27179): Launched 16:16:25.578244 run osmo-stp_10.42.42.5(pid=27180): Launched 16:16:25.701972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:16:26.238622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27182): Launched 16:16:26.365480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:16:26.642615 run patchelf(pid=27183): Launched 16:16:26.823720 run osmo-stp_10.42.42.5(pid=27180): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27180)] 16:16:26.962329 run osmo-stp_10.42.42.5(pid=27180): stdout: | (launched: 2022-12-12_16:16:25.516747) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:27.102809 run osmo-stp_10.42.42.5(pid=27180): stderr: | 20221212161625706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161625706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161625707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161625707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161625708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161625708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161625708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:27.242891 run osmo-stp_10.42.42.5(pid=27180): stdout: | (launched: 2022-12-12_16:16:25.516747) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:27.377145 run osmo-stp_10.42.42.5(pid=27180): stderr: | 20221212161625706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161625706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161625707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161625707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161625708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161625708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161625708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:27.536114 run patchelf(pid=27183): Terminating (SIGINT) 16:16:27.718216 run patchelf(pid=27183): Terminated: ok {rc=0} 16:16:27.849358 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27180): Process ended prematurely: osmo-stp_10.42.42.5(pid=27180) [trial-2379↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27180)] [trial-2379↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:16:27.859104 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:16:27.888031 run osmo-hlr_10.42.42.2(pid=27177): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27177)] 16:16:27.938849 run osmo-hlr_10.42.42.2(pid=27177): stdout: | (launched: 2022-12-12_16:16:24.521169) 16:16:27.991389 run osmo-hlr_10.42.42.2(pid=27177): stderr: | 20221212161624717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161624717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161624717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161624717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161624717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161624717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161624730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161624740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161624740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161624740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:28.044616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27176): Terminating (SIGTERM) 16:16:28.087155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27179): Terminating (SIGTERM) 16:16:28.129566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27182): Terminating (SIGTERM) 16:16:28.172168 --- ParallelTerminationStrategy: PID 27176 died... 16:16:28.192507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27176): Terminated: ok {rc=0} 16:16:28.239636 --- ParallelTerminationStrategy: PID 27179 died... 16:16:28.259974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27179): Terminated: ok {rc=0} 16:16:28.307404 --- ParallelTerminationStrategy: PID 27182 died... 16:16:28.327023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27182): Terminated: ok {rc=0} 16:16:28.415264 bus /gobi_0: Setting Powered False 16:16:29.516544 bus /gobi_0: Setting Powered False 16:16:30.635890 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_sms:oc2g --------------------------------------------------------------------- 16:16:31.917565 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:31.921910 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 16:16:31.948237 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 16:16:31.957450 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 16:16:32.023661 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 16:16:32.058672 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 16:16:32.066805 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 16:16:32.578578 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 16:16:32.583857 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 16:16:32.594506 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 16:16:32.627971 tst mo_mt_sms.py: using LAC 30018 16:16:32.748600 tst mo_mt_sms.py: using RAC 183 16:16:32.869808 tst mo_mt_sms.py: using CellId 30018 16:16:32.991377 tst mo_mt_sms.py: using BVCI 30019 16:16:33.103637 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 16:16:33.223104 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 16:16:33.339639 tst mo_mt_sms.py:9: start nitb and bts... 16:16:33.543260 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:16:34.166147 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27187): Launched 16:16:34.473919 run osmo-nitb_10.42.42.2(pid=27188): Launched 16:16:34.642572 run osmo-nitb_10.42.42.2(pid=27188): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27188)] 16:16:34.778766 run osmo-nitb_10.42.42.2(pid=27188): stdout: | (launched: 2022-12-12_16:16:34.415851) 16:16:34.916275 run osmo-nitb_10.42.42.2(pid=27188): stderr: | (launched: 2022-12-12_16:16:34.461369) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:16:35.053941 run osmo-nitb_10.42.42.2(pid=27188): stdout: | (launched: 2022-12-12_16:16:34.415851) 16:16:35.186003 run osmo-nitb_10.42.42.2(pid=27188): stderr: | (launched: 2022-12-12_16:16:34.461369) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27188): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27188) [trial-2379↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27188)] 16:16:35.588763 tst osmo-nitb_10.42.42.2(pid=27188): stdout: | (launched: 2022-12-12_16:16:34.415851) 16:16:35.711145 tst osmo-nitb_10.42.42.2(pid=27188): stderr: | (launched: 2022-12-12_16:16:34.461369) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:16:35.855313 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27188): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27188) [trial-2379↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27188)] [trial-2379↪nitb_sms:oc2g↪mo_mt_sms.py:11] 16:16:35.863856 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 16:16:35.870479 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27187): Terminating (SIGTERM) 16:16:36.078755 --- ParallelTerminationStrategy: PID 27187 died... 16:16:36.099539 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27187): Terminated: ok {rc=0} 16:16:36.185522 bus /sierra_3: Setting Powered False 16:16:37.286784 bus /sierra_3: Setting Powered False 16:16:38.403158 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 sms:oc2g --------------------------------------------------------------------- 16:16:39.585303 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:39.589497 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 16:16:39.610033 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 16:16:39.636727 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 16:16:39.688687 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 16:16:39.709325 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 16:16:39.735749 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 16:16:40.280101 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 sms:oc2g mo_mt_sms.py ---------------------------------------------- 16:16:40.284917 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 16:16:40.295872 tst sms:oc2g: Using 1 x bts (candidates: 1) 16:16:40.329528 tst mo_mt_sms.py: using LAC 30019 16:16:40.448702 tst mo_mt_sms.py: using RAC 184 16:16:40.567586 tst mo_mt_sms.py: using CellId 30019 16:16:40.688617 tst mo_mt_sms.py: using BVCI 30020 16:16:40.800116 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 16:16:40.810933 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 16:16:40.821388 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 16:16:40.831757 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 16:16:40.842163 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 16:16:40.852662 tst sms:oc2g: Using 1 x modem (candidates: 2) 16:16:40.971686 tst sms:oc2g: Using 1 x modem (candidates: 2) 16:16:41.092034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:41.600865 run create_hlr_db(pid=27192): Launched 16:16:41.727260 bus /sierra_2: Setting Powered False 16:16:42.791427 run create_hlr_db(pid=27192): Terminated: ok {rc=0} 16:16:43.229088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27194): Launched 16:16:43.560456 run osmo-hlr_10.42.42.2(pid=27195): Launched 16:16:43.686602 run osmo-stp_10.42.42.5: Starting osmo-stp 16:16:44.249219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27197): Launched 16:16:44.578827 run osmo-stp_10.42.42.5(pid=27198): Launched 16:16:44.703173 run osmo-msc_10.42.42.6: Starting osmo-msc 16:16:45.295482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27200): Launched 16:16:45.607507 run osmo-msc_10.42.42.6(pid=27201): Launched 16:16:45.783842 run osmo-stp_10.42.42.5(pid=27198): ERR: Terminated: ERROR {rc=1} [trial-2379↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27198)] 16:16:46.062920 run osmo-stp_10.42.42.5(pid=27198): stdout: | (launched: 2022-12-12_16:16:44.517035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:46.205487 run osmo-stp_10.42.42.5(pid=27198): stderr: | 20221212161644708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161644708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161644708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161644709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161644709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161644709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161644709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:46.345560 run osmo-stp_10.42.42.5(pid=27198): stdout: | (launched: 2022-12-12_16:16:44.517035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:16:46.479976 run osmo-stp_10.42.42.5(pid=27198): stderr: | 20221212161644708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161644708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161644708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161644709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161644709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161644709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161644709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:16:46.640079 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27198): Process ended prematurely: osmo-stp_10.42.42.5(pid=27198) [trial-2379↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27198)] [trial-2379↪sms:oc2g↪mo_mt_sms.py:16] 16:16:46.650546 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 16:16:46.682944 run osmo-hlr_10.42.42.2(pid=27195): ERR: Terminated: ERROR {rc=237} [trial-2379↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27195)] 16:16:46.736339 run osmo-hlr_10.42.42.2(pid=27195): stdout: | (launched: 2022-12-12_16:16:43.499199) 16:16:46.791415 run osmo-hlr_10.42.42.2(pid=27195): stderr: | 20221212161643694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161643694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161643694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161643694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161643694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161643694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161643707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161643715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161643715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161643715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:16:46.867562 run osmo-msc_10.42.42.6(pid=27201): ERR: Terminated: ERROR {rc=2} [trial-2379↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27201)] 16:16:46.921854 run osmo-msc_10.42.42.6(pid=27201): stdout: | (launched: 2022-12-12_16:16:45.548903) 16:16:46.976804 run osmo-msc_10.42.42.6(pid=27201): stderr: | 20221212161645881 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161645881 DLGLOBAL DEBUG validating counter group 0x7fa3089efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161645881 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161645881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161645882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161645882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161645883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161645884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161645884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161645884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:16:47.032160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27194): Terminating (SIGTERM) 16:16:47.079071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27197): Terminating (SIGTERM) 16:16:47.126055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27200): Terminating (SIGTERM) 16:16:47.174510 --- ParallelTerminationStrategy: PID 27194 died... 16:16:47.195555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27194): Terminated: ok {rc=0} 16:16:47.246012 --- ParallelTerminationStrategy: PID 27197 died... 16:16:47.266929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27197): Terminated: ok {rc=0} 16:16:47.318398 --- ParallelTerminationStrategy: PID 27200 died... 16:16:47.338712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27200): Terminated: ok {rc=0} 16:16:47.429009 bus /sierra_3: Setting Powered False 16:16:48.528269 bus /sierra_3: Setting Powered False 16:16:49.645527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_ussd:oc2g --------------------------------------------------------------------- 16:16:50.864365 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:50.868873 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 16:16:50.891115 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 16:16:50.899392 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 16:16:50.933578 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 16:16:50.954830 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 16:16:50.961952 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 16:16:51.481295 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 16:16:51.487399 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 16:16:51.499753 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 16:16:51.535431 tst assert_extension.py: using LAC 30020 16:16:51.661362 tst assert_extension.py: using RAC 185 16:16:51.787412 tst assert_extension.py: using CellId 30020 16:16:51.913406 tst assert_extension.py: using BVCI 30021 16:16:52.031593 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 16:16:52.148602 tst assert_extension.py:10: start nitb and bts... 16:16:52.352448 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:16:52.974521 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27206): Launched 16:16:53.281662 run osmo-nitb_10.42.42.2(pid=27207): Launched 16:16:53.450776 run osmo-nitb_10.42.42.2(pid=27207): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27207)] 16:16:53.587269 run osmo-nitb_10.42.42.2(pid=27207): stdout: | (launched: 2022-12-12_16:16:53.223828) 16:16:53.724574 run osmo-nitb_10.42.42.2(pid=27207): stderr: | (launched: 2022-12-12_16:16:53.268934) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:16:53.861760 run osmo-nitb_10.42.42.2(pid=27207): stdout: | (launched: 2022-12-12_16:16:53.223828) 16:16:53.993832 run osmo-nitb_10.42.42.2(pid=27207): stderr: | (launched: 2022-12-12_16:16:53.268934) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27207): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27207) [trial-2379↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27207)] 16:16:54.396799 tst osmo-nitb_10.42.42.2(pid=27207): stdout: | (launched: 2022-12-12_16:16:53.223828) 16:16:54.518990 tst osmo-nitb_10.42.42.2(pid=27207): stderr: | (launched: 2022-12-12_16:16:53.268934) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:16:54.663413 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27207): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27207) [trial-2379↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27207)] [trial-2379↪nitb_ussd:oc2g↪assert_extension.py:12] 16:16:54.671763 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:16:54.678444 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27206): Terminating (SIGTERM) 16:16:54.887435 --- ParallelTerminationStrategy: PID 27206 died... 16:16:54.908357 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27206): Terminated: ok {rc=0} 16:16:54.991294 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 ussd:oc2g --------------------------------------------------------------------- 16:16:56.148579 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:16:56.152365 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 16:16:56.172755 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 16:16:56.199275 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 16:16:56.235720 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 16:16:56.257337 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 16:16:56.285696 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 16:16:56.808586 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 ussd:oc2g assert_extension.py ---------------------------------------------- 16:16:56.813908 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 16:16:56.824613 tst ussd:oc2g: Using 1 x bts (candidates: 1) 16:16:56.858721 tst assert_extension.py: using LAC 30021 16:16:56.977430 tst assert_extension.py: using RAC 186 16:16:57.106954 tst assert_extension.py: using CellId 30021 16:16:57.235278 tst assert_extension.py: using BVCI 30022 16:16:57.346351 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 16:16:57.356845 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 16:16:57.367252 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 16:16:57.377675 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 16:16:57.388465 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 16:16:57.398951 tst ussd:oc2g: Using 1 x modem (candidates: 1) 16:16:57.516561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:16:57.989254 run create_hlr_db(pid=27211): Launched 16:16:58.115525 bus /sierra_2: Setting Powered False 16:16:59.176056 run create_hlr_db(pid=27211): Terminated: ok {rc=0} 16:16:59.624002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27213): Launched 16:16:59.953098 run osmo-hlr_10.42.42.2(pid=27214): Launched 16:17:00.079654 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:00.651170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27216): Launched 16:17:00.989357 run osmo-stp_10.42.42.5(pid=27217): Launched 16:17:01.123780 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:01.907046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27222): Launched 16:17:02.241898 run osmo-msc_10.42.42.6(pid=27223): Launched 16:17:02.430806 run osmo-stp_10.42.42.5(pid=27217): ERR: Terminated: ERROR {rc=1} [trial-2379↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27217)] 16:17:02.562312 run osmo-stp_10.42.42.5(pid=27217): stdout: | (launched: 2022-12-12_16:17:00.927143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:02.692318 run osmo-stp_10.42.42.5(pid=27217): stderr: | 20221212161701264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161701264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161701264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161701273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161701274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161701274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161701274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:02.819590 run osmo-stp_10.42.42.5(pid=27217): stdout: | (launched: 2022-12-12_16:17:00.927143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:02.940099 run osmo-stp_10.42.42.5(pid=27217): stderr: | 20221212161701264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161701264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161701264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161701273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161701274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161701274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161701274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:03.085632 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27217): Process ended prematurely: osmo-stp_10.42.42.5(pid=27217) [trial-2379↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27217)] [trial-2379↪ussd:oc2g↪assert_extension.py:17] 16:17:03.094077 tst assert_extension.py:17: Test FAILED (6.3 sec) 16:17:03.120411 run osmo-hlr_10.42.42.2(pid=27214): ERR: Terminated: ERROR {rc=237} [trial-2379↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27214)] 16:17:03.168026 run osmo-hlr_10.42.42.2(pid=27214): stdout: | (launched: 2022-12-12_16:16:59.891540) 16:17:03.217434 run osmo-hlr_10.42.42.2(pid=27214): stderr: | 20221212161700087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161700087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161700087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161700087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161700087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161700087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161700099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161700108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161700108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161700108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:03.287003 run osmo-msc_10.42.42.6(pid=27223): ERR: Terminated: ERROR {rc=2} [trial-2379↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27223)] 16:17:03.334923 run osmo-msc_10.42.42.6(pid=27223): stdout: | (launched: 2022-12-12_16:17:02.179294) 16:17:03.384116 run osmo-msc_10.42.42.6(pid=27223): stderr: | 20221212161702499 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161702499 DLGLOBAL DEBUG validating counter group 0x7f63a04efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161702499 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161702499 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161702500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161702500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161702502 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161702502 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161702502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161702502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:03.433789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27213): Terminating (SIGTERM) 16:17:03.473710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27216): Terminating (SIGTERM) 16:17:03.513657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27222): Terminating (SIGTERM) 16:17:03.553607 --- ParallelTerminationStrategy: PID 27213 died... 16:17:03.572558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27213): Terminated: ok {rc=0} 16:17:03.616382 --- ParallelTerminationStrategy: PID 27216 died... 16:17:03.635100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27216): Terminated: ok {rc=0} 16:17:03.678735 --- ParallelTerminationStrategy: PID 27222 died... 16:17:03.697348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27222): Terminated: ok {rc=0} 16:17:03.780786 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:17:04.974826 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:17:04.981992 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:17:05.004086 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:17:05.031657 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:17:05.086635 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:17:05.108652 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:17:05.136242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:17:05.684842 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:17:05.739224 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:05.750765 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:17:05.808331 tst mo_mt_call.py: using LAC 30022 16:17:05.939294 tst mo_mt_call.py: using RAC 187 16:17:06.068743 tst mo_mt_call.py: using CellId 30022 16:17:06.200083 tst mo_mt_call.py: using BVCI 30023 16:17:06.320911 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:06.332652 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:06.344096 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:06.355831 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:06.367570 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:06.379328 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:17:06.498022 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:17:06.616518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:07.102819 run create_hlr_db(pid=27228): Launched 16:17:07.231932 bus /sierra_2: Setting Powered False 16:17:08.293987 run create_hlr_db(pid=27228): Terminated: ok {rc=0} 16:17:08.748014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27230): Launched 16:17:09.082644 run osmo-hlr_10.42.42.2(pid=27231): Launched 16:17:09.202567 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:09.742261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27233): Launched 16:17:10.055729 run osmo-stp_10.42.42.5(pid=27234): Launched 16:17:10.174731 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:10.735343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27236): Launched 16:17:11.048199 run osmo-msc_10.42.42.6(pid=27237): Launched 16:17:11.222669 run osmo-stp_10.42.42.5(pid=27234): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27234)] 16:17:11.353081 run osmo-stp_10.42.42.5(pid=27234): stdout: | (launched: 2022-12-12_16:17:09.997054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:11.484576 run osmo-stp_10.42.42.5(pid=27234): stderr: | 20221212161710169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161710169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161710170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161710170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161710171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161710171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161710171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:11.614294 run osmo-stp_10.42.42.5(pid=27234): stdout: | (launched: 2022-12-12_16:17:09.997054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:11.737387 run osmo-stp_10.42.42.5(pid=27234): stderr: | 20221212161710169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161710169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161710170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161710170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161710171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161710171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161710171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:11.885568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27234): Process ended prematurely: osmo-stp_10.42.42.5(pid=27234) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27234)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:17:11.894518 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:17:11.921115 run osmo-hlr_10.42.42.2(pid=27231): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27231)] 16:17:11.968567 run osmo-hlr_10.42.42.2(pid=27231): stdout: | (launched: 2022-12-12_16:17:09.020117) 16:17:12.017679 run osmo-hlr_10.42.42.2(pid=27231): stderr: | 20221212161709202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161709202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161709202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161709202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161709203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161709203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161709215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161709223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161709223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161709223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:12.086445 run osmo-msc_10.42.42.6(pid=27237): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27237)] 16:17:12.133931 run osmo-msc_10.42.42.6(pid=27237): stdout: | (launched: 2022-12-12_16:17:10.989154) 16:17:12.182859 run osmo-msc_10.42.42.6(pid=27237): stderr: | 20221212161711263 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161711263 DLGLOBAL DEBUG validating counter group 0x7fbdb8271c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161711263 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161711263 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161711263 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161711263 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161711265 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161711266 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161711266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161711266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:12.232301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27230): Terminating (SIGTERM) 16:17:12.271925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27233): Terminating (SIGTERM) 16:17:12.311397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27236): Terminating (SIGTERM) 16:17:12.351082 --- ParallelTerminationStrategy: PID 27230 died... 16:17:12.370170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27230): Terminated: ok {rc=0} 16:17:12.414628 --- ParallelTerminationStrategy: PID 27233 died... 16:17:12.433082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27233): Terminated: ok {rc=0} 16:17:12.476892 --- ParallelTerminationStrategy: PID 27236 died... 16:17:12.496045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27236): Terminated: ok {rc=0} 16:17:12.581477 bus /sierra_3: Setting Powered False 16:17:13.679825 bus /sierra_3: Setting Powered False 16:17:14.792401 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:17:15.941065 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:15.954250 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:17:16.013902 tst mo_mt_call_osmux.py: using LAC 30023 16:17:16.169548 tst mo_mt_call_osmux.py: using RAC 188 16:17:16.344087 tst mo_mt_call_osmux.py: using CellId 30023 16:17:16.476092 tst mo_mt_call_osmux.py: using BVCI 30024 16:17:16.591788 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:16.603498 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:16.615127 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:16.626812 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:16.638254 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:17:16.649939 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:17:16.767488 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:17:16.911816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:17.470936 run create_hlr_db(pid=27239): Launched 16:17:17.603054 bus /sierra_2: Setting Powered False 16:17:18.668298 run create_hlr_db(pid=27239): Terminated: ok {rc=0} 16:17:19.117167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27241): Launched 16:17:19.430706 run osmo-hlr_10.42.42.2(pid=27242): Launched 16:17:19.549153 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:20.085072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27244): Launched 16:17:20.397415 run osmo-stp_10.42.42.5(pid=27245): Launched 16:17:20.515091 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:21.078330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27247): Launched 16:17:21.390077 run osmo-msc_10.42.42.6(pid=27248): Launched 16:17:21.563037 run osmo-stp_10.42.42.5(pid=27245): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27245)] 16:17:21.694510 run osmo-stp_10.42.42.5(pid=27245): stdout: | (launched: 2022-12-12_16:17:20.338201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:21.826387 run osmo-stp_10.42.42.5(pid=27245): stderr: | 20221212161720512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161720512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161720512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161720512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161720513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161720513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161720513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:21.956412 run osmo-stp_10.42.42.5(pid=27245): stdout: | (launched: 2022-12-12_16:17:20.338201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:22.079621 run osmo-stp_10.42.42.5(pid=27245): stderr: | 20221212161720512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161720512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161720512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161720512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161720513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161720513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161720513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:22.227182 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27245): Process ended prematurely: osmo-stp_10.42.42.5(pid=27245) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27245)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:17:22.236017 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:17:22.262609 run osmo-hlr_10.42.42.2(pid=27242): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27242)] 16:17:22.310509 run osmo-hlr_10.42.42.2(pid=27242): stdout: | (launched: 2022-12-12_16:17:19.371934) 16:17:22.360784 run osmo-hlr_10.42.42.2(pid=27242): stderr: | 20221212161719551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161719551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161719551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161719551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161719551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161719551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161719563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161719574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161719575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161719575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:22.429718 run osmo-msc_10.42.42.6(pid=27248): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27248)] 16:17:22.477211 run osmo-msc_10.42.42.6(pid=27248): stdout: | (launched: 2022-12-12_16:17:21.331179) 16:17:22.526386 run osmo-msc_10.42.42.6(pid=27248): stderr: | 20221212161721606 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161721606 DLGLOBAL DEBUG validating counter group 0x7f79e918dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161721606 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161721606 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161721606 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161721606 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161721608 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161721609 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161721609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161721609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:22.575979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27241): Terminating (SIGTERM) 16:17:22.615750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27244): Terminating (SIGTERM) 16:17:22.655507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27247): Terminating (SIGTERM) 16:17:22.695537 --- ParallelTerminationStrategy: PID 27241 died... 16:17:22.714595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27241): Terminated: ok {rc=0} 16:17:22.758306 --- ParallelTerminationStrategy: PID 27244 died... 16:17:22.776594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27244): Terminated: ok {rc=0} 16:17:22.820229 --- ParallelTerminationStrategy: PID 27247 died... 16:17:22.838796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27247): Terminated: ok {rc=0} 16:17:22.921762 bus /sierra_3: Setting Powered False 16:17:24.019430 bus /sierra_3: Setting Powered False 16:17:25.140221 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:17:26.374907 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:17:26.381592 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:17:26.402756 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:17:26.430294 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:17:26.481388 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:17:26.501815 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:17:26.529062 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:17:27.083687 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:17:27.136266 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:27.147414 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:17:27.202195 tst mo_mt_call.py: using LAC 30024 16:17:27.327033 tst mo_mt_call.py: using RAC 189 16:17:27.449663 tst mo_mt_call.py: using CellId 30024 16:17:27.570919 tst mo_mt_call.py: using BVCI 30025 16:17:27.686223 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:27.697507 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:27.708420 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:27.719854 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:27.731301 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:27.742862 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:17:27.864203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:17:27.985639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:28.507482 run create_hlr_db(pid=27253): Launched 16:17:28.637089 bus /sierra_2: Setting Powered False 16:17:29.703094 run create_hlr_db(pid=27253): Terminated: ok {rc=0} 16:17:30.149627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27255): Launched 16:17:30.463471 run osmo-hlr_10.42.42.2(pid=27256): Launched 16:17:30.584202 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:31.152687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27258): Launched 16:17:31.484743 run osmo-stp_10.42.42.5(pid=27259): Launched 16:17:31.764600 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:32.413296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27261): Launched 16:17:32.750979 run osmo-msc_10.42.42.6(pid=27262): Launched 16:17:32.937607 run osmo-stp_10.42.42.5(pid=27259): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27259)] 16:17:33.078189 run osmo-stp_10.42.42.5(pid=27259): stdout: | (launched: 2022-12-12_16:17:31.423008) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:33.219427 run osmo-stp_10.42.42.5(pid=27259): stderr: | 20221212161731672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161731673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161731673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161731673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161731674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161731674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161731674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:33.358573 run osmo-stp_10.42.42.5(pid=27259): stdout: | (launched: 2022-12-12_16:17:31.423008) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:33.491501 run osmo-stp_10.42.42.5(pid=27259): stderr: | 20221212161731672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161731673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161731673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161731673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161731674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161731674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161731674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:33.650843 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27259): Process ended prematurely: osmo-stp_10.42.42.5(pid=27259) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27259)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:17:33.660658 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:17:33.689709 run osmo-hlr_10.42.42.2(pid=27256): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27256)] 16:17:33.740893 run osmo-hlr_10.42.42.2(pid=27256): stdout: | (launched: 2022-12-12_16:17:30.404498) 16:17:33.793539 run osmo-hlr_10.42.42.2(pid=27256): stderr: | 20221212161730581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161730581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161730581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161730581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161730581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161730582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161730594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161730605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161730605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161730605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:33.866591 run osmo-msc_10.42.42.6(pid=27262): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27262)] 16:17:33.917456 run osmo-msc_10.42.42.6(pid=27262): stdout: | (launched: 2022-12-12_16:17:32.687792) 16:17:33.969560 run osmo-msc_10.42.42.6(pid=27262): stderr: | 20221212161733010 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161733011 DLGLOBAL DEBUG validating counter group 0x7f943357ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161733011 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161733011 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161733011 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161733011 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161733013 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161733013 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161733013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161733013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:34.022204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27255): Terminating (SIGTERM) 16:17:34.064725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27258): Terminating (SIGTERM) 16:17:34.107316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27261): Terminating (SIGTERM) 16:17:34.149993 --- ParallelTerminationStrategy: PID 27255 died... 16:17:34.170374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27255): Terminated: ok {rc=0} 16:17:34.217564 --- ParallelTerminationStrategy: PID 27258 died... 16:17:34.237271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27258): Terminated: ok {rc=0} 16:17:34.283721 --- ParallelTerminationStrategy: PID 27261 died... 16:17:34.303858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27261): Terminated: ok {rc=0} 16:17:34.392825 bus /sierra_3: Setting Powered False 16:17:35.492527 bus /sierra_3: Setting Powered False 16:17:36.610480 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:17:37.764539 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:37.776926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:17:37.835451 tst mo_mt_call_osmux.py: using LAC 30025 16:17:37.966255 tst mo_mt_call_osmux.py: using RAC 190 16:17:38.099489 tst mo_mt_call_osmux.py: using CellId 30025 16:17:38.231423 tst mo_mt_call_osmux.py: using BVCI 30026 16:17:38.354283 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:38.366105 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:38.377484 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:38.389057 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:38.400712 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:17:38.412456 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:17:38.531611 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:17:38.656060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:39.176833 run create_hlr_db(pid=27264): Launched 16:17:39.305447 bus /sierra_2: Setting Powered False 16:17:40.371429 run create_hlr_db(pid=27264): Terminated: ok {rc=0} 16:17:40.815772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27266): Launched 16:17:41.130613 run osmo-hlr_10.42.42.2(pid=27267): Launched 16:17:41.248865 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:41.804154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27269): Launched 16:17:42.120213 run osmo-stp_10.42.42.5(pid=27270): Launched 16:17:42.239854 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:42.804914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27272): Launched 16:17:43.119664 run osmo-msc_10.42.42.6(pid=27273): Launched 16:17:43.294199 run osmo-stp_10.42.42.5(pid=27270): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27270)] 16:17:43.424914 run osmo-stp_10.42.42.5(pid=27270): stdout: | (launched: 2022-12-12_16:17:42.060442) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:43.559562 run osmo-stp_10.42.42.5(pid=27270): stderr: | 20221212161742232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161742232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161742233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161742233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161742234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161742234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161742234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:43.689362 run osmo-stp_10.42.42.5(pid=27270): stdout: | (launched: 2022-12-12_16:17:42.060442) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:43.813746 run osmo-stp_10.42.42.5(pid=27270): stderr: | 20221212161742232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161742232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161742233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161742233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161742234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161742234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161742234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:43.961854 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27270): Process ended prematurely: osmo-stp_10.42.42.5(pid=27270) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27270)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:17:43.970862 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:17:43.997458 run osmo-hlr_10.42.42.2(pid=27267): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27267)] 16:17:44.045105 run osmo-hlr_10.42.42.2(pid=27267): stdout: | (launched: 2022-12-12_16:17:41.071227) 16:17:44.094512 run osmo-hlr_10.42.42.2(pid=27267): stderr: | 20221212161741248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161741248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161741248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161741249 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161741249 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161741249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161741261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161741269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161741269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161741270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:44.163631 run osmo-msc_10.42.42.6(pid=27273): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27273)] 16:17:44.211722 run osmo-msc_10.42.42.6(pid=27273): stdout: | (launched: 2022-12-12_16:17:43.060149) 16:17:44.261314 run osmo-msc_10.42.42.6(pid=27273): stderr: | 20221212161743334 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161743335 DLGLOBAL DEBUG validating counter group 0x7fa2cc5b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161743335 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161743335 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161743335 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161743335 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161743337 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161743337 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161743338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161743338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:44.310790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27266): Terminating (SIGTERM) 16:17:44.350674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27269): Terminating (SIGTERM) 16:17:44.390446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27272): Terminating (SIGTERM) 16:17:44.430693 --- ParallelTerminationStrategy: PID 27266 died... 16:17:44.449964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27266): Terminated: ok {rc=0} 16:17:44.493666 --- ParallelTerminationStrategy: PID 27269 died... 16:17:44.511998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27269): Terminated: ok {rc=0} 16:17:44.556515 --- ParallelTerminationStrategy: PID 27272 died... 16:17:44.574958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27272): Terminated: ok {rc=0} 16:17:44.661854 bus /sierra_3: Setting Powered False 16:17:45.761795 bus /sierra_3: Setting Powered False 16:17:46.904361 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:17:48.146120 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:17:48.153420 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:17:48.175460 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:17:48.204800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:17:48.258413 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:17:48.279512 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:17:48.306950 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:17:48.857554 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:17:48.911526 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:48.923020 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:17:48.979634 tst mo_mt_call.py: using LAC 30026 16:17:49.110244 tst mo_mt_call.py: using RAC 191 16:17:49.238889 tst mo_mt_call.py: using CellId 30026 16:17:49.367311 tst mo_mt_call.py: using BVCI 30027 16:17:49.488292 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:49.499935 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:49.511291 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:49.522895 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:49.534589 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:49.546291 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:17:49.667604 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:17:49.785576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:17:50.271745 run create_hlr_db(pid=27279): Launched 16:17:50.401419 bus /sierra_2: Setting Powered False 16:17:51.463102 run create_hlr_db(pid=27279): Terminated: ok {rc=0} 16:17:51.919224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27281): Launched 16:17:52.255100 run osmo-hlr_10.42.42.2(pid=27282): Launched 16:17:52.382185 run osmo-stp_10.42.42.5: Starting osmo-stp 16:17:52.964792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27284): Launched 16:17:53.300457 run osmo-stp_10.42.42.5(pid=27285): Launched 16:17:53.428531 run osmo-msc_10.42.42.6: Starting osmo-msc 16:17:54.032288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27287): Launched 16:17:54.367359 run osmo-msc_10.42.42.6(pid=27288): Launched 16:17:54.552502 run osmo-stp_10.42.42.5(pid=27285): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27285)] 16:17:54.692863 run osmo-stp_10.42.42.5(pid=27285): stdout: | (launched: 2022-12-12_16:17:53.238053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:54.833755 run osmo-stp_10.42.42.5(pid=27285): stderr: | 20221212161753429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161753429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161753429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161753430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161753430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161753430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161753430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:54.972576 run osmo-stp_10.42.42.5(pid=27285): stdout: | (launched: 2022-12-12_16:17:53.238053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:17:55.105896 run osmo-stp_10.42.42.5(pid=27285): stderr: | 20221212161753429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161753429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161753429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161753430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161753430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161753430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161753430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:17:55.264739 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27285): Process ended prematurely: osmo-stp_10.42.42.5(pid=27285) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27285)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:17:55.274538 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:17:55.302889 run osmo-hlr_10.42.42.2(pid=27282): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27282)] 16:17:55.353763 run osmo-hlr_10.42.42.2(pid=27282): stdout: | (launched: 2022-12-12_16:17:52.192420) 16:17:55.406024 run osmo-hlr_10.42.42.2(pid=27282): stderr: | 20221212161752391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161752391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161752391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161752391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161752391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161752391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161752403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161752412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161752413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161752413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:17:55.478755 run osmo-msc_10.42.42.6(pid=27288): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27288)] 16:17:55.529326 run osmo-msc_10.42.42.6(pid=27288): stdout: | (launched: 2022-12-12_16:17:54.304583) 16:17:55.581477 run osmo-msc_10.42.42.6(pid=27288): stderr: | 20221212161754626 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161754626 DLGLOBAL DEBUG validating counter group 0x7f5de3f58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161754626 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161754626 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161754627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161754627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161754629 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161754629 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161754629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161754630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:17:55.634364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27281): Terminating (SIGTERM) 16:17:55.676290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27284): Terminating (SIGTERM) 16:17:55.718369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27287): Terminating (SIGTERM) 16:17:55.760529 --- ParallelTerminationStrategy: PID 27281 died... 16:17:55.780617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27281): Terminated: ok {rc=0} 16:17:55.827728 --- ParallelTerminationStrategy: PID 27284 died... 16:17:55.847320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27284): Terminated: ok {rc=0} 16:17:55.893950 --- ParallelTerminationStrategy: PID 27287 died... 16:17:55.913622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27287): Terminated: ok {rc=0} 16:17:56.001219 bus /sierra_3: Setting Powered False 16:17:57.101957 bus /sierra_3: Setting Powered False 16:17:58.216936 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:17:59.362629 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:59.374409 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:17:59.431044 tst mo_mt_call_osmux.py: using LAC 30027 16:17:59.554501 tst mo_mt_call_osmux.py: using RAC 192 16:17:59.678234 tst mo_mt_call_osmux.py: using CellId 30027 16:17:59.801781 tst mo_mt_call_osmux.py: using BVCI 30028 16:17:59.916808 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:59.928122 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:59.939161 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:59.950092 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:59.961052 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:17:59.971994 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:18:00.092462 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:18:00.214908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:00.736772 run create_hlr_db(pid=27290): Launched 16:18:00.900151 bus /sierra_2: Setting Powered False 16:18:01.981696 run create_hlr_db(pid=27290): Terminated: ok {rc=0} 16:18:02.468018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27292): Launched 16:18:02.782651 run osmo-hlr_10.42.42.2(pid=27293): Launched 16:18:02.902013 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:03.438505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27295): Launched 16:18:03.750663 run osmo-stp_10.42.42.5(pid=27296): Launched 16:18:03.869924 run osmo-msc_10.42.42.6: Starting osmo-msc 16:18:04.433508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27298): Launched 16:18:04.745797 run osmo-msc_10.42.42.6(pid=27299): Launched 16:18:04.920483 run osmo-stp_10.42.42.5(pid=27296): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27296)] 16:18:05.051072 run osmo-stp_10.42.42.5(pid=27296): stdout: | (launched: 2022-12-12_16:18:03.691412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:05.181929 run osmo-stp_10.42.42.5(pid=27296): stderr: | 20221212161803863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161803863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161803864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161803864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161803865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161803865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161803865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:05.310863 run osmo-stp_10.42.42.5(pid=27296): stdout: | (launched: 2022-12-12_16:18:03.691412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:05.434368 run osmo-stp_10.42.42.5(pid=27296): stderr: | 20221212161803863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161803863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161803864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161803864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161803865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161803865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161803865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:05.582165 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27296): Process ended prematurely: osmo-stp_10.42.42.5(pid=27296) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27296)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:18:05.591032 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:18:05.617662 run osmo-hlr_10.42.42.2(pid=27293): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27293)] 16:18:05.665421 run osmo-hlr_10.42.42.2(pid=27293): stdout: | (launched: 2022-12-12_16:18:02.723580) 16:18:05.715368 run osmo-hlr_10.42.42.2(pid=27293): stderr: | 20221212161802902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161802902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161802902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161802902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161802902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161802903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161802915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161802923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161802923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161802924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:05.784293 run osmo-msc_10.42.42.6(pid=27299): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27299)] 16:18:05.832129 run osmo-msc_10.42.42.6(pid=27299): stdout: | (launched: 2022-12-12_16:18:04.686407) 16:18:05.881233 run osmo-msc_10.42.42.6(pid=27299): stderr: | 20221212161804962 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161804962 DLGLOBAL DEBUG validating counter group 0x7f7014640c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161804963 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161804963 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161804963 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161804963 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161804965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161804965 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161804965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161804965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:18:05.930801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27292): Terminating (SIGTERM) 16:18:05.970787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27295): Terminating (SIGTERM) 16:18:06.010584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27298): Terminating (SIGTERM) 16:18:06.050314 --- ParallelTerminationStrategy: PID 27292 died... 16:18:06.069351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27292): Terminated: ok {rc=0} 16:18:06.114010 --- ParallelTerminationStrategy: PID 27295 died... 16:18:06.132337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27295): Terminated: ok {rc=0} 16:18:06.176165 --- ParallelTerminationStrategy: PID 27298 died... 16:18:06.194824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27298): Terminated: ok {rc=0} 16:18:06.279865 bus /sierra_3: Setting Powered False 16:18:07.378961 bus /sierra_3: Setting Powered False 16:18:08.495214 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:18:09.727754 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:18:09.734532 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:18:09.755106 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:18:09.781786 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:18:09.834503 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:18:09.855406 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:18:09.881875 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:18:10.430679 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:18:10.480261 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:10.491418 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:18:10.547481 tst mo_mt_call.py: using LAC 30028 16:18:10.672547 tst mo_mt_call.py: using RAC 193 16:18:10.796730 tst mo_mt_call.py: using CellId 30028 16:18:10.920544 tst mo_mt_call.py: using BVCI 30029 16:18:11.035326 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:11.046625 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:11.057516 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:11.068338 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:11.079249 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:11.090208 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:18:11.209952 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:18:11.331737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:11.816004 run create_hlr_db(pid=27304): Launched 16:18:11.944778 bus /sierra_2: Setting Powered False 16:18:13.007095 run create_hlr_db(pid=27304): Terminated: ok {rc=0} 16:18:13.463290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27306): Launched 16:18:13.799436 run osmo-hlr_10.42.42.2(pid=27307): Launched 16:18:13.927367 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:14.505099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27309): Launched 16:18:14.840752 run osmo-stp_10.42.42.5(pid=27310): Launched 16:18:14.969357 run osmo-msc_10.42.42.6: Starting osmo-msc 16:18:15.575317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27312): Launched 16:18:15.929702 run osmo-msc_10.42.42.6(pid=27313): Launched 16:18:16.223517 run osmo-stp_10.42.42.5(pid=27310): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27310)] 16:18:16.408111 run osmo-stp_10.42.42.5(pid=27310): stdout: | (launched: 2022-12-12_16:18:14.778128) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:16.614379 run osmo-stp_10.42.42.5(pid=27310): stderr: | 20221212161814971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161814971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161814971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161814972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161814972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161814972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161814972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:16.841525 run osmo-stp_10.42.42.5(pid=27310): stdout: | (launched: 2022-12-12_16:18:14.778128) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:16.974480 run osmo-stp_10.42.42.5(pid=27310): stderr: | 20221212161814971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161814971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161814971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161814972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161814972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161814972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161814972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:17.132816 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27310): Process ended prematurely: osmo-stp_10.42.42.5(pid=27310) [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27310)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:18:17.142784 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 16:18:17.171075 run osmo-hlr_10.42.42.2(pid=27307): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27307)] 16:18:17.221263 run osmo-hlr_10.42.42.2(pid=27307): stdout: | (launched: 2022-12-12_16:18:13.736735) 16:18:17.272317 run osmo-hlr_10.42.42.2(pid=27307): stderr: | 20221212161813934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161813934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161813934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161813934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161813934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161813935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161813947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161813958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161813958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161813958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:17.345815 run osmo-msc_10.42.42.6(pid=27313): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27313)] 16:18:17.396520 run osmo-msc_10.42.42.6(pid=27313): stdout: | (launched: 2022-12-12_16:18:15.862454) 16:18:17.446253 run osmo-msc_10.42.42.6(pid=27313): stderr: | 20221212161816479 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161816480 DLGLOBAL DEBUG validating counter group 0x7f169e368c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161816480 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161816480 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161816480 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161816480 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161816491 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161816491 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161816491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161816491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:18:17.497427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27306): Terminating (SIGTERM) 16:18:17.537471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27309): Terminating (SIGTERM) 16:18:17.577411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27312): Terminating (SIGTERM) 16:18:17.617720 --- ParallelTerminationStrategy: PID 27306 died... 16:18:17.636251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27306): Terminated: ok {rc=0} 16:18:17.680375 --- ParallelTerminationStrategy: PID 27309 died... 16:18:17.699250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27309): Terminated: ok {rc=0} 16:18:17.743169 --- ParallelTerminationStrategy: PID 27312 died... 16:18:17.761908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27312): Terminated: ok {rc=0} 16:18:17.848324 bus /sierra_3: Setting Powered False 16:18:18.948664 bus /sierra_3: Setting Powered False 16:18:20.065275 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:18:21.214064 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:21.225828 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:18:21.282486 tst mo_mt_call_osmux.py: using LAC 30029 16:18:21.405564 tst mo_mt_call_osmux.py: using RAC 194 16:18:21.529164 tst mo_mt_call_osmux.py: using CellId 30029 16:18:21.650525 tst mo_mt_call_osmux.py: using BVCI 30030 16:18:21.765207 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:21.776290 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:21.787205 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:21.798232 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:21.809242 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:18:21.820118 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:18:21.935300 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:18:22.054637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:22.575427 run create_hlr_db(pid=27315): Launched 16:18:22.704025 bus /sierra_2: Setting Powered False 16:18:23.768911 run create_hlr_db(pid=27315): Terminated: ok {rc=0} 16:18:24.216787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27317): Launched 16:18:24.531469 run osmo-hlr_10.42.42.2(pid=27318): Launched 16:18:24.650313 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:25.201513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27320): Launched 16:18:25.513603 run osmo-stp_10.42.42.5(pid=27321): Launched 16:18:25.630786 run osmo-msc_10.42.42.6: Starting osmo-msc 16:18:26.193722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27323): Launched 16:18:26.505464 run osmo-msc_10.42.42.6(pid=27324): Launched 16:18:26.680547 run osmo-stp_10.42.42.5(pid=27321): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27321)] 16:18:26.811127 run osmo-stp_10.42.42.5(pid=27321): stdout: | (launched: 2022-12-12_16:18:25.454449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:26.941363 run osmo-stp_10.42.42.5(pid=27321): stderr: | 20221212161825627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161825628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161825628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161825628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161825629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161825629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161825629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:27.069907 run osmo-stp_10.42.42.5(pid=27321): stdout: | (launched: 2022-12-12_16:18:25.454449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:27.192723 run osmo-stp_10.42.42.5(pid=27321): stderr: | 20221212161825627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161825628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161825628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161825628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161825629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161825629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161825629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:27.340288 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27321): Process ended prematurely: osmo-stp_10.42.42.5(pid=27321) [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27321)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:18:27.349487 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:18:27.376065 run osmo-hlr_10.42.42.2(pid=27318): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27318)] 16:18:27.423401 run osmo-hlr_10.42.42.2(pid=27318): stdout: | (launched: 2022-12-12_16:18:24.472604) 16:18:27.472329 run osmo-hlr_10.42.42.2(pid=27318): stderr: | 20221212161824649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161824649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161824649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161824649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161824649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161824649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161824662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161824670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161824670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161824671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:27.542166 run osmo-msc_10.42.42.6(pid=27324): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27324)] 16:18:27.589627 run osmo-msc_10.42.42.6(pid=27324): stdout: | (launched: 2022-12-12_16:18:26.446111) 16:18:27.638682 run osmo-msc_10.42.42.6(pid=27324): stderr: | 20221212161826723 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161826723 DLGLOBAL DEBUG validating counter group 0x7f9d1ad7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161826723 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161826723 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161826723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161826723 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161826725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161826725 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161826726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161826726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:18:27.688042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27317): Terminating (SIGTERM) 16:18:27.727662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27320): Terminating (SIGTERM) 16:18:27.767167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27323): Terminating (SIGTERM) 16:18:27.807163 --- ParallelTerminationStrategy: PID 27317 died... 16:18:27.826454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27317): Terminated: ok {rc=0} 16:18:27.870242 --- ParallelTerminationStrategy: PID 27320 died... 16:18:27.888824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27320): Terminated: ok {rc=0} 16:18:27.932635 --- ParallelTerminationStrategy: PID 27323 died... 16:18:27.951224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27323): Terminated: ok {rc=0} 16:18:28.037219 bus /sierra_3: Setting Powered False 16:18:29.136703 bus /sierra_3: Setting Powered False 16:18:30.252151 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:18:31.519886 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:18:31.528807 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:18:31.554311 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:18:31.587475 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:18:31.644185 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:18:31.670247 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:18:31.701252 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:18:32.246180 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:18:32.302176 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:32.313924 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:18:32.372474 tst mo_mt_call.py: using LAC 30030 16:18:32.503221 tst mo_mt_call.py: using RAC 195 16:18:32.633936 tst mo_mt_call.py: using CellId 30030 16:18:32.764459 tst mo_mt_call.py: using BVCI 30031 16:18:32.886174 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:32.897802 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:32.909164 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:32.921481 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:32.933695 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:32.945887 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:18:33.067769 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:18:33.183619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:33.668169 run create_hlr_db(pid=27329): Launched 16:18:33.797755 bus /sierra_2: Setting Powered False 16:18:34.859354 run create_hlr_db(pid=27329): Terminated: ok {rc=0} 16:18:35.314885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27331): Launched 16:18:35.631949 run osmo-hlr_10.42.42.2(pid=27332): Launched 16:18:35.750720 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:36.299157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27334): Launched 16:18:36.612673 run osmo-stp_10.42.42.5(pid=27335): Launched 16:18:36.732310 run osmo-msc_10.42.42.6: Starting osmo-msc 16:18:37.293895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27337): Launched 16:18:37.606176 run osmo-msc_10.42.42.6(pid=27338): Launched 16:18:37.781778 run osmo-stp_10.42.42.5(pid=27335): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27335)] 16:18:37.912499 run osmo-stp_10.42.42.5(pid=27335): stdout: | (launched: 2022-12-12_16:18:36.553319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:38.043378 run osmo-stp_10.42.42.5(pid=27335): stderr: | 20221212161836727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161836728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161836728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161836728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161836729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161836729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161836729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:38.172566 run osmo-stp_10.42.42.5(pid=27335): stdout: | (launched: 2022-12-12_16:18:36.553319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:38.296428 run osmo-stp_10.42.42.5(pid=27335): stderr: | 20221212161836727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161836728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161836728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161836728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161836729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161836729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161836729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:38.443924 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27335): Process ended prematurely: osmo-stp_10.42.42.5(pid=27335) [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27335)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:18:38.453071 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:18:38.479729 run osmo-hlr_10.42.42.2(pid=27332): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27332)] 16:18:38.527187 run osmo-hlr_10.42.42.2(pid=27332): stdout: | (launched: 2022-12-12_16:18:35.573068) 16:18:38.576175 run osmo-hlr_10.42.42.2(pid=27332): stderr: | 20221212161835751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161835751 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161835751 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161835751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161835751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161835751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161835763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161835771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161835772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161835772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:38.644611 run osmo-msc_10.42.42.6(pid=27338): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27338)] 16:18:38.692360 run osmo-msc_10.42.42.6(pid=27338): stdout: | (launched: 2022-12-12_16:18:37.547100) 16:18:38.741348 run osmo-msc_10.42.42.6(pid=27338): stderr: | 20221212161837821 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161837821 DLGLOBAL DEBUG validating counter group 0x7f007d842c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161837821 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161837821 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161837821 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161837822 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161837823 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161837824 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161837824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161837824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:18:38.790823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27331): Terminating (SIGTERM) 16:18:38.830467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27334): Terminating (SIGTERM) 16:18:38.870149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27337): Terminating (SIGTERM) 16:18:38.909980 --- ParallelTerminationStrategy: PID 27331 died... 16:18:38.929251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27331): Terminated: ok {rc=0} 16:18:38.973619 --- ParallelTerminationStrategy: PID 27334 died... 16:18:38.992238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27334): Terminated: ok {rc=0} 16:18:39.035743 --- ParallelTerminationStrategy: PID 27337 died... 16:18:39.054198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27337): Terminated: ok {rc=0} 16:18:39.140206 bus /sierra_3: Setting Powered False 16:18:40.242004 bus /sierra_3: Setting Powered False 16:18:41.358726 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:18:42.507313 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:42.519054 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:18:42.575737 tst mo_mt_call_osmux.py: using LAC 30031 16:18:42.699317 tst mo_mt_call_osmux.py: using RAC 196 16:18:42.831976 tst mo_mt_call_osmux.py: using CellId 30031 16:18:42.964266 tst mo_mt_call_osmux.py: using BVCI 30032 16:18:43.078658 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:43.089898 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:43.100701 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:43.111611 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:43.122576 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:18:43.133595 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:18:43.249709 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:18:43.370382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:43.893266 run create_hlr_db(pid=27340): Launched 16:18:44.022872 bus /sierra_2: Setting Powered False 16:18:45.088415 run create_hlr_db(pid=27340): Terminated: ok {rc=0} 16:18:45.553218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27342): Launched 16:18:45.899894 run osmo-hlr_10.42.42.2(pid=27343): Launched 16:18:46.101205 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:46.761675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27345): Launched 16:18:47.091425 run osmo-stp_10.42.42.5(pid=27346): Launched 16:18:47.279631 run osmo-msc_10.42.42.6: Starting osmo-msc 16:18:47.858204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27348): Launched 16:18:48.170569 run osmo-msc_10.42.42.6(pid=27349): Launched 16:18:48.346562 run osmo-stp_10.42.42.5(pid=27346): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27346)] 16:18:48.477614 run osmo-stp_10.42.42.5(pid=27346): stdout: | (launched: 2022-12-12_16:18:47.030403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:48.608311 run osmo-stp_10.42.42.5(pid=27346): stderr: | 20221212161847290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161847291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161847291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161847291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161847292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161847292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161847292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:48.737315 run osmo-stp_10.42.42.5(pid=27346): stdout: | (launched: 2022-12-12_16:18:47.030403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:48.860538 run osmo-stp_10.42.42.5(pid=27346): stderr: | 20221212161847290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161847291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161847291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161847291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161847292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161847292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161847292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:49.008293 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27346): Process ended prematurely: osmo-stp_10.42.42.5(pid=27346) [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27346)] [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:18:49.017345 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:18:49.043961 run osmo-hlr_10.42.42.2(pid=27343): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27343)] 16:18:49.091496 run osmo-hlr_10.42.42.2(pid=27343): stdout: | (launched: 2022-12-12_16:18:45.827090) 16:18:49.140862 run osmo-hlr_10.42.42.2(pid=27343): stderr: | 20221212161846094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161846094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161846094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161846094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161846094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161846094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161846112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161846135 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161846135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161846135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:18:49.209829 run osmo-msc_10.42.42.6(pid=27349): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27349)] 16:18:49.257372 run osmo-msc_10.42.42.6(pid=27349): stdout: | (launched: 2022-12-12_16:18:48.111180) 16:18:49.306582 run osmo-msc_10.42.42.6(pid=27349): stderr: | 20221212161848387 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161848387 DLGLOBAL DEBUG validating counter group 0x7fa6a0d12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161848387 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161848387 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161848387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161848388 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161848389 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161848390 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161848390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161848390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:18:49.356264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27342): Terminating (SIGTERM) 16:18:49.395898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27345): Terminating (SIGTERM) 16:18:49.435530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27348): Terminating (SIGTERM) 16:18:49.475420 --- ParallelTerminationStrategy: PID 27342 died... 16:18:49.494596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27342): Terminated: ok {rc=0} 16:18:49.538515 --- ParallelTerminationStrategy: PID 27345 died... 16:18:49.556907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27345): Terminated: ok {rc=0} 16:18:49.601826 --- ParallelTerminationStrategy: PID 27348 died... 16:18:49.620374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27348): Terminated: ok {rc=0} 16:18:49.704612 bus /sierra_3: Setting Powered False 16:18:50.804916 bus /sierra_3: Setting Powered False 16:18:51.920841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:18:53.171009 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:18:53.179333 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:18:53.201961 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:18:53.230217 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:18:53.282801 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:18:53.303470 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:18:53.329750 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:18:53.880417 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:18:53.930435 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:18:53.941514 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:18:53.995390 tst mo_mt_call.py: using LAC 30032 16:18:54.126392 tst mo_mt_call.py: using RAC 197 16:18:54.256406 tst mo_mt_call.py: using CellId 30032 16:18:54.384477 tst mo_mt_call.py: using BVCI 30033 16:18:54.505707 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:18:54.517481 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:18:54.528706 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:18:54.540401 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:18:54.552072 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:18:54.563851 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:18:54.683662 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:18:54.801480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:18:55.287675 run create_hlr_db(pid=27354): Launched 16:18:55.416030 bus /sierra_2: Setting Powered False 16:18:56.478250 run create_hlr_db(pid=27354): Terminated: ok {rc=0} 16:18:56.932563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27356): Launched 16:18:57.268128 run osmo-hlr_10.42.42.2(pid=27357): Launched 16:18:57.397440 run osmo-stp_10.42.42.5: Starting osmo-stp 16:18:57.976322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27359): Launched 16:18:58.312641 run osmo-stp_10.42.42.5(pid=27360): Launched 16:18:58.441663 run osmo-msc_10.42.42.6: Starting osmo-msc 16:18:59.046634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27362): Launched 16:18:59.383226 run osmo-msc_10.42.42.6(pid=27363): Launched 16:18:59.570312 run osmo-stp_10.42.42.5(pid=27360): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27360)] 16:18:59.711792 run osmo-stp_10.42.42.5(pid=27360): stdout: | (launched: 2022-12-12_16:18:58.249801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:18:59.853045 run osmo-stp_10.42.42.5(pid=27360): stderr: | 20221212161858442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161858442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161858442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161858443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161858443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161858443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161858443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:18:59.991909 run osmo-stp_10.42.42.5(pid=27360): stdout: | (launched: 2022-12-12_16:18:58.249801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:00.125829 run osmo-stp_10.42.42.5(pid=27360): stderr: | 20221212161858442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161858442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161858442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161858443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161858443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161858443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161858443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:00.285412 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27360): Process ended prematurely: osmo-stp_10.42.42.5(pid=27360) [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27360)] [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:19:00.295246 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:19:00.323729 run osmo-hlr_10.42.42.2(pid=27357): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27357)] 16:19:00.375165 run osmo-hlr_10.42.42.2(pid=27357): stdout: | (launched: 2022-12-12_16:18:57.205713) 16:19:00.428122 run osmo-hlr_10.42.42.2(pid=27357): stderr: | 20221212161857402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161857402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161857402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161857403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161857403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161857403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161857416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161857425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161857426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161857426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:00.501506 run osmo-msc_10.42.42.6(pid=27363): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27363)] 16:19:00.552355 run osmo-msc_10.42.42.6(pid=27363): stdout: | (launched: 2022-12-12_16:18:59.320516) 16:19:00.604744 run osmo-msc_10.42.42.6(pid=27363): stderr: | 20221212161859641 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161859642 DLGLOBAL DEBUG validating counter group 0x7f0878939c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161859642 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161859642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161859642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161859642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161859644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161859644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161859644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161859644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:19:00.657824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27356): Terminating (SIGTERM) 16:19:00.700445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27359): Terminating (SIGTERM) 16:19:00.743075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27362): Terminating (SIGTERM) 16:19:00.801425 --- ParallelTerminationStrategy: PID 27356 died... 16:19:00.823463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27356): Terminated: ok {rc=0} 16:19:00.877979 --- ParallelTerminationStrategy: PID 27359 died... 16:19:00.898757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27359): Terminated: ok {rc=0} 16:19:00.945817 --- ParallelTerminationStrategy: PID 27362 died... 16:19:00.965823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27362): Terminated: ok {rc=0} 16:19:01.055905 bus /sierra_3: Setting Powered False 16:19:02.157537 bus /sierra_3: Setting Powered False 16:19:03.278030 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:19:04.427214 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:19:04.439238 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:19:04.496533 tst mo_mt_call_osmux.py: using LAC 30033 16:19:04.620886 tst mo_mt_call_osmux.py: using RAC 198 16:19:04.742952 tst mo_mt_call_osmux.py: using CellId 30033 16:19:04.873137 tst mo_mt_call_osmux.py: using BVCI 30034 16:19:04.986639 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:19:04.997945 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:19:05.008894 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:19:05.020172 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:19:05.031155 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:19:05.042266 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:19:05.158785 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:19:05.278628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:05.800483 run create_hlr_db(pid=27365): Launched 16:19:05.930330 bus /sierra_2: Setting Powered False 16:19:06.995981 run create_hlr_db(pid=27365): Terminated: ok {rc=0} 16:19:07.444082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27367): Launched 16:19:07.757437 run osmo-hlr_10.42.42.2(pid=27368): Launched 16:19:07.874459 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:08.410345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27370): Launched 16:19:08.724367 run osmo-stp_10.42.42.5(pid=27371): Launched 16:19:08.844747 run osmo-msc_10.42.42.6: Starting osmo-msc 16:19:09.409936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27373): Launched 16:19:09.722773 run osmo-msc_10.42.42.6(pid=27374): Launched 16:19:09.897348 run osmo-stp_10.42.42.5(pid=27371): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27371)] 16:19:10.028159 run osmo-stp_10.42.42.5(pid=27371): stdout: | (launched: 2022-12-12_16:19:08.665406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:10.159530 run osmo-stp_10.42.42.5(pid=27371): stderr: | 20221212161908836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161908836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161908836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161908837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161908837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161908837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161908838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:10.288648 run osmo-stp_10.42.42.5(pid=27371): stdout: | (launched: 2022-12-12_16:19:08.665406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:10.412096 run osmo-stp_10.42.42.5(pid=27371): stderr: | 20221212161908836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161908836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161908836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161908837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161908837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161908837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161908838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:10.561253 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27371): Process ended prematurely: osmo-stp_10.42.42.5(pid=27371) [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27371)] [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:19:10.570227 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:19:10.596815 run osmo-hlr_10.42.42.2(pid=27368): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27368)] 16:19:10.644467 run osmo-hlr_10.42.42.2(pid=27368): stdout: | (launched: 2022-12-12_16:19:07.698344) 16:19:10.693930 run osmo-hlr_10.42.42.2(pid=27368): stderr: | 20221212161907877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161907877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161907877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161907877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161907877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161907877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161907890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161907898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161907899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161907899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:10.762957 run osmo-msc_10.42.42.6(pid=27374): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27374)] 16:19:10.810381 run osmo-msc_10.42.42.6(pid=27374): stdout: | (launched: 2022-12-12_16:19:09.663465) 16:19:10.859753 run osmo-msc_10.42.42.6(pid=27374): stderr: | 20221212161909939 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161909939 DLGLOBAL DEBUG validating counter group 0x7f5b70595c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161909939 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161909939 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161909939 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161909939 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161909941 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161909942 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161909942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161909942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:19:10.909180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27367): Terminating (SIGTERM) 16:19:10.948527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27370): Terminating (SIGTERM) 16:19:10.987912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27373): Terminating (SIGTERM) 16:19:11.027706 --- ParallelTerminationStrategy: PID 27367 died... 16:19:11.046964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27367): Terminated: ok {rc=0} 16:19:11.090876 --- ParallelTerminationStrategy: PID 27370 died... 16:19:11.109608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27370): Terminated: ok {rc=0} 16:19:11.153406 --- ParallelTerminationStrategy: PID 27373 died... 16:19:11.172551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27373): Terminated: ok {rc=0} 16:19:11.257947 bus /sierra_3: Setting Powered False 16:19:12.356740 bus /sierra_3: Setting Powered False 16:19:13.472442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:19:14.710286 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:19:14.716380 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:19:14.737039 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:19:14.763631 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:19:14.815804 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:19:14.836246 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:19:14.862408 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:19:15.410760 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:19:15.460333 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:15.471270 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:19:15.528217 tst mo_mt_call.py: using LAC 30034 16:19:15.650753 tst mo_mt_call.py: using RAC 199 16:19:15.786919 tst mo_mt_call.py: using CellId 30034 16:19:15.927075 tst mo_mt_call.py: using BVCI 30035 16:19:16.052163 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:16.064826 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:16.078495 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:16.090820 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:16.103868 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:16.117911 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:19:16.247072 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:19:16.379664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:16.916655 run create_hlr_db(pid=27379): Launched 16:19:17.080645 bus /sierra_2: Setting Powered False 16:19:18.142773 run create_hlr_db(pid=27379): Terminated: ok {rc=0} 16:19:18.578412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27381): Launched 16:19:18.892914 run osmo-hlr_10.42.42.2(pid=27382): Launched 16:19:19.009794 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:19.552169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27384): Launched 16:19:19.866618 run osmo-stp_10.42.42.5(pid=27385): Launched 16:19:19.983776 run osmo-msc_10.42.42.6: Starting osmo-msc 16:19:20.548456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27387): Launched 16:19:20.864892 run osmo-msc_10.42.42.6(pid=27388): Launched 16:19:21.040843 run osmo-stp_10.42.42.5(pid=27385): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27385)] 16:19:21.172191 run osmo-stp_10.42.42.5(pid=27385): stdout: | (launched: 2022-12-12_16:19:19.807220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:21.304064 run osmo-stp_10.42.42.5(pid=27385): stderr: | 20221212161919982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161919982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161919983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161919983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161919983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161919984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161919984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:21.433607 run osmo-stp_10.42.42.5(pid=27385): stdout: | (launched: 2022-12-12_16:19:19.807220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:21.557888 run osmo-stp_10.42.42.5(pid=27385): stderr: | 20221212161919982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161919982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161919983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161919983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161919983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161919984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161919984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:21.705862 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27385): Process ended prematurely: osmo-stp_10.42.42.5(pid=27385) [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27385)] [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:19:21.714801 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:19:21.741578 run osmo-hlr_10.42.42.2(pid=27382): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27382)] 16:19:21.789705 run osmo-hlr_10.42.42.2(pid=27382): stdout: | (launched: 2022-12-12_16:19:18.833871) 16:19:21.839711 run osmo-hlr_10.42.42.2(pid=27382): stderr: | 20221212161919013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161919013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161919013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161919013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161919013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161919013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161919025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161919034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161919035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161919035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:21.909680 run osmo-msc_10.42.42.6(pid=27388): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27388)] 16:19:21.957824 run osmo-msc_10.42.42.6(pid=27388): stdout: | (launched: 2022-12-12_16:19:20.805488) 16:19:22.007615 run osmo-msc_10.42.42.6(pid=27388): stderr: | 20221212161921080 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161921080 DLGLOBAL DEBUG validating counter group 0x7f5235644c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161921080 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161921080 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161921080 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161921081 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161921082 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161921083 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161921083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161921083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:19:22.057516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27381): Terminating (SIGTERM) 16:19:22.097667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27384): Terminating (SIGTERM) 16:19:22.137673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27387): Terminating (SIGTERM) 16:19:22.178017 --- ParallelTerminationStrategy: PID 27381 died... 16:19:22.197409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27381): Terminated: ok {rc=0} 16:19:22.241588 --- ParallelTerminationStrategy: PID 27384 died... 16:19:22.260412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27384): Terminated: ok {rc=0} 16:19:22.304891 --- ParallelTerminationStrategy: PID 27387 died... 16:19:22.324139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27387): Terminated: ok {rc=0} 16:19:22.411603 bus /sierra_3: Setting Powered False 16:19:23.512914 bus /sierra_3: Setting Powered False 16:19:24.630747 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:19:25.779901 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:25.791553 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:19:25.853882 tst mo_mt_call_osmux.py: using LAC 30035 16:19:25.976549 tst mo_mt_call_osmux.py: using RAC 200 16:19:26.097461 tst mo_mt_call_osmux.py: using CellId 30035 16:19:26.220545 tst mo_mt_call_osmux.py: using BVCI 30036 16:19:26.333520 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:26.344458 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:26.355158 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:26.365895 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:26.376532 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:19:26.387307 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:19:26.507746 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:19:26.625134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:27.111852 run create_hlr_db(pid=27391): Launched 16:19:27.240043 bus /sierra_2: Setting Powered False 16:19:28.302325 run create_hlr_db(pid=27391): Terminated: ok {rc=0} 16:19:28.761120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27393): Launched 16:19:29.096600 run osmo-hlr_10.42.42.2(pid=27394): Launched 16:19:29.226094 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:29.806813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27396): Launched 16:19:30.141949 run osmo-stp_10.42.42.5(pid=27397): Launched 16:19:30.270733 run osmo-msc_10.42.42.6: Starting osmo-msc 16:19:30.913651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27399): Launched 16:19:31.238627 run osmo-msc_10.42.42.6(pid=27400): Launched 16:19:31.465713 run osmo-stp_10.42.42.5(pid=27397): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27397)] 16:19:31.726471 run osmo-stp_10.42.42.5(pid=27397): stdout: | (launched: 2022-12-12_16:19:30.078533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:32.049842 run osmo-stp_10.42.42.5(pid=27397): stderr: | 20221212161930268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161930269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161930269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161930269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161930270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161930270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161930270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:32.270798 run osmo-stp_10.42.42.5(pid=27397): stdout: | (launched: 2022-12-12_16:19:30.078533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:32.406340 run osmo-stp_10.42.42.5(pid=27397): stderr: | 20221212161930268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161930269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161930269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161930269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161930270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161930270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161930270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:32.566849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27397): Process ended prematurely: osmo-stp_10.42.42.5(pid=27397) [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27397)] [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:19:32.577061 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 16:19:32.607424 run osmo-hlr_10.42.42.2(pid=27394): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27394)] 16:19:32.659622 run osmo-hlr_10.42.42.2(pid=27394): stdout: | (launched: 2022-12-12_16:19:29.033858) 16:19:32.713831 run osmo-hlr_10.42.42.2(pid=27394): stderr: | 20221212161929232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161929232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161929232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161929232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161929232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161929232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161929244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161929253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161929253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161929253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:32.788734 run osmo-msc_10.42.42.6(pid=27400): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27400)] 16:19:32.840696 run osmo-msc_10.42.42.6(pid=27400): stdout: | (launched: 2022-12-12_16:19:31.178421) 16:19:32.894510 run osmo-msc_10.42.42.6(pid=27400): stderr: | 20221212161931839 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161931839 DLGLOBAL DEBUG validating counter group 0x7f49c84b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161931839 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161931839 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161931840 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161931840 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161931845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161931846 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161931847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161931848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:19:32.949058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27393): Terminating (SIGTERM) 16:19:32.992569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27396): Terminating (SIGTERM) 16:19:33.036208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27399): Terminating (SIGTERM) 16:19:33.079874 --- ParallelTerminationStrategy: PID 27393 died... 16:19:33.100402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27393): Terminated: ok {rc=0} 16:19:33.149625 --- ParallelTerminationStrategy: PID 27396 died... 16:19:33.169532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27396): Terminated: ok {rc=0} 16:19:33.218292 --- ParallelTerminationStrategy: PID 27399 died... 16:19:33.238253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27399): Terminated: ok {rc=0} 16:19:33.328434 bus /sierra_3: Setting Powered False 16:19:34.429137 bus /sierra_3: Setting Powered False 16:19:35.546408 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 emergency:oc2g --------------------------------------------------------------------- 16:19:36.780072 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:19:36.784785 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 16:19:36.806308 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 16:19:36.834458 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 16:19:36.919204 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 16:19:36.940325 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 16:19:36.968395 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 16:19:37.554008 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2379 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 16:19:37.559239 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:37.570368 tst emergency:oc2g: Using 1 x bts (candidates: 1) 16:19:37.608537 tst emergency_mo_mt_call.py: using LAC 30036 16:19:37.729396 tst emergency_mo_mt_call.py: using RAC 201 16:19:37.849355 tst emergency_mo_mt_call.py: using CellId 30036 16:19:37.971258 tst emergency_mo_mt_call.py: using BVCI 30037 16:19:38.084448 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:38.095441 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:38.106152 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:38.117364 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:38.128370 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:38.139391 tst emergency:oc2g: Using 1 x modem (candidates: 4) 16:19:38.258972 tst emergency:oc2g: Using 1 x modem (candidates: 4) 16:19:38.375211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:38.855348 run create_hlr_db(pid=27406): Launched 16:19:38.983857 bus /sierra_2: Setting Powered False 16:19:40.045392 run create_hlr_db(pid=27406): Terminated: ok {rc=0} 16:19:40.495050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27408): Launched 16:19:40.826812 run osmo-hlr_10.42.42.2(pid=27409): Launched 16:19:40.951204 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:41.523583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27411): Launched 16:19:41.852283 run osmo-stp_10.42.42.5(pid=27412): Launched 16:19:41.988923 tst emergency_mo_mt_call.py: using MSISDN 7862 16:19:42.160729 run osmo-msc_10.42.42.6: Starting osmo-msc 16:19:42.753299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27414): Launched 16:19:43.084469 run osmo-msc_10.42.42.6(pid=27415): Launched 16:19:43.269773 run osmo-stp_10.42.42.5(pid=27412): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27412)] 16:19:43.408435 run osmo-stp_10.42.42.5(pid=27412): stdout: | (launched: 2022-12-12_16:19:41.790667) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:43.547535 run osmo-stp_10.42.42.5(pid=27412): stderr: | 20221212161941982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161941982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161941982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161941983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161941983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161941983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161941983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:43.684360 run osmo-stp_10.42.42.5(pid=27412): stdout: | (launched: 2022-12-12_16:19:41.790667) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:43.815634 run osmo-stp_10.42.42.5(pid=27412): stderr: | 20221212161941982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161941982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161941982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161941983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161941983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161941983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161941983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:43.972075 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27412): Process ended prematurely: osmo-stp_10.42.42.5(pid=27412) [trial-2379↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27412)] [trial-2379↪emergency:oc2g↪emergency_mo_mt_call.py:19] 16:19:43.981457 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 16:19:44.009688 run osmo-hlr_10.42.42.2(pid=27409): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27409)] 16:19:44.061082 run osmo-hlr_10.42.42.2(pid=27409): stdout: | (launched: 2022-12-12_16:19:40.765068) 16:19:44.113456 run osmo-hlr_10.42.42.2(pid=27409): stderr: | 20221212161940962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161940962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161940962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161940962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161940962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161940962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161940975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161940984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161940984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161940984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:44.186780 run osmo-msc_10.42.42.6(pid=27415): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27415)] 16:19:44.237638 run osmo-msc_10.42.42.6(pid=27415): stdout: | (launched: 2022-12-12_16:19:43.022475) 16:19:44.289914 run osmo-msc_10.42.42.6(pid=27415): stderr: | 20221212161943342 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161943343 DLGLOBAL DEBUG validating counter group 0x7f1b2a809c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161943343 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161943343 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161943343 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161943343 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161943345 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161943346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161943346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161943346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:19:44.342945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27408): Terminating (SIGTERM) 16:19:44.385075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27411): Terminating (SIGTERM) 16:19:44.427400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27414): Terminating (SIGTERM) 16:19:44.470027 --- ParallelTerminationStrategy: PID 27408 died... 16:19:44.490362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27408): Terminated: ok {rc=0} 16:19:44.537781 --- ParallelTerminationStrategy: PID 27411 died... 16:19:44.557566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27411): Terminated: ok {rc=0} 16:19:44.605045 --- ParallelTerminationStrategy: PID 27414 died... 16:19:44.624652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27414): Terminated: ok {rc=0} 16:19:44.713815 bus /sierra_3: Setting Powered False 16:19:45.827841 bus /sierra_3: Setting Powered False 16:19:46.961883 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 16:19:48.048271 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:48.059906 tst emergency:oc2g: Using 1 x bts (candidates: 1) 16:19:48.101782 tst emergency_preemptive_call.py: using LAC 30037 16:19:48.223289 tst emergency_preemptive_call.py: using RAC 202 16:19:48.344682 tst emergency_preemptive_call.py: using CellId 30037 16:19:48.464847 tst emergency_preemptive_call.py: using BVCI 30038 16:19:48.576861 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:48.587702 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:48.598451 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:48.609808 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:48.620872 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 16:19:48.632020 tst emergency:oc2g: Using 1 x modem (candidates: 4) 16:19:48.747869 tst emergency:oc2g: Using 1 x modem (candidates: 4) 16:19:48.869290 tst emergency:oc2g: Using 1 x modem (candidates: 4) 16:19:48.989205 tst emergency:oc2g: Using 1 x modem (candidates: 4) 16:19:49.105997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:19:49.619906 run create_hlr_db(pid=27417): Launched 16:19:49.747066 bus /sierra_2: Setting Powered False 16:19:50.812549 run create_hlr_db(pid=27417): Terminated: ok {rc=0} 16:19:51.253697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27419): Launched 16:19:51.563806 run osmo-hlr_10.42.42.2(pid=27420): Launched 16:19:51.682109 run osmo-stp_10.42.42.5: Starting osmo-stp 16:19:52.209324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27422): Launched 16:19:52.516044 run osmo-stp_10.42.42.5(pid=27423): Launched 16:19:52.644497 tst emergency_preemptive_call.py: using MSISDN 7863 16:19:52.813813 run osmo-msc_10.42.42.6: Starting osmo-msc 16:19:53.363619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27425): Launched 16:19:53.672869 run osmo-msc_10.42.42.6(pid=27426): Launched 16:19:53.842733 run osmo-stp_10.42.42.5(pid=27423): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27423)] 16:19:53.971935 run osmo-stp_10.42.42.5(pid=27423): stdout: | (launched: 2022-12-12_16:19:52.457861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:54.101202 run osmo-stp_10.42.42.5(pid=27423): stderr: | 20221212161952629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161952629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161952629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161952630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161952630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161952630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161952630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:54.227901 run osmo-stp_10.42.42.5(pid=27423): stdout: | (launched: 2022-12-12_16:19:52.457861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:19:54.349131 run osmo-stp_10.42.42.5(pid=27423): stderr: | 20221212161952629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212161952629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212161952629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212161952630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212161952630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212161952630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212161952630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:19:54.494180 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27423): Process ended prematurely: osmo-stp_10.42.42.5(pid=27423) [trial-2379↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27423)] [trial-2379↪emergency:oc2g↪emergency_preemptive_call.py:32] 16:19:54.502537 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 16:19:54.528727 run osmo-hlr_10.42.42.2(pid=27420): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27420)] 16:19:54.576255 run osmo-hlr_10.42.42.2(pid=27420): stdout: | (launched: 2022-12-12_16:19:51.505307) 16:19:54.625495 run osmo-hlr_10.42.42.2(pid=27420): stderr: | 20221212161951682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212161951682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212161951682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212161951682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212161951682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212161951682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212161951696 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212161951704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212161951704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212161951704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:19:54.694286 run osmo-msc_10.42.42.6(pid=27426): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27426)] 16:19:54.741787 run osmo-msc_10.42.42.6(pid=27426): stdout: | (launched: 2022-12-12_16:19:53.614318) 16:19:54.790683 run osmo-msc_10.42.42.6(pid=27426): stderr: | 20221212161953887 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212161953887 DLGLOBAL DEBUG validating counter group 0x7f0ede47dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212161953887 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212161953887 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212161953887 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212161953888 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212161953889 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212161953890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212161953891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212161953891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:19:54.840681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27419): Terminating (SIGTERM) 16:19:54.880270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27422): Terminating (SIGTERM) 16:19:54.919510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27425): Terminating (SIGTERM) 16:19:54.959278 --- ParallelTerminationStrategy: PID 27419 died... 16:19:54.978389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27419): Terminated: ok {rc=0} 16:19:55.021961 --- ParallelTerminationStrategy: PID 27422 died... 16:19:55.040465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27422): Terminated: ok {rc=0} 16:19:55.084263 --- ParallelTerminationStrategy: PID 27425 died... 16:19:55.102883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27425): Terminated: ok {rc=0} 16:19:55.190840 bus /sierra_9: Setting Powered False 16:19:56.292113 bus /sierra_9: Setting Powered False 16:19:57.408324 bus /sierra_8: Setting Powered False 16:19:58.508354 bus /sierra_8: Setting Powered False 16:19:59.621297 bus /sierra_3: Setting Powered False 16:20:00.716821 bus /sierra_3: Setting Powered False 16:20:01.827717 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:oc2g --------------------------------------------------------------------- 16:20:03.086966 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:20:03.091403 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 16:20:03.111744 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 16:20:03.150163 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 16:20:03.236902 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 16:20:03.257416 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 16:20:03.295442 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 16:20:03.883127 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 16:20:03.933950 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:03.944371 tst gprs:oc2g: Using 1 x bts (candidates: 1) 16:20:03.979219 tst cs_paging_gprs_active.py: using LAC 30038 16:20:04.102073 tst cs_paging_gprs_active.py: using RAC 203 16:20:04.225234 tst cs_paging_gprs_active.py: using CellId 30038 16:20:04.347213 tst cs_paging_gprs_active.py: using BVCI 30039 16:20:04.462398 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:04.472932 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:04.483434 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:04.493846 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:04.504091 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:04.514398 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:04.524764 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:04.535220 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:04.545718 tst gprs:oc2g: Using 1 x modem (candidates: 4) 16:20:04.665788 tst gprs:oc2g: Using 1 x modem (candidates: 4) 16:20:04.788929 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:20:05.016327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:05.355490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27434): Launched 16:20:05.650113 run iperf3-srv_10.42.42.10(pid=27435): Launched 16:20:05.778138 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:20:06.004119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:06.342502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27436): Launched 16:20:06.636933 run iperf3-srv_10.42.42.10(pid=27437): Launched 16:20:06.764093 tst cs_paging_gprs_active.py:38: start network... 16:20:06.990015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:07.509839 run create_hlr_db(pid=27438): Launched 16:20:07.640232 bus /sierra_2: Setting Powered False 16:20:08.706360 run create_hlr_db(pid=27438): Terminated: ok {rc=0} 16:20:09.170987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27440): Launched 16:20:09.507734 run osmo-hlr_10.42.42.2(pid=27441): Launched 16:20:09.636418 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:10.209579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27443): Launched 16:20:10.545838 run osmo-stp_10.42.42.5(pid=27444): Launched 16:20:10.675599 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:11.252447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27446): Launched 16:20:11.380752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:11.664345 run patchelf(pid=27447): Launched 16:20:11.849145 run osmo-stp_10.42.42.5(pid=27444): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27444)] 16:20:11.989912 run osmo-stp_10.42.42.5(pid=27444): stdout: | (launched: 2022-12-12_16:20:10.482572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:12.132135 run osmo-stp_10.42.42.5(pid=27444): stderr: | 20221212162010673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162010673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162010674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162010674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162010675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162010675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162010675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:12.274688 run osmo-stp_10.42.42.5(pid=27444): stdout: | (launched: 2022-12-12_16:20:10.482572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:12.411211 run osmo-stp_10.42.42.5(pid=27444): stderr: | 20221212162010673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162010673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162010674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162010674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162010675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162010675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162010675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:12.572705 run patchelf(pid=27447): Terminating (SIGINT) 16:20:12.758514 run patchelf(pid=27447): Terminated: ok {rc=0} 16:20:12.893358 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27444): Process ended prematurely: osmo-stp_10.42.42.5(pid=27444) [trial-2379↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27444)] [trial-2379↪gprs:oc2g↪cs_paging_gprs_active.py:38] 16:20:12.903620 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:20:12.933248 run osmo-hlr_10.42.42.2(pid=27441): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27441)] 16:20:12.983786 run osmo-hlr_10.42.42.2(pid=27441): stdout: | (launched: 2022-12-12_16:20:09.444596) 16:20:13.036202 run osmo-hlr_10.42.42.2(pid=27441): stderr: | 20221212162009641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162009641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162009641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162009641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162009641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162009641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162009746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162009756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162009757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162009757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:13.088733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27434): Terminating (SIGTERM) 16:20:13.130894 run iperf3-srv_10.42.42.10(pid=27435): Terminating (SIGTERM) 16:20:13.173191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27436): Terminating (SIGTERM) 16:20:13.215397 run iperf3-srv_10.42.42.10(pid=27437): Terminating (SIGTERM) 16:20:13.257368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27440): Terminating (SIGTERM) 16:20:13.299978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27443): Terminating (SIGTERM) 16:20:13.342304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27446): Terminating (SIGTERM) 16:20:13.384570 --- ParallelTerminationStrategy: PID 27434 died... 16:20:13.404708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27434): Terminated: ok {rc=0} 16:20:13.451746 --- ParallelTerminationStrategy: PID 27435 died... 16:20:13.471004 run iperf3-srv_10.42.42.10(pid=27435): Terminated {rc=256} 16:20:13.517422 --- ParallelTerminationStrategy: PID 27436 died... 16:20:13.537014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27436): Terminated: ok {rc=0} 16:20:13.583236 --- ParallelTerminationStrategy: PID 27437 died... 16:20:13.602740 run iperf3-srv_10.42.42.10(pid=27437): Terminated {rc=256} 16:20:13.648829 --- ParallelTerminationStrategy: PID 27440 died... 16:20:13.668823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27440): Terminated: ok {rc=0} 16:20:13.715485 --- ParallelTerminationStrategy: PID 27443 died... 16:20:13.735231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27443): Terminated: ok {rc=0} 16:20:13.781543 --- ParallelTerminationStrategy: PID 27446 died... 16:20:13.801176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27446): Terminated: ok {rc=0} 16:20:13.888819 bus /gobi_0: Setting Powered False 16:20:14.987455 bus /gobi_0: Setting Powered False 16:20:16.099052 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g iperf3.py ---------------------------------------------- 16:20:17.252640 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:17.264618 tst gprs:oc2g: Using 1 x bts (candidates: 1) 16:20:17.305474 tst iperf3.py: using LAC 30039 16:20:17.426592 tst iperf3.py: using RAC 204 16:20:17.548471 tst iperf3.py: using CellId 30039 16:20:17.669769 tst iperf3.py: using BVCI 30040 16:20:17.782202 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:17.793340 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:17.804049 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:17.814629 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:17.825131 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:17.835925 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:17.846646 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:17.857246 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:17.868095 tst gprs:oc2g: Using 1 x modem (candidates: 4) 16:20:17.987441 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:20:18.196430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:18.510543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27448): Launched 16:20:18.785405 run iperf3-srv_10.42.42.10(pid=27449): Launched 16:20:18.903806 tst iperf3.py:8: start network... 16:20:19.113137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:19.599235 run create_hlr_db(pid=27450): Launched 16:20:19.727832 bus /gobi_6: Setting Powered False 16:20:20.789336 run create_hlr_db(pid=27450): Terminated: ok {rc=0} 16:20:21.247541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27452): Launched 16:20:21.582544 run osmo-hlr_10.42.42.2(pid=27453): Launched 16:20:21.709681 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:22.292237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27455): Launched 16:20:22.629880 run osmo-stp_10.42.42.5(pid=27456): Launched 16:20:22.758720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:23.338202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27458): Launched 16:20:23.466089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:23.750539 run patchelf(pid=27459): Launched 16:20:23.936084 run osmo-stp_10.42.42.5(pid=27456): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27456)] 16:20:24.076663 run osmo-stp_10.42.42.5(pid=27456): stdout: | (launched: 2022-12-12_16:20:22.566855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:24.219831 run osmo-stp_10.42.42.5(pid=27456): stderr: | 20221212162022757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162022758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162022758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162022758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162022759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162022759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162022759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:24.362843 run osmo-stp_10.42.42.5(pid=27456): stdout: | (launched: 2022-12-12_16:20:22.566855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:24.499970 run osmo-stp_10.42.42.5(pid=27456): stderr: | 20221212162022757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162022758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162022758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162022758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162022759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162022759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162022759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:24.662295 run patchelf(pid=27459): Terminating (SIGINT) 16:20:24.847998 run patchelf(pid=27459): Terminated: ok {rc=0} 16:20:24.982329 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27456): Process ended prematurely: osmo-stp_10.42.42.5(pid=27456) [trial-2379↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27456)] [trial-2379↪gprs:oc2g↪iperf3.py:8] 16:20:24.992590 tst iperf3.py:8: Test FAILED (7.8 sec) 16:20:25.021966 run osmo-hlr_10.42.42.2(pid=27453): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27453)] 16:20:25.072206 run osmo-hlr_10.42.42.2(pid=27453): stdout: | (launched: 2022-12-12_16:20:21.519749) 16:20:25.124482 run osmo-hlr_10.42.42.2(pid=27453): stderr: | 20221212162021717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162021717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162021717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162021717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162021717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162021717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162021730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162021739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162021739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162021739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:25.177821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27448): Terminating (SIGTERM) 16:20:25.220216 run iperf3-srv_10.42.42.10(pid=27449): Terminating (SIGTERM) 16:20:25.262481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27452): Terminating (SIGTERM) 16:20:25.304755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27455): Terminating (SIGTERM) 16:20:25.346914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27458): Terminating (SIGTERM) 16:20:25.389366 --- ParallelTerminationStrategy: PID 27448 died... 16:20:25.409434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27448): Terminated: ok {rc=0} 16:20:25.456126 --- ParallelTerminationStrategy: PID 27449 died... 16:20:25.475713 run iperf3-srv_10.42.42.10(pid=27449): Terminated {rc=256} 16:20:25.522245 --- ParallelTerminationStrategy: PID 27452 died... 16:20:25.541954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27452): Terminated: ok {rc=0} 16:20:25.588725 --- ParallelTerminationStrategy: PID 27455 died... 16:20:25.608308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27455): Terminated: ok {rc=0} 16:20:25.654763 --- ParallelTerminationStrategy: PID 27458 died... 16:20:25.674371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27458): Terminated: ok {rc=0} 16:20:25.763091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g iperf3m4.py ---------------------------------------------- 16:20:26.916140 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:26.928122 tst gprs:oc2g: Using 1 x bts (candidates: 1) 16:20:26.965211 tst iperf3m4.py: using LAC 30040 16:20:27.096937 tst iperf3m4.py: using RAC 205 16:20:27.227910 tst iperf3m4.py: using CellId 30040 16:20:27.357393 tst iperf3m4.py: using BVCI 30041 16:20:27.481198 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:27.492644 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:27.503907 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:27.515466 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:27.526722 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:27.538061 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:27.549569 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:27.560770 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:27.572318 tst gprs:oc2g: Using 1 x modem (candidates: 4) 16:20:27.689983 tst gprs:oc2g: Using 1 x modem (candidates: 4) 16:20:27.812926 tst gprs:oc2g: Using 1 x modem (candidates: 4) 16:20:27.933993 tst gprs:oc2g: Using 1 x modem (candidates: 4) 16:20:28.051917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:20:28.280041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:28.619443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27460): Launched 16:20:28.912819 run iperf3-srv_10.42.42.10(pid=27461): Launched 16:20:29.039779 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:20:29.266544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:29.604561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27462): Launched 16:20:29.897352 run iperf3-srv_10.42.42.10(pid=27463): Launched 16:20:30.024318 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:20:30.250250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:30.587903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27464): Launched 16:20:30.896346 run iperf3-srv_10.42.42.10(pid=27465): Launched 16:20:31.044878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:20:31.263575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:20:31.592433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27466): Launched 16:20:31.948994 run iperf3-srv_10.42.42.10(pid=27467): Launched 16:20:32.096233 tst iperf3m4.py:8: start network... 16:20:32.306806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:32.798775 run create_hlr_db(pid=27468): Launched 16:20:32.925685 bus /gobi_6: Setting Powered False 16:20:33.987357 run create_hlr_db(pid=27468): Terminated: ok {rc=0} 16:20:34.423263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27470): Launched 16:20:34.738209 run osmo-hlr_10.42.42.2(pid=27471): Launched 16:20:34.858230 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:35.396707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27473): Launched 16:20:35.710918 run osmo-stp_10.42.42.5(pid=27474): Launched 16:20:35.830971 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:36.371446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27476): Launched 16:20:36.491967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:36.758347 run patchelf(pid=27477): Launched 16:20:36.931376 run osmo-stp_10.42.42.5(pid=27474): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27474)] 16:20:37.062882 run osmo-stp_10.42.42.5(pid=27474): stdout: | (launched: 2022-12-12_16:20:35.651385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:37.196942 run osmo-stp_10.42.42.5(pid=27474): stderr: | 20221212162035823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162035823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162035824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162035824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162035825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162035825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162035825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:37.330473 run osmo-stp_10.42.42.5(pid=27474): stdout: | (launched: 2022-12-12_16:20:35.651385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:37.457797 run osmo-stp_10.42.42.5(pid=27474): stderr: | 20221212162035823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162035823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162035824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162035824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162035825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162035825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162035825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:37.609539 run patchelf(pid=27477): Terminating (SIGINT) 16:20:37.783506 run patchelf(pid=27477): Terminated: ok {rc=0} 16:20:37.908679 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27474): Process ended prematurely: osmo-stp_10.42.42.5(pid=27474) [trial-2379↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27474)] [trial-2379↪gprs:oc2g↪iperf3m4.py:8] 16:20:37.918511 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:20:37.946135 run osmo-hlr_10.42.42.2(pid=27471): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27471)] 16:20:37.993890 run osmo-hlr_10.42.42.2(pid=27471): stdout: | (launched: 2022-12-12_16:20:34.678695) 16:20:38.043243 run osmo-hlr_10.42.42.2(pid=27471): stderr: | 20221212162034856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162034856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162034856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162034856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162034856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162034856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162034868 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162034876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162034877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162034877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:38.093960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27460): Terminating (SIGTERM) 16:20:38.134325 run iperf3-srv_10.42.42.10(pid=27461): Terminating (SIGTERM) 16:20:38.174512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27462): Terminating (SIGTERM) 16:20:38.214582 run iperf3-srv_10.42.42.10(pid=27463): Terminating (SIGTERM) 16:20:38.254634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27464): Terminating (SIGTERM) 16:20:38.294832 run iperf3-srv_10.42.42.10(pid=27465): Terminating (SIGTERM) 16:20:38.334840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27466): Terminating (SIGTERM) 16:20:38.374969 run iperf3-srv_10.42.42.10(pid=27467): Terminating (SIGTERM) 16:20:38.414933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27470): Terminating (SIGTERM) 16:20:38.455071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27473): Terminating (SIGTERM) 16:20:38.495257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27476): Terminating (SIGTERM) 16:20:38.535667 --- ParallelTerminationStrategy: PID 27460 died... 16:20:38.555218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27460): Terminated: ok {rc=0} 16:20:38.599851 --- ParallelTerminationStrategy: PID 27461 died... 16:20:38.618852 run iperf3-srv_10.42.42.10(pid=27461): Terminated {rc=256} 16:20:38.663073 --- ParallelTerminationStrategy: PID 27462 died... 16:20:38.682442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27462): Terminated: ok {rc=0} 16:20:38.727064 --- ParallelTerminationStrategy: PID 27463 died... 16:20:38.745963 run iperf3-srv_10.42.42.10(pid=27463): Terminated {rc=256} 16:20:38.789956 --- ParallelTerminationStrategy: PID 27464 died... 16:20:38.808937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27464): Terminated: ok {rc=0} 16:20:38.853370 --- ParallelTerminationStrategy: PID 27465 died... 16:20:38.872246 run iperf3-srv_10.42.42.10(pid=27465): Terminated {rc=256} 16:20:38.917279 --- ParallelTerminationStrategy: PID 27466 died... 16:20:38.936231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27466): Terminated: ok {rc=0} 16:20:38.980680 --- ParallelTerminationStrategy: PID 27467 died... 16:20:38.999805 run iperf3-srv_10.42.42.10(pid=27467): Terminated {rc=256} 16:20:39.044661 --- ParallelTerminationStrategy: PID 27470 died... 16:20:39.063798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27470): Terminated: ok {rc=0} 16:20:39.108410 --- ParallelTerminationStrategy: PID 27473 died... 16:20:39.127459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27473): Terminated: ok {rc=0} 16:20:39.171924 --- ParallelTerminationStrategy: PID 27476 died... 16:20:39.191402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27476): Terminated: ok {rc=0} 16:20:39.277948 bus /gobi_4: Setting Powered False 16:20:40.381045 bus /gobi_4: Setting Powered False 16:20:41.498857 bus /gobi_1: Setting Powered False 16:20:42.598995 bus /gobi_1: Setting Powered False 16:20:43.716042 bus /gobi_0: Setting Powered False 16:20:44.814417 bus /gobi_0: Setting Powered False 16:20:45.929755 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g ping.py ---------------------------------------------- 16:20:47.033682 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:47.046811 tst gprs:oc2g: Using 1 x bts (candidates: 1) 16:20:47.086560 tst ping.py: using LAC 30041 16:20:47.224540 tst ping.py: using RAC 206 16:20:47.354815 tst ping.py: using CellId 30041 16:20:47.490394 tst ping.py: using BVCI 30042 16:20:47.611809 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:47.623259 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:47.634394 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:47.645611 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:47.656576 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:47.667804 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:47.679177 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:47.690488 tst gprs:oc2g: Using 1 x modem (candidates: 4) 16:20:47.809845 tst ping.py:19: start network... 16:20:48.031664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:48.542628 run create_hlr_db(pid=27478): Launched 16:20:48.669297 bus /gobi_6: Setting Powered False 16:20:49.734334 run create_hlr_db(pid=27478): Terminated: ok {rc=0} 16:20:50.174553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27480): Launched 16:20:50.485585 run osmo-hlr_10.42.42.2(pid=27481): Launched 16:20:50.603108 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:51.136435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27483): Launched 16:20:51.448230 run osmo-stp_10.42.42.5(pid=27484): Launched 16:20:51.567037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:20:52.097593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27486): Launched 16:20:52.214942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:20:52.476302 run patchelf(pid=27487): Launched 16:20:52.648726 run osmo-stp_10.42.42.5(pid=27484): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27484)] 16:20:52.778610 run osmo-stp_10.42.42.5(pid=27484): stdout: | (launched: 2022-12-12_16:20:51.389631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:52.909995 run osmo-stp_10.42.42.5(pid=27484): stderr: | 20221212162051562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162051562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162051563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162051563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162051563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162051564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162051564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:53.041157 run osmo-stp_10.42.42.5(pid=27484): stdout: | (launched: 2022-12-12_16:20:51.389631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:20:53.166754 run osmo-stp_10.42.42.5(pid=27484): stderr: | 20221212162051562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162051562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162051563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162051563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162051563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162051564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162051564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:20:53.315913 run patchelf(pid=27487): Terminating (SIGINT) 16:20:53.486990 run patchelf(pid=27487): Terminated: ok {rc=0} 16:20:53.610115 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27484): Process ended prematurely: osmo-stp_10.42.42.5(pid=27484) [trial-2379↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27484)] [trial-2379↪gprs:oc2g↪ping.py:22] 16:20:53.619121 tst ping.py:22: Test FAILED (6.6 sec) 16:20:53.646508 run osmo-hlr_10.42.42.2(pid=27481): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27481)] 16:20:53.694477 run osmo-hlr_10.42.42.2(pid=27481): stdout: | (launched: 2022-12-12_16:20:50.426790) 16:20:53.744138 run osmo-hlr_10.42.42.2(pid=27481): stderr: | 20221212162050610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162050610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162050610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162050610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162050610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162050611 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162050620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162050633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162050633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162050633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:20:53.794025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27480): Terminating (SIGTERM) 16:20:53.834328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27483): Terminating (SIGTERM) 16:20:53.874411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27486): Terminating (SIGTERM) 16:20:53.915031 --- ParallelTerminationStrategy: PID 27480 died... 16:20:53.934543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27480): Terminated: ok {rc=0} 16:20:53.979019 --- ParallelTerminationStrategy: PID 27483 died... 16:20:53.998134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27483): Terminated: ok {rc=0} 16:20:54.042615 --- ParallelTerminationStrategy: PID 27486 died... 16:20:54.061638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27486): Terminated: ok {rc=0} 16:20:54.145407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 16:20:55.233943 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:55.246404 tst gprs:oc2g: Using 1 x bts (candidates: 1) 16:20:55.286744 tst ping_idle_ping.py: using LAC 30042 16:20:55.420352 tst ping_idle_ping.py: using RAC 207 16:20:55.551071 tst ping_idle_ping.py: using CellId 30042 16:20:55.685136 tst ping_idle_ping.py: using BVCI 30043 16:20:55.807317 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:55.818491 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:55.829507 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:55.841325 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:55.853570 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:55.865692 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:55.877846 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 16:20:55.889798 tst gprs:oc2g: Using 1 x modem (candidates: 4) 16:20:56.008340 tst ping_idle_ping.py:24: start network... 16:20:56.214639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:20:56.695380 run create_hlr_db(pid=27488): Launched 16:20:56.823678 bus /gobi_6: Setting Powered False 16:20:57.884593 run create_hlr_db(pid=27488): Terminated: ok {rc=0} 16:20:58.315740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27490): Launched 16:20:58.626868 run osmo-hlr_10.42.42.2(pid=27491): Launched 16:20:58.744246 run osmo-stp_10.42.42.5: Starting osmo-stp 16:20:59.273485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27493): Launched 16:20:59.583666 run osmo-stp_10.42.42.5(pid=27494): Launched 16:20:59.701465 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:00.232226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27496): Launched 16:21:00.351367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:00.612798 run patchelf(pid=27497): Launched 16:21:00.787804 run osmo-stp_10.42.42.5(pid=27494): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27494)] 16:21:00.925481 run osmo-stp_10.42.42.5(pid=27494): stdout: | (launched: 2022-12-12_16:20:59.524787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:01.059184 run osmo-stp_10.42.42.5(pid=27494): stderr: | 20221212162059698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162059698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162059698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162059699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162059699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162059699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162059699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:01.193901 run osmo-stp_10.42.42.5(pid=27494): stdout: | (launched: 2022-12-12_16:20:59.524787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:01.322493 run osmo-stp_10.42.42.5(pid=27494): stderr: | 20221212162059698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162059698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162059698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162059699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162059699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162059699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162059699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:01.475383 run patchelf(pid=27497): Terminating (SIGINT) 16:21:01.650580 run patchelf(pid=27497): Terminated: ok {rc=0} 16:21:01.776769 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27494): Process ended prematurely: osmo-stp_10.42.42.5(pid=27494) [trial-2379↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27494)] [trial-2379↪gprs:oc2g↪ping_idle_ping.py:27] 16:21:01.786685 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:21:01.814793 run osmo-hlr_10.42.42.2(pid=27491): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27491)] 16:21:01.863851 run osmo-hlr_10.42.42.2(pid=27491): stdout: | (launched: 2022-12-12_16:20:58.567861) 16:21:01.914431 run osmo-hlr_10.42.42.2(pid=27491): stderr: | 20221212162058747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162058747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162058747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162058747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162058747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162058747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162058763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162058774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162058774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162058774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:01.965495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27490): Terminating (SIGTERM) 16:21:02.006261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27493): Terminating (SIGTERM) 16:21:02.048023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27496): Terminating (SIGTERM) 16:21:02.090817 --- ParallelTerminationStrategy: PID 27490 died... 16:21:02.110377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27490): Terminated: ok {rc=0} 16:21:02.155490 --- ParallelTerminationStrategy: PID 27493 died... 16:21:02.174763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27493): Terminated: ok {rc=0} 16:21:02.219420 --- ParallelTerminationStrategy: PID 27496 died... 16:21:02.238283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27496): Terminated: ok {rc=0} 16:21:02.324054 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 16:21:03.618310 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:21:03.624061 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:21:03.645091 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:21:03.683242 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:21:03.769467 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:21:03.789598 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:21:03.827134 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:21:04.418918 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:21:04.468237 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:04.478930 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:21:04.514764 tst cs_paging_gprs_active.py: using LAC 30043 16:21:04.640153 tst cs_paging_gprs_active.py: using RAC 208 16:21:04.760564 tst cs_paging_gprs_active.py: using CellId 30043 16:21:04.878805 tst cs_paging_gprs_active.py: using BVCI 30044 16:21:04.991193 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:05.001920 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:05.012413 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:05.023121 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:05.033593 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:05.043926 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:05.054577 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:05.065143 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:05.075754 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:21:05.196461 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:21:05.315800 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:21:05.539096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:05.870415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27501): Launched 16:21:06.158808 run iperf3-srv_10.42.42.10(pid=27502): Launched 16:21:06.283117 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:21:06.504792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:06.835589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27503): Launched 16:21:07.122745 run iperf3-srv_10.42.42.10(pid=27504): Launched 16:21:07.246653 tst cs_paging_gprs_active.py:38: start network... 16:21:07.467299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:07.978600 run create_hlr_db(pid=27505): Launched 16:21:08.107151 bus /gobi_6: Setting Powered False 16:21:09.172041 run create_hlr_db(pid=27505): Terminated: ok {rc=0} 16:21:09.630352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27507): Launched 16:21:09.962260 run osmo-hlr_10.42.42.2(pid=27508): Launched 16:21:10.087948 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:10.662455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27510): Launched 16:21:10.994013 run osmo-stp_10.42.42.5(pid=27511): Launched 16:21:11.119121 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:11.687894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27513): Launched 16:21:11.815602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:12.094691 run patchelf(pid=27514): Launched 16:21:12.277460 run osmo-stp_10.42.42.5(pid=27511): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27511)] 16:21:12.416651 run osmo-stp_10.42.42.5(pid=27511): stdout: | (launched: 2022-12-12_16:21:10.932209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:12.557203 run osmo-stp_10.42.42.5(pid=27511): stderr: | 20221212162111123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162111123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162111123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162111124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162111124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162111124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162111124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:12.698200 run osmo-stp_10.42.42.5(pid=27511): stdout: | (launched: 2022-12-12_16:21:10.932209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:12.833022 run osmo-stp_10.42.42.5(pid=27511): stderr: | 20221212162111123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162111123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162111123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162111124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162111124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162111124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162111124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:12.993283 run patchelf(pid=27514): Terminating (SIGINT) 16:21:13.176894 run patchelf(pid=27514): Terminated: ok {rc=0} 16:21:13.309932 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27511): Process ended prematurely: osmo-stp_10.42.42.5(pid=27511) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27511)] [trial-2379↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:21:13.320237 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:21:13.349337 run osmo-hlr_10.42.42.2(pid=27508): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27508)] 16:21:13.400438 run osmo-hlr_10.42.42.2(pid=27508): stdout: | (launched: 2022-12-12_16:21:09.900370) 16:21:13.453099 run osmo-hlr_10.42.42.2(pid=27508): stderr: | 20221212162110097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162110097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162110097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162110097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162110097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162110098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162110110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162110119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162110119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162110119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:13.506446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27501): Terminating (SIGTERM) 16:21:13.549552 run iperf3-srv_10.42.42.10(pid=27502): Terminating (SIGTERM) 16:21:13.592605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27503): Terminating (SIGTERM) 16:21:13.635037 run iperf3-srv_10.42.42.10(pid=27504): Terminating (SIGTERM) 16:21:13.677221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27507): Terminating (SIGTERM) 16:21:13.719340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27510): Terminating (SIGTERM) 16:21:13.761647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27513): Terminating (SIGTERM) 16:21:13.803976 --- ParallelTerminationStrategy: PID 27501 died... 16:21:13.824019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27501): Terminated: ok {rc=0} 16:21:13.870626 --- ParallelTerminationStrategy: PID 27502 died... 16:21:13.890037 run iperf3-srv_10.42.42.10(pid=27502): Terminated {rc=256} 16:21:13.936242 --- ParallelTerminationStrategy: PID 27503 died... 16:21:13.955666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27503): Terminated: ok {rc=0} 16:21:14.001874 --- ParallelTerminationStrategy: PID 27504 died... 16:21:14.021360 run iperf3-srv_10.42.42.10(pid=27504): Terminated {rc=256} 16:21:14.067491 --- ParallelTerminationStrategy: PID 27507 died... 16:21:14.086916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27507): Terminated: ok {rc=0} 16:21:14.133367 --- ParallelTerminationStrategy: PID 27510 died... 16:21:14.152744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27510): Terminated: ok {rc=0} 16:21:14.199347 --- ParallelTerminationStrategy: PID 27513 died... 16:21:14.218843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27513): Terminated: ok {rc=0} 16:21:14.307241 bus /gobi_0: Setting Powered False 16:21:15.403701 bus /gobi_0: Setting Powered False 16:21:16.526924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:21:17.689072 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:17.701294 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:21:17.740083 tst iperf3.py: using LAC 30044 16:21:17.870864 tst iperf3.py: using RAC 209 16:21:17.999286 tst iperf3.py: using CellId 30044 16:21:18.126143 tst iperf3.py: using BVCI 30045 16:21:18.239508 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:18.250561 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:18.261394 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:18.272175 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:18.282930 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:18.293506 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:18.304047 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:18.314716 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:18.325471 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:21:18.446050 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:21:18.666918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:18.998109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27515): Launched 16:21:19.286882 run iperf3-srv_10.42.42.10(pid=27516): Launched 16:21:19.410931 tst iperf3.py:8: start network... 16:21:19.631601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:20.141477 run create_hlr_db(pid=27517): Launched 16:21:20.266951 bus /gobi_6: Setting Powered False 16:21:21.331042 run create_hlr_db(pid=27517): Terminated: ok {rc=0} 16:21:21.770714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27519): Launched 16:21:22.107345 run osmo-hlr_10.42.42.2(pid=27520): Launched 16:21:22.235425 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:22.804231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27522): Launched 16:21:23.135981 run osmo-stp_10.42.42.5(pid=27523): Launched 16:21:23.262633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:23.831071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27525): Launched 16:21:23.956137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:24.235926 run patchelf(pid=27526): Launched 16:21:24.419315 run osmo-stp_10.42.42.5(pid=27523): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27523)] 16:21:24.558336 run osmo-stp_10.42.42.5(pid=27523): stdout: | (launched: 2022-12-12_16:21:23.074255) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:24.699152 run osmo-stp_10.42.42.5(pid=27523): stderr: | 20221212162123263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162123263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162123263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162123264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162123264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162123264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162123264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:24.840233 run osmo-stp_10.42.42.5(pid=27523): stdout: | (launched: 2022-12-12_16:21:23.074255) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:24.974739 run osmo-stp_10.42.42.5(pid=27523): stderr: | 20221212162123263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162123263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162123263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162123264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162123264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162123264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162123264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:25.134778 run patchelf(pid=27526): Terminating (SIGINT) 16:21:25.317610 run patchelf(pid=27526): Terminated: ok {rc=0} 16:21:25.449642 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27523): Process ended prematurely: osmo-stp_10.42.42.5(pid=27523) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27523)] [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 16:21:25.460079 tst iperf3.py:8: Test FAILED (7.8 sec) 16:21:25.489124 run osmo-hlr_10.42.42.2(pid=27520): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27520)] 16:21:25.539470 run osmo-hlr_10.42.42.2(pid=27520): stdout: | (launched: 2022-12-12_16:21:22.045859) 16:21:25.591792 run osmo-hlr_10.42.42.2(pid=27520): stderr: | 20221212162122239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162122239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162122239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162122239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162122239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162122239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162122252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162122260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162122260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162122260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:25.644564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27515): Terminating (SIGTERM) 16:21:25.687212 run iperf3-srv_10.42.42.10(pid=27516): Terminating (SIGTERM) 16:21:25.729502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27519): Terminating (SIGTERM) 16:21:25.771888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27522): Terminating (SIGTERM) 16:21:25.814301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27525): Terminating (SIGTERM) 16:21:25.857197 --- ParallelTerminationStrategy: PID 27515 died... 16:21:25.877548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27515): Terminated: ok {rc=0} 16:21:25.924734 --- ParallelTerminationStrategy: PID 27516 died... 16:21:25.944529 run iperf3-srv_10.42.42.10(pid=27516): Terminated {rc=256} 16:21:25.990996 --- ParallelTerminationStrategy: PID 27519 died... 16:21:26.010416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27519): Terminated: ok {rc=0} 16:21:26.056927 --- ParallelTerminationStrategy: PID 27522 died... 16:21:26.077042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27522): Terminated: ok {rc=0} 16:21:26.124044 --- ParallelTerminationStrategy: PID 27525 died... 16:21:26.143783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27525): Terminated: ok {rc=0} 16:21:26.234480 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:21:27.387128 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:27.399285 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:21:27.438283 tst iperf3m4.py: using LAC 30045 16:21:27.566416 tst iperf3m4.py: using RAC 210 16:21:27.694760 tst iperf3m4.py: using CellId 30045 16:21:27.823007 tst iperf3m4.py: using BVCI 30046 16:21:27.942394 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:27.953827 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:27.964914 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:27.976374 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:27.987737 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:27.998973 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:28.010628 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:28.021994 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:28.033536 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:21:28.154993 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:21:28.275759 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:21:28.393633 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:21:28.512127 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:21:28.719593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:29.030947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27527): Launched 16:21:29.301248 run iperf3-srv_10.42.42.10(pid=27528): Launched 16:21:29.416399 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:21:29.621475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:29.930544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27529): Launched 16:21:30.200041 run iperf3-srv_10.42.42.10(pid=27530): Launched 16:21:30.316004 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:21:30.520343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:30.833658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27531): Launched 16:21:31.121710 run iperf3-srv_10.42.42.10(pid=27532): Launched 16:21:31.260486 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:21:31.485441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:21:31.799634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27533): Launched 16:21:32.105626 run iperf3-srv_10.42.42.10(pid=27534): Launched 16:21:32.237861 tst iperf3m4.py:8: start network... 16:21:32.458418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:32.969628 run create_hlr_db(pid=27535): Launched 16:21:33.096512 bus /gobi_6: Setting Powered False 16:21:34.161381 run create_hlr_db(pid=27535): Terminated: ok {rc=0} 16:21:34.602749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27537): Launched 16:21:34.912663 run osmo-hlr_10.42.42.2(pid=27538): Launched 16:21:35.029669 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:35.565096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27540): Launched 16:21:35.874428 run osmo-stp_10.42.42.5(pid=27541): Launched 16:21:35.992488 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:36.524185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27543): Launched 16:21:36.645037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:36.907355 run patchelf(pid=27544): Launched 16:21:37.078682 run osmo-stp_10.42.42.5(pid=27541): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27541)] 16:21:37.208425 run osmo-stp_10.42.42.5(pid=27541): stdout: | (launched: 2022-12-12_16:21:35.815802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:37.340231 run osmo-stp_10.42.42.5(pid=27541): stderr: | 20221212162135989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162135989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162135989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162135990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162135990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162135990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162135991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:37.472158 run osmo-stp_10.42.42.5(pid=27541): stdout: | (launched: 2022-12-12_16:21:35.815802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:37.597979 run osmo-stp_10.42.42.5(pid=27541): stderr: | 20221212162135989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162135989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162135989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162135990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162135990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162135990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162135991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:37.747922 run patchelf(pid=27544): Terminating (SIGINT) 16:21:37.919322 run patchelf(pid=27544): Terminated: ok {rc=0} 16:21:38.042563 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27541): Process ended prematurely: osmo-stp_10.42.42.5(pid=27541) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27541)] [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 16:21:38.052251 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:21:38.079694 run osmo-hlr_10.42.42.2(pid=27538): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27538)] 16:21:38.127342 run osmo-hlr_10.42.42.2(pid=27538): stdout: | (launched: 2022-12-12_16:21:34.854533) 16:21:38.176630 run osmo-hlr_10.42.42.2(pid=27538): stderr: | 20221212162135032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162135032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162135032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162135032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162135032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162135032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162135045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162135053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162135054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162135054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:38.226446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27527): Terminating (SIGTERM) 16:21:38.266192 run iperf3-srv_10.42.42.10(pid=27528): Terminating (SIGTERM) 16:21:38.305857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27529): Terminating (SIGTERM) 16:21:38.345516 run iperf3-srv_10.42.42.10(pid=27530): Terminating (SIGTERM) 16:21:38.385121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27531): Terminating (SIGTERM) 16:21:38.424818 run iperf3-srv_10.42.42.10(pid=27532): Terminating (SIGTERM) 16:21:38.464402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27533): Terminating (SIGTERM) 16:21:38.503948 run iperf3-srv_10.42.42.10(pid=27534): Terminating (SIGTERM) 16:21:38.543602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27537): Terminating (SIGTERM) 16:21:38.583427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27540): Terminating (SIGTERM) 16:21:38.623095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27543): Terminating (SIGTERM) 16:21:38.662924 --- ParallelTerminationStrategy: PID 27527 died... 16:21:38.681968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27527): Terminated: ok {rc=0} 16:21:38.725596 --- ParallelTerminationStrategy: PID 27528 died... 16:21:38.743847 run iperf3-srv_10.42.42.10(pid=27528): Terminated {rc=256} 16:21:38.787484 --- ParallelTerminationStrategy: PID 27529 died... 16:21:38.805982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27529): Terminated: ok {rc=0} 16:21:38.850076 --- ParallelTerminationStrategy: PID 27530 died... 16:21:38.868483 run iperf3-srv_10.42.42.10(pid=27530): Terminated {rc=256} 16:21:38.912439 --- ParallelTerminationStrategy: PID 27531 died... 16:21:38.931046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27531): Terminated: ok {rc=0} 16:21:38.974538 --- ParallelTerminationStrategy: PID 27532 died... 16:21:38.993339 run iperf3-srv_10.42.42.10(pid=27532): Terminated {rc=256} 16:21:39.036817 --- ParallelTerminationStrategy: PID 27533 died... 16:21:39.055774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27533): Terminated: ok {rc=0} 16:21:39.099210 --- ParallelTerminationStrategy: PID 27534 died... 16:21:39.117815 run iperf3-srv_10.42.42.10(pid=27534): Terminated {rc=256} 16:21:39.161216 --- ParallelTerminationStrategy: PID 27537 died... 16:21:39.179857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27537): Terminated: ok {rc=0} 16:21:39.223467 --- ParallelTerminationStrategy: PID 27540 died... 16:21:39.242086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27540): Terminated: ok {rc=0} 16:21:39.285683 --- ParallelTerminationStrategy: PID 27543 died... 16:21:39.304402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27543): Terminated: ok {rc=0} 16:21:39.389691 bus /gobi_4: Setting Powered False 16:21:40.493491 bus /gobi_4: Setting Powered False 16:21:41.610387 bus /gobi_1: Setting Powered False 16:21:42.709698 bus /gobi_1: Setting Powered False 16:21:43.826475 bus /gobi_0: Setting Powered False 16:21:44.922722 bus /gobi_0: Setting Powered False 16:21:46.039878 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 16:21:47.150461 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:47.163568 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:21:47.201269 tst ping.py: using LAC 30046 16:21:47.320811 tst ping.py: using RAC 211 16:21:47.440596 tst ping.py: using CellId 30046 16:21:47.563486 tst ping.py: using BVCI 30047 16:21:47.674375 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:47.685328 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:47.696061 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:47.706737 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:47.717292 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:47.728206 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:47.739125 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:47.749992 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:21:47.866395 tst ping.py:19: start network... 16:21:48.067439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:48.535260 run create_hlr_db(pid=27545): Launched 16:21:48.659900 bus /gobi_6: Setting Powered False 16:21:49.720247 run create_hlr_db(pid=27545): Terminated: ok {rc=0} 16:21:50.162544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27547): Launched 16:21:50.487397 run osmo-hlr_10.42.42.2(pid=27548): Launched 16:21:50.611778 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:51.167284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27550): Launched 16:21:51.493120 run osmo-stp_10.42.42.5(pid=27551): Launched 16:21:51.617842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:21:52.177517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27553): Launched 16:21:52.303372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:21:52.578216 run patchelf(pid=27554): Launched 16:21:52.759570 run osmo-stp_10.42.42.5(pid=27551): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27551)] 16:21:52.896464 run osmo-stp_10.42.42.5(pid=27551): stdout: | (launched: 2022-12-12_16:21:51.432231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:53.034996 run osmo-stp_10.42.42.5(pid=27551): stderr: | 20221212162151621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162151621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162151621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162151622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162151622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162151622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162151622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:53.173970 run osmo-stp_10.42.42.5(pid=27551): stdout: | (launched: 2022-12-12_16:21:51.432231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:21:53.307244 run osmo-stp_10.42.42.5(pid=27551): stderr: | 20221212162151621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162151621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162151621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162151622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162151622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162151622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162151622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:21:53.463965 run patchelf(pid=27554): Terminating (SIGINT) 16:21:53.644371 run patchelf(pid=27554): Terminated: ok {rc=0} 16:21:53.774233 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27551): Process ended prematurely: osmo-stp_10.42.42.5(pid=27551) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27551)] [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 16:21:53.784133 tst ping.py:22: Test FAILED (6.6 sec) 16:21:53.813526 run osmo-hlr_10.42.42.2(pid=27548): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27548)] 16:21:53.864189 run osmo-hlr_10.42.42.2(pid=27548): stdout: | (launched: 2022-12-12_16:21:50.426693) 16:21:53.916703 run osmo-hlr_10.42.42.2(pid=27548): stderr: | 20221212162150622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162150622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162150622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162150622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162150622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162150622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162150636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162150644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162150645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162150645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:21:53.969691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27547): Terminating (SIGTERM) 16:21:54.012110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27550): Terminating (SIGTERM) 16:21:54.054612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27553): Terminating (SIGTERM) 16:21:54.097474 --- ParallelTerminationStrategy: PID 27547 died... 16:21:54.117656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27547): Terminated: ok {rc=0} 16:21:54.165038 --- ParallelTerminationStrategy: PID 27550 died... 16:21:54.184866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27550): Terminated: ok {rc=0} 16:21:54.232313 --- ParallelTerminationStrategy: PID 27553 died... 16:21:54.252283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27553): Terminated: ok {rc=0} 16:21:54.340463 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:21:55.428609 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:55.440273 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:21:55.478753 tst ping_idle_ping.py: using LAC 30047 16:21:55.598642 tst ping_idle_ping.py: using RAC 212 16:21:55.719390 tst ping_idle_ping.py: using CellId 30047 16:21:55.840180 tst ping_idle_ping.py: using BVCI 30048 16:21:55.949764 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:55.960516 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:55.971285 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:55.982055 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:55.992624 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:56.003207 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:56.013956 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:21:56.024620 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:21:56.140748 tst ping_idle_ping.py:24: start network... 16:21:56.356119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:21:56.862913 run create_hlr_db(pid=27555): Launched 16:21:56.987621 bus /gobi_6: Setting Powered False 16:21:58.051937 run create_hlr_db(pid=27555): Terminated: ok {rc=0} 16:21:58.487552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27557): Launched 16:21:58.795013 run osmo-hlr_10.42.42.2(pid=27558): Launched 16:21:58.913113 run osmo-stp_10.42.42.5: Starting osmo-stp 16:21:59.452013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27560): Launched 16:21:59.759724 run osmo-stp_10.42.42.5(pid=27561): Launched 16:21:59.876338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:00.400590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27563): Launched 16:22:00.518312 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:00.776569 run patchelf(pid=27564): Launched 16:22:00.979865 run osmo-stp_10.42.42.5(pid=27561): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27561)] 16:22:01.110446 run osmo-stp_10.42.42.5(pid=27561): stdout: | (launched: 2022-12-12_16:21:59.701905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:01.243134 run osmo-stp_10.42.42.5(pid=27561): stderr: | 20221212162159873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162159873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162159874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162159874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162159875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162159875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162159875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:01.376530 run osmo-stp_10.42.42.5(pid=27561): stdout: | (launched: 2022-12-12_16:21:59.701905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:01.503365 run osmo-stp_10.42.42.5(pid=27561): stderr: | 20221212162159873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162159873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162159874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162159874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162159875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162159875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162159875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:01.654819 run patchelf(pid=27564): Terminating (SIGINT) 16:22:01.828841 run patchelf(pid=27564): Terminated: ok {rc=0} 16:22:01.955618 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27561): Process ended prematurely: osmo-stp_10.42.42.5(pid=27561) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27561)] [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 16:22:01.965640 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:22:01.994044 run osmo-hlr_10.42.42.2(pid=27558): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27558)] 16:22:02.043716 run osmo-hlr_10.42.42.2(pid=27558): stdout: | (launched: 2022-12-12_16:21:58.737224) 16:22:02.095066 run osmo-hlr_10.42.42.2(pid=27558): stderr: | 20221212162158917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162158918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162158918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162158918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162158918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162158918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162158930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162158939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162158939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162158939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:02.145946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27557): Terminating (SIGTERM) 16:22:02.187380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27560): Terminating (SIGTERM) 16:22:02.227541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27563): Terminating (SIGTERM) 16:22:02.267960 --- ParallelTerminationStrategy: PID 27557 died... 16:22:02.287803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27557): Terminated: ok {rc=0} 16:22:02.333789 --- ParallelTerminationStrategy: PID 27560 died... 16:22:02.352616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27560): Terminated: ok {rc=0} 16:22:02.396468 --- ParallelTerminationStrategy: PID 27563 died... 16:22:02.415149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27563): Terminated: ok {rc=0} 16:22:02.500936 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:22:03.803025 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:22:03.809963 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:22:03.831496 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:22:03.872372 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:22:03.961380 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:22:03.982583 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:22:04.022524 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:22:04.621962 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:22:04.677299 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:04.688648 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:22:04.744632 tst cs_paging_gprs_active.py: using LAC 30048 16:22:04.872568 tst cs_paging_gprs_active.py: using RAC 213 16:22:04.999211 tst cs_paging_gprs_active.py: using CellId 30048 16:22:05.126608 tst cs_paging_gprs_active.py: using BVCI 30049 16:22:05.246856 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:05.258362 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:05.269604 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:05.280940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:05.292474 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:05.303905 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:05.315482 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:05.326897 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:05.338485 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:22:05.456208 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:22:05.576276 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:22:05.799613 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:06.133100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27570): Launched 16:22:06.423571 run iperf3-srv_10.42.42.10(pid=27571): Launched 16:22:06.549521 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:22:06.772790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:07.106980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27572): Launched 16:22:07.397055 run iperf3-srv_10.42.42.10(pid=27573): Launched 16:22:07.523667 tst cs_paging_gprs_active.py:38: start network... 16:22:07.747366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:08.262742 run create_hlr_db(pid=27574): Launched 16:22:08.390920 bus /gobi_6: Setting Powered False 16:22:09.454982 run create_hlr_db(pid=27574): Terminated: ok {rc=0} 16:22:09.914367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27576): Launched 16:22:10.248082 run osmo-hlr_10.42.42.2(pid=27577): Launched 16:22:10.375969 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:10.947826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27579): Launched 16:22:11.281777 run osmo-stp_10.42.42.5(pid=27580): Launched 16:22:11.410458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:11.981589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27582): Launched 16:22:12.107955 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:12.389307 run patchelf(pid=27583): Launched 16:22:12.572907 run osmo-stp_10.42.42.5(pid=27580): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27580)] 16:22:12.712419 run osmo-stp_10.42.42.5(pid=27580): stdout: | (launched: 2022-12-12_16:22:11.219361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:12.853207 run osmo-stp_10.42.42.5(pid=27580): stderr: | 20221212162211410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162211410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162211411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162211411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162211411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162211411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162211412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:12.994424 run osmo-stp_10.42.42.5(pid=27580): stdout: | (launched: 2022-12-12_16:22:11.219361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:13.129696 run osmo-stp_10.42.42.5(pid=27580): stderr: | 20221212162211410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162211410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162211411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162211411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162211411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162211411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162211412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:13.291167 run patchelf(pid=27583): Terminating (SIGINT) 16:22:13.475247 run patchelf(pid=27583): Terminated: ok {rc=0} 16:22:13.609221 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27580): Process ended prematurely: osmo-stp_10.42.42.5(pid=27580) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27580)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:22:13.619550 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:22:13.648942 run osmo-hlr_10.42.42.2(pid=27577): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27577)] 16:22:13.699580 run osmo-hlr_10.42.42.2(pid=27577): stdout: | (launched: 2022-12-12_16:22:10.185508) 16:22:13.751969 run osmo-hlr_10.42.42.2(pid=27577): stderr: | 20221212162210382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162210382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162210382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162210382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162210382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162210382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162210395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162210403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162210403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162210403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:13.804688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27570): Terminating (SIGTERM) 16:22:13.847024 run iperf3-srv_10.42.42.10(pid=27571): Terminating (SIGTERM) 16:22:13.889141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27572): Terminating (SIGTERM) 16:22:13.931308 run iperf3-srv_10.42.42.10(pid=27573): Terminating (SIGTERM) 16:22:13.973659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27576): Terminating (SIGTERM) 16:22:14.016192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27579): Terminating (SIGTERM) 16:22:14.058776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27582): Terminating (SIGTERM) 16:22:14.101459 --- ParallelTerminationStrategy: PID 27570 died... 16:22:14.121574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27570): Terminated: ok {rc=0} 16:22:14.169415 --- ParallelTerminationStrategy: PID 27571 died... 16:22:14.189085 run iperf3-srv_10.42.42.10(pid=27571): Terminated {rc=256} 16:22:14.236343 --- ParallelTerminationStrategy: PID 27572 died... 16:22:14.256068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27572): Terminated: ok {rc=0} 16:22:14.302790 --- ParallelTerminationStrategy: PID 27573 died... 16:22:14.322365 run iperf3-srv_10.42.42.10(pid=27573): Terminated {rc=256} 16:22:14.368341 --- ParallelTerminationStrategy: PID 27576 died... 16:22:14.388514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27576): Terminated: ok {rc=0} 16:22:14.435336 --- ParallelTerminationStrategy: PID 27579 died... 16:22:14.454960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27579): Terminated: ok {rc=0} 16:22:14.501797 --- ParallelTerminationStrategy: PID 27582 died... 16:22:14.521902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27582): Terminated: ok {rc=0} 16:22:14.610414 bus /gobi_0: Setting Powered False 16:22:15.711156 bus /gobi_0: Setting Powered False 16:22:16.828697 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:22:17.984319 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:17.995870 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:22:18.078685 tst iperf3.py: using LAC 30049 16:22:18.222273 tst iperf3.py: using RAC 214 16:22:18.351781 tst iperf3.py: using CellId 30049 16:22:18.482591 tst iperf3.py: using BVCI 30050 16:22:18.604655 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:18.616107 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:18.627217 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:18.638720 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:18.650122 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:18.661542 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:18.673249 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:18.684567 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:18.696176 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:22:18.811871 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:22:19.020344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:19.331738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27584): Launched 16:22:19.604106 run iperf3-srv_10.42.42.10(pid=27585): Launched 16:22:19.721066 tst iperf3.py:8: start network... 16:22:19.926954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:20.440084 run create_hlr_db(pid=27586): Launched 16:22:20.568070 bus /gobi_6: Setting Powered False 16:22:21.632286 run create_hlr_db(pid=27586): Terminated: ok {rc=0} 16:22:22.091946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27588): Launched 16:22:22.425047 run osmo-hlr_10.42.42.2(pid=27589): Launched 16:22:22.551947 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:23.122729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27591): Launched 16:22:23.452908 run osmo-stp_10.42.42.5(pid=27592): Launched 16:22:23.579874 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:24.149976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27594): Launched 16:22:24.276275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:24.556694 run patchelf(pid=27595): Launched 16:22:24.740129 run osmo-stp_10.42.42.5(pid=27592): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27592)] 16:22:24.879359 run osmo-stp_10.42.42.5(pid=27592): stdout: | (launched: 2022-12-12_16:22:23.391310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:25.020119 run osmo-stp_10.42.42.5(pid=27592): stderr: | 20221212162223582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162223582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162223583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162223584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162223584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162223584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162223584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:25.160860 run osmo-stp_10.42.42.5(pid=27592): stdout: | (launched: 2022-12-12_16:22:23.391310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:25.296469 run osmo-stp_10.42.42.5(pid=27592): stderr: | 20221212162223582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162223582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162223583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162223584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162223584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162223584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162223584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:25.456081 run patchelf(pid=27595): Terminating (SIGINT) 16:22:25.639248 run patchelf(pid=27595): Terminated: ok {rc=0} 16:22:25.771463 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27592): Process ended prematurely: osmo-stp_10.42.42.5(pid=27592) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27592)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 16:22:25.781946 tst iperf3.py:8: Test FAILED (7.8 sec) 16:22:25.811106 run osmo-hlr_10.42.42.2(pid=27589): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27589)] 16:22:25.861358 run osmo-hlr_10.42.42.2(pid=27589): stdout: | (launched: 2022-12-12_16:22:22.363322) 16:22:25.913761 run osmo-hlr_10.42.42.2(pid=27589): stderr: | 20221212162222560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162222561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162222561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162222561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162222561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162222561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162222573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162222583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162222583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162222583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:25.966464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27584): Terminating (SIGTERM) 16:22:26.008620 run iperf3-srv_10.42.42.10(pid=27585): Terminating (SIGTERM) 16:22:26.051028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27588): Terminating (SIGTERM) 16:22:26.093583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27591): Terminating (SIGTERM) 16:22:26.136131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27594): Terminating (SIGTERM) 16:22:26.178562 --- ParallelTerminationStrategy: PID 27584 died... 16:22:26.198666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27584): Terminated: ok {rc=0} 16:22:26.246491 --- ParallelTerminationStrategy: PID 27585 died... 16:22:26.266270 run iperf3-srv_10.42.42.10(pid=27585): Terminated {rc=256} 16:22:26.312860 --- ParallelTerminationStrategy: PID 27588 died... 16:22:26.332796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27588): Terminated: ok {rc=0} 16:22:26.379192 --- ParallelTerminationStrategy: PID 27591 died... 16:22:26.398679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27591): Terminated: ok {rc=0} 16:22:26.445259 --- ParallelTerminationStrategy: PID 27594 died... 16:22:26.464804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27594): Terminated: ok {rc=0} 16:22:26.554290 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:22:27.706909 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:27.719011 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:22:27.777934 tst iperf3m4.py: using LAC 30050 16:22:27.900899 tst iperf3m4.py: using RAC 215 16:22:28.031742 tst iperf3m4.py: using CellId 30050 16:22:28.163596 tst iperf3m4.py: using BVCI 30051 16:22:28.284276 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:28.295995 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:28.307419 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:28.319609 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:28.331724 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:28.344080 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:28.356303 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:28.368175 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:28.380278 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:22:28.502325 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:22:28.625087 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:22:28.747808 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:22:28.868336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:22:29.090531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:29.423332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27596): Launched 16:22:29.711175 run iperf3-srv_10.42.42.10(pid=27597): Launched 16:22:29.834914 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:22:30.056542 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:30.390291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27598): Launched 16:22:30.679364 run iperf3-srv_10.42.42.10(pid=27599): Launched 16:22:30.822140 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:22:31.065470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:31.406433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27600): Launched 16:22:31.710750 run iperf3-srv_10.42.42.10(pid=27601): Launched 16:22:31.851066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:22:32.062178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:22:32.375924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27602): Launched 16:22:32.648109 run iperf3-srv_10.42.42.10(pid=27603): Launched 16:22:32.765171 tst iperf3m4.py:8: start network... 16:22:32.971551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:33.453615 run create_hlr_db(pid=27604): Launched 16:22:33.578265 bus /gobi_6: Setting Powered False 16:22:34.639468 run create_hlr_db(pid=27604): Terminated: ok {rc=0} 16:22:35.089585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27606): Launched 16:22:35.423463 run osmo-hlr_10.42.42.2(pid=27607): Launched 16:22:35.550482 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:36.121195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27609): Launched 16:22:36.454350 run osmo-stp_10.42.42.5(pid=27610): Launched 16:22:36.580022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:37.151539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27612): Launched 16:22:37.278959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:37.559880 run patchelf(pid=27613): Launched 16:22:37.743903 run osmo-stp_10.42.42.5(pid=27610): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27610)] 16:22:37.883808 run osmo-stp_10.42.42.5(pid=27610): stdout: | (launched: 2022-12-12_16:22:36.391899) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:38.025040 run osmo-stp_10.42.42.5(pid=27610): stderr: | 20221212162236583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162236583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162236583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162236584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162236584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162236584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162236584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:38.166611 run osmo-stp_10.42.42.5(pid=27610): stdout: | (launched: 2022-12-12_16:22:36.391899) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:38.303081 run osmo-stp_10.42.42.5(pid=27610): stderr: | 20221212162236583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162236583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162236583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162236584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162236584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162236584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162236584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:38.463485 run patchelf(pid=27613): Terminating (SIGINT) 16:22:38.647835 run patchelf(pid=27613): Terminated: ok {rc=0} 16:22:38.780397 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27610): Process ended prematurely: osmo-stp_10.42.42.5(pid=27610) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27610)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:22:38.790704 tst iperf3m4.py:8: Test FAILED (11.1 sec) 16:22:38.820080 run osmo-hlr_10.42.42.2(pid=27607): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27607)] 16:22:38.871347 run osmo-hlr_10.42.42.2(pid=27607): stdout: | (launched: 2022-12-12_16:22:35.361394) 16:22:38.924031 run osmo-hlr_10.42.42.2(pid=27607): stderr: | 20221212162235558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162235558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162235558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162235558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162235558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162235558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162235570 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162235580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162235580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162235580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:38.976788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27596): Terminating (SIGTERM) 16:22:39.019382 run iperf3-srv_10.42.42.10(pid=27597): Terminating (SIGTERM) 16:22:39.061983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27598): Terminating (SIGTERM) 16:22:39.104403 run iperf3-srv_10.42.42.10(pid=27599): Terminating (SIGTERM) 16:22:39.146809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27600): Terminating (SIGTERM) 16:22:39.189518 run iperf3-srv_10.42.42.10(pid=27601): Terminating (SIGTERM) 16:22:39.232126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27602): Terminating (SIGTERM) 16:22:39.274807 run iperf3-srv_10.42.42.10(pid=27603): Terminating (SIGTERM) 16:22:39.318524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27606): Terminating (SIGTERM) 16:22:39.361467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27609): Terminating (SIGTERM) 16:22:39.403845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27612): Terminating (SIGTERM) 16:22:39.446413 --- ParallelTerminationStrategy: PID 27596 died... 16:22:39.466637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27596): Terminated: ok {rc=0} 16:22:39.514030 --- ParallelTerminationStrategy: PID 27597 died... 16:22:39.533753 run iperf3-srv_10.42.42.10(pid=27597): Terminated {rc=256} 16:22:39.580549 --- ParallelTerminationStrategy: PID 27598 died... 16:22:39.600383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27598): Terminated: ok {rc=0} 16:22:39.647380 --- ParallelTerminationStrategy: PID 27599 died... 16:22:39.667228 run iperf3-srv_10.42.42.10(pid=27599): Terminated {rc=256} 16:22:39.713791 --- ParallelTerminationStrategy: PID 27600 died... 16:22:39.733453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27600): Terminated: ok {rc=0} 16:22:39.780130 --- ParallelTerminationStrategy: PID 27601 died... 16:22:39.799636 run iperf3-srv_10.42.42.10(pid=27601): Terminated {rc=256} 16:22:39.846431 --- ParallelTerminationStrategy: PID 27602 died... 16:22:39.866147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27602): Terminated: ok {rc=0} 16:22:39.912846 --- ParallelTerminationStrategy: PID 27603 died... 16:22:39.933059 run iperf3-srv_10.42.42.10(pid=27603): Terminated {rc=256} 16:22:39.979805 --- ParallelTerminationStrategy: PID 27606 died... 16:22:39.999517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27606): Terminated: ok {rc=0} 16:22:40.046335 --- ParallelTerminationStrategy: PID 27609 died... 16:22:40.066204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27609): Terminated: ok {rc=0} 16:22:40.113262 --- ParallelTerminationStrategy: PID 27612 died... 16:22:40.132860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27612): Terminated: ok {rc=0} 16:22:40.222327 bus /gobi_4: Setting Powered False 16:22:41.321775 bus /gobi_4: Setting Powered False 16:22:42.438148 bus /gobi_1: Setting Powered False 16:22:43.536029 bus /gobi_1: Setting Powered False 16:22:44.652718 bus /gobi_0: Setting Powered False 16:22:45.750349 bus /gobi_0: Setting Powered False 16:22:46.899424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:22:48.010390 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:48.021978 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:22:48.081633 tst ping.py: using LAC 30051 16:22:48.199180 tst ping.py: using RAC 216 16:22:48.327258 tst ping.py: using CellId 30051 16:22:48.452051 tst ping.py: using BVCI 30052 16:22:48.569661 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:48.581449 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:48.592729 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:48.604418 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:48.615956 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:48.627334 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:48.639092 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:48.650583 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:22:48.770092 tst ping.py:19: start network... 16:22:48.988847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:49.492848 run create_hlr_db(pid=27614): Launched 16:22:49.617283 bus /gobi_6: Setting Powered False 16:22:50.681408 run create_hlr_db(pid=27614): Terminated: ok {rc=0} 16:22:51.134532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27616): Launched 16:22:51.462007 run osmo-hlr_10.42.42.2(pid=27617): Launched 16:22:51.587239 run osmo-stp_10.42.42.5: Starting osmo-stp 16:22:52.147543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27619): Launched 16:22:52.473426 run osmo-stp_10.42.42.5(pid=27620): Launched 16:22:52.598802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:22:53.160129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27622): Launched 16:22:53.285985 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:22:53.561881 run patchelf(pid=27623): Launched 16:22:53.742240 run osmo-stp_10.42.42.5(pid=27620): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27620)] 16:22:53.878718 run osmo-stp_10.42.42.5(pid=27620): stdout: | (launched: 2022-12-12_16:22:52.412152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:54.017235 run osmo-stp_10.42.42.5(pid=27620): stderr: | 20221212162252602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162252602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162252602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162252602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162252603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162252603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162252603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:54.155434 run osmo-stp_10.42.42.5(pid=27620): stdout: | (launched: 2022-12-12_16:22:52.412152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:22:54.289191 run osmo-stp_10.42.42.5(pid=27620): stderr: | 20221212162252602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162252602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162252602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162252602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162252603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162252603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162252603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:22:54.446354 run patchelf(pid=27623): Terminating (SIGINT) 16:22:54.626802 run patchelf(pid=27623): Terminated: ok {rc=0} 16:22:54.756923 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27620): Process ended prematurely: osmo-stp_10.42.42.5(pid=27620) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27620)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 16:22:54.766914 tst ping.py:22: Test FAILED (6.7 sec) 16:22:54.795549 run osmo-hlr_10.42.42.2(pid=27617): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27617)] 16:22:54.845657 run osmo-hlr_10.42.42.2(pid=27617): stdout: | (launched: 2022-12-12_16:22:51.400767) 16:22:54.897437 run osmo-hlr_10.42.42.2(pid=27617): stderr: | 20221212162251596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162251596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162251596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162251596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162251596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162251596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162251608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162251618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162251618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162251618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:22:54.949773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27616): Terminating (SIGTERM) 16:22:54.991747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27619): Terminating (SIGTERM) 16:22:55.033939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27622): Terminating (SIGTERM) 16:22:55.076250 --- ParallelTerminationStrategy: PID 27616 died... 16:22:55.096355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27616): Terminated: ok {rc=0} 16:22:55.143177 --- ParallelTerminationStrategy: PID 27619 died... 16:22:55.162737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27619): Terminated: ok {rc=0} 16:22:55.209687 --- ParallelTerminationStrategy: PID 27622 died... 16:22:55.229524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27622): Terminated: ok {rc=0} 16:22:55.318366 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:22:56.406397 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:56.418499 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:22:56.476665 tst ping_idle_ping.py: using LAC 30052 16:22:56.599201 tst ping_idle_ping.py: using RAC 217 16:22:56.725542 tst ping_idle_ping.py: using CellId 30052 16:22:56.847032 tst ping_idle_ping.py: using BVCI 30053 16:22:56.958739 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:56.969738 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:56.980425 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:56.991183 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:57.001841 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:57.012722 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:57.023681 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:22:57.034375 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:22:57.149649 tst ping_idle_ping.py:24: start network... 16:22:57.352263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:22:57.825834 run create_hlr_db(pid=27624): Launched 16:22:57.950134 bus /gobi_6: Setting Powered False 16:22:59.011259 run create_hlr_db(pid=27624): Terminated: ok {rc=0} 16:22:59.436832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27626): Launched 16:22:59.743389 run osmo-hlr_10.42.42.2(pid=27627): Launched 16:22:59.858783 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:00.385818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27629): Launched 16:23:00.690673 run osmo-stp_10.42.42.5(pid=27630): Launched 16:23:00.866214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:23:01.450066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27632): Launched 16:23:01.580453 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:23:01.844726 run patchelf(pid=27633): Launched 16:23:02.044036 run osmo-stp_10.42.42.5(pid=27630): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27630)] 16:23:02.186764 run osmo-stp_10.42.42.5(pid=27630): stdout: | (launched: 2022-12-12_16:23:00.632763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:02.328616 run osmo-stp_10.42.42.5(pid=27630): stderr: | 20221212162300832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162300832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162300832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162300833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162300833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162300833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162300833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:02.468397 run osmo-stp_10.42.42.5(pid=27630): stdout: | (launched: 2022-12-12_16:23:00.632763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:02.603504 run osmo-stp_10.42.42.5(pid=27630): stderr: | 20221212162300832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162300832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162300832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162300833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162300833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162300833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162300833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:02.761686 run patchelf(pid=27633): Terminating (SIGINT) 16:23:02.943324 run patchelf(pid=27633): Terminated: ok {rc=0} 16:23:03.074237 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27630): Process ended prematurely: osmo-stp_10.42.42.5(pid=27630) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27630)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:23:03.084135 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:23:03.113183 run osmo-hlr_10.42.42.2(pid=27627): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27627)] 16:23:03.163991 run osmo-hlr_10.42.42.2(pid=27627): stdout: | (launched: 2022-12-12_16:22:59.685737) 16:23:03.216602 run osmo-hlr_10.42.42.2(pid=27627): stderr: | 20221212162259862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162259862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162259862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162259862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162259862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162259862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162259874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162259883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162259883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162259884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:03.269812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27626): Terminating (SIGTERM) 16:23:03.312576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27629): Terminating (SIGTERM) 16:23:03.355350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27632): Terminating (SIGTERM) 16:23:03.398590 --- ParallelTerminationStrategy: PID 27626 died... 16:23:03.419051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27626): Terminated: ok {rc=0} 16:23:03.466874 --- ParallelTerminationStrategy: PID 27629 died... 16:23:03.486912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27629): Terminated: ok {rc=0} 16:23:03.534470 --- ParallelTerminationStrategy: PID 27632 died... 16:23:03.554391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27632): Terminated: ok {rc=0} 16:23:03.644059 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:23:04.943959 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:23:04.951030 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:23:04.973635 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:23:05.013419 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:23:05.102048 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:23:05.123145 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:23:05.162611 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:23:05.756738 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:23:05.809871 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:05.821273 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:23:05.879551 tst cs_paging_gprs_active.py: using LAC 30053 16:23:06.010186 tst cs_paging_gprs_active.py: using RAC 218 16:23:06.138915 tst cs_paging_gprs_active.py: using CellId 30053 16:23:06.262375 tst cs_paging_gprs_active.py: using BVCI 30054 16:23:06.376233 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:06.387319 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:06.398054 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:06.408629 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:06.419186 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:06.429858 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:06.440628 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:06.451213 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:06.461986 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:23:06.582220 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:23:06.701268 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:23:06.909619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:23:07.221221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27637): Launched 16:23:07.491649 run iperf3-srv_10.42.42.10(pid=27638): Launched 16:23:07.609339 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:23:07.816527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:23:08.129101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27639): Launched 16:23:08.401242 run iperf3-srv_10.42.42.10(pid=27640): Launched 16:23:08.519717 tst cs_paging_gprs_active.py:38: start network... 16:23:08.727063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:09.209172 run create_hlr_db(pid=27641): Launched 16:23:09.337223 bus /gobi_6: Setting Powered False 16:23:10.399595 run create_hlr_db(pid=27641): Terminated: ok {rc=0} 16:23:10.832101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27643): Launched 16:23:11.146984 run osmo-hlr_10.42.42.2(pid=27644): Launched 16:23:11.264531 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:11.802791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27646): Launched 16:23:12.115633 run osmo-stp_10.42.42.5(pid=27647): Launched 16:23:12.235103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:23:12.770985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27649): Launched 16:23:12.890286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:23:13.153404 run patchelf(pid=27650): Launched 16:23:13.326269 run osmo-stp_10.42.42.5(pid=27647): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27647)] 16:23:13.456810 run osmo-stp_10.42.42.5(pid=27647): stdout: | (launched: 2022-12-12_16:23:12.056824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:13.589038 run osmo-stp_10.42.42.5(pid=27647): stderr: | 20221212162312229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162312229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162312229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162312230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162312230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162312230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162312230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:13.721490 run osmo-stp_10.42.42.5(pid=27647): stdout: | (launched: 2022-12-12_16:23:12.056824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:13.848249 run osmo-stp_10.42.42.5(pid=27647): stderr: | 20221212162312229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162312229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162312229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162312230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162312230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162312230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162312230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:14.000185 run patchelf(pid=27650): Terminating (SIGINT) 16:23:14.173221 run patchelf(pid=27650): Terminated: ok {rc=0} 16:23:14.298375 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27647): Process ended prematurely: osmo-stp_10.42.42.5(pid=27647) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27647)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:23:14.308105 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 16:23:14.335372 run osmo-hlr_10.42.42.2(pid=27644): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27644)] 16:23:14.383178 run osmo-hlr_10.42.42.2(pid=27644): stdout: | (launched: 2022-12-12_16:23:11.087129) 16:23:14.433422 run osmo-hlr_10.42.42.2(pid=27644): stderr: | 20221212162311265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162311265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162311265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162311266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162311266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162311266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162311278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162311286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162311286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162311286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:14.483172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27637): Terminating (SIGTERM) 16:23:14.522810 run iperf3-srv_10.42.42.10(pid=27638): Terminating (SIGTERM) 16:23:14.562459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27639): Terminating (SIGTERM) 16:23:14.602244 run iperf3-srv_10.42.42.10(pid=27640): Terminating (SIGTERM) 16:23:14.641887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27643): Terminating (SIGTERM) 16:23:14.681573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27646): Terminating (SIGTERM) 16:23:14.721256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27649): Terminating (SIGTERM) 16:23:14.761682 --- ParallelTerminationStrategy: PID 27637 died... 16:23:14.780665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27637): Terminated: ok {rc=0} 16:23:14.824721 --- ParallelTerminationStrategy: PID 27638 died... 16:23:14.843214 run iperf3-srv_10.42.42.10(pid=27638): Terminated {rc=256} 16:23:14.887277 --- ParallelTerminationStrategy: PID 27639 died... 16:23:14.905774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27639): Terminated: ok {rc=0} 16:23:14.949203 --- ParallelTerminationStrategy: PID 27640 died... 16:23:14.967487 run iperf3-srv_10.42.42.10(pid=27640): Terminated {rc=256} 16:23:15.011363 --- ParallelTerminationStrategy: PID 27643 died... 16:23:15.029911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27643): Terminated: ok {rc=0} 16:23:15.073575 --- ParallelTerminationStrategy: PID 27646 died... 16:23:15.092075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27646): Terminated: ok {rc=0} 16:23:15.135625 --- ParallelTerminationStrategy: PID 27649 died... 16:23:15.154195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27649): Terminated: ok {rc=0} 16:23:15.240013 bus /gobi_0: Setting Powered False 16:23:16.362371 bus /gobi_0: Setting Powered False 16:23:17.497930 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:23:18.645172 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:18.656710 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:23:18.716301 tst iperf3.py: using LAC 30054 16:23:18.838632 tst iperf3.py: using RAC 219 16:23:18.968095 tst iperf3.py: using CellId 30054 16:23:19.096385 tst iperf3.py: using BVCI 30055 16:23:19.215909 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:19.227507 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:19.239143 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:19.250736 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:19.262085 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:19.273564 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:19.285333 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:19.296471 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:19.308091 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:23:19.424541 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:23:19.631156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:23:19.941733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27651): Launched 16:23:20.212712 run iperf3-srv_10.42.42.10(pid=27652): Launched 16:23:20.329784 tst iperf3.py:8: start network... 16:23:20.536619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:21.016253 run create_hlr_db(pid=27653): Launched 16:23:21.145922 bus /gobi_6: Setting Powered False 16:23:22.206908 run create_hlr_db(pid=27653): Terminated: ok {rc=0} 16:23:22.638725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27655): Launched 16:23:22.950623 run osmo-hlr_10.42.42.2(pid=27656): Launched 16:23:23.068740 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:23.601535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27658): Launched 16:23:23.913657 run osmo-stp_10.42.42.5(pid=27659): Launched 16:23:24.031232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:23:24.565903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27661): Launched 16:23:24.683678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:23:24.946591 run patchelf(pid=27662): Launched 16:23:25.118752 run osmo-stp_10.42.42.5(pid=27659): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27659)] 16:23:25.248922 run osmo-stp_10.42.42.5(pid=27659): stdout: | (launched: 2022-12-12_16:23:23.854201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:25.381086 run osmo-stp_10.42.42.5(pid=27659): stderr: | 20221212162324026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162324026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162324026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162324027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162324027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162324027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162324027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:25.513236 run osmo-stp_10.42.42.5(pid=27659): stdout: | (launched: 2022-12-12_16:23:23.854201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:25.639175 run osmo-stp_10.42.42.5(pid=27659): stderr: | 20221212162324026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162324026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162324026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162324027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162324027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162324027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162324027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:25.788687 run patchelf(pid=27662): Terminating (SIGINT) 16:23:25.960860 run patchelf(pid=27662): Terminated: ok {rc=0} 16:23:26.085300 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27659): Process ended prematurely: osmo-stp_10.42.42.5(pid=27659) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27659)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 16:23:26.095157 tst iperf3.py:8: Test FAILED (7.5 sec) 16:23:26.122303 run osmo-hlr_10.42.42.2(pid=27656): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27656)] 16:23:26.170096 run osmo-hlr_10.42.42.2(pid=27656): stdout: | (launched: 2022-12-12_16:23:22.892033) 16:23:26.219574 run osmo-hlr_10.42.42.2(pid=27656): stderr: | 20221212162323071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162323071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162323071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162323071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162323071 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162323071 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162323084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162323093 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162323093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162323093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:26.269574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27651): Terminating (SIGTERM) 16:23:26.309412 run iperf3-srv_10.42.42.10(pid=27652): Terminating (SIGTERM) 16:23:26.349031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27655): Terminating (SIGTERM) 16:23:26.388758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27658): Terminating (SIGTERM) 16:23:26.428512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27661): Terminating (SIGTERM) 16:23:26.468270 --- ParallelTerminationStrategy: PID 27651 died... 16:23:26.487389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27651): Terminated: ok {rc=0} 16:23:26.532366 --- ParallelTerminationStrategy: PID 27652 died... 16:23:26.551085 run iperf3-srv_10.42.42.10(pid=27652): Terminated {rc=256} 16:23:26.594619 --- ParallelTerminationStrategy: PID 27655 died... 16:23:26.613120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27655): Terminated: ok {rc=0} 16:23:26.656690 --- ParallelTerminationStrategy: PID 27658 died... 16:23:26.675550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27658): Terminated: ok {rc=0} 16:23:26.719315 --- ParallelTerminationStrategy: PID 27661 died... 16:23:26.737901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27661): Terminated: ok {rc=0} 16:23:26.824165 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:23:27.973349 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:27.984889 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:23:28.043775 tst iperf3m4.py: using LAC 30055 16:23:28.165678 tst iperf3m4.py: using RAC 220 16:23:28.287711 tst iperf3m4.py: using CellId 30055 16:23:28.419893 tst iperf3m4.py: using BVCI 30056 16:23:28.540699 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:28.552480 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:28.563884 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:28.575919 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:28.588027 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:28.599934 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:28.611962 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:28.623855 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:28.636052 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:23:28.756331 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:23:28.875283 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:23:28.996597 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:23:29.114639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:23:29.321808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:23:29.633935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27663): Launched 16:23:29.905707 run iperf3-srv_10.42.42.10(pid=27664): Launched 16:23:30.021184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:23:30.227116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:23:30.538357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27665): Launched 16:23:30.817699 run iperf3-srv_10.42.42.10(pid=27666): Launched 16:23:30.975289 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:23:31.214168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:23:31.558540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27667): Launched 16:23:31.860731 run iperf3-srv_10.42.42.10(pid=27668): Launched 16:23:32.002622 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:23:32.250647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:23:32.564616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27669): Launched 16:23:32.837123 run iperf3-srv_10.42.42.10(pid=27670): Launched 16:23:32.952115 tst iperf3m4.py:8: start network... 16:23:33.157953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:33.639919 run create_hlr_db(pid=27671): Launched 16:23:33.767071 bus /gobi_6: Setting Powered False 16:23:34.828209 run create_hlr_db(pid=27671): Terminated: ok {rc=0} 16:23:35.279674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27673): Launched 16:23:35.613148 run osmo-hlr_10.42.42.2(pid=27674): Launched 16:23:35.742064 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:36.314726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27676): Launched 16:23:36.631091 run osmo-stp_10.42.42.5(pid=27677): Launched 16:23:36.750393 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:23:37.282113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27679): Launched 16:23:37.399436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:23:37.663007 run patchelf(pid=27680): Launched 16:23:37.835972 run osmo-stp_10.42.42.5(pid=27677): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27677)] 16:23:37.965988 run osmo-stp_10.42.42.5(pid=27677): stdout: | (launched: 2022-12-12_16:23:36.571650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:38.097908 run osmo-stp_10.42.42.5(pid=27677): stderr: | 20221212162336746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162336746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162336746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162336747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162336747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162336747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162336747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:38.229897 run osmo-stp_10.42.42.5(pid=27677): stdout: | (launched: 2022-12-12_16:23:36.571650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:38.355875 run osmo-stp_10.42.42.5(pid=27677): stderr: | 20221212162336746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162336746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162336746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162336747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162336747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162336747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162336747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:38.505359 run patchelf(pid=27680): Terminating (SIGINT) 16:23:38.678695 run patchelf(pid=27680): Terminated: ok {rc=0} 16:23:38.802872 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27677): Process ended prematurely: osmo-stp_10.42.42.5(pid=27677) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27677)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:23:38.812481 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:23:38.840111 run osmo-hlr_10.42.42.2(pid=27674): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27674)] 16:23:38.887738 run osmo-hlr_10.42.42.2(pid=27674): stdout: | (launched: 2022-12-12_16:23:35.551147) 16:23:38.937133 run osmo-hlr_10.42.42.2(pid=27674): stderr: | 20221212162335747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162335747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162335747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162335747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162335747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162335747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162335762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162335773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162335773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162335773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:38.986734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27663): Terminating (SIGTERM) 16:23:39.026603 run iperf3-srv_10.42.42.10(pid=27664): Terminating (SIGTERM) 16:23:39.066487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27665): Terminating (SIGTERM) 16:23:39.106569 run iperf3-srv_10.42.42.10(pid=27666): Terminating (SIGTERM) 16:23:39.146455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27667): Terminating (SIGTERM) 16:23:39.186321 run iperf3-srv_10.42.42.10(pid=27668): Terminating (SIGTERM) 16:23:39.226096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27669): Terminating (SIGTERM) 16:23:39.265773 run iperf3-srv_10.42.42.10(pid=27670): Terminating (SIGTERM) 16:23:39.305402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27673): Terminating (SIGTERM) 16:23:39.345271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27676): Terminating (SIGTERM) 16:23:39.385538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27679): Terminating (SIGTERM) 16:23:39.425725 --- ParallelTerminationStrategy: PID 27663 died... 16:23:39.445028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27663): Terminated: ok {rc=0} 16:23:39.489169 --- ParallelTerminationStrategy: PID 27664 died... 16:23:39.507657 run iperf3-srv_10.42.42.10(pid=27664): Terminated {rc=256} 16:23:39.551490 --- ParallelTerminationStrategy: PID 27665 died... 16:23:39.570179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27665): Terminated: ok {rc=0} 16:23:39.614803 --- ParallelTerminationStrategy: PID 27666 died... 16:23:39.633320 run iperf3-srv_10.42.42.10(pid=27666): Terminated {rc=256} 16:23:39.677184 --- ParallelTerminationStrategy: PID 27667 died... 16:23:39.695529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27667): Terminated: ok {rc=0} 16:23:39.739115 --- ParallelTerminationStrategy: PID 27668 died... 16:23:39.757450 run iperf3-srv_10.42.42.10(pid=27668): Terminated {rc=256} 16:23:39.800779 --- ParallelTerminationStrategy: PID 27669 died... 16:23:39.819248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27669): Terminated: ok {rc=0} 16:23:39.862741 --- ParallelTerminationStrategy: PID 27670 died... 16:23:39.881134 run iperf3-srv_10.42.42.10(pid=27670): Terminated {rc=256} 16:23:39.924500 --- ParallelTerminationStrategy: PID 27673 died... 16:23:39.943135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27673): Terminated: ok {rc=0} 16:23:39.987537 --- ParallelTerminationStrategy: PID 27676 died... 16:23:40.006073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27676): Terminated: ok {rc=0} 16:23:40.049522 --- ParallelTerminationStrategy: PID 27679 died... 16:23:40.067971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27679): Terminated: ok {rc=0} 16:23:40.154090 bus /gobi_4: Setting Powered False 16:23:41.254840 bus /gobi_4: Setting Powered False 16:23:42.367076 bus /gobi_1: Setting Powered False 16:23:43.465472 bus /gobi_1: Setting Powered False 16:23:44.583147 bus /gobi_0: Setting Powered False 16:23:45.682603 bus /gobi_0: Setting Powered False 16:23:46.816288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:23:47.953305 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:47.970349 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:23:48.049067 tst ping.py: using LAC 30056 16:23:48.199484 tst ping.py: using RAC 221 16:23:48.330487 tst ping.py: using CellId 30056 16:23:48.459178 tst ping.py: using BVCI 30057 16:23:48.580246 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:48.593051 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:48.605544 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:48.618916 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:48.631919 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:48.645684 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:48.658814 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:48.673449 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:23:48.797043 tst ping.py:19: start network... 16:23:49.022101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:49.536200 run create_hlr_db(pid=27950): Launched 16:23:49.700124 bus /gobi_6: Setting Powered False 16:23:50.765129 run create_hlr_db(pid=27950): Terminated: ok {rc=0} 16:23:51.229808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27954): Launched 16:23:51.571641 run osmo-hlr_10.42.42.2(pid=27955): Launched 16:23:51.820227 run osmo-stp_10.42.42.5: Starting osmo-stp 16:23:52.495544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27957): Launched 16:23:52.817568 run osmo-stp_10.42.42.5(pid=27958): Launched 16:23:53.052567 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:23:53.723872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27960): Launched 16:23:53.853708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:23:54.117155 run patchelf(pid=27961): Launched 16:23:54.302979 run osmo-stp_10.42.42.5(pid=27958): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27958)] 16:23:54.433950 run osmo-stp_10.42.42.5(pid=27958): stdout: | (launched: 2022-12-12_16:23:52.758831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:54.567320 run osmo-stp_10.42.42.5(pid=27958): stderr: | 20221212162353080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162353080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162353080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162353081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162353081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162353081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162353081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:54.700925 run osmo-stp_10.42.42.5(pid=27958): stdout: | (launched: 2022-12-12_16:23:52.758831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:23:54.829096 run osmo-stp_10.42.42.5(pid=27958): stderr: | 20221212162353080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162353080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162353080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162353081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162353081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162353081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162353081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:23:54.979775 run patchelf(pid=27961): Terminating (SIGINT) 16:23:55.152105 run patchelf(pid=27961): Terminated: ok {rc=0} 16:23:55.276755 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27958): Process ended prematurely: osmo-stp_10.42.42.5(pid=27958) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27958)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 16:23:55.287308 tst ping.py:22: Test FAILED (7.3 sec) 16:23:55.315662 run osmo-hlr_10.42.42.2(pid=27955): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27955)] 16:23:55.365345 run osmo-hlr_10.42.42.2(pid=27955): stdout: | (launched: 2022-12-12_16:23:51.510278) 16:23:55.416632 run osmo-hlr_10.42.42.2(pid=27955): stderr: | 20221212162351827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162351827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162351827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162351827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162351827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162351827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162351839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162351851 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162351852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162351852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:23:55.468689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27954): Terminating (SIGTERM) 16:23:55.510873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27957): Terminating (SIGTERM) 16:23:55.554690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27960): Terminating (SIGTERM) 16:23:55.599639 --- ParallelTerminationStrategy: PID 27954 died... 16:23:55.620084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27954): Terminated: ok {rc=0} 16:23:55.667946 --- ParallelTerminationStrategy: PID 27957 died... 16:23:55.688027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27957): Terminated: ok {rc=0} 16:23:55.734051 --- ParallelTerminationStrategy: PID 27960 died... 16:23:55.754024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27960): Terminated: ok {rc=0} 16:23:55.842263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:23:56.933058 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:56.945969 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:23:57.006629 tst ping_idle_ping.py: using LAC 30057 16:23:57.130245 tst ping_idle_ping.py: using RAC 222 16:23:57.254619 tst ping_idle_ping.py: using CellId 30057 16:23:57.377976 tst ping_idle_ping.py: using BVCI 30058 16:23:57.494860 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:57.507194 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:57.520101 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:57.543481 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:57.572118 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:57.599396 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:57.629230 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:23:57.646780 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:23:57.867488 tst ping_idle_ping.py:24: start network... 16:23:58.076398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:23:58.571894 run create_hlr_db(pid=27962): Launched 16:23:58.702155 bus /gobi_6: Setting Powered False 16:23:59.768278 run create_hlr_db(pid=27962): Terminated: ok {rc=0} 16:24:00.237098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27964): Launched 16:24:00.585909 run osmo-hlr_10.42.42.2(pid=27965): Launched 16:24:00.853139 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:01.669179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27967): Launched 16:24:02.100736 run osmo-stp_10.42.42.5(pid=27968): Launched 16:24:02.325651 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:24:03.003546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27970): Launched 16:24:03.150375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:24:03.421693 run patchelf(pid=27971): Launched 16:24:03.630477 run osmo-stp_10.42.42.5(pid=27968): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27968)] 16:24:03.777255 run osmo-stp_10.42.42.5(pid=27968): stdout: | (launched: 2022-12-12_16:24:02.030102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:03.922650 run osmo-stp_10.42.42.5(pid=27968): stderr: | 20221212162402393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162402393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162402393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162402393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162402394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162402394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162402394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:04.067826 run osmo-stp_10.42.42.5(pid=27968): stdout: | (launched: 2022-12-12_16:24:02.030102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:04.207667 run osmo-stp_10.42.42.5(pid=27968): stderr: | 20221212162402393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162402393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162402393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162402393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162402394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162402394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162402394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:04.374011 run patchelf(pid=27971): Terminating (SIGINT) 16:24:04.562927 run patchelf(pid=27971): Terminated: ok {rc=0} 16:24:04.700730 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27968): Process ended prematurely: osmo-stp_10.42.42.5(pid=27968) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27968)] [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:24:04.711827 tst ping_idle_ping.py:27: Test FAILED (7.8 sec) 16:24:04.745758 run osmo-hlr_10.42.42.2(pid=27965): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27965)] 16:24:04.799443 run osmo-hlr_10.42.42.2(pid=27965): stdout: | (launched: 2022-12-12_16:24:00.523893) 16:24:04.855051 run osmo-hlr_10.42.42.2(pid=27965): stderr: | 20221212162400850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162400850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162400850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162400850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162400850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162400850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162400872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162400880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162400880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162400885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:04.911245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27964): Terminating (SIGTERM) 16:24:04.958158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27967): Terminating (SIGTERM) 16:24:05.006497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27970): Terminating (SIGTERM) 16:24:05.054101 --- ParallelTerminationStrategy: PID 27964 died... 16:24:05.075179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27964): Terminated: ok {rc=0} 16:24:05.127990 --- ParallelTerminationStrategy: PID 27967 died... 16:24:05.149154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27967): Terminated: ok {rc=0} 16:24:05.199425 --- ParallelTerminationStrategy: PID 27970 died... 16:24:05.220775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27970): Terminated: ok {rc=0} 16:24:05.316009 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:24:06.619484 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:06.627982 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:24:06.653489 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:24:06.693588 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:24:06.750874 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:24:06.773253 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:24:06.813051 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:24:07.369127 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:24:07.376321 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:24:07.389127 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:24:07.453403 tst switch_tch_pdch.py: using LAC 30058 16:24:07.586787 tst switch_tch_pdch.py: using RAC 223 16:24:07.718012 tst switch_tch_pdch.py: using CellId 30058 16:24:07.847722 tst switch_tch_pdch.py: using BVCI 30059 16:24:07.971619 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:24:07.984430 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:24:07.998208 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:24:08.012894 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:24:08.025501 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:24:08.040060 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:24:08.054069 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:24:08.068127 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:24:08.195920 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:24:08.324382 tst switch_tch_pdch.py:51: start network... 16:24:08.552409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:09.075606 run create_hlr_db(pid=27975): Launched 16:24:09.242315 bus /gobi_6: Setting Powered False 16:24:10.308119 run create_hlr_db(pid=27975): Terminated: ok {rc=0} 16:24:10.754323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27978): Launched 16:24:11.059405 run osmo-hlr_10.42.42.2(pid=27979): Launched 16:24:11.175311 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:11.698294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27981): Launched 16:24:12.002224 run osmo-stp_10.42.42.5(pid=27982): Launched 16:24:12.118678 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:24:12.643569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27984): Launched 16:24:12.760784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:24:13.018802 run patchelf(pid=27985): Launched 16:24:13.187969 run osmo-stp_10.42.42.5(pid=27982): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27982)] 16:24:13.315821 run osmo-stp_10.42.42.5(pid=27982): stdout: | (launched: 2022-12-12_16:24:11.944618) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:13.445836 run osmo-stp_10.42.42.5(pid=27982): stderr: | 20221212162412115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162412115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162412115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162412116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162412117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162412117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162412117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:13.575443 run osmo-stp_10.42.42.5(pid=27982): stdout: | (launched: 2022-12-12_16:24:11.944618) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:13.699226 run osmo-stp_10.42.42.5(pid=27982): stderr: | 20221212162412115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162412115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162412115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162412116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162412117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162412117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162412117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:13.846217 run patchelf(pid=27985): Terminating (SIGINT) 16:24:14.015405 run patchelf(pid=27985): Terminated: ok {rc=0} 16:24:14.137159 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27982): Process ended prematurely: osmo-stp_10.42.42.5(pid=27982) [trial-2379↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27982)] [trial-2379↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:24:14.146090 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 16:24:14.172544 run osmo-hlr_10.42.42.2(pid=27979): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27979)] 16:24:14.219965 run osmo-hlr_10.42.42.2(pid=27979): stdout: | (launched: 2022-12-12_16:24:11.001742) 16:24:14.269133 run osmo-hlr_10.42.42.2(pid=27979): stderr: | 20221212162411178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162411178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162411178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162411178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162411178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162411178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162411191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162411200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162411200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162411200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:14.318557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27978): Terminating (SIGTERM) 16:24:14.358210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27981): Terminating (SIGTERM) 16:24:14.397874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27984): Terminating (SIGTERM) 16:24:14.437635 --- ParallelTerminationStrategy: PID 27978 died... 16:24:14.456497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27978): Terminated: ok {rc=0} 16:24:14.500552 --- ParallelTerminationStrategy: PID 27981 died... 16:24:14.519030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27981): Terminated: ok {rc=0} 16:24:14.562350 --- ParallelTerminationStrategy: PID 27984 died... 16:24:14.580644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27984): Terminated: ok {rc=0} 16:24:14.665512 bus /gobi_0: Setting Powered False 16:24:15.767130 bus /gobi_0: Setting Powered False 16:24:16.891604 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:24:18.126467 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:18.132205 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:24:18.152812 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:24:18.187606 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:24:18.241912 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:24:18.263004 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:24:18.297202 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:24:18.849970 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:24:18.855029 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:24:18.866004 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:24:18.921224 tst switch_tch_pdch.py: using LAC 30059 16:24:19.039786 tst switch_tch_pdch.py: using RAC 224 16:24:19.159562 tst switch_tch_pdch.py: using CellId 30059 16:24:19.277977 tst switch_tch_pdch.py: using BVCI 30060 16:24:19.388775 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:24:19.399849 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:24:19.410618 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:24:19.421390 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:24:19.432003 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:24:19.442719 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:24:19.453683 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:24:19.464393 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:24:19.581381 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:24:19.699694 tst switch_tch_pdch.py:51: start network... 16:24:19.917865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:20.393978 run create_hlr_db(pid=27990): Launched 16:24:20.520075 bus /gobi_6: Setting Powered False 16:24:21.583928 run create_hlr_db(pid=27990): Terminated: ok {rc=0} 16:24:21.991789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27992): Launched 16:24:22.297676 run osmo-hlr_10.42.42.2(pid=27993): Launched 16:24:22.414108 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:22.910796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27995): Launched 16:24:23.216370 run osmo-stp_10.42.42.5(pid=27996): Launched 16:24:23.332522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:24:23.830345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27998): Launched 16:24:23.945679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:24:24.202878 run patchelf(pid=27999): Launched 16:24:24.372134 run osmo-stp_10.42.42.5(pid=27996): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27996)] 16:24:24.499991 run osmo-stp_10.42.42.5(pid=27996): stdout: | (launched: 2022-12-12_16:24:23.158830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:24.629430 run osmo-stp_10.42.42.5(pid=27996): stderr: | 20221212162423330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162423331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162423331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162423331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162423332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162423332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162423332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:24.758793 run osmo-stp_10.42.42.5(pid=27996): stdout: | (launched: 2022-12-12_16:24:23.158830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:24.882681 run osmo-stp_10.42.42.5(pid=27996): stderr: | 20221212162423330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162423331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162423331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162423331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162423332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162423332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162423332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:25.030346 run patchelf(pid=27999): Terminating (SIGINT) 16:24:25.198757 run patchelf(pid=27999): Terminated: ok {rc=0} 16:24:25.320395 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27996): Process ended prematurely: osmo-stp_10.42.42.5(pid=27996) [trial-2379↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27996)] [trial-2379↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:24:25.329564 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:24:25.355916 run osmo-hlr_10.42.42.2(pid=27993): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27993)] 16:24:25.403272 run osmo-hlr_10.42.42.2(pid=27993): stdout: | (launched: 2022-12-12_16:24:22.240267) 16:24:25.452428 run osmo-hlr_10.42.42.2(pid=27993): stderr: | 20221212162422416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162422416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162422416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162422416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162422416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162422416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162422428 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162422437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162422437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162422437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:25.501944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27992): Terminating (SIGTERM) 16:24:25.541848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27995): Terminating (SIGTERM) 16:24:25.581596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27998): Terminating (SIGTERM) 16:24:25.621449 --- ParallelTerminationStrategy: PID 27992 died... 16:24:25.640345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27992): Terminated: ok {rc=0} 16:24:25.685825 --- ParallelTerminationStrategy: PID 27995 died... 16:24:25.704280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27995): Terminated: ok {rc=0} 16:24:25.748221 --- ParallelTerminationStrategy: PID 27998 died... 16:24:25.766936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27998): Terminated: ok {rc=0} 16:24:25.850295 bus /gobi_0: Setting Powered False 16:24:26.945880 bus /gobi_0: Setting Powered False 16:24:28.060885 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_sms:trx-b200 --------------------------------------------------------------------- 16:24:29.293188 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:29.297462 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 16:24:29.330674 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 16:24:29.337429 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 16:24:29.390229 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 16:24:29.423525 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 16:24:29.430195 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 16:24:29.969235 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 16:24:29.974506 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 16:24:29.985333 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 16:24:30.036770 tst mo_mt_sms.py: using LAC 30060 16:24:30.156426 tst mo_mt_sms.py: using RAC 225 16:24:30.273914 tst mo_mt_sms.py: using CellId 30060 16:24:30.391565 tst mo_mt_sms.py: using BVCI 30061 16:24:30.501491 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 16:24:30.615453 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 16:24:30.731122 tst mo_mt_sms.py:9: start nitb and bts... 16:24:30.945817 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:24:31.585116 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28003): Launched 16:24:31.935860 run osmo-nitb_10.42.42.2(pid=28004): Launched 16:24:32.138093 run osmo-nitb_10.42.42.2(pid=28004): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28004)] 16:24:32.286722 run osmo-nitb_10.42.42.2(pid=28004): stdout: | (launched: 2022-12-12_16:24:31.875081) 16:24:32.434421 run osmo-nitb_10.42.42.2(pid=28004): stderr: | (launched: 2022-12-12_16:24:31.924358) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:24:32.581160 run osmo-nitb_10.42.42.2(pid=28004): stdout: | (launched: 2022-12-12_16:24:31.875081) 16:24:32.723657 run osmo-nitb_10.42.42.2(pid=28004): stderr: | (launched: 2022-12-12_16:24:31.924358) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28004): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28004) [trial-2379↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28004)] 16:24:33.080503 tst osmo-nitb_10.42.42.2(pid=28004): stdout: | (launched: 2022-12-12_16:24:31.875081) 16:24:33.211441 tst osmo-nitb_10.42.42.2(pid=28004): stderr: | (launched: 2022-12-12_16:24:31.924358) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:24:33.366301 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28004): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28004) [trial-2379↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28004)] [trial-2379↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 16:24:33.375738 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 16:24:33.383164 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28003): Terminating (SIGTERM) 16:24:33.595226 --- ParallelTerminationStrategy: PID 28003 died... 16:24:33.617331 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28003): Terminated: ok {rc=0} 16:24:33.707035 bus /sierra_3: Setting Powered False 16:24:34.810785 bus /sierra_3: Setting Powered False 16:24:35.927958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 sms:trx-b200 --------------------------------------------------------------------- 16:24:37.127437 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:37.131553 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 16:24:37.164831 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 16:24:37.191541 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 16:24:37.243235 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 16:24:37.275863 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 16:24:37.302222 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 16:24:37.852688 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 16:24:37.859016 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:37.870062 tst sms:trx-b200: Using 1 x bts (candidates: 1) 16:24:37.917195 tst mo_mt_sms.py: using LAC 30061 16:24:38.048858 tst mo_mt_sms.py: using RAC 226 16:24:38.167138 tst mo_mt_sms.py: using CellId 30061 16:24:38.284142 tst mo_mt_sms.py: using BVCI 30062 16:24:38.393643 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:38.404183 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:38.414616 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:38.424898 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:38.435286 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:38.445654 tst sms:trx-b200: Using 1 x modem (candidates: 2) 16:24:38.565540 tst sms:trx-b200: Using 1 x modem (candidates: 2) 16:24:38.681137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:39.153958 run create_hlr_db(pid=28008): Launched 16:24:39.279607 bus /sierra_2: Setting Powered False 16:24:40.339782 run create_hlr_db(pid=28008): Terminated: ok {rc=0} 16:24:40.783967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28010): Launched 16:24:41.111708 run osmo-hlr_10.42.42.2(pid=28011): Launched 16:24:41.236546 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:41.793451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28013): Launched 16:24:42.120056 run osmo-stp_10.42.42.5(pid=28014): Launched 16:24:42.242810 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:42.831251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28016): Launched 16:24:43.156007 run osmo-msc_10.42.42.6(pid=28017): Launched 16:24:43.337361 run osmo-stp_10.42.42.5(pid=28014): ERR: Terminated: ERROR {rc=1} [trial-2379↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28014)] 16:24:43.474525 run osmo-stp_10.42.42.5(pid=28014): stdout: | (launched: 2022-12-12_16:24:42.059205) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:43.611660 run osmo-stp_10.42.42.5(pid=28014): stderr: | 20221212162442248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162442248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162442249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162442249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162442249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162442250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162442250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:43.747371 run osmo-stp_10.42.42.5(pid=28014): stdout: | (launched: 2022-12-12_16:24:42.059205) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:43.876019 run osmo-stp_10.42.42.5(pid=28014): stderr: | 20221212162442248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162442248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162442249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162442249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162442249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162442250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162442250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:24:44.030344 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28014): Process ended prematurely: osmo-stp_10.42.42.5(pid=28014) [trial-2379↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28014)] [trial-2379↪sms:trx-b200↪mo_mt_sms.py:16] 16:24:44.039557 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 16:24:44.067686 run osmo-hlr_10.42.42.2(pid=28011): ERR: Terminated: ERROR {rc=237} [trial-2379↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28011)] 16:24:44.118555 run osmo-hlr_10.42.42.2(pid=28011): stdout: | (launched: 2022-12-12_16:24:41.050504) 16:24:44.170809 run osmo-hlr_10.42.42.2(pid=28011): stderr: | 20221212162441246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162441246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162441246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162441246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162441246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162441246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162441258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162441268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162441268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162441268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:24:44.244154 run osmo-msc_10.42.42.6(pid=28017): ERR: Terminated: ERROR {rc=2} [trial-2379↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28017)] 16:24:44.295194 run osmo-msc_10.42.42.6(pid=28017): stdout: | (launched: 2022-12-12_16:24:43.095460) 16:24:44.347482 run osmo-msc_10.42.42.6(pid=28017): stderr: | 20221212162443413 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162443414 DLGLOBAL DEBUG validating counter group 0x7f7372122c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162443414 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162443414 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162443414 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162443414 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162443416 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162443416 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162443416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162443416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:24:44.400002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28010): Terminating (SIGTERM) 16:24:44.442214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28013): Terminating (SIGTERM) 16:24:44.484893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28016): Terminating (SIGTERM) 16:24:44.527622 --- ParallelTerminationStrategy: PID 28010 died... 16:24:44.548026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28010): Terminated: ok {rc=0} 16:24:44.595388 --- ParallelTerminationStrategy: PID 28013 died... 16:24:44.615243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28013): Terminated: ok {rc=0} 16:24:44.662256 --- ParallelTerminationStrategy: PID 28016 died... 16:24:44.681997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28016): Terminated: ok {rc=0} 16:24:44.770855 bus /sierra_3: Setting Powered False 16:24:45.870495 bus /sierra_3: Setting Powered False 16:24:47.002368 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-b200 --------------------------------------------------------------------- 16:24:48.246768 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:48.250920 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 16:24:48.286193 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 16:24:48.293291 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 16:24:48.328840 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 16:24:48.363596 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 16:24:48.370643 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 16:24:48.890391 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 16:24:48.895585 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 16:24:48.906828 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 16:24:48.955441 tst assert_extension.py: using LAC 30062 16:24:49.080173 tst assert_extension.py: using RAC 227 16:24:49.203347 tst assert_extension.py: using CellId 30062 16:24:49.322591 tst assert_extension.py: using BVCI 30063 16:24:49.434224 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 16:24:49.547055 tst assert_extension.py:10: start nitb and bts... 16:24:49.749695 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:24:50.371616 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28022): Launched 16:24:50.677315 run osmo-nitb_10.42.42.2(pid=28023): Launched 16:24:50.846585 run osmo-nitb_10.42.42.2(pid=28023): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28023)] 16:24:50.982351 run osmo-nitb_10.42.42.2(pid=28023): stdout: | (launched: 2022-12-12_16:24:50.619797) 16:24:51.119515 run osmo-nitb_10.42.42.2(pid=28023): stderr: | (launched: 2022-12-12_16:24:50.664751) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:24:51.259104 run osmo-nitb_10.42.42.2(pid=28023): stdout: | (launched: 2022-12-12_16:24:50.619797) 16:24:51.391012 run osmo-nitb_10.42.42.2(pid=28023): stderr: | (launched: 2022-12-12_16:24:50.664751) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28023) [trial-2379↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28023)] 16:24:51.793850 tst osmo-nitb_10.42.42.2(pid=28023): stdout: | (launched: 2022-12-12_16:24:50.619797) 16:24:51.915516 tst osmo-nitb_10.42.42.2(pid=28023): stderr: | (launched: 2022-12-12_16:24:50.664751) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:24:52.059422 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28023) [trial-2379↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28023)] [trial-2379↪nitb_ussd:trx-b200↪assert_extension.py:12] 16:24:52.068140 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:24:52.075056 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28022): Terminating (SIGTERM) 16:24:52.284360 --- ParallelTerminationStrategy: PID 28022 died... 16:24:52.305110 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28022): Terminated: ok {rc=0} 16:24:52.392366 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 ussd:trx-b200 --------------------------------------------------------------------- 16:24:53.569902 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:24:53.574044 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 16:24:53.607255 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 16:24:53.634027 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 16:24:53.669798 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 16:24:53.702834 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 16:24:53.729404 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 16:24:54.257875 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 ussd:trx-b200 assert_extension.py ---------------------------------------------- 16:24:54.263165 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:54.273954 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 16:24:54.321061 tst assert_extension.py: using LAC 30063 16:24:54.449656 tst assert_extension.py: using RAC 228 16:24:54.577147 tst assert_extension.py: using CellId 30063 16:24:54.696751 tst assert_extension.py: using BVCI 30064 16:24:54.808179 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:54.819008 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:54.829792 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:54.840584 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:54.851414 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 16:24:54.862086 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 16:24:54.976837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:24:55.448335 run create_hlr_db(pid=28027): Launched 16:24:55.573120 bus /sierra_2: Setting Powered False 16:24:56.633186 run create_hlr_db(pid=28027): Terminated: ok {rc=0} 16:24:57.076294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28029): Launched 16:24:57.403755 run osmo-hlr_10.42.42.2(pid=28030): Launched 16:24:57.530152 run osmo-stp_10.42.42.5: Starting osmo-stp 16:24:58.092175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28032): Launched 16:24:58.419650 run osmo-stp_10.42.42.5(pid=28033): Launched 16:24:58.544372 run osmo-msc_10.42.42.6: Starting osmo-msc 16:24:59.128595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28035): Launched 16:24:59.454701 run osmo-msc_10.42.42.6(pid=28036): Launched 16:24:59.636467 run osmo-stp_10.42.42.5(pid=28033): ERR: Terminated: ERROR {rc=1} [trial-2379↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28033)] 16:24:59.773190 run osmo-stp_10.42.42.5(pid=28033): stdout: | (launched: 2022-12-12_16:24:58.358643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:24:59.910385 run osmo-stp_10.42.42.5(pid=28033): stderr: | 20221212162458547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162458547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162458547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162458548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162458548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162458548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162458549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:00.045420 run osmo-stp_10.42.42.5(pid=28033): stdout: | (launched: 2022-12-12_16:24:58.358643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:00.174431 run osmo-stp_10.42.42.5(pid=28033): stderr: | 20221212162458547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162458547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162458547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162458548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162458548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162458548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162458549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:00.329118 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28033): Process ended prematurely: osmo-stp_10.42.42.5(pid=28033) [trial-2379↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28033)] [trial-2379↪ussd:trx-b200↪assert_extension.py:17] 16:25:00.338425 tst assert_extension.py:17: Test FAILED (6.1 sec) 16:25:00.366494 run osmo-hlr_10.42.42.2(pid=28030): ERR: Terminated: ERROR {rc=237} [trial-2379↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28030)] 16:25:00.417572 run osmo-hlr_10.42.42.2(pid=28030): stdout: | (launched: 2022-12-12_16:24:57.342790) 16:25:00.469846 run osmo-hlr_10.42.42.2(pid=28030): stderr: | 20221212162457538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162457538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162457538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162457538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162457538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162457538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162457551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162457561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162457562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162457562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:00.542596 run osmo-msc_10.42.42.6(pid=28036): ERR: Terminated: ERROR {rc=2} [trial-2379↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28036)] 16:25:00.592939 run osmo-msc_10.42.42.6(pid=28036): stdout: | (launched: 2022-12-12_16:24:59.393984) 16:25:00.644842 run osmo-msc_10.42.42.6(pid=28036): stderr: | 20221212162459713 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162459713 DLGLOBAL DEBUG validating counter group 0x7f0d1dbd6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162459713 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162459713 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162459713 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162459714 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162459715 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162459716 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162459716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162459716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:00.697514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28029): Terminating (SIGTERM) 16:25:00.739863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28032): Terminating (SIGTERM) 16:25:00.782430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28035): Terminating (SIGTERM) 16:25:00.846719 --- ParallelTerminationStrategy: PID 28029 died... 16:25:00.866884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28029): Terminated: ok {rc=0} 16:25:00.916321 --- ParallelTerminationStrategy: PID 28032 died... 16:25:00.936590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28032): Terminated: ok {rc=0} 16:25:00.988397 --- ParallelTerminationStrategy: PID 28035 died... 16:25:01.008635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28035): Terminated: ok {rc=0} 16:25:01.098026 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:25:02.317944 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:25:02.326581 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:25:02.362043 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:25:02.388354 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:25:02.443439 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:25:02.476845 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:25:02.503529 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:25:03.051127 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:25:03.102137 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:03.113297 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:25:03.182673 tst mo_mt_call.py: using LAC 30064 16:25:03.307320 tst mo_mt_call.py: using RAC 229 16:25:03.431539 tst mo_mt_call.py: using CellId 30064 16:25:03.552289 tst mo_mt_call.py: using BVCI 30065 16:25:03.663864 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:03.674978 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:03.685920 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:03.696829 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:03.707843 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:03.718794 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:25:03.838610 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:25:03.959811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:04.473147 run create_hlr_db(pid=28044): Launched 16:25:04.600201 bus /sierra_2: Setting Powered False 16:25:05.664441 run create_hlr_db(pid=28044): Terminated: ok {rc=0} 16:25:06.107193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28046): Launched 16:25:06.418144 run osmo-hlr_10.42.42.2(pid=28047): Launched 16:25:06.536634 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:07.082125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28049): Launched 16:25:07.394648 run osmo-stp_10.42.42.5(pid=28050): Launched 16:25:07.514373 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:08.073702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28052): Launched 16:25:08.384572 run osmo-msc_10.42.42.6(pid=28053): Launched 16:25:08.557872 run osmo-stp_10.42.42.5(pid=28050): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28050)] 16:25:08.687997 run osmo-stp_10.42.42.5(pid=28050): stdout: | (launched: 2022-12-12_16:25:07.336066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:08.818376 run osmo-stp_10.42.42.5(pid=28050): stderr: | 20221212162507508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162507508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162507509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162507509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162507509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162507510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162507510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:08.946822 run osmo-stp_10.42.42.5(pid=28050): stdout: | (launched: 2022-12-12_16:25:07.336066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:09.069640 run osmo-stp_10.42.42.5(pid=28050): stderr: | 20221212162507508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162507508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162507509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162507509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162507509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162507510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162507510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:09.216660 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28050): Process ended prematurely: osmo-stp_10.42.42.5(pid=28050) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28050)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:25:09.225991 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:25:09.252484 run osmo-hlr_10.42.42.2(pid=28047): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28047)] 16:25:09.300418 run osmo-hlr_10.42.42.2(pid=28047): stdout: | (launched: 2022-12-12_16:25:06.359891) 16:25:09.350830 run osmo-hlr_10.42.42.2(pid=28047): stderr: | 20221212162506538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162506538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162506538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162506538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162506538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162506538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162506550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162506558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162506558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162506558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:09.420040 run osmo-msc_10.42.42.6(pid=28053): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28053)] 16:25:09.467796 run osmo-msc_10.42.42.6(pid=28053): stdout: | (launched: 2022-12-12_16:25:08.326111) 16:25:09.517231 run osmo-msc_10.42.42.6(pid=28053): stderr: | 20221212162508600 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162508600 DLGLOBAL DEBUG validating counter group 0x7efe61364c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162508600 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162508600 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162508601 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162508601 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162508603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162508603 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162508603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162508603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:09.567038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28046): Terminating (SIGTERM) 16:25:09.606723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28049): Terminating (SIGTERM) 16:25:09.646361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28052): Terminating (SIGTERM) 16:25:09.686412 --- ParallelTerminationStrategy: PID 28046 died... 16:25:09.705533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28046): Terminated: ok {rc=0} 16:25:09.749807 --- ParallelTerminationStrategy: PID 28049 died... 16:25:09.768348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28049): Terminated: ok {rc=0} 16:25:09.812600 --- ParallelTerminationStrategy: PID 28052 died... 16:25:09.831473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28052): Terminated: ok {rc=0} 16:25:09.915596 bus /sierra_3: Setting Powered False 16:25:11.015178 bus /sierra_3: Setting Powered False 16:25:12.133820 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:25:13.286923 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:13.299555 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:25:13.373332 tst mo_mt_call_osmux.py: using LAC 30065 16:25:13.505584 tst mo_mt_call_osmux.py: using RAC 230 16:25:13.638359 tst mo_mt_call_osmux.py: using CellId 30065 16:25:13.762240 tst mo_mt_call_osmux.py: using BVCI 30066 16:25:13.874936 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:13.886353 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:13.897572 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:13.908892 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:13.920439 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:25:13.931830 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:25:14.051525 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:25:14.170907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:14.655527 run create_hlr_db(pid=28055): Launched 16:25:14.785284 bus /sierra_2: Setting Powered False 16:25:15.862523 run create_hlr_db(pid=28055): Terminated: ok {rc=0} 16:25:16.317287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28057): Launched 16:25:16.733054 run osmo-hlr_10.42.42.2(pid=28058): Launched 16:25:17.007448 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:17.659397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28060): Launched 16:25:17.991124 run osmo-stp_10.42.42.5(pid=28061): Launched 16:25:18.117774 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:18.713413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28063): Launched 16:25:19.044549 run osmo-msc_10.42.42.6(pid=28064): Launched 16:25:19.228876 run osmo-stp_10.42.42.5(pid=28061): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28061)] 16:25:19.368199 run osmo-stp_10.42.42.5(pid=28061): stdout: | (launched: 2022-12-12_16:25:17.929525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:19.506909 run osmo-stp_10.42.42.5(pid=28061): stderr: | 20221212162518118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162518118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162518119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162518120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162518121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162518121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162518121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:19.643740 run osmo-stp_10.42.42.5(pid=28061): stdout: | (launched: 2022-12-12_16:25:17.929525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:19.774691 run osmo-stp_10.42.42.5(pid=28061): stderr: | 20221212162518118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162518118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162518119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162518120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162518121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162518121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162518121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:19.930721 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28061): Process ended prematurely: osmo-stp_10.42.42.5(pid=28061) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28061)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:25:19.940338 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 16:25:19.968610 run osmo-hlr_10.42.42.2(pid=28058): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28058)] 16:25:20.018916 run osmo-hlr_10.42.42.2(pid=28058): stdout: | (launched: 2022-12-12_16:25:16.651288) 16:25:20.071066 run osmo-hlr_10.42.42.2(pid=28058): stderr: | 20221212162516938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162516939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162516939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162516939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162516939 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162516939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162516954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162516974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162516975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162516975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:20.143609 run osmo-msc_10.42.42.6(pid=28064): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28064)] 16:25:20.193817 run osmo-msc_10.42.42.6(pid=28064): stdout: | (launched: 2022-12-12_16:25:18.982910) 16:25:20.245725 run osmo-msc_10.42.42.6(pid=28064): stderr: | 20221212162519303 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162519303 DLGLOBAL DEBUG validating counter group 0x7f3292da4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162519303 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162519303 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162519303 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162519303 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162519305 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162519306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162519306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162519306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:20.298112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28057): Terminating (SIGTERM) 16:25:20.340118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28060): Terminating (SIGTERM) 16:25:20.382681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28063): Terminating (SIGTERM) 16:25:20.425405 --- ParallelTerminationStrategy: PID 28057 died... 16:25:20.445602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28057): Terminated: ok {rc=0} 16:25:20.492632 --- ParallelTerminationStrategy: PID 28060 died... 16:25:20.512326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28060): Terminated: ok {rc=0} 16:25:20.559242 --- ParallelTerminationStrategy: PID 28063 died... 16:25:20.578851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28063): Terminated: ok {rc=0} 16:25:20.667674 bus /sierra_3: Setting Powered False 16:25:21.767149 bus /sierra_3: Setting Powered False 16:25:22.885655 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:25:24.141277 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:25:24.148446 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:25:24.182527 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:25:24.210100 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:25:24.262883 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:25:24.297412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:25:24.324835 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:25:24.875965 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:25:24.928364 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:24.939937 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:25:25.010058 tst mo_mt_call.py: using LAC 30066 16:25:25.138204 tst mo_mt_call.py: using RAC 231 16:25:25.268109 tst mo_mt_call.py: using CellId 30066 16:25:25.410417 tst mo_mt_call.py: using BVCI 30067 16:25:25.531899 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:25.543474 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:25.554940 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:25.566346 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:25.577834 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:25.589243 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:25:25.707636 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:25:25.822408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:26.302592 run create_hlr_db(pid=28069): Launched 16:25:26.428696 bus /sierra_2: Setting Powered False 16:25:27.490015 run create_hlr_db(pid=28069): Terminated: ok {rc=0} 16:25:27.942174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28071): Launched 16:25:28.273338 run osmo-hlr_10.42.42.2(pid=28072): Launched 16:25:28.399324 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:28.968163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28074): Launched 16:25:29.297539 run osmo-stp_10.42.42.5(pid=28075): Launched 16:25:29.423955 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:30.021420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28077): Launched 16:25:30.353821 run osmo-msc_10.42.42.6(pid=28078): Launched 16:25:30.536226 run osmo-stp_10.42.42.5(pid=28075): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28075)] 16:25:30.674402 run osmo-stp_10.42.42.5(pid=28075): stdout: | (launched: 2022-12-12_16:25:29.235872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:30.812714 run osmo-stp_10.42.42.5(pid=28075): stderr: | 20221212162529426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162529426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162529426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162529426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162529427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162529427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162529427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:30.961272 run osmo-stp_10.42.42.5(pid=28075): stdout: | (launched: 2022-12-12_16:25:29.235872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:31.094502 run osmo-stp_10.42.42.5(pid=28075): stderr: | 20221212162529426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162529426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162529426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162529426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162529427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162529427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162529427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:31.253930 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28075): Process ended prematurely: osmo-stp_10.42.42.5(pid=28075) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28075)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:25:31.264358 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:25:31.293143 run osmo-hlr_10.42.42.2(pid=28072): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28072)] 16:25:31.345278 run osmo-hlr_10.42.42.2(pid=28072): stdout: | (launched: 2022-12-12_16:25:28.211467) 16:25:31.398166 run osmo-hlr_10.42.42.2(pid=28072): stderr: | 20221212162528406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162528406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162528407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162528407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162528407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162528407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162528419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162528427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162528428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162528428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:31.471888 run osmo-msc_10.42.42.6(pid=28078): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28078)] 16:25:31.523089 run osmo-msc_10.42.42.6(pid=28078): stdout: | (launched: 2022-12-12_16:25:30.291267) 16:25:31.575994 run osmo-msc_10.42.42.6(pid=28078): stderr: | 20221212162530612 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162530612 DLGLOBAL DEBUG validating counter group 0x7f4c28ec8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162530612 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162530612 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162530613 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162530613 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162530614 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162530615 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162530615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162530615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:31.630164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28071): Terminating (SIGTERM) 16:25:31.676853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28074): Terminating (SIGTERM) 16:25:31.732307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28077): Terminating (SIGTERM) 16:25:31.787933 --- ParallelTerminationStrategy: PID 28071 died... 16:25:31.812870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28071): Terminated: ok {rc=0} 16:25:31.868442 --- ParallelTerminationStrategy: PID 28074 died... 16:25:31.892551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28074): Terminated: ok {rc=0} 16:25:31.951239 --- ParallelTerminationStrategy: PID 28077 died... 16:25:31.975454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28077): Terminated: ok {rc=0} 16:25:32.076694 bus /sierra_3: Setting Powered False 16:25:33.177256 bus /sierra_3: Setting Powered False 16:25:34.294263 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:25:35.445382 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:35.457787 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:25:35.530915 tst mo_mt_call_osmux.py: using LAC 30067 16:25:35.654905 tst mo_mt_call_osmux.py: using RAC 232 16:25:35.778725 tst mo_mt_call_osmux.py: using CellId 30067 16:25:35.902191 tst mo_mt_call_osmux.py: using BVCI 30068 16:25:36.016133 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:36.027576 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:36.038943 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:36.050255 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:36.061566 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:25:36.072754 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:25:36.193970 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:25:36.314702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:36.798730 run create_hlr_db(pid=28080): Launched 16:25:36.926647 bus /sierra_2: Setting Powered False 16:25:37.988047 run create_hlr_db(pid=28080): Terminated: ok {rc=0} 16:25:38.442006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28082): Launched 16:25:38.775724 run osmo-hlr_10.42.42.2(pid=28083): Launched 16:25:38.902367 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:39.479509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28085): Launched 16:25:39.811066 run osmo-stp_10.42.42.5(pid=28086): Launched 16:25:39.936638 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:40.541973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28088): Launched 16:25:40.875032 run osmo-msc_10.42.42.6(pid=28089): Launched 16:25:41.059627 run osmo-stp_10.42.42.5(pid=28086): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28086)] 16:25:41.198281 run osmo-stp_10.42.42.5(pid=28086): stdout: | (launched: 2022-12-12_16:25:39.749615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:41.338119 run osmo-stp_10.42.42.5(pid=28086): stderr: | 20221212162539938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162539938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162539939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162539939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162539940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162539940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162539940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:41.475895 run osmo-stp_10.42.42.5(pid=28086): stdout: | (launched: 2022-12-12_16:25:39.749615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:41.607800 run osmo-stp_10.42.42.5(pid=28086): stderr: | 20221212162539938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162539938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162539939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162539939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162539940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162539940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162539940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:41.765183 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28086): Process ended prematurely: osmo-stp_10.42.42.5(pid=28086) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28086)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:25:41.774857 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:25:41.802792 run osmo-hlr_10.42.42.2(pid=28083): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28083)] 16:25:41.853355 run osmo-hlr_10.42.42.2(pid=28083): stdout: | (launched: 2022-12-12_16:25:38.713593) 16:25:41.930358 run osmo-hlr_10.42.42.2(pid=28083): stderr: | 20221212162538910 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162538911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162538911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162538911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162538911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162538911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162538923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162538932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162538933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162538933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:42.003435 run osmo-msc_10.42.42.6(pid=28089): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28089)] 16:25:42.053857 run osmo-msc_10.42.42.6(pid=28089): stdout: | (launched: 2022-12-12_16:25:40.813129) 16:25:42.106121 run osmo-msc_10.42.42.6(pid=28089): stderr: | 20221212162541133 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162541133 DLGLOBAL DEBUG validating counter group 0x7f51467a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162541133 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162541134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162541134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162541134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162541136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162541136 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162541136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162541136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:42.158558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28082): Terminating (SIGTERM) 16:25:42.200549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28085): Terminating (SIGTERM) 16:25:42.242751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28088): Terminating (SIGTERM) 16:25:42.285174 --- ParallelTerminationStrategy: PID 28082 died... 16:25:42.305213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28082): Terminated: ok {rc=0} 16:25:42.351938 --- ParallelTerminationStrategy: PID 28085 died... 16:25:42.371519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28085): Terminated: ok {rc=0} 16:25:42.417967 --- ParallelTerminationStrategy: PID 28088 died... 16:25:42.437568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28088): Terminated: ok {rc=0} 16:25:42.526418 bus /sierra_3: Setting Powered False 16:25:43.626521 bus /sierra_3: Setting Powered False 16:25:44.742408 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:25:46.020681 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:25:46.030916 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:25:46.073093 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:25:46.106695 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:25:46.169533 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:25:46.204716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:25:46.233481 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:25:46.785633 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:25:46.839189 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:46.851691 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:25:46.923243 tst mo_mt_call.py: using LAC 30068 16:25:47.083314 tst mo_mt_call.py: using RAC 233 16:25:47.239406 tst mo_mt_call.py: using CellId 30068 16:25:47.372542 tst mo_mt_call.py: using BVCI 30069 16:25:47.492397 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:47.504075 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:47.515428 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:47.526802 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:47.538272 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:47.549782 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:25:47.666413 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:25:47.783466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:48.265254 run create_hlr_db(pid=28094): Launched 16:25:48.391312 bus /sierra_2: Setting Powered False 16:25:49.456714 run create_hlr_db(pid=28094): Terminated: ok {rc=0} 16:25:49.916515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28096): Launched 16:25:50.248122 run osmo-hlr_10.42.42.2(pid=28097): Launched 16:25:50.374611 run osmo-stp_10.42.42.5: Starting osmo-stp 16:25:50.946979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28099): Launched 16:25:51.277825 run osmo-stp_10.42.42.5(pid=28100): Launched 16:25:51.404785 run osmo-msc_10.42.42.6: Starting osmo-msc 16:25:52.002112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28102): Launched 16:25:52.335830 run osmo-msc_10.42.42.6(pid=28103): Launched 16:25:52.520366 run osmo-stp_10.42.42.5(pid=28100): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28100)] 16:25:52.658633 run osmo-stp_10.42.42.5(pid=28100): stdout: | (launched: 2022-12-12_16:25:51.215715) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:52.808278 run osmo-stp_10.42.42.5(pid=28100): stderr: | 20221212162551405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162551406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162551406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162551406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162551407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162551407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162551407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:52.961436 run osmo-stp_10.42.42.5(pid=28100): stdout: | (launched: 2022-12-12_16:25:51.215715) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:25:53.094368 run osmo-stp_10.42.42.5(pid=28100): stderr: | 20221212162551405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162551406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162551406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162551406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162551407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162551407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162551407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:25:53.242823 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28100): Process ended prematurely: osmo-stp_10.42.42.5(pid=28100) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28100)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:25:53.251824 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:25:53.278989 run osmo-hlr_10.42.42.2(pid=28097): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28097)] 16:25:53.328000 run osmo-hlr_10.42.42.2(pid=28097): stdout: | (launched: 2022-12-12_16:25:50.186269) 16:25:53.378041 run osmo-hlr_10.42.42.2(pid=28097): stderr: | 20221212162550381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162550381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162550381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162550381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162550381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162550382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162550394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162550402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162550403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162550403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:25:53.447513 run osmo-msc_10.42.42.6(pid=28103): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28103)] 16:25:53.495955 run osmo-msc_10.42.42.6(pid=28103): stdout: | (launched: 2022-12-12_16:25:52.273347) 16:25:53.545878 run osmo-msc_10.42.42.6(pid=28103): stderr: | 20221212162552592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162552592 DLGLOBAL DEBUG validating counter group 0x7fe18a86ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162552593 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162552593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162552593 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162552593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162552595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162552595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162552595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162552595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:25:53.596391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28096): Terminating (SIGTERM) 16:25:53.636614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28099): Terminating (SIGTERM) 16:25:53.677334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28102): Terminating (SIGTERM) 16:25:53.718139 --- ParallelTerminationStrategy: PID 28096 died... 16:25:53.737374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28096): Terminated: ok {rc=0} 16:25:53.782372 --- ParallelTerminationStrategy: PID 28099 died... 16:25:53.801066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28099): Terminated: ok {rc=0} 16:25:53.845940 --- ParallelTerminationStrategy: PID 28102 died... 16:25:53.864474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28102): Terminated: ok {rc=0} 16:25:53.952764 bus /sierra_3: Setting Powered False 16:25:55.053831 bus /sierra_3: Setting Powered False 16:25:56.170757 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:25:57.321215 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:57.333147 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:25:57.403720 tst mo_mt_call_osmux.py: using LAC 30069 16:25:57.525706 tst mo_mt_call_osmux.py: using RAC 234 16:25:57.656700 tst mo_mt_call_osmux.py: using CellId 30069 16:25:57.786756 tst mo_mt_call_osmux.py: using BVCI 30070 16:25:57.906897 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:57.918649 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:57.930312 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:57.942040 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:57.953845 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:25:57.965575 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:25:58.083565 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:25:58.205320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:25:58.721730 run create_hlr_db(pid=28106): Launched 16:25:58.848082 bus /sierra_2: Setting Powered False 16:25:59.912437 run create_hlr_db(pid=28106): Terminated: ok {rc=0} 16:26:00.355409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28108): Launched 16:26:00.667167 run osmo-hlr_10.42.42.2(pid=28109): Launched 16:26:00.785050 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:01.457696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28111): Launched 16:26:01.800189 run osmo-stp_10.42.42.5(pid=28112): Launched 16:26:02.081386 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:02.677559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28114): Launched 16:26:02.990408 run osmo-msc_10.42.42.6(pid=28115): Launched 16:26:03.163729 run osmo-stp_10.42.42.5(pid=28112): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28112)] 16:26:03.293375 run osmo-stp_10.42.42.5(pid=28112): stdout: | (launched: 2022-12-12_16:26:01.738231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:03.423073 run osmo-stp_10.42.42.5(pid=28112): stderr: | 20221212162601981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162601981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162601982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162601982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162601983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162601983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162601983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:03.551165 run osmo-stp_10.42.42.5(pid=28112): stdout: | (launched: 2022-12-12_16:26:01.738231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:03.673834 run osmo-stp_10.42.42.5(pid=28112): stderr: | 20221212162601981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162601981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162601982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162601982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162601983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162601983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162601983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:03.821721 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28112): Process ended prematurely: osmo-stp_10.42.42.5(pid=28112) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28112)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:26:03.830967 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:26:03.857796 run osmo-hlr_10.42.42.2(pid=28109): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28109)] 16:26:03.905849 run osmo-hlr_10.42.42.2(pid=28109): stdout: | (launched: 2022-12-12_16:26:00.608712) 16:26:03.955534 run osmo-hlr_10.42.42.2(pid=28109): stderr: | 20221212162600786 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162600786 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162600786 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162600786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162600787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162600787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162600803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162600820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162600820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162600820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:04.024493 run osmo-msc_10.42.42.6(pid=28115): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28115)] 16:26:04.072249 run osmo-msc_10.42.42.6(pid=28115): stdout: | (launched: 2022-12-12_16:26:02.931845) 16:26:04.121789 run osmo-msc_10.42.42.6(pid=28115): stderr: | 20221212162603206 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162603206 DLGLOBAL DEBUG validating counter group 0x7f6d35036c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162603207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162603207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162603207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162603207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162603209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162603209 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162603209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162603209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:04.171564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28108): Terminating (SIGTERM) 16:26:04.211561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28111): Terminating (SIGTERM) 16:26:04.251574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28114): Terminating (SIGTERM) 16:26:04.291702 --- ParallelTerminationStrategy: PID 28108 died... 16:26:04.311035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28108): Terminated: ok {rc=0} 16:26:04.355570 --- ParallelTerminationStrategy: PID 28111 died... 16:26:04.374405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28111): Terminated: ok {rc=0} 16:26:04.418348 --- ParallelTerminationStrategy: PID 28114 died... 16:26:04.437355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28114): Terminated: ok {rc=0} 16:26:04.524018 bus /sierra_3: Setting Powered False 16:26:05.624332 bus /sierra_3: Setting Powered False 16:26:06.739906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:26:07.990726 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:26:07.997473 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:26:08.030251 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:26:08.057172 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:26:08.107650 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:26:08.140572 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:26:08.167207 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:26:08.719175 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:26:08.769664 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:08.781125 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:26:08.850713 tst mo_mt_call.py: using LAC 30070 16:26:08.973056 tst mo_mt_call.py: using RAC 235 16:26:09.094483 tst mo_mt_call.py: using CellId 30070 16:26:09.217329 tst mo_mt_call.py: using BVCI 30071 16:26:09.329663 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:09.341125 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:09.352167 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:09.363315 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:09.374566 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:09.385951 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:26:09.505043 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:26:09.621550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:10.104687 run create_hlr_db(pid=28120): Launched 16:26:10.233168 bus /sierra_2: Setting Powered False 16:26:11.294829 run create_hlr_db(pid=28120): Terminated: ok {rc=0} 16:26:11.747480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28122): Launched 16:26:12.080712 run osmo-hlr_10.42.42.2(pid=28123): Launched 16:26:12.207363 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:12.776573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28125): Launched 16:26:13.107726 run osmo-stp_10.42.42.5(pid=28126): Launched 16:26:13.234300 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:13.834463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28128): Launched 16:26:14.167651 run osmo-msc_10.42.42.6(pid=28129): Launched 16:26:14.352635 run osmo-stp_10.42.42.5(pid=28126): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28126)] 16:26:14.491953 run osmo-stp_10.42.42.5(pid=28126): stdout: | (launched: 2022-12-12_16:26:13.046038) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:14.631547 run osmo-stp_10.42.42.5(pid=28126): stderr: | 20221212162613237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162613237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162613238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162613238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162613239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162613239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162613239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:14.769107 run osmo-stp_10.42.42.5(pid=28126): stdout: | (launched: 2022-12-12_16:26:13.046038) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:14.900641 run osmo-stp_10.42.42.5(pid=28126): stderr: | 20221212162613237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162613237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162613238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162613238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162613239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162613239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162613239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:15.058087 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28126): Process ended prematurely: osmo-stp_10.42.42.5(pid=28126) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28126)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:26:15.067731 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:26:15.096212 run osmo-hlr_10.42.42.2(pid=28123): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28123)] 16:26:15.146654 run osmo-hlr_10.42.42.2(pid=28123): stdout: | (launched: 2022-12-12_16:26:12.018912) 16:26:15.198824 run osmo-hlr_10.42.42.2(pid=28123): stderr: | 20221212162612215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162612215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162612215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162612215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162612215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162612215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162612227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162612238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162612238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162612238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:15.271420 run osmo-msc_10.42.42.6(pid=28129): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28129)] 16:26:15.322345 run osmo-msc_10.42.42.6(pid=28129): stdout: | (launched: 2022-12-12_16:26:14.105771) 16:26:15.374633 run osmo-msc_10.42.42.6(pid=28129): stderr: | 20221212162614426 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162614426 DLGLOBAL DEBUG validating counter group 0x7efdb6a4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162614426 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162614426 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162614426 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162614427 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162614428 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162614429 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162614429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162614429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:15.427062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28122): Terminating (SIGTERM) 16:26:15.469071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28125): Terminating (SIGTERM) 16:26:15.511010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28128): Terminating (SIGTERM) 16:26:15.553276 --- ParallelTerminationStrategy: PID 28122 died... 16:26:15.573500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28122): Terminated: ok {rc=0} 16:26:15.620608 --- ParallelTerminationStrategy: PID 28125 died... 16:26:15.640212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28125): Terminated: ok {rc=0} 16:26:15.687184 --- ParallelTerminationStrategy: PID 28128 died... 16:26:15.706684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28128): Terminated: ok {rc=0} 16:26:15.795904 bus /sierra_3: Setting Powered False 16:26:16.912911 bus /sierra_3: Setting Powered False 16:26:18.033473 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:26:19.184555 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:19.196890 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:26:19.273977 tst mo_mt_call_osmux.py: using LAC 30071 16:26:19.404121 tst mo_mt_call_osmux.py: using RAC 236 16:26:19.533689 tst mo_mt_call_osmux.py: using CellId 30071 16:26:19.659667 tst mo_mt_call_osmux.py: using BVCI 30072 16:26:19.774513 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:19.785926 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:19.797120 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:19.808861 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:19.820722 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:26:19.832520 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:26:19.955554 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:26:20.078411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:20.592673 run create_hlr_db(pid=28131): Launched 16:26:20.719559 bus /sierra_2: Setting Powered False 16:26:21.784160 run create_hlr_db(pid=28131): Terminated: ok {rc=0} 16:26:22.226847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28133): Launched 16:26:22.538856 run osmo-hlr_10.42.42.2(pid=28134): Launched 16:26:22.658005 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:23.190879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28136): Launched 16:26:23.503360 run osmo-stp_10.42.42.5(pid=28137): Launched 16:26:23.622766 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:24.184557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28139): Launched 16:26:24.495725 run osmo-msc_10.42.42.6(pid=28140): Launched 16:26:24.670262 run osmo-stp_10.42.42.5(pid=28137): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28137)] 16:26:24.800495 run osmo-stp_10.42.42.5(pid=28137): stdout: | (launched: 2022-12-12_16:26:23.444795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:24.930855 run osmo-stp_10.42.42.5(pid=28137): stderr: | 20221212162623617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162623618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162623618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162623618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162623619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162623619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162623619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:25.059358 run osmo-stp_10.42.42.5(pid=28137): stdout: | (launched: 2022-12-12_16:26:23.444795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:25.182083 run osmo-stp_10.42.42.5(pid=28137): stderr: | 20221212162623617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162623618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162623618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162623618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162623619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162623619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162623619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:25.329061 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28137): Process ended prematurely: osmo-stp_10.42.42.5(pid=28137) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28137)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:26:25.338049 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:26:25.364752 run osmo-hlr_10.42.42.2(pid=28134): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28134)] 16:26:25.412896 run osmo-hlr_10.42.42.2(pid=28134): stdout: | (launched: 2022-12-12_16:26:22.480502) 16:26:25.462704 run osmo-hlr_10.42.42.2(pid=28134): stderr: | 20221212162622657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162622657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162622657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162622657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162622657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162622657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162622669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162622678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162622678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162622678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:25.531982 run osmo-msc_10.42.42.6(pid=28140): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28140)] 16:26:25.579777 run osmo-msc_10.42.42.6(pid=28140): stdout: | (launched: 2022-12-12_16:26:24.437364) 16:26:25.629339 run osmo-msc_10.42.42.6(pid=28140): stderr: | 20221212162624711 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162624711 DLGLOBAL DEBUG validating counter group 0x7f0fe4990c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162624711 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162624711 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162624711 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162624712 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162624713 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162624714 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162624714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162624714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:25.679009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28133): Terminating (SIGTERM) 16:26:25.719228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28136): Terminating (SIGTERM) 16:26:25.759303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28139): Terminating (SIGTERM) 16:26:25.799627 --- ParallelTerminationStrategy: PID 28133 died... 16:26:25.819121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28133): Terminated: ok {rc=0} 16:26:25.863622 --- ParallelTerminationStrategy: PID 28136 died... 16:26:25.882382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28136): Terminated: ok {rc=0} 16:26:25.926197 --- ParallelTerminationStrategy: PID 28139 died... 16:26:25.945436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28139): Terminated: ok {rc=0} 16:26:26.031885 bus /sierra_3: Setting Powered False 16:26:27.131994 bus /sierra_3: Setting Powered False 16:26:28.248489 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:26:29.497620 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:26:29.504636 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:26:29.538257 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:26:29.564643 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:26:29.619334 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:26:29.655183 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:26:29.683294 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:26:30.229813 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:26:30.285222 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:30.297044 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:26:30.367333 tst mo_mt_call.py: using LAC 30072 16:26:30.500246 tst mo_mt_call.py: using RAC 237 16:26:30.621350 tst mo_mt_call.py: using CellId 30072 16:26:30.742709 tst mo_mt_call.py: using BVCI 30073 16:26:30.890029 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:30.902651 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:30.915156 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:30.931080 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:30.945018 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:30.958830 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:26:31.079041 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:26:31.199460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:31.760893 run create_hlr_db(pid=28145): Launched 16:26:31.928914 bus /sierra_2: Setting Powered False 16:26:32.994033 run create_hlr_db(pid=28145): Terminated: ok {rc=0} 16:26:33.455829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28147): Launched 16:26:33.788027 run osmo-hlr_10.42.42.2(pid=28148): Launched 16:26:33.914934 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:34.488821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28150): Launched 16:26:34.820686 run osmo-stp_10.42.42.5(pid=28151): Launched 16:26:34.947215 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:35.544417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28153): Launched 16:26:35.875656 run osmo-msc_10.42.42.6(pid=28154): Launched 16:26:36.059758 run osmo-stp_10.42.42.5(pid=28151): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28151)] 16:26:36.198824 run osmo-stp_10.42.42.5(pid=28151): stdout: | (launched: 2022-12-12_16:26:34.759198) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:36.339054 run osmo-stp_10.42.42.5(pid=28151): stderr: | 20221212162634950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162634950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162634951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162634951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162634951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162634951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162634952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:36.476496 run osmo-stp_10.42.42.5(pid=28151): stdout: | (launched: 2022-12-12_16:26:34.759198) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:36.608173 run osmo-stp_10.42.42.5(pid=28151): stderr: | 20221212162634950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162634950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162634951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162634951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162634951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162634951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162634952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:36.765296 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28151): Process ended prematurely: osmo-stp_10.42.42.5(pid=28151) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28151)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:26:36.775171 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:26:36.803483 run osmo-hlr_10.42.42.2(pid=28148): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28148)] 16:26:36.854226 run osmo-hlr_10.42.42.2(pid=28148): stdout: | (launched: 2022-12-12_16:26:33.725680) 16:26:36.906430 run osmo-hlr_10.42.42.2(pid=28148): stderr: | 20221212162633922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162633922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162633922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162633922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162633923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162633923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162633935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162633945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162633946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162633946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:36.978987 run osmo-msc_10.42.42.6(pid=28154): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28154)] 16:26:37.029461 run osmo-msc_10.42.42.6(pid=28154): stdout: | (launched: 2022-12-12_16:26:35.813775) 16:26:37.081694 run osmo-msc_10.42.42.6(pid=28154): stderr: | 20221212162636135 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162636136 DLGLOBAL DEBUG validating counter group 0x7f246798fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162636136 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162636136 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162636136 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162636136 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162636138 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162636138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162636138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162636138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:37.134267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28147): Terminating (SIGTERM) 16:26:37.176422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28150): Terminating (SIGTERM) 16:26:37.218879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28153): Terminating (SIGTERM) 16:26:37.261474 --- ParallelTerminationStrategy: PID 28147 died... 16:26:37.281639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28147): Terminated: ok {rc=0} 16:26:37.329408 --- ParallelTerminationStrategy: PID 28150 died... 16:26:37.349174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28150): Terminated: ok {rc=0} 16:26:37.396070 --- ParallelTerminationStrategy: PID 28153 died... 16:26:37.415769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28153): Terminated: ok {rc=0} 16:26:37.504423 bus /sierra_3: Setting Powered False 16:26:38.604240 bus /sierra_3: Setting Powered False 16:26:39.722892 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:26:40.872003 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:40.883984 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:26:40.953636 tst mo_mt_call_osmux.py: using LAC 30073 16:26:41.077212 tst mo_mt_call_osmux.py: using RAC 238 16:26:41.199661 tst mo_mt_call_osmux.py: using CellId 30073 16:26:41.330897 tst mo_mt_call_osmux.py: using BVCI 30074 16:26:41.454074 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:41.465976 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:41.477652 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:41.489683 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:41.502516 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:26:41.514811 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:26:41.632537 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:26:41.753210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:42.267487 run create_hlr_db(pid=28156): Launched 16:26:42.393696 bus /sierra_2: Setting Powered False 16:26:43.458494 run create_hlr_db(pid=28156): Terminated: ok {rc=0} 16:26:43.902082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28158): Launched 16:26:44.214838 run osmo-hlr_10.42.42.2(pid=28159): Launched 16:26:44.333536 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:44.866882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28161): Launched 16:26:45.178989 run osmo-stp_10.42.42.5(pid=28162): Launched 16:26:45.298473 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:45.881684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28164): Launched 16:26:46.237663 run osmo-msc_10.42.42.6(pid=28165): Launched 16:26:46.480639 run osmo-stp_10.42.42.5(pid=28162): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28162)] 16:26:46.713982 run osmo-stp_10.42.42.5(pid=28162): stdout: | (launched: 2022-12-12_16:26:45.120368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:46.860826 run osmo-stp_10.42.42.5(pid=28162): stderr: | 20221212162645291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162645291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162645292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162645292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162645293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162645293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162645293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:47.141609 run osmo-stp_10.42.42.5(pid=28162): stdout: | (launched: 2022-12-12_16:26:45.120368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:47.269797 run osmo-stp_10.42.42.5(pid=28162): stderr: | 20221212162645291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162645291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162645292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162645292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162645293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162645293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162645293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:47.417066 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28162): Process ended prematurely: osmo-stp_10.42.42.5(pid=28162) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28162)] [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:26:47.426401 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 16:26:47.453225 run osmo-hlr_10.42.42.2(pid=28159): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28159)] 16:26:47.501181 run osmo-hlr_10.42.42.2(pid=28159): stdout: | (launched: 2022-12-12_16:26:44.156368) 16:26:47.550989 run osmo-hlr_10.42.42.2(pid=28159): stderr: | 20221212162644335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162644335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162644335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162644335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162644335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162644335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162644347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162644355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162644355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162644355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:47.620258 run osmo-msc_10.42.42.6(pid=28165): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28165)] 16:26:47.668521 run osmo-msc_10.42.42.6(pid=28165): stdout: | (launched: 2022-12-12_16:26:46.171299) 16:26:47.718190 run osmo-msc_10.42.42.6(pid=28165): stderr: | 20221212162646795 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162646795 DLGLOBAL DEBUG validating counter group 0x7f953f9dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162646795 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162646795 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162646795 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162646795 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162646803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162646804 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162646804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162646804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:47.768508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28158): Terminating (SIGTERM) 16:26:47.808479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28161): Terminating (SIGTERM) 16:26:47.848586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28164): Terminating (SIGTERM) 16:26:47.888842 --- ParallelTerminationStrategy: PID 28158 died... 16:26:47.908169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28158): Terminated: ok {rc=0} 16:26:47.952520 --- ParallelTerminationStrategy: PID 28161 died... 16:26:47.971290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28161): Terminated: ok {rc=0} 16:26:48.016192 --- ParallelTerminationStrategy: PID 28164 died... 16:26:48.035502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28164): Terminated: ok {rc=0} 16:26:48.122233 bus /sierra_3: Setting Powered False 16:26:49.222983 bus /sierra_3: Setting Powered False 16:26:50.339163 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:26:51.590911 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:26:51.597979 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:26:51.631105 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:26:51.657432 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:26:51.708769 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:26:51.741646 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:26:51.768123 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:26:52.324329 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:26:52.374013 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:52.385302 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:26:52.455783 tst mo_mt_call.py: using LAC 30074 16:26:52.579071 tst mo_mt_call.py: using RAC 239 16:26:52.711147 tst mo_mt_call.py: using CellId 30074 16:26:52.841216 tst mo_mt_call.py: using BVCI 30075 16:26:52.955457 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:52.966803 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:52.977841 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:52.988807 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:52.999971 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:26:53.011494 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:26:53.130518 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:26:53.246445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:26:53.727325 run create_hlr_db(pid=28171): Launched 16:26:53.853961 bus /sierra_2: Setting Powered False 16:26:54.914605 run create_hlr_db(pid=28171): Terminated: ok {rc=0} 16:26:55.365944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28173): Launched 16:26:55.697422 run osmo-hlr_10.42.42.2(pid=28174): Launched 16:26:55.823815 run osmo-stp_10.42.42.5: Starting osmo-stp 16:26:56.395238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28176): Launched 16:26:56.726394 run osmo-stp_10.42.42.5(pid=28177): Launched 16:26:56.851656 run osmo-msc_10.42.42.6: Starting osmo-msc 16:26:57.449957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28179): Launched 16:26:57.783786 run osmo-msc_10.42.42.6(pid=28180): Launched 16:26:57.968366 run osmo-stp_10.42.42.5(pid=28177): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28177)] 16:26:58.115966 run osmo-stp_10.42.42.5(pid=28177): stdout: | (launched: 2022-12-12_16:26:56.664471) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:58.255578 run osmo-stp_10.42.42.5(pid=28177): stderr: | 20221212162656855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162656855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162656855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162656856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162656856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162656856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162656856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:58.393951 run osmo-stp_10.42.42.5(pid=28177): stdout: | (launched: 2022-12-12_16:26:56.664471) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:26:58.525485 run osmo-stp_10.42.42.5(pid=28177): stderr: | 20221212162656855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162656855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162656855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162656856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162656856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162656856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162656856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:26:58.683091 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28177): Process ended prematurely: osmo-stp_10.42.42.5(pid=28177) [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28177)] [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:26:58.693088 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:26:58.722083 run osmo-hlr_10.42.42.2(pid=28174): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28174)] 16:26:58.773186 run osmo-hlr_10.42.42.2(pid=28174): stdout: | (launched: 2022-12-12_16:26:55.635644) 16:26:58.825819 run osmo-hlr_10.42.42.2(pid=28174): stderr: | 20221212162655833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162655833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162655834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162655834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162655834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162655834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162655850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162655859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162655859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162655859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:26:58.898787 run osmo-msc_10.42.42.6(pid=28180): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28180)] 16:26:58.949633 run osmo-msc_10.42.42.6(pid=28180): stdout: | (launched: 2022-12-12_16:26:57.721733) 16:26:59.002134 run osmo-msc_10.42.42.6(pid=28180): stderr: | 20221212162658042 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162658042 DLGLOBAL DEBUG validating counter group 0x7f9f08dc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162658042 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162658042 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162658043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162658043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162658044 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162658045 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162658045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162658045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:26:59.055132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28173): Terminating (SIGTERM) 16:26:59.097920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28176): Terminating (SIGTERM) 16:26:59.140602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28179): Terminating (SIGTERM) 16:26:59.183539 --- ParallelTerminationStrategy: PID 28173 died... 16:26:59.203791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28173): Terminated: ok {rc=0} 16:26:59.251340 --- ParallelTerminationStrategy: PID 28176 died... 16:26:59.271046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28176): Terminated: ok {rc=0} 16:26:59.317768 --- ParallelTerminationStrategy: PID 28179 died... 16:26:59.337523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28179): Terminated: ok {rc=0} 16:26:59.426038 bus /sierra_3: Setting Powered False 16:27:00.525233 bus /sierra_3: Setting Powered False 16:27:01.651736 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:27:02.805681 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:27:02.818403 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:27:02.890571 tst mo_mt_call_osmux.py: using LAC 30075 16:27:03.022405 tst mo_mt_call_osmux.py: using RAC 240 16:27:03.151860 tst mo_mt_call_osmux.py: using CellId 30075 16:27:03.280494 tst mo_mt_call_osmux.py: using BVCI 30076 16:27:03.403539 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:27:03.415430 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:27:03.426960 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:27:03.438781 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:27:03.450709 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:27:03.462561 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:27:03.580676 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:27:03.700066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:04.182280 run create_hlr_db(pid=28182): Launched 16:27:04.312032 bus /sierra_2: Setting Powered False 16:27:05.373282 run create_hlr_db(pid=28182): Terminated: ok {rc=0} 16:27:05.826176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28184): Launched 16:27:06.161341 run osmo-hlr_10.42.42.2(pid=28185): Launched 16:27:06.286998 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:06.858518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28187): Launched 16:27:07.193212 run osmo-stp_10.42.42.5(pid=28188): Launched 16:27:07.320634 run osmo-msc_10.42.42.6: Starting osmo-msc 16:27:07.921609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28190): Launched 16:27:08.254117 run osmo-msc_10.42.42.6(pid=28191): Launched 16:27:08.440461 run osmo-stp_10.42.42.5(pid=28188): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28188)] 16:27:08.580166 run osmo-stp_10.42.42.5(pid=28188): stdout: | (launched: 2022-12-12_16:27:07.130690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:08.720324 run osmo-stp_10.42.42.5(pid=28188): stderr: | 20221212162707321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162707322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162707322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162707322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162707323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162707323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162707323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:08.858648 run osmo-stp_10.42.42.5(pid=28188): stdout: | (launched: 2022-12-12_16:27:07.130690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:08.991153 run osmo-stp_10.42.42.5(pid=28188): stderr: | 20221212162707321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162707322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162707322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162707322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162707323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162707323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162707323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:09.148827 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28188): Process ended prematurely: osmo-stp_10.42.42.5(pid=28188) [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28188)] [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:27:09.158965 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:27:09.187795 run osmo-hlr_10.42.42.2(pid=28185): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28185)] 16:27:09.238407 run osmo-hlr_10.42.42.2(pid=28185): stdout: | (launched: 2022-12-12_16:27:06.099205) 16:27:09.290926 run osmo-hlr_10.42.42.2(pid=28185): stderr: | 20221212162706295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162706296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162706296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162706296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162706296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162706296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162706308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162706318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162706318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162706318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:09.364512 run osmo-msc_10.42.42.6(pid=28191): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28191)] 16:27:09.415105 run osmo-msc_10.42.42.6(pid=28191): stdout: | (launched: 2022-12-12_16:27:08.191699) 16:27:09.467205 run osmo-msc_10.42.42.6(pid=28191): stderr: | 20221212162708513 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162708513 DLGLOBAL DEBUG validating counter group 0x7f7c97551c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162708513 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162708513 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162708514 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162708514 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162708515 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162708516 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162708516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162708516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:27:09.519824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28184): Terminating (SIGTERM) 16:27:09.562578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28187): Terminating (SIGTERM) 16:27:09.605172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28190): Terminating (SIGTERM) 16:27:09.647851 --- ParallelTerminationStrategy: PID 28184 died... 16:27:09.668152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28184): Terminated: ok {rc=0} 16:27:09.715777 --- ParallelTerminationStrategy: PID 28187 died... 16:27:09.735480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28187): Terminated: ok {rc=0} 16:27:09.782174 --- ParallelTerminationStrategy: PID 28190 died... 16:27:09.801679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28190): Terminated: ok {rc=0} 16:27:09.889515 bus /sierra_3: Setting Powered False 16:27:10.990082 bus /sierra_3: Setting Powered False 16:27:12.106338 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:27:13.360271 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:27:13.366874 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:27:13.402926 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:27:13.430267 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:27:13.483937 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:27:13.518559 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:27:13.546363 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:27:14.095870 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:27:14.149154 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:14.160483 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:27:14.232536 tst mo_mt_call.py: using LAC 30076 16:27:14.361356 tst mo_mt_call.py: using RAC 241 16:27:14.490557 tst mo_mt_call.py: using CellId 30076 16:27:14.620701 tst mo_mt_call.py: using BVCI 30077 16:27:14.742103 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:14.753559 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:14.764693 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:14.776243 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:14.787830 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:14.799447 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:27:14.917607 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:27:15.035408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:15.516617 run create_hlr_db(pid=28196): Launched 16:27:15.647080 bus /sierra_2: Setting Powered False 16:27:16.727691 run create_hlr_db(pid=28196): Terminated: ok {rc=0} 16:27:17.193872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28198): Launched 16:27:17.537123 run osmo-hlr_10.42.42.2(pid=28199): Launched 16:27:17.664586 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:18.240935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28201): Launched 16:27:18.575854 run osmo-stp_10.42.42.5(pid=28202): Launched 16:27:18.703920 run osmo-msc_10.42.42.6: Starting osmo-msc 16:27:19.305121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28204): Launched 16:27:19.638955 run osmo-msc_10.42.42.6(pid=28205): Launched 16:27:19.823666 run osmo-stp_10.42.42.5(pid=28202): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28202)] 16:27:19.963240 run osmo-stp_10.42.42.5(pid=28202): stdout: | (launched: 2022-12-12_16:27:18.513698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:20.103437 run osmo-stp_10.42.42.5(pid=28202): stderr: | 20221212162718703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162718703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162718704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162718704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162718705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162718705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162718705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:20.241893 run osmo-stp_10.42.42.5(pid=28202): stdout: | (launched: 2022-12-12_16:27:18.513698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:20.373954 run osmo-stp_10.42.42.5(pid=28202): stderr: | 20221212162718703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162718703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162718704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162718704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162718705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162718705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162718705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:20.532083 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28202): Process ended prematurely: osmo-stp_10.42.42.5(pid=28202) [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28202)] [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:27:20.541801 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:27:20.570108 run osmo-hlr_10.42.42.2(pid=28199): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28199)] 16:27:20.620873 run osmo-hlr_10.42.42.2(pid=28199): stdout: | (launched: 2022-12-12_16:27:17.474057) 16:27:20.672856 run osmo-hlr_10.42.42.2(pid=28199): stderr: | 20221212162717672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162717672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162717672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162717672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162717672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162717672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162717701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162717711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162717712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162717712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:20.745294 run osmo-msc_10.42.42.6(pid=28205): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28205)] 16:27:20.795582 run osmo-msc_10.42.42.6(pid=28205): stdout: | (launched: 2022-12-12_16:27:19.576880) 16:27:20.847393 run osmo-msc_10.42.42.6(pid=28205): stderr: | 20221212162719898 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162719898 DLGLOBAL DEBUG validating counter group 0x7facd5edec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162719898 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162719899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162719899 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162719899 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162719901 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162719901 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162719901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162719901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:27:20.899765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28198): Terminating (SIGTERM) 16:27:20.941664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28201): Terminating (SIGTERM) 16:27:20.983673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28204): Terminating (SIGTERM) 16:27:21.026326 --- ParallelTerminationStrategy: PID 28198 died... 16:27:21.046511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28198): Terminated: ok {rc=0} 16:27:21.093437 --- ParallelTerminationStrategy: PID 28201 died... 16:27:21.113099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28201): Terminated: ok {rc=0} 16:27:21.160145 --- ParallelTerminationStrategy: PID 28204 died... 16:27:21.179751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28204): Terminated: ok {rc=0} 16:27:21.269159 bus /sierra_3: Setting Powered False 16:27:22.370007 bus /sierra_3: Setting Powered False 16:27:23.486533 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:27:24.639607 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:24.651870 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:27:24.725289 tst mo_mt_call_osmux.py: using LAC 30077 16:27:24.855400 tst mo_mt_call_osmux.py: using RAC 242 16:27:24.985376 tst mo_mt_call_osmux.py: using CellId 30077 16:27:25.116858 tst mo_mt_call_osmux.py: using BVCI 30078 16:27:25.237792 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:25.249211 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:25.260439 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:25.272041 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:25.283624 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:27:25.295433 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:27:25.413684 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:27:25.531952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:26.016856 run create_hlr_db(pid=28207): Launched 16:27:26.145460 bus /sierra_2: Setting Powered False 16:27:27.207543 run create_hlr_db(pid=28207): Terminated: ok {rc=0} 16:27:27.640586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28209): Launched 16:27:27.952739 run osmo-hlr_10.42.42.2(pid=28210): Launched 16:27:28.068926 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:28.617022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28212): Launched 16:27:28.927864 run osmo-stp_10.42.42.5(pid=28213): Launched 16:27:29.046656 run osmo-msc_10.42.42.6: Starting osmo-msc 16:27:29.608926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28215): Launched 16:27:29.920485 run osmo-msc_10.42.42.6(pid=28216): Launched 16:27:30.097353 run osmo-stp_10.42.42.5(pid=28213): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28213)] 16:27:30.228359 run osmo-stp_10.42.42.5(pid=28213): stdout: | (launched: 2022-12-12_16:27:28.869448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:30.359439 run osmo-stp_10.42.42.5(pid=28213): stderr: | 20221212162729042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162729042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162729042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162729043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162729043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162729043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162729043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:30.489453 run osmo-stp_10.42.42.5(pid=28213): stdout: | (launched: 2022-12-12_16:27:28.869448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:30.612682 run osmo-stp_10.42.42.5(pid=28213): stderr: | 20221212162729042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162729042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162729042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162729043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162729043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162729043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162729043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:30.760441 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28213): Process ended prematurely: osmo-stp_10.42.42.5(pid=28213) [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28213)] [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:27:30.769777 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:27:30.800898 run osmo-hlr_10.42.42.2(pid=28210): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28210)] 16:27:30.850451 run osmo-hlr_10.42.42.2(pid=28210): stdout: | (launched: 2022-12-12_16:27:27.894258) 16:27:30.901861 run osmo-hlr_10.42.42.2(pid=28210): stderr: | 20221212162728074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162728074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162728074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162728074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162728074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162728074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162728086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162728096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162728096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162728096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:30.972525 run osmo-msc_10.42.42.6(pid=28216): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28216)] 16:27:31.021440 run osmo-msc_10.42.42.6(pid=28216): stdout: | (launched: 2022-12-12_16:27:29.861576) 16:27:31.072634 run osmo-msc_10.42.42.6(pid=28216): stderr: | 20221212162730138 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162730138 DLGLOBAL DEBUG validating counter group 0x7f666b6bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162730138 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162730138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162730138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162730138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162730140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162730140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162730141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162730141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:27:31.123738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28209): Terminating (SIGTERM) 16:27:31.165646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28212): Terminating (SIGTERM) 16:27:31.208700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28215): Terminating (SIGTERM) 16:27:31.252168 --- ParallelTerminationStrategy: PID 28209 died... 16:27:31.271478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28209): Terminated: ok {rc=0} 16:27:31.316418 --- ParallelTerminationStrategy: PID 28212 died... 16:27:31.336146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28212): Terminated: ok {rc=0} 16:27:31.381483 --- ParallelTerminationStrategy: PID 28215 died... 16:27:31.401201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28215): Terminated: ok {rc=0} 16:27:31.486645 bus /sierra_3: Setting Powered False 16:27:32.582586 bus /sierra_3: Setting Powered False 16:27:33.696405 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 16:27:34.950407 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:27:34.955434 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 16:27:34.988509 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 16:27:35.015044 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 16:27:35.067377 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 16:27:35.100818 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 16:27:35.127289 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 16:27:35.677883 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 16:27:35.735730 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:35.747262 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 16:27:35.798359 tst mo_mt_call.py: using LAC 30078 16:27:35.929125 tst mo_mt_call.py: using RAC 243 16:27:36.056629 tst mo_mt_call.py: using CellId 30078 16:27:36.184454 tst mo_mt_call.py: using BVCI 30079 16:27:36.305103 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:36.316742 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:36.328117 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:36.339791 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:36.351616 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:36.363735 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 16:27:36.481240 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 16:27:36.600498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:37.115615 run create_hlr_db(pid=28226): Launched 16:27:37.243057 bus /sierra_2: Setting Powered False 16:27:38.308405 run create_hlr_db(pid=28226): Terminated: ok {rc=0} 16:27:38.751629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Launched 16:27:39.063552 run osmo-hlr_10.42.42.2(pid=28229): Launched 16:27:39.182998 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:39.721336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Launched 16:27:40.033183 run osmo-stp_10.42.42.5(pid=28232): Launched 16:27:40.151073 run osmo-msc_10.42.42.6: Starting osmo-msc 16:27:40.714136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28234): Launched 16:27:41.027732 run osmo-msc_10.42.42.6(pid=28235): Launched 16:27:41.201191 run osmo-stp_10.42.42.5(pid=28232): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] 16:27:41.331735 run osmo-stp_10.42.42.5(pid=28232): stdout: | (launched: 2022-12-12_16:27:39.974418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:41.462086 run osmo-stp_10.42.42.5(pid=28232): stderr: | 20221212162740147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162740147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162740147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162740148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162740148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162740148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162740149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:41.590511 run osmo-stp_10.42.42.5(pid=28232): stdout: | (launched: 2022-12-12_16:27:39.974418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:41.712939 run osmo-stp_10.42.42.5(pid=28232): stderr: | 20221212162740147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162740147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162740147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162740148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162740148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162740148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162740149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:41.873508 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28232): Process ended prematurely: osmo-stp_10.42.42.5(pid=28232) [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 16:27:41.883488 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:27:41.912232 run osmo-hlr_10.42.42.2(pid=28229): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28229)] 16:27:41.963072 run osmo-hlr_10.42.42.2(pid=28229): stdout: | (launched: 2022-12-12_16:27:39.005164) 16:27:42.015195 run osmo-hlr_10.42.42.2(pid=28229): stderr: | 20221212162739183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162739183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162739183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162739183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162739183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162739183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162739199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162739209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162739209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162739209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:42.088357 run osmo-msc_10.42.42.6(pid=28235): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28235)] 16:27:42.139187 run osmo-msc_10.42.42.6(pid=28235): stdout: | (launched: 2022-12-12_16:27:40.968615) 16:27:42.191292 run osmo-msc_10.42.42.6(pid=28235): stderr: | 20221212162741243 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162741243 DLGLOBAL DEBUG validating counter group 0x7f9f480d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162741243 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162741243 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162741243 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162741244 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162741245 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162741246 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162741246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162741246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:27:42.243831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Terminating (SIGTERM) 16:27:42.286030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Terminating (SIGTERM) 16:27:42.328441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28234): Terminating (SIGTERM) 16:27:42.371461 --- ParallelTerminationStrategy: PID 28228 died... 16:27:42.391755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Terminated: ok {rc=0} 16:27:42.438750 --- ParallelTerminationStrategy: PID 28231 died... 16:27:42.458413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Terminated: ok {rc=0} 16:27:42.505247 --- ParallelTerminationStrategy: PID 28234 died... 16:27:42.524860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28234): Terminated: ok {rc=0} 16:27:42.614659 bus /sierra_3: Setting Powered False 16:27:43.714109 bus /sierra_3: Setting Powered False 16:27:44.831755 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 16:27:45.985438 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:45.997897 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 16:27:46.049228 tst mo_mt_call_osmux.py: using LAC 30079 16:27:46.217945 tst mo_mt_call_osmux.py: using RAC 244 16:27:46.343920 tst mo_mt_call_osmux.py: using CellId 30079 16:27:46.493029 tst mo_mt_call_osmux.py: using BVCI 30080 16:27:46.618329 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:46.630957 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:46.643313 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:46.658030 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:46.671896 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 16:27:46.684292 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 16:27:46.826601 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 16:27:46.945968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:47.436421 run create_hlr_db(pid=28237): Launched 16:27:47.565662 bus /sierra_2: Setting Powered False 16:27:48.628151 run create_hlr_db(pid=28237): Terminated: ok {rc=0} 16:27:49.060836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28239): Launched 16:27:49.375050 run osmo-hlr_10.42.42.2(pid=28240): Launched 16:27:49.493363 run osmo-stp_10.42.42.5: Starting osmo-stp 16:27:50.033660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28242): Launched 16:27:50.347086 run osmo-stp_10.42.42.5(pid=28243): Launched 16:27:50.467893 run osmo-msc_10.42.42.6: Starting osmo-msc 16:27:51.052596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28245): Launched 16:27:51.364835 run osmo-msc_10.42.42.6(pid=28246): Launched 16:27:51.538923 run osmo-stp_10.42.42.5(pid=28243): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28243)] 16:27:51.669140 run osmo-stp_10.42.42.5(pid=28243): stdout: | (launched: 2022-12-12_16:27:50.288263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:51.798907 run osmo-stp_10.42.42.5(pid=28243): stderr: | 20221212162750461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162750461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162750462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162750462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162750463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162750463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162750463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:51.927556 run osmo-stp_10.42.42.5(pid=28243): stdout: | (launched: 2022-12-12_16:27:50.288263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:27:52.050562 run osmo-stp_10.42.42.5(pid=28243): stderr: | 20221212162750461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162750461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162750462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162750462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162750463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162750463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162750463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:27:52.197589 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28243): Process ended prematurely: osmo-stp_10.42.42.5(pid=28243) [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28243)] [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 16:27:52.206787 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:27:52.233598 run osmo-hlr_10.42.42.2(pid=28240): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28240)] 16:27:52.281341 run osmo-hlr_10.42.42.2(pid=28240): stdout: | (launched: 2022-12-12_16:27:49.316218) 16:27:52.330910 run osmo-hlr_10.42.42.2(pid=28240): stderr: | 20221212162749494 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162749494 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162749494 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162749494 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162749494 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162749494 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162749506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162749514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162749515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162749515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:27:52.399725 run osmo-msc_10.42.42.6(pid=28246): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28246)] 16:27:52.447578 run osmo-msc_10.42.42.6(pid=28246): stdout: | (launched: 2022-12-12_16:27:51.306013) 16:27:52.497024 run osmo-msc_10.42.42.6(pid=28246): stderr: | 20221212162751582 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162751583 DLGLOBAL DEBUG validating counter group 0x7f1b07becc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162751583 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162751583 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162751583 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162751583 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162751585 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162751585 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162751586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162751586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:27:52.546600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28239): Terminating (SIGTERM) 16:27:52.586250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28242): Terminating (SIGTERM) 16:27:52.626145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28245): Terminating (SIGTERM) 16:27:52.666060 --- ParallelTerminationStrategy: PID 28239 died... 16:27:52.685266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28239): Terminated: ok {rc=0} 16:27:52.729364 --- ParallelTerminationStrategy: PID 28242 died... 16:27:52.748003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28242): Terminated: ok {rc=0} 16:27:52.792370 --- ParallelTerminationStrategy: PID 28245 died... 16:27:52.811157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28245): Terminated: ok {rc=0} 16:27:52.894336 bus /sierra_3: Setting Powered False 16:27:53.992652 bus /sierra_3: Setting Powered False 16:27:55.110012 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:27:56.362435 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:27:56.369039 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:27:56.402144 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 16:27:56.428714 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 16:27:56.483067 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:27:56.516232 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 16:27:56.542660 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 16:27:57.093822 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 16:27:57.143184 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:27:57.154548 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:27:57.207369 tst mo_mt_call.py: using LAC 30080 16:27:57.328579 tst mo_mt_call.py: using RAC 245 16:27:57.453421 tst mo_mt_call.py: using CellId 30080 16:27:57.576312 tst mo_mt_call.py: using BVCI 30081 16:27:57.690265 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:27:57.701691 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:27:57.712757 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:27:57.723970 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:27:57.735214 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:27:57.746476 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:27:57.865754 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:27:57.983191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:27:58.466050 run create_hlr_db(pid=28251): Launched 16:27:58.594186 bus /sierra_2: Setting Powered False 16:27:59.655187 run create_hlr_db(pid=28251): Terminated: ok {rc=0} 16:28:00.106554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28253): Launched 16:28:00.440342 run osmo-hlr_10.42.42.2(pid=28254): Launched 16:28:00.568100 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:01.190929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28256): Launched 16:28:01.550488 run osmo-stp_10.42.42.5(pid=28257): Launched 16:28:01.678756 run osmo-msc_10.42.42.6: Starting osmo-msc 16:28:02.395918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28259): Launched 16:28:02.710703 run osmo-msc_10.42.42.6(pid=28260): Launched 16:28:02.883595 run osmo-stp_10.42.42.5(pid=28257): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28257)] 16:28:03.014103 run osmo-stp_10.42.42.5(pid=28257): stdout: | (launched: 2022-12-12_16:28:01.489691) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:03.144168 run osmo-stp_10.42.42.5(pid=28257): stderr: | 20221212162801844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162801844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162801845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162801846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162801846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162801846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162801846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:03.273141 run osmo-stp_10.42.42.5(pid=28257): stdout: | (launched: 2022-12-12_16:28:01.489691) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:03.396063 run osmo-stp_10.42.42.5(pid=28257): stderr: | 20221212162801844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162801844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162801845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162801846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162801846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162801846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162801846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:03.543140 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28257): Process ended prematurely: osmo-stp_10.42.42.5(pid=28257) [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28257)] [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 16:28:03.552137 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:28:03.578506 run osmo-hlr_10.42.42.2(pid=28254): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28254)] 16:28:03.625938 run osmo-hlr_10.42.42.2(pid=28254): stdout: | (launched: 2022-12-12_16:28:00.378433) 16:28:03.674921 run osmo-hlr_10.42.42.2(pid=28254): stderr: | 20221212162800576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162800576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162800576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162800576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162800576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162800576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162800588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162800597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162800597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162800597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:03.743470 run osmo-msc_10.42.42.6(pid=28260): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28260)] 16:28:03.790724 run osmo-msc_10.42.42.6(pid=28260): stdout: | (launched: 2022-12-12_16:28:02.651350) 16:28:03.839743 run osmo-msc_10.42.42.6(pid=28260): stderr: | 20221212162802928 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162802929 DLGLOBAL DEBUG validating counter group 0x7f014d9ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162802929 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162802929 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162802929 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162802929 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162802931 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162802931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162802931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162802931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:28:03.889179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28253): Terminating (SIGTERM) 16:28:03.928529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28256): Terminating (SIGTERM) 16:28:03.968107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28259): Terminating (SIGTERM) 16:28:04.007987 --- ParallelTerminationStrategy: PID 28253 died... 16:28:04.026920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28253): Terminated: ok {rc=0} 16:28:04.071146 --- ParallelTerminationStrategy: PID 28256 died... 16:28:04.089664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28256): Terminated: ok {rc=0} 16:28:04.134016 --- ParallelTerminationStrategy: PID 28259 died... 16:28:04.152532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28259): Terminated: ok {rc=0} 16:28:04.238540 bus /sierra_3: Setting Powered False 16:28:05.338100 bus /sierra_3: Setting Powered False 16:28:06.454095 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 16:28:07.603667 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:28:07.615845 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:28:07.669774 tst mo_mt_call_osmux.py: using LAC 30081 16:28:07.792803 tst mo_mt_call_osmux.py: using RAC 246 16:28:07.916368 tst mo_mt_call_osmux.py: using CellId 30081 16:28:08.039277 tst mo_mt_call_osmux.py: using BVCI 30082 16:28:08.153155 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:28:08.164505 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:28:08.175806 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:28:08.186971 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:28:08.198292 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:28:08.209496 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:28:08.329823 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:28:08.452549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:08.938980 run create_hlr_db(pid=28262): Launched 16:28:09.067320 bus /sierra_2: Setting Powered False 16:28:10.128737 run create_hlr_db(pid=28262): Terminated: ok {rc=0} 16:28:10.583413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28264): Launched 16:28:10.916080 run osmo-hlr_10.42.42.2(pid=28265): Launched 16:28:11.045389 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:11.618269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28267): Launched 16:28:11.950266 run osmo-stp_10.42.42.5(pid=28268): Launched 16:28:12.076553 run osmo-msc_10.42.42.6: Starting osmo-msc 16:28:12.678552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28270): Launched 16:28:13.012682 run osmo-msc_10.42.42.6(pid=28271): Launched 16:28:13.197166 run osmo-stp_10.42.42.5(pid=28268): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28268)] 16:28:13.336359 run osmo-stp_10.42.42.5(pid=28268): stdout: | (launched: 2022-12-12_16:28:11.887736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:13.476570 run osmo-stp_10.42.42.5(pid=28268): stderr: | 20221212162812078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162812078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162812078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162812079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162812079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162812079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162812079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:13.614223 run osmo-stp_10.42.42.5(pid=28268): stdout: | (launched: 2022-12-12_16:28:11.887736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:13.745883 run osmo-stp_10.42.42.5(pid=28268): stderr: | 20221212162812078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162812078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162812078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162812079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162812079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162812079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162812079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:13.903323 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28268): Process ended prematurely: osmo-stp_10.42.42.5(pid=28268) [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28268)] [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 16:28:13.913355 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:28:13.942330 run osmo-hlr_10.42.42.2(pid=28265): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28265)] 16:28:13.993293 run osmo-hlr_10.42.42.2(pid=28265): stdout: | (launched: 2022-12-12_16:28:10.854265) 16:28:14.045723 run osmo-hlr_10.42.42.2(pid=28265): stderr: | 20221212162811052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162811052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162811052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162811052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162811052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162811052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162811064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162811074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162811074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162811074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:14.118547 run osmo-msc_10.42.42.6(pid=28271): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28271)] 16:28:14.169250 run osmo-msc_10.42.42.6(pid=28271): stdout: | (launched: 2022-12-12_16:28:12.950805) 16:28:14.221621 run osmo-msc_10.42.42.6(pid=28271): stderr: | 20221212162813270 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162813270 DLGLOBAL DEBUG validating counter group 0x7f2243161c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162813271 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162813271 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162813271 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162813271 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162813273 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162813273 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162813273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162813274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:28:14.274648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28264): Terminating (SIGTERM) 16:28:14.317223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28267): Terminating (SIGTERM) 16:28:14.359937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28270): Terminating (SIGTERM) 16:28:14.402846 --- ParallelTerminationStrategy: PID 28264 died... 16:28:14.422962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28264): Terminated: ok {rc=0} 16:28:14.470130 --- ParallelTerminationStrategy: PID 28267 died... 16:28:14.489696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28267): Terminated: ok {rc=0} 16:28:14.536791 --- ParallelTerminationStrategy: PID 28270 died... 16:28:14.556774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28270): Terminated: ok {rc=0} 16:28:14.645457 bus /sierra_3: Setting Powered False 16:28:15.744690 bus /sierra_3: Setting Powered False 16:28:16.885288 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 emergency:trx-b200 --------------------------------------------------------------------- 16:28:18.138220 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:28:18.143103 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 16:28:18.177006 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 16:28:18.203589 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 16:28:18.288801 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 16:28:18.323637 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 16:28:18.351358 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 16:28:18.930694 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2379 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 16:28:18.936071 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:18.946974 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 16:28:18.996705 tst emergency_mo_mt_call.py: using LAC 30082 16:28:19.116626 tst emergency_mo_mt_call.py: using RAC 247 16:28:19.236814 tst emergency_mo_mt_call.py: using CellId 30082 16:28:19.356318 tst emergency_mo_mt_call.py: using BVCI 30083 16:28:19.467970 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:19.478725 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:19.489298 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:19.499781 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:19.510323 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:19.520792 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:28:19.635967 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:28:19.750986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:20.224292 run create_hlr_db(pid=28276): Launched 16:28:20.349823 bus /sierra_2: Setting Powered False 16:28:21.410443 run create_hlr_db(pid=28276): Terminated: ok {rc=0} 16:28:21.855921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28278): Launched 16:28:22.184451 run osmo-hlr_10.42.42.2(pid=28279): Launched 16:28:22.309089 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:22.872318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28281): Launched 16:28:23.202475 run osmo-stp_10.42.42.5(pid=28282): Launched 16:28:23.337155 tst emergency_mo_mt_call.py: using MSISDN 7864 16:28:23.505537 run osmo-msc_10.42.42.6: Starting osmo-msc 16:28:24.091523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28284): Launched 16:28:24.419309 run osmo-msc_10.42.42.6(pid=28285): Launched 16:28:24.601578 run osmo-stp_10.42.42.5(pid=28282): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28282)] 16:28:24.738641 run osmo-stp_10.42.42.5(pid=28282): stdout: | (launched: 2022-12-12_16:28:23.140901) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:24.876624 run osmo-stp_10.42.42.5(pid=28282): stderr: | 20221212162823331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162823331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162823331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162823332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162823333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162823333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162823333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:25.013036 run osmo-stp_10.42.42.5(pid=28282): stdout: | (launched: 2022-12-12_16:28:23.140901) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:25.143044 run osmo-stp_10.42.42.5(pid=28282): stderr: | 20221212162823331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162823331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162823331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162823332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162823333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162823333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162823333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:25.297964 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28282): Process ended prematurely: osmo-stp_10.42.42.5(pid=28282) [trial-2379↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28282)] [trial-2379↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 16:28:25.307308 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 16:28:25.335489 run osmo-hlr_10.42.42.2(pid=28279): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28279)] 16:28:25.386471 run osmo-hlr_10.42.42.2(pid=28279): stdout: | (launched: 2022-12-12_16:28:22.123472) 16:28:25.438948 run osmo-hlr_10.42.42.2(pid=28279): stderr: | 20221212162822317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162822317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162822317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162822317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162822317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162822317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162822329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162822340 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162822340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162822340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:25.511674 run osmo-msc_10.42.42.6(pid=28285): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28285)] 16:28:25.562227 run osmo-msc_10.42.42.6(pid=28285): stdout: | (launched: 2022-12-12_16:28:24.357763) 16:28:25.614446 run osmo-msc_10.42.42.6(pid=28285): stderr: | 20221212162824677 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162824677 DLGLOBAL DEBUG validating counter group 0x7fd8165f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162824677 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162824677 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162824678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162824678 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162824679 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162824680 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162824680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162824680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:28:25.666720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28278): Terminating (SIGTERM) 16:28:25.709092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28281): Terminating (SIGTERM) 16:28:25.751385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28284): Terminating (SIGTERM) 16:28:25.793959 --- ParallelTerminationStrategy: PID 28278 died... 16:28:25.814061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28278): Terminated: ok {rc=0} 16:28:25.861154 --- ParallelTerminationStrategy: PID 28281 died... 16:28:25.881043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28281): Terminated: ok {rc=0} 16:28:25.927628 --- ParallelTerminationStrategy: PID 28284 died... 16:28:25.947282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28284): Terminated: ok {rc=0} 16:28:26.035227 bus /sierra_3: Setting Powered False 16:28:27.137470 bus /sierra_3: Setting Powered False 16:28:28.253325 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 16:28:29.339894 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:29.352051 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 16:28:29.408863 tst emergency_preemptive_call.py: using LAC 30083 16:28:29.536580 tst emergency_preemptive_call.py: using RAC 248 16:28:29.662791 tst emergency_preemptive_call.py: using CellId 30083 16:28:29.788911 tst emergency_preemptive_call.py: using BVCI 30084 16:28:29.907345 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:29.918693 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:29.929775 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:29.941681 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:29.953601 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 16:28:29.965562 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:28:30.084363 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:28:30.202487 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:28:30.318631 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 16:28:30.433682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:30.922873 run create_hlr_db(pid=28287): Launched 16:28:31.077612 bus /sierra_2: Setting Powered False 16:28:32.168798 run create_hlr_db(pid=28287): Terminated: ok {rc=0} 16:28:32.619281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28289): Launched 16:28:32.947367 run osmo-hlr_10.42.42.2(pid=28290): Launched 16:28:33.072437 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:33.634513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28292): Launched 16:28:33.963091 run osmo-stp_10.42.42.5(pid=28293): Launched 16:28:34.097890 tst emergency_preemptive_call.py: using MSISDN 7865 16:28:34.267736 run osmo-msc_10.42.42.6: Starting osmo-msc 16:28:34.853706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28295): Launched 16:28:35.184117 run osmo-msc_10.42.42.6(pid=28296): Launched 16:28:35.367293 run osmo-stp_10.42.42.5(pid=28293): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28293)] 16:28:35.505848 run osmo-stp_10.42.42.5(pid=28293): stdout: | (launched: 2022-12-12_16:28:33.901689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:35.643809 run osmo-stp_10.42.42.5(pid=28293): stderr: | 20221212162834092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162834092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162834092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162834093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162834093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162834094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162834094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:35.780748 run osmo-stp_10.42.42.5(pid=28293): stdout: | (launched: 2022-12-12_16:28:33.901689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:35.910978 run osmo-stp_10.42.42.5(pid=28293): stderr: | 20221212162834092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162834092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162834092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162834093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162834093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162834094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162834094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:36.066487 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28293): Process ended prematurely: osmo-stp_10.42.42.5(pid=28293) [trial-2379↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28293)] [trial-2379↪emergency:trx-b200↪emergency_preemptive_call.py:32] 16:28:36.075900 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 16:28:36.104591 run osmo-hlr_10.42.42.2(pid=28290): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28290)] 16:28:36.155935 run osmo-hlr_10.42.42.2(pid=28290): stdout: | (launched: 2022-12-12_16:28:32.886511) 16:28:36.208807 run osmo-hlr_10.42.42.2(pid=28290): stderr: | 20221212162833080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162833081 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162833081 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162833081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162833081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162833081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162833092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162833102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162833102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162833102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:36.282650 run osmo-msc_10.42.42.6(pid=28296): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28296)] 16:28:36.333561 run osmo-msc_10.42.42.6(pid=28296): stdout: | (launched: 2022-12-12_16:28:35.120803) 16:28:36.386205 run osmo-msc_10.42.42.6(pid=28296): stderr: | 20221212162835443 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212162835444 DLGLOBAL DEBUG validating counter group 0x7fee6ac70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212162835444 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212162835444 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212162835444 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212162835444 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212162835446 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212162835447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212162835447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212162835447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:28:36.439693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28289): Terminating (SIGTERM) 16:28:36.482422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28292): Terminating (SIGTERM) 16:28:36.525072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28295): Terminating (SIGTERM) 16:28:36.568012 --- ParallelTerminationStrategy: PID 28289 died... 16:28:36.588449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28289): Terminated: ok {rc=0} 16:28:36.635794 --- ParallelTerminationStrategy: PID 28292 died... 16:28:36.655684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28292): Terminated: ok {rc=0} 16:28:36.702723 --- ParallelTerminationStrategy: PID 28295 died... 16:28:36.722641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28295): Terminated: ok {rc=0} 16:28:36.812015 bus /sierra_9: Setting Powered False 16:28:37.911308 bus /sierra_9: Setting Powered False 16:28:39.028350 bus /sierra_8: Setting Powered False 16:28:40.127582 bus /sierra_8: Setting Powered False 16:28:41.244684 bus /sierra_3: Setting Powered False 16:28:42.341614 bus /sierra_3: Setting Powered False 16:28:43.458017 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-b200 --------------------------------------------------------------------- 16:28:44.738898 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:28:44.743310 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 16:28:44.776055 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 16:28:44.814281 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 16:28:44.903613 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 16:28:44.939287 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 16:28:44.979205 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 16:28:45.560661 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 16:28:45.616445 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:45.627635 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:28:45.680540 tst cs_paging_gprs_active.py: using LAC 30084 16:28:45.826141 tst cs_paging_gprs_active.py: using RAC 249 16:28:45.994450 tst cs_paging_gprs_active.py: using CellId 30084 16:28:46.169846 tst cs_paging_gprs_active.py: using BVCI 30085 16:28:46.324883 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:46.339924 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:46.354157 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:46.368160 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:46.383361 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:46.397714 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:46.412930 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:46.428086 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:46.440123 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:28:46.590814 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:28:46.714027 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:28:46.945711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:47.285984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28302): Launched 16:28:47.588595 run iperf3-srv_10.42.42.10(pid=28303): Launched 16:28:47.715558 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:28:47.939758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:28:48.275451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28304): Launched 16:28:48.567158 run iperf3-srv_10.42.42.10(pid=28305): Launched 16:28:48.692205 tst cs_paging_gprs_active.py:38: start network... 16:28:48.916677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:28:49.434550 run create_hlr_db(pid=28306): Launched 16:28:49.564291 bus /sierra_2: Setting Powered False 16:28:50.628740 run create_hlr_db(pid=28306): Terminated: ok {rc=0} 16:28:51.072641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28308): Launched 16:28:51.387897 run osmo-hlr_10.42.42.2(pid=28309): Launched 16:28:51.507220 run osmo-stp_10.42.42.5: Starting osmo-stp 16:28:52.057822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28311): Launched 16:28:52.370183 run osmo-stp_10.42.42.5(pid=28312): Launched 16:28:52.490792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:28:53.030151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28314): Launched 16:28:53.149554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:28:53.414112 run patchelf(pid=28315): Launched 16:28:53.587002 run osmo-stp_10.42.42.5(pid=28312): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28312)] 16:28:53.719076 run osmo-stp_10.42.42.5(pid=28312): stdout: | (launched: 2022-12-12_16:28:52.310803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:53.852653 run osmo-stp_10.42.42.5(pid=28312): stderr: | 20221212162852484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162852484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162852484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162852484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162852485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162852485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162852485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:53.986395 run osmo-stp_10.42.42.5(pid=28312): stdout: | (launched: 2022-12-12_16:28:52.310803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:28:54.114990 run osmo-stp_10.42.42.5(pid=28312): stderr: | 20221212162852484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162852484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162852484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162852484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162852485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162852485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162852485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:28:54.266579 run patchelf(pid=28315): Terminating (SIGINT) 16:28:54.440683 run patchelf(pid=28315): Terminated: ok {rc=0} 16:28:54.566726 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28312): Process ended prematurely: osmo-stp_10.42.42.5(pid=28312) [trial-2379↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28312)] [trial-2379↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 16:28:54.576568 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:28:54.604138 run osmo-hlr_10.42.42.2(pid=28309): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28309)] 16:28:54.651859 run osmo-hlr_10.42.42.2(pid=28309): stdout: | (launched: 2022-12-12_16:28:51.329200) 16:28:54.701204 run osmo-hlr_10.42.42.2(pid=28309): stderr: | 20221212162851506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162851506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162851506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162851506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162851506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162851506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162851518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162851527 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162851527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162851527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:28:54.750736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28302): Terminating (SIGTERM) 16:28:54.790466 run iperf3-srv_10.42.42.10(pid=28303): Terminating (SIGTERM) 16:28:54.830340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28304): Terminating (SIGTERM) 16:28:54.870157 run iperf3-srv_10.42.42.10(pid=28305): Terminating (SIGTERM) 16:28:54.909853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28308): Terminating (SIGTERM) 16:28:54.949662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28311): Terminating (SIGTERM) 16:28:54.989566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28314): Terminating (SIGTERM) 16:28:55.029782 --- ParallelTerminationStrategy: PID 28302 died... 16:28:55.049137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28302): Terminated: ok {rc=0} 16:28:55.093830 --- ParallelTerminationStrategy: PID 28303 died... 16:28:55.112609 run iperf3-srv_10.42.42.10(pid=28303): Terminated {rc=256} 16:28:55.157442 --- ParallelTerminationStrategy: PID 28304 died... 16:28:55.175956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28304): Terminated: ok {rc=0} 16:28:55.219493 --- ParallelTerminationStrategy: PID 28305 died... 16:28:55.238263 run iperf3-srv_10.42.42.10(pid=28305): Terminated {rc=256} 16:28:55.281745 --- ParallelTerminationStrategy: PID 28308 died... 16:28:55.300401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28308): Terminated: ok {rc=0} 16:28:55.344013 --- ParallelTerminationStrategy: PID 28311 died... 16:28:55.362440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28311): Terminated: ok {rc=0} 16:28:55.406067 --- ParallelTerminationStrategy: PID 28314 died... 16:28:55.424478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28314): Terminated: ok {rc=0} 16:28:55.511138 bus /gobi_0: Setting Powered False 16:28:56.613058 bus /gobi_0: Setting Powered False 16:28:57.728782 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200 iperf3.py ---------------------------------------------- 16:28:58.878296 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:58.889841 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:28:58.941645 tst iperf3.py: using LAC 30085 16:28:59.072650 tst iperf3.py: using RAC 250 16:28:59.204509 tst iperf3.py: using CellId 30085 16:28:59.337169 tst iperf3.py: using BVCI 30086 16:28:59.451085 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:59.462124 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:59.472800 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:59.483328 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:59.493741 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:59.504066 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:59.514669 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:59.525155 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:28:59.535909 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:28:59.650264 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:28:59.858088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:00.172097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28317): Launched 16:29:00.445198 run iperf3-srv_10.42.42.10(pid=28318): Launched 16:29:00.561160 tst iperf3.py:8: start network... 16:29:00.768099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:01.273825 run create_hlr_db(pid=28319): Launched 16:29:01.428577 bus /gobi_6: Setting Powered False 16:29:02.490201 run create_hlr_db(pid=28319): Terminated: ok {rc=0} 16:29:02.943327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28322): Launched 16:29:03.276393 run osmo-hlr_10.42.42.2(pid=28323): Launched 16:29:03.404604 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:03.977710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28325): Launched 16:29:04.311234 run osmo-stp_10.42.42.5(pid=28326): Launched 16:29:04.439804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:05.013582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28328): Launched 16:29:05.141448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:05.424940 run patchelf(pid=28329): Launched 16:29:05.610251 run osmo-stp_10.42.42.5(pid=28326): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28326)] 16:29:05.750364 run osmo-stp_10.42.42.5(pid=28326): stdout: | (launched: 2022-12-12_16:29:04.248824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:05.892207 run osmo-stp_10.42.42.5(pid=28326): stderr: | 20221212162904439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162904439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162904440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162904440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162904441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162904441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162904441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:06.034177 run osmo-stp_10.42.42.5(pid=28326): stdout: | (launched: 2022-12-12_16:29:04.248824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:06.170234 run osmo-stp_10.42.42.5(pid=28326): stderr: | 20221212162904439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162904439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162904440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162904440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162904441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162904441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162904441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:06.331204 run patchelf(pid=28329): Terminating (SIGINT) 16:29:06.516785 run patchelf(pid=28329): Terminated: ok {rc=0} 16:29:06.650294 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28326): Process ended prematurely: osmo-stp_10.42.42.5(pid=28326) [trial-2379↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28326)] [trial-2379↪gprs:trx-b200↪iperf3.py:8] 16:29:06.660592 tst iperf3.py:8: Test FAILED (7.8 sec) 16:29:06.689953 run osmo-hlr_10.42.42.2(pid=28323): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28323)] 16:29:06.740435 run osmo-hlr_10.42.42.2(pid=28323): stdout: | (launched: 2022-12-12_16:29:03.214307) 16:29:06.792925 run osmo-hlr_10.42.42.2(pid=28323): stderr: | 20221212162903411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162903411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162903411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162903411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162903411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162903412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162903424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162903435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162903435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162903435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:06.845682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28317): Terminating (SIGTERM) 16:29:06.888179 run iperf3-srv_10.42.42.10(pid=28318): Terminating (SIGTERM) 16:29:06.931067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28322): Terminating (SIGTERM) 16:29:06.974108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28325): Terminating (SIGTERM) 16:29:07.016371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28328): Terminating (SIGTERM) 16:29:07.059078 --- ParallelTerminationStrategy: PID 28317 died... 16:29:07.079403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28317): Terminated: ok {rc=0} 16:29:07.126714 --- ParallelTerminationStrategy: PID 28318 died... 16:29:07.146458 run iperf3-srv_10.42.42.10(pid=28318): Terminated {rc=256} 16:29:07.193362 --- ParallelTerminationStrategy: PID 28322 died... 16:29:07.213212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28322): Terminated: ok {rc=0} 16:29:07.260258 --- ParallelTerminationStrategy: PID 28325 died... 16:29:07.279976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28325): Terminated: ok {rc=0} 16:29:07.326834 --- ParallelTerminationStrategy: PID 28328 died... 16:29:07.346671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28328): Terminated: ok {rc=0} 16:29:07.435322 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 16:29:08.586071 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:08.598168 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:29:08.649827 tst iperf3m4.py: using LAC 30086 16:29:08.780465 tst iperf3m4.py: using RAC 251 16:29:08.910614 tst iperf3m4.py: using CellId 30086 16:29:09.042337 tst iperf3m4.py: using BVCI 30087 16:29:09.165207 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:09.176480 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:09.187545 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:09.198885 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:09.210158 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:09.221419 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:09.232800 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:09.244071 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:09.256068 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:29:09.376390 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:29:09.499504 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:29:09.620063 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:29:09.738569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:29:09.947281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:10.261993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28330): Launched 16:29:10.534388 run iperf3-srv_10.42.42.10(pid=28331): Launched 16:29:10.650976 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:29:10.859653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:11.174343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28332): Launched 16:29:11.449336 run iperf3-srv_10.42.42.10(pid=28333): Launched 16:29:11.565972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:29:11.774243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:12.088004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28334): Launched 16:29:12.365725 run iperf3-srv_10.42.42.10(pid=28335): Launched 16:29:12.500818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:29:12.726183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:13.063050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28336): Launched 16:29:13.355345 run iperf3-srv_10.42.42.10(pid=28337): Launched 16:29:13.482278 tst iperf3m4.py:8: start network... 16:29:13.706232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:14.224766 run create_hlr_db(pid=28338): Launched 16:29:14.353265 bus /gobi_6: Setting Powered False 16:29:15.418883 run create_hlr_db(pid=28338): Terminated: ok {rc=0} 16:29:15.900921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28340): Launched 16:29:16.269659 run osmo-hlr_10.42.42.2(pid=28341): Launched 16:29:16.415173 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:17.156220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28343): Launched 16:29:17.512886 run osmo-stp_10.42.42.5(pid=28344): Launched 16:29:17.641069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:18.214788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28346): Launched 16:29:18.343596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:18.626858 run patchelf(pid=28347): Launched 16:29:18.812249 run osmo-stp_10.42.42.5(pid=28344): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28344)] 16:29:18.953240 run osmo-stp_10.42.42.5(pid=28344): stdout: | (launched: 2022-12-12_16:29:17.450033) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:19.095620 run osmo-stp_10.42.42.5(pid=28344): stderr: | 20221212162917642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162917642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162917642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162917642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162917643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162917643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162917643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:19.237742 run osmo-stp_10.42.42.5(pid=28344): stdout: | (launched: 2022-12-12_16:29:17.450033) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:19.374525 run osmo-stp_10.42.42.5(pid=28344): stderr: | 20221212162917642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162917642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162917642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162917642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162917643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162917643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162917643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:19.536714 run patchelf(pid=28347): Terminating (SIGINT) 16:29:19.721775 run patchelf(pid=28347): Terminated: ok {rc=0} 16:29:19.855640 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28344): Process ended prematurely: osmo-stp_10.42.42.5(pid=28344) [trial-2379↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28344)] [trial-2379↪gprs:trx-b200↪iperf3m4.py:8] 16:29:19.866325 tst iperf3m4.py:8: Test FAILED (11.3 sec) 16:29:19.895697 run osmo-hlr_10.42.42.2(pid=28341): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28341)] 16:29:19.946481 run osmo-hlr_10.42.42.2(pid=28341): stdout: | (launched: 2022-12-12_16:29:16.202863) 16:29:19.998492 run osmo-hlr_10.42.42.2(pid=28341): stderr: | 20221212162916560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162916560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162916560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162916560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162916560 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162916560 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162916579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162916595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162916595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162916595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:20.050952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28330): Terminating (SIGTERM) 16:29:20.093170 run iperf3-srv_10.42.42.10(pid=28331): Terminating (SIGTERM) 16:29:20.135219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28332): Terminating (SIGTERM) 16:29:20.177555 run iperf3-srv_10.42.42.10(pid=28333): Terminating (SIGTERM) 16:29:20.219728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28334): Terminating (SIGTERM) 16:29:20.262024 run iperf3-srv_10.42.42.10(pid=28335): Terminating (SIGTERM) 16:29:20.304255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28336): Terminating (SIGTERM) 16:29:20.346458 run iperf3-srv_10.42.42.10(pid=28337): Terminating (SIGTERM) 16:29:20.388247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28340): Terminating (SIGTERM) 16:29:20.430757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28343): Terminating (SIGTERM) 16:29:20.473008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28346): Terminating (SIGTERM) 16:29:20.515412 --- ParallelTerminationStrategy: PID 28330 died... 16:29:20.535460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28330): Terminated: ok {rc=0} 16:29:20.582974 --- ParallelTerminationStrategy: PID 28331 died... 16:29:20.602590 run iperf3-srv_10.42.42.10(pid=28331): Terminated {rc=256} 16:29:20.648782 --- ParallelTerminationStrategy: PID 28332 died... 16:29:20.668785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28332): Terminated: ok {rc=0} 16:29:20.715627 --- ParallelTerminationStrategy: PID 28333 died... 16:29:20.735221 run iperf3-srv_10.42.42.10(pid=28333): Terminated {rc=256} 16:29:20.781440 --- ParallelTerminationStrategy: PID 28334 died... 16:29:20.801048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28334): Terminated: ok {rc=0} 16:29:20.847584 --- ParallelTerminationStrategy: PID 28335 died... 16:29:20.867182 run iperf3-srv_10.42.42.10(pid=28335): Terminated {rc=256} 16:29:20.913448 --- ParallelTerminationStrategy: PID 28336 died... 16:29:20.933044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28336): Terminated: ok {rc=0} 16:29:20.979548 --- ParallelTerminationStrategy: PID 28337 died... 16:29:20.999055 run iperf3-srv_10.42.42.10(pid=28337): Terminated {rc=256} 16:29:21.045513 --- ParallelTerminationStrategy: PID 28340 died... 16:29:21.064935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28340): Terminated: ok {rc=0} 16:29:21.111809 --- ParallelTerminationStrategy: PID 28343 died... 16:29:21.131526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28343): Terminated: ok {rc=0} 16:29:21.178489 --- ParallelTerminationStrategy: PID 28346 died... 16:29:21.198197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28346): Terminated: ok {rc=0} 16:29:21.287200 bus /gobi_4: Setting Powered False 16:29:22.384688 bus /gobi_4: Setting Powered False 16:29:23.501103 bus /gobi_1: Setting Powered False 16:29:24.600902 bus /gobi_1: Setting Powered False 16:29:25.717060 bus /gobi_0: Setting Powered False 16:29:26.815986 bus /gobi_0: Setting Powered False 16:29:27.935814 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200 ping.py ---------------------------------------------- 16:29:29.038651 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:29.050132 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:29:29.100173 tst ping.py: using LAC 30087 16:29:29.220743 tst ping.py: using RAC 252 16:29:29.339856 tst ping.py: using CellId 30087 16:29:29.461336 tst ping.py: using BVCI 30088 16:29:29.571646 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:29.582487 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:29.593159 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:29.603725 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:29.614201 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:29.624670 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:29.635390 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:29.646048 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:29:29.760807 tst ping.py:19: start network... 16:29:29.963344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:30.433927 run create_hlr_db(pid=28348): Launched 16:29:30.559905 bus /gobi_6: Setting Powered False 16:29:31.623297 run create_hlr_db(pid=28348): Terminated: ok {rc=0} 16:29:32.104040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28350): Launched 16:29:32.415216 run osmo-hlr_10.42.42.2(pid=28351): Launched 16:29:32.531566 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:33.058149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28353): Launched 16:29:33.365756 run osmo-stp_10.42.42.5(pid=28354): Launched 16:29:33.480602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:34.004251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28356): Launched 16:29:34.121876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:34.381886 run patchelf(pid=28358): Launched 16:29:34.552238 run osmo-stp_10.42.42.5(pid=28354): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28354)] 16:29:34.680225 run osmo-stp_10.42.42.5(pid=28354): stdout: | (launched: 2022-12-12_16:29:33.307727) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:34.810146 run osmo-stp_10.42.42.5(pid=28354): stderr: | 20221212162933479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162933479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162933479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162933480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162933480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162933480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162933480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:34.939909 run osmo-stp_10.42.42.5(pid=28354): stdout: | (launched: 2022-12-12_16:29:33.307727) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:35.064273 run osmo-stp_10.42.42.5(pid=28354): stderr: | 20221212162933479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162933479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162933479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162933480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162933480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162933480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162933480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:35.211923 run patchelf(pid=28358): Terminating (SIGINT) 16:29:35.382485 run patchelf(pid=28358): Terminated: ok {rc=0} 16:29:35.506373 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28354): Process ended prematurely: osmo-stp_10.42.42.5(pid=28354) [trial-2379↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28354)] [trial-2379↪gprs:trx-b200↪ping.py:22] 16:29:35.515433 tst ping.py:22: Test FAILED (6.5 sec) 16:29:35.542542 run osmo-hlr_10.42.42.2(pid=28351): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28351)] 16:29:35.590110 run osmo-hlr_10.42.42.2(pid=28351): stdout: | (launched: 2022-12-12_16:29:32.357414) 16:29:35.639471 run osmo-hlr_10.42.42.2(pid=28351): stderr: | 20221212162932533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162932533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162932533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162932533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162932533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162932533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162932545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162932554 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162932555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162932555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:35.689285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28350): Terminating (SIGTERM) 16:29:35.728782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28353): Terminating (SIGTERM) 16:29:35.768507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28356): Terminating (SIGTERM) 16:29:35.808280 --- ParallelTerminationStrategy: PID 28350 died... 16:29:35.827406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28350): Terminated: ok {rc=0} 16:29:35.871587 --- ParallelTerminationStrategy: PID 28353 died... 16:29:35.890269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28353): Terminated: ok {rc=0} 16:29:35.933802 --- ParallelTerminationStrategy: PID 28356 died... 16:29:35.952292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28356): Terminated: ok {rc=0} 16:29:36.038117 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 16:29:37.127591 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:37.139504 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 16:29:37.196503 tst ping_idle_ping.py: using LAC 30088 16:29:37.325262 tst ping_idle_ping.py: using RAC 253 16:29:37.456171 tst ping_idle_ping.py: using CellId 30088 16:29:37.578291 tst ping_idle_ping.py: using BVCI 30089 16:29:37.690905 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:37.701824 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:37.712461 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:37.723077 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:37.733934 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:37.744325 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:37.754981 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 16:29:37.765576 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 16:29:37.884026 tst ping_idle_ping.py:24: start network... 16:29:38.105267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:38.614923 run create_hlr_db(pid=28361): Launched 16:29:38.741630 bus /gobi_6: Setting Powered False 16:29:39.806426 run create_hlr_db(pid=28361): Terminated: ok {rc=0} 16:29:40.244831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28363): Launched 16:29:40.552669 run osmo-hlr_10.42.42.2(pid=28364): Launched 16:29:40.670098 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:41.195696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28366): Launched 16:29:41.504178 run osmo-stp_10.42.42.5(pid=28367): Launched 16:29:41.622748 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:42.150271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28369): Launched 16:29:42.266286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:42.525451 run patchelf(pid=28370): Launched 16:29:42.694524 run osmo-stp_10.42.42.5(pid=28367): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28367)] 16:29:42.822925 run osmo-stp_10.42.42.5(pid=28367): stdout: | (launched: 2022-12-12_16:29:41.445506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:42.952788 run osmo-stp_10.42.42.5(pid=28367): stderr: | 20221212162941618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162941618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162941618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162941618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162941619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162941619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162941619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:43.083281 run osmo-stp_10.42.42.5(pid=28367): stdout: | (launched: 2022-12-12_16:29:41.445506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:43.208144 run osmo-stp_10.42.42.5(pid=28367): stderr: | 20221212162941618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162941618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162941618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162941618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162941619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162941619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162941619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:43.356107 run patchelf(pid=28370): Terminating (SIGINT) 16:29:43.527034 run patchelf(pid=28370): Terminated: ok {rc=0} 16:29:43.649608 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28367): Process ended prematurely: osmo-stp_10.42.42.5(pid=28367) [trial-2379↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28367)] [trial-2379↪gprs:trx-b200↪ping_idle_ping.py:27] 16:29:43.658620 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:29:43.685530 run osmo-hlr_10.42.42.2(pid=28364): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28364)] 16:29:43.732774 run osmo-hlr_10.42.42.2(pid=28364): stdout: | (launched: 2022-12-12_16:29:40.494970) 16:29:43.781774 run osmo-hlr_10.42.42.2(pid=28364): stderr: | 20221212162940670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162940670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162940670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162940670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162940670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162940670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162940682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162940693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162940693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162940693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:43.831203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28363): Terminating (SIGTERM) 16:29:43.870599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28366): Terminating (SIGTERM) 16:29:43.909820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28369): Terminating (SIGTERM) 16:29:43.949500 --- ParallelTerminationStrategy: PID 28363 died... 16:29:43.968511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28363): Terminated: ok {rc=0} 16:29:44.011944 --- ParallelTerminationStrategy: PID 28366 died... 16:29:44.030533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28366): Terminated: ok {rc=0} 16:29:44.073871 --- ParallelTerminationStrategy: PID 28369 died... 16:29:44.092155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28369): Terminated: ok {rc=0} 16:29:44.175361 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 16:29:45.486054 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:29:45.491859 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:29:45.525044 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:29:45.563714 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:29:45.650292 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:29:45.682800 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:29:45.720591 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:29:46.356067 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:29:46.448032 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:46.461976 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:29:46.528658 tst cs_paging_gprs_active.py: using LAC 30089 16:29:46.653281 tst cs_paging_gprs_active.py: using RAC 254 16:29:46.809495 tst cs_paging_gprs_active.py: using CellId 30089 16:29:46.970265 tst cs_paging_gprs_active.py: using BVCI 30090 16:29:47.107420 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:47.118971 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:47.130603 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:47.144324 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:47.156539 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:47.167745 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:47.179038 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:47.190173 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:47.201446 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:29:47.321521 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:29:47.442172 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:29:47.670209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:48.005891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28374): Launched 16:29:48.299252 run iperf3-srv_10.42.42.10(pid=28375): Launched 16:29:48.426852 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:29:48.652050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:29:48.987283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28376): Launched 16:29:49.278692 run iperf3-srv_10.42.42.10(pid=28377): Launched 16:29:49.405614 tst cs_paging_gprs_active.py:38: start network... 16:29:49.630974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:29:50.148409 run create_hlr_db(pid=28378): Launched 16:29:50.277890 bus /gobi_6: Setting Powered False 16:29:51.342542 run create_hlr_db(pid=28378): Terminated: ok {rc=0} 16:29:51.806477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28380): Launched 16:29:52.141463 run osmo-hlr_10.42.42.2(pid=28381): Launched 16:29:52.270104 run osmo-stp_10.42.42.5: Starting osmo-stp 16:29:52.845471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28383): Launched 16:29:53.181438 run osmo-stp_10.42.42.5(pid=28384): Launched 16:29:53.310153 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:29:53.886502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28386): Launched 16:29:54.014858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:29:54.298138 run patchelf(pid=28387): Launched 16:29:54.484325 run osmo-stp_10.42.42.5(pid=28384): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28384)] 16:29:54.624615 run osmo-stp_10.42.42.5(pid=28384): stdout: | (launched: 2022-12-12_16:29:53.118997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:54.767419 run osmo-stp_10.42.42.5(pid=28384): stderr: | 20221212162953308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162953308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162953308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162953309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162953309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162953309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162953309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:54.909065 run osmo-stp_10.42.42.5(pid=28384): stdout: | (launched: 2022-12-12_16:29:53.118997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:29:55.046111 run osmo-stp_10.42.42.5(pid=28384): stderr: | 20221212162953308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212162953308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212162953308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212162953309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212162953309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212162953309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212162953309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:29:55.208110 run patchelf(pid=28387): Terminating (SIGINT) 16:29:55.393839 run patchelf(pid=28387): Terminated: ok {rc=0} 16:29:55.528783 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28384): Process ended prematurely: osmo-stp_10.42.42.5(pid=28384) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28384)] [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:29:55.539142 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 16:29:55.568039 run osmo-hlr_10.42.42.2(pid=28381): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28381)] 16:29:55.619436 run osmo-hlr_10.42.42.2(pid=28381): stdout: | (launched: 2022-12-12_16:29:52.078633) 16:29:55.671995 run osmo-hlr_10.42.42.2(pid=28381): stderr: | 20221212162952275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212162952275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212162952275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212162952276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212162952276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212162952276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212162952288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212162952297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212162952297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212162952297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:29:55.724825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28374): Terminating (SIGTERM) 16:29:55.767445 run iperf3-srv_10.42.42.10(pid=28375): Terminating (SIGTERM) 16:29:55.809742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28376): Terminating (SIGTERM) 16:29:55.852132 run iperf3-srv_10.42.42.10(pid=28377): Terminating (SIGTERM) 16:29:55.894382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28380): Terminating (SIGTERM) 16:29:55.936811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28383): Terminating (SIGTERM) 16:29:55.979331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28386): Terminating (SIGTERM) 16:29:56.021835 --- ParallelTerminationStrategy: PID 28374 died... 16:29:56.041969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28374): Terminated: ok {rc=0} 16:29:56.088771 --- ParallelTerminationStrategy: PID 28375 died... 16:29:56.108268 run iperf3-srv_10.42.42.10(pid=28375): Terminated {rc=256} 16:29:56.154735 --- ParallelTerminationStrategy: PID 28376 died... 16:29:56.174361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28376): Terminated: ok {rc=0} 16:29:56.220655 --- ParallelTerminationStrategy: PID 28377 died... 16:29:56.240016 run iperf3-srv_10.42.42.10(pid=28377): Terminated {rc=256} 16:29:56.286432 --- ParallelTerminationStrategy: PID 28380 died... 16:29:56.305872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28380): Terminated: ok {rc=0} 16:29:56.352580 --- ParallelTerminationStrategy: PID 28383 died... 16:29:56.372094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28383): Terminated: ok {rc=0} 16:29:56.418727 --- ParallelTerminationStrategy: PID 28386 died... 16:29:56.438572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28386): Terminated: ok {rc=0} 16:29:56.526341 bus /gobi_0: Setting Powered False 16:29:57.625557 bus /gobi_0: Setting Powered False 16:29:58.741646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:29:59.892581 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:29:59.904625 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:29:59.961121 tst iperf3.py: using LAC 30090 16:30:00.093342 tst iperf3.py: using RAC 255 16:30:00.224324 tst iperf3.py: using CellId 30090 16:30:00.351354 tst iperf3.py: using BVCI 30091 16:30:00.466381 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:00.477889 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:00.488613 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:00.499653 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:00.510535 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:00.521199 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:00.532018 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:00.542712 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:00.553519 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:30:00.672347 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:30:00.921543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:01.266122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28388): Launched 16:30:01.579448 run iperf3-srv_10.42.42.10(pid=28389): Launched 16:30:01.718731 tst iperf3.py:8: start network... 16:30:01.950841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:02.441807 run create_hlr_db(pid=28393): Launched 16:30:02.569899 bus /gobi_6: Setting Powered False 16:30:03.630945 run create_hlr_db(pid=28393): Terminated: ok {rc=0} 16:30:04.085664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28395): Launched 16:30:04.420847 run osmo-hlr_10.42.42.2(pid=28396): Launched 16:30:04.549246 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:05.126904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28398): Launched 16:30:05.460592 run osmo-stp_10.42.42.5(pid=28399): Launched 16:30:05.589116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:30:06.161350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28401): Launched 16:30:06.289571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:30:06.572825 run patchelf(pid=28402): Launched 16:30:06.757647 run osmo-stp_10.42.42.5(pid=28399): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28399)] 16:30:06.898051 run osmo-stp_10.42.42.5(pid=28399): stdout: | (launched: 2022-12-12_16:30:05.398097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:07.040311 run osmo-stp_10.42.42.5(pid=28399): stderr: | 20221212163005588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163005588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163005589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163005589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163005590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163005590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163005590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:07.182910 run osmo-stp_10.42.42.5(pid=28399): stdout: | (launched: 2022-12-12_16:30:05.398097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:07.318915 run osmo-stp_10.42.42.5(pid=28399): stderr: | 20221212163005588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163005588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163005589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163005589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163005590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163005590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163005590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:07.480640 run patchelf(pid=28402): Terminating (SIGINT) 16:30:07.665527 run patchelf(pid=28402): Terminated: ok {rc=0} 16:30:07.799448 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28399): Process ended prematurely: osmo-stp_10.42.42.5(pid=28399) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28399)] [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 16:30:07.809825 tst iperf3.py:8: Test FAILED (8.0 sec) 16:30:07.839275 run osmo-hlr_10.42.42.2(pid=28396): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28396)] 16:30:07.889888 run osmo-hlr_10.42.42.2(pid=28396): stdout: | (launched: 2022-12-12_16:30:04.358542) 16:30:07.943023 run osmo-hlr_10.42.42.2(pid=28396): stderr: | 20221212163004555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163004555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163004555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163004555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163004555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163004555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163004566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163004576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163004576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163004576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:07.995683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28388): Terminating (SIGTERM) 16:30:08.037667 run iperf3-srv_10.42.42.10(pid=28389): Terminating (SIGTERM) 16:30:08.079651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28395): Terminating (SIGTERM) 16:30:08.122013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28398): Terminating (SIGTERM) 16:30:08.164071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28401): Terminating (SIGTERM) 16:30:08.206450 --- ParallelTerminationStrategy: PID 28388 died... 16:30:08.226433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28388): Terminated: ok {rc=0} 16:30:08.273442 --- ParallelTerminationStrategy: PID 28389 died... 16:30:08.292905 run iperf3-srv_10.42.42.10(pid=28389): Terminated {rc=256} 16:30:08.339681 --- ParallelTerminationStrategy: PID 28395 died... 16:30:08.359665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28395): Terminated: ok {rc=0} 16:30:08.406071 --- ParallelTerminationStrategy: PID 28398 died... 16:30:08.425603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28398): Terminated: ok {rc=0} 16:30:08.472931 --- ParallelTerminationStrategy: PID 28401 died... 16:30:08.492736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28401): Terminated: ok {rc=0} 16:30:08.580449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:30:09.730460 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:09.742546 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:30:09.794134 tst iperf3m4.py: using LAC 30091 16:30:09.922698 tst iperf3m4.py: using RAC 1 16:30:10.043732 tst iperf3m4.py: using CellId 30091 16:30:10.165222 tst iperf3m4.py: using BVCI 30092 16:30:10.278645 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:10.289856 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:10.300690 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:10.311641 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:10.322718 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:10.333692 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:10.344875 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:10.356045 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:10.367290 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:30:10.488756 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:30:10.608433 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:30:10.729966 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:30:10.850644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:30:11.060021 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:11.373228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28403): Launched 16:30:11.647204 run iperf3-srv_10.42.42.10(pid=28404): Launched 16:30:11.766048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:30:11.974276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:12.288084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28405): Launched 16:30:12.561802 run iperf3-srv_10.42.42.10(pid=28406): Launched 16:30:12.687916 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:30:12.911977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:13.247785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28407): Launched 16:30:13.539315 run iperf3-srv_10.42.42.10(pid=28408): Launched 16:30:13.665344 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:30:13.890367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:14.225503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28409): Launched 16:30:14.517935 run iperf3-srv_10.42.42.10(pid=28410): Launched 16:30:14.643340 tst iperf3m4.py:8: start network... 16:30:14.867505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:15.387272 run create_hlr_db(pid=28411): Launched 16:30:15.515663 bus /gobi_6: Setting Powered False 16:30:16.605245 run create_hlr_db(pid=28411): Terminated: ok {rc=0} 16:30:17.080677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28413): Launched 16:30:17.445556 run osmo-hlr_10.42.42.2(pid=28414): Launched 16:30:17.574881 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:18.152556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28416): Launched 16:30:18.488881 run osmo-stp_10.42.42.5(pid=28417): Launched 16:30:18.617984 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:30:19.194346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28419): Launched 16:30:19.322507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:30:19.606123 run patchelf(pid=28420): Launched 16:30:19.792034 run osmo-stp_10.42.42.5(pid=28417): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28417)] 16:30:19.932171 run osmo-stp_10.42.42.5(pid=28417): stdout: | (launched: 2022-12-12_16:30:18.425754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:20.073867 run osmo-stp_10.42.42.5(pid=28417): stderr: | 20221212163018616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163018616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163018617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163018617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163018618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163018618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163018618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:20.215628 run osmo-stp_10.42.42.5(pid=28417): stdout: | (launched: 2022-12-12_16:30:18.425754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:20.351098 run osmo-stp_10.42.42.5(pid=28417): stderr: | 20221212163018616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163018616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163018617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163018617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163018618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163018618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163018618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:20.512669 run patchelf(pid=28420): Terminating (SIGINT) 16:30:20.697184 run patchelf(pid=28420): Terminated: ok {rc=0} 16:30:20.830025 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28417): Process ended prematurely: osmo-stp_10.42.42.5(pid=28417) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28417)] [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 16:30:20.840347 tst iperf3m4.py:8: Test FAILED (11.1 sec) 16:30:20.869883 run osmo-hlr_10.42.42.2(pid=28414): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28414)] 16:30:20.920242 run osmo-hlr_10.42.42.2(pid=28414): stdout: | (launched: 2022-12-12_16:30:17.382281) 16:30:20.972237 run osmo-hlr_10.42.42.2(pid=28414): stderr: | 20221212163017580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163017580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163017580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163017580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163017580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163017580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163017593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163017603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163017603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163017603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:21.024783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28403): Terminating (SIGTERM) 16:30:21.066954 run iperf3-srv_10.42.42.10(pid=28404): Terminating (SIGTERM) 16:30:21.109280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28405): Terminating (SIGTERM) 16:30:21.151850 run iperf3-srv_10.42.42.10(pid=28406): Terminating (SIGTERM) 16:30:21.194194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28407): Terminating (SIGTERM) 16:30:21.236624 run iperf3-srv_10.42.42.10(pid=28408): Terminating (SIGTERM) 16:30:21.279038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28409): Terminating (SIGTERM) 16:30:21.321365 run iperf3-srv_10.42.42.10(pid=28410): Terminating (SIGTERM) 16:30:21.363618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28413): Terminating (SIGTERM) 16:30:21.405928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28416): Terminating (SIGTERM) 16:30:21.448566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28419): Terminating (SIGTERM) 16:30:21.491991 --- ParallelTerminationStrategy: PID 28403 died... 16:30:21.512172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28403): Terminated: ok {rc=0} 16:30:21.559299 --- ParallelTerminationStrategy: PID 28404 died... 16:30:21.578990 run iperf3-srv_10.42.42.10(pid=28404): Terminated {rc=256} 16:30:21.625869 --- ParallelTerminationStrategy: PID 28405 died... 16:30:21.645505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28405): Terminated: ok {rc=0} 16:30:21.692108 --- ParallelTerminationStrategy: PID 28406 died... 16:30:21.711836 run iperf3-srv_10.42.42.10(pid=28406): Terminated {rc=256} 16:30:21.758406 --- ParallelTerminationStrategy: PID 28407 died... 16:30:21.778058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28407): Terminated: ok {rc=0} 16:30:21.825188 --- ParallelTerminationStrategy: PID 28408 died... 16:30:21.844738 run iperf3-srv_10.42.42.10(pid=28408): Terminated {rc=256} 16:30:21.891915 --- ParallelTerminationStrategy: PID 28409 died... 16:30:21.911480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28409): Terminated: ok {rc=0} 16:30:21.958335 --- ParallelTerminationStrategy: PID 28410 died... 16:30:21.978139 run iperf3-srv_10.42.42.10(pid=28410): Terminated {rc=256} 16:30:22.025123 --- ParallelTerminationStrategy: PID 28413 died... 16:30:22.044915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28413): Terminated: ok {rc=0} 16:30:22.091774 --- ParallelTerminationStrategy: PID 28416 died... 16:30:22.111512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28416): Terminated: ok {rc=0} 16:30:22.158271 --- ParallelTerminationStrategy: PID 28419 died... 16:30:22.178021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28419): Terminated: ok {rc=0} 16:30:22.266075 bus /gobi_4: Setting Powered False 16:30:23.366920 bus /gobi_4: Setting Powered False 16:30:24.483838 bus /gobi_1: Setting Powered False 16:30:25.583228 bus /gobi_1: Setting Powered False 16:30:26.700870 bus /gobi_0: Setting Powered False 16:30:27.799210 bus /gobi_0: Setting Powered False 16:30:28.918874 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 16:30:30.022811 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:30.034748 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:30:30.088150 tst ping.py: using LAC 30092 16:30:30.208271 tst ping.py: using RAC 2 16:30:30.336223 tst ping.py: using CellId 30092 16:30:30.465373 tst ping.py: using BVCI 30093 16:30:30.585080 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:30.596799 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:30.608215 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:30.620162 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:30.631863 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:30.643453 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:30.655355 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:30.667073 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:30:30.783852 tst ping.py:19: start network... 16:30:31.033465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:31.517342 run create_hlr_db(pid=28421): Launched 16:30:31.661002 bus /gobi_6: Setting Powered False 16:30:32.725517 run create_hlr_db(pid=28421): Terminated: ok {rc=0} 16:30:33.164374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28423): Launched 16:30:33.474018 run osmo-hlr_10.42.42.2(pid=28424): Launched 16:30:33.591847 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:34.126095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28426): Launched 16:30:34.433426 run osmo-stp_10.42.42.5(pid=28427): Launched 16:30:34.548119 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:30:35.074517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28429): Launched 16:30:35.190741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:30:35.450186 run patchelf(pid=28430): Launched 16:30:35.620015 run osmo-stp_10.42.42.5(pid=28427): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28427)] 16:30:35.748291 run osmo-stp_10.42.42.5(pid=28427): stdout: | (launched: 2022-12-12_16:30:34.375331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:35.878337 run osmo-stp_10.42.42.5(pid=28427): stderr: | 20221212163034548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163034548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163034548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163034549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163034549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163034549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163034549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:36.009121 run osmo-stp_10.42.42.5(pid=28427): stdout: | (launched: 2022-12-12_16:30:34.375331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:36.133431 run osmo-stp_10.42.42.5(pid=28427): stderr: | 20221212163034548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163034548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163034548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163034549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163034549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163034549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163034549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:36.280593 run patchelf(pid=28430): Terminating (SIGINT) 16:30:36.450584 run patchelf(pid=28430): Terminated: ok {rc=0} 16:30:36.572900 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28427): Process ended prematurely: osmo-stp_10.42.42.5(pid=28427) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28427)] [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 16:30:36.582111 tst ping.py:22: Test FAILED (6.6 sec) 16:30:36.608678 run osmo-hlr_10.42.42.2(pid=28424): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28424)] 16:30:36.655946 run osmo-hlr_10.42.42.2(pid=28424): stdout: | (launched: 2022-12-12_16:30:33.415831) 16:30:36.704939 run osmo-hlr_10.42.42.2(pid=28424): stderr: | 20221212163033594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163033594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163033594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163033594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163033594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163033594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163033606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163033615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163033615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163033616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:36.754301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28423): Terminating (SIGTERM) 16:30:36.794096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28426): Terminating (SIGTERM) 16:30:36.833881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28429): Terminating (SIGTERM) 16:30:36.874032 --- ParallelTerminationStrategy: PID 28423 died... 16:30:36.893423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28423): Terminated: ok {rc=0} 16:30:36.937459 --- ParallelTerminationStrategy: PID 28426 died... 16:30:36.955989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28426): Terminated: ok {rc=0} 16:30:36.999871 --- ParallelTerminationStrategy: PID 28429 died... 16:30:37.018586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28429): Terminated: ok {rc=0} 16:30:37.105663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:30:38.193555 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:38.205446 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:30:38.257282 tst ping_idle_ping.py: using LAC 30093 16:30:38.379793 tst ping_idle_ping.py: using RAC 3 16:30:38.501784 tst ping_idle_ping.py: using CellId 30093 16:30:38.624897 tst ping_idle_ping.py: using BVCI 30094 16:30:38.736892 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:38.747955 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:38.758732 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:38.769449 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:38.780213 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:38.790894 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:38.801751 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:30:38.812403 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:30:38.927446 tst ping_idle_ping.py:24: start network... 16:30:39.131882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:39.608438 run create_hlr_db(pid=28431): Launched 16:30:39.734759 bus /gobi_6: Setting Powered False 16:30:40.796076 run create_hlr_db(pid=28431): Terminated: ok {rc=0} 16:30:41.243670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28433): Launched 16:30:41.572888 run osmo-hlr_10.42.42.2(pid=28434): Launched 16:30:41.699502 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:42.265047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28436): Launched 16:30:42.595523 run osmo-stp_10.42.42.5(pid=28437): Launched 16:30:42.721724 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:30:43.286764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28439): Launched 16:30:43.412609 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:30:43.691346 run patchelf(pid=28440): Launched 16:30:43.872341 run osmo-stp_10.42.42.5(pid=28437): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28437)] 16:30:44.010596 run osmo-stp_10.42.42.5(pid=28437): stdout: | (launched: 2022-12-12_16:30:42.533831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:44.150294 run osmo-stp_10.42.42.5(pid=28437): stderr: | 20221212163042722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163042722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163042723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163042723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163042724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163042724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163042724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:44.290254 run osmo-stp_10.42.42.5(pid=28437): stdout: | (launched: 2022-12-12_16:30:42.533831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:44.424227 run osmo-stp_10.42.42.5(pid=28437): stderr: | 20221212163042722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163042722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163042723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163042723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163042724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163042724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163042724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:44.583734 run patchelf(pid=28440): Terminating (SIGINT) 16:30:44.766167 run patchelf(pid=28440): Terminated: ok {rc=0} 16:30:44.897789 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28437): Process ended prematurely: osmo-stp_10.42.42.5(pid=28437) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28437)] [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 16:30:44.907504 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:30:44.936533 run osmo-hlr_10.42.42.2(pid=28434): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28434)] 16:30:44.986631 run osmo-hlr_10.42.42.2(pid=28434): stdout: | (launched: 2022-12-12_16:30:41.511456) 16:30:45.038792 run osmo-hlr_10.42.42.2(pid=28434): stderr: | 20221212163041705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163041705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163041705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163041705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163041705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163041705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163041718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163041726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163041726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163041726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:45.091648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28433): Terminating (SIGTERM) 16:30:45.134003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28436): Terminating (SIGTERM) 16:30:45.176251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28439): Terminating (SIGTERM) 16:30:45.218989 --- ParallelTerminationStrategy: PID 28433 died... 16:30:45.239464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28433): Terminated: ok {rc=0} 16:30:45.286751 --- ParallelTerminationStrategy: PID 28436 died... 16:30:45.306580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28436): Terminated: ok {rc=0} 16:30:45.353642 --- ParallelTerminationStrategy: PID 28439 died... 16:30:45.373553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28439): Terminated: ok {rc=0} 16:30:45.462364 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:30:46.778480 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:30:46.793417 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:30:46.834961 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:30:46.883411 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:30:46.987861 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:30:47.030588 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:30:47.077916 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:30:47.651377 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:30:47.701707 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:47.712646 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:30:47.781609 tst cs_paging_gprs_active.py: using LAC 30094 16:30:47.916043 tst cs_paging_gprs_active.py: using RAC 4 16:30:48.046720 tst cs_paging_gprs_active.py: using CellId 30094 16:30:48.175068 tst cs_paging_gprs_active.py: using BVCI 30095 16:30:48.296055 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:48.307635 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:48.318794 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:48.330364 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:48.341827 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:48.353482 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:48.364865 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:48.376336 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:30:48.387880 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:30:48.506805 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:30:48.628884 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:30:48.854409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:49.190157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28444): Launched 16:30:49.483192 run iperf3-srv_10.42.42.10(pid=28445): Launched 16:30:49.608069 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:30:49.832605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:30:50.168691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28446): Launched 16:30:50.460329 run iperf3-srv_10.42.42.10(pid=28447): Launched 16:30:50.587289 tst cs_paging_gprs_active.py:38: start network... 16:30:50.811957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:30:51.328378 run create_hlr_db(pid=28448): Launched 16:30:51.456725 bus /gobi_6: Setting Powered False 16:30:52.520352 run create_hlr_db(pid=28448): Terminated: ok {rc=0} 16:30:52.982217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28450): Launched 16:30:53.317644 run osmo-hlr_10.42.42.2(pid=28451): Launched 16:30:53.445944 run osmo-stp_10.42.42.5: Starting osmo-stp 16:30:54.022921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28453): Launched 16:30:54.358498 run osmo-stp_10.42.42.5(pid=28454): Launched 16:30:54.485995 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:30:55.059392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28456): Launched 16:30:55.187364 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:30:55.470352 run patchelf(pid=28457): Launched 16:30:55.656026 run osmo-stp_10.42.42.5(pid=28454): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28454)] 16:30:55.796241 run osmo-stp_10.42.42.5(pid=28454): stdout: | (launched: 2022-12-12_16:30:54.295673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:55.937880 run osmo-stp_10.42.42.5(pid=28454): stderr: | 20221212163054485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163054485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163054485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163054486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163054486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163054486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163054487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:56.079739 run osmo-stp_10.42.42.5(pid=28454): stdout: | (launched: 2022-12-12_16:30:54.295673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:30:56.216055 run osmo-stp_10.42.42.5(pid=28454): stderr: | 20221212163054485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163054485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163054485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163054486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163054486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163054486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163054487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:30:56.377782 run patchelf(pid=28457): Terminating (SIGINT) 16:30:56.563479 run patchelf(pid=28457): Terminated: ok {rc=0} 16:30:56.697285 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28454): Process ended prematurely: osmo-stp_10.42.42.5(pid=28454) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28454)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:30:56.707591 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:30:56.736658 run osmo-hlr_10.42.42.2(pid=28451): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28451)] 16:30:56.787018 run osmo-hlr_10.42.42.2(pid=28451): stdout: | (launched: 2022-12-12_16:30:53.255360) 16:30:56.839138 run osmo-hlr_10.42.42.2(pid=28451): stderr: | 20221212163053451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163053451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163053451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163053451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163053451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163053451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163053464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163053473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163053473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163053473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:30:56.891743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28444): Terminating (SIGTERM) 16:30:56.934285 run iperf3-srv_10.42.42.10(pid=28445): Terminating (SIGTERM) 16:30:56.976248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28446): Terminating (SIGTERM) 16:30:57.018647 run iperf3-srv_10.42.42.10(pid=28447): Terminating (SIGTERM) 16:30:57.060576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28450): Terminating (SIGTERM) 16:30:57.102897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28453): Terminating (SIGTERM) 16:30:57.145141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28456): Terminating (SIGTERM) 16:30:57.187567 --- ParallelTerminationStrategy: PID 28444 died... 16:30:57.207739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28444): Terminated: ok {rc=0} 16:30:57.254662 --- ParallelTerminationStrategy: PID 28445 died... 16:30:57.274266 run iperf3-srv_10.42.42.10(pid=28445): Terminated {rc=256} 16:30:57.321280 --- ParallelTerminationStrategy: PID 28446 died... 16:30:57.340883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28446): Terminated: ok {rc=0} 16:30:57.387363 --- ParallelTerminationStrategy: PID 28447 died... 16:30:57.406870 run iperf3-srv_10.42.42.10(pid=28447): Terminated {rc=256} 16:30:57.453361 --- ParallelTerminationStrategy: PID 28450 died... 16:30:57.473230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28450): Terminated: ok {rc=0} 16:30:57.520178 --- ParallelTerminationStrategy: PID 28453 died... 16:30:57.539823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28453): Terminated: ok {rc=0} 16:30:57.586419 --- ParallelTerminationStrategy: PID 28456 died... 16:30:57.606021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28456): Terminated: ok {rc=0} 16:30:57.694277 bus /gobi_0: Setting Powered False 16:30:58.794191 bus /gobi_0: Setting Powered False 16:30:59.910414 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:31:01.058146 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:01.070882 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:31:01.145650 tst iperf3.py: using LAC 30095 16:31:01.311035 tst iperf3.py: using RAC 5 16:31:01.464212 tst iperf3.py: using CellId 30095 16:31:01.627791 tst iperf3.py: using BVCI 30096 16:31:01.790750 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:01.805826 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:01.818594 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:01.832692 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:01.847997 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:01.862659 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:01.877645 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:01.892195 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:01.906465 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:31:02.051800 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:31:02.306673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:31:02.619909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28458): Launched 16:31:02.892556 run iperf3-srv_10.42.42.10(pid=28459): Launched 16:31:03.011482 tst iperf3.py:8: start network... 16:31:03.218906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:03.701579 run create_hlr_db(pid=28460): Launched 16:31:03.833624 bus /gobi_6: Setting Powered False 16:31:04.899085 run create_hlr_db(pid=28460): Terminated: ok {rc=0} 16:31:05.343731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28462): Launched 16:31:05.656370 run osmo-hlr_10.42.42.2(pid=28463): Launched 16:31:05.774412 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:06.328734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28465): Launched 16:31:06.641777 run osmo-stp_10.42.42.5(pid=28466): Launched 16:31:06.761535 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:31:07.300746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28468): Launched 16:31:07.420456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:31:07.684641 run patchelf(pid=28469): Launched 16:31:07.857923 run osmo-stp_10.42.42.5(pid=28466): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28466)] 16:31:07.988886 run osmo-stp_10.42.42.5(pid=28466): stdout: | (launched: 2022-12-12_16:31:06.582687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:08.121670 run osmo-stp_10.42.42.5(pid=28466): stderr: | 20221212163106756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163106756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163106756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163106757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163106757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163106757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163106757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:08.255032 run osmo-stp_10.42.42.5(pid=28466): stdout: | (launched: 2022-12-12_16:31:06.582687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:08.382147 run osmo-stp_10.42.42.5(pid=28466): stderr: | 20221212163106756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163106756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163106756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163106757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163106757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163106757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163106757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:08.533059 run patchelf(pid=28469): Terminating (SIGINT) 16:31:08.705812 run patchelf(pid=28469): Terminated: ok {rc=0} 16:31:08.830443 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28466): Process ended prematurely: osmo-stp_10.42.42.5(pid=28466) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28466)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 16:31:08.840019 tst iperf3.py:8: Test FAILED (7.8 sec) 16:31:08.867428 run osmo-hlr_10.42.42.2(pid=28463): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28463)] 16:31:08.915966 run osmo-hlr_10.42.42.2(pid=28463): stdout: | (launched: 2022-12-12_16:31:05.597439) 16:31:08.965951 run osmo-hlr_10.42.42.2(pid=28463): stderr: | 20221212163105775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163105775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163105776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163105776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163105776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163105776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163105788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163105796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163105797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163105797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:09.016340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28458): Terminating (SIGTERM) 16:31:09.056711 run iperf3-srv_10.42.42.10(pid=28459): Terminating (SIGTERM) 16:31:09.096842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28462): Terminating (SIGTERM) 16:31:09.137198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28465): Terminating (SIGTERM) 16:31:09.177348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28468): Terminating (SIGTERM) 16:31:09.217855 --- ParallelTerminationStrategy: PID 28458 died... 16:31:09.237320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28458): Terminated: ok {rc=0} 16:31:09.281914 --- ParallelTerminationStrategy: PID 28459 died... 16:31:09.300793 run iperf3-srv_10.42.42.10(pid=28459): Terminated {rc=256} 16:31:09.345507 --- ParallelTerminationStrategy: PID 28462 died... 16:31:09.364449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28462): Terminated: ok {rc=0} 16:31:09.408746 --- ParallelTerminationStrategy: PID 28465 died... 16:31:09.427625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28465): Terminated: ok {rc=0} 16:31:09.471525 --- ParallelTerminationStrategy: PID 28468 died... 16:31:09.490378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28468): Terminated: ok {rc=0} 16:31:09.576383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:31:10.727031 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:10.738940 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:31:10.811258 tst iperf3m4.py: using LAC 30096 16:31:10.932531 tst iperf3m4.py: using RAC 6 16:31:11.052718 tst iperf3m4.py: using CellId 30096 16:31:11.172624 tst iperf3m4.py: using BVCI 30097 16:31:11.285391 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:11.296249 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:11.307035 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:11.317877 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:11.328497 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:11.339332 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:11.350222 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:11.360900 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:11.371817 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:31:11.489292 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:31:11.611812 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:31:11.728165 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:31:11.847429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:31:12.056490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:31:12.372391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28470): Launched 16:31:12.647908 run iperf3-srv_10.42.42.10(pid=28471): Launched 16:31:12.766408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:31:12.974789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:31:13.288393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28472): Launched 16:31:13.561982 run iperf3-srv_10.42.42.10(pid=28473): Launched 16:31:13.678567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:31:13.886635 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:31:14.200607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28474): Launched 16:31:14.475138 run iperf3-srv_10.42.42.10(pid=28475): Launched 16:31:14.592940 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:31:14.800591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:31:15.113988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28476): Launched 16:31:15.386834 run iperf3-srv_10.42.42.10(pid=28477): Launched 16:31:15.504866 tst iperf3m4.py:8: start network... 16:31:15.712524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:16.204345 run create_hlr_db(pid=28478): Launched 16:31:16.366105 bus /gobi_6: Setting Powered False 16:31:17.431340 run create_hlr_db(pid=28478): Terminated: ok {rc=0} 16:31:17.878453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28480): Launched 16:31:18.214462 run osmo-hlr_10.42.42.2(pid=28481): Launched 16:31:18.340490 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:18.920041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28483): Launched 16:31:19.255769 run osmo-stp_10.42.42.5(pid=28484): Launched 16:31:19.384332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:31:19.960373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28486): Launched 16:31:20.088895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:31:20.372403 run patchelf(pid=28487): Launched 16:31:20.558695 run osmo-stp_10.42.42.5(pid=28484): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28484)] 16:31:20.699375 run osmo-stp_10.42.42.5(pid=28484): stdout: | (launched: 2022-12-12_16:31:19.193469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:20.841776 run osmo-stp_10.42.42.5(pid=28484): stderr: | 20221212163119384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163119384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163119384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163119385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163119385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163119385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163119385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:20.984103 run osmo-stp_10.42.42.5(pid=28484): stdout: | (launched: 2022-12-12_16:31:19.193469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:21.120714 run osmo-stp_10.42.42.5(pid=28484): stderr: | 20221212163119384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163119384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163119384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163119385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163119385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163119385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163119385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:21.282135 run patchelf(pid=28487): Terminating (SIGINT) 16:31:21.468189 run patchelf(pid=28487): Terminated: ok {rc=0} 16:31:21.602299 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28484): Process ended prematurely: osmo-stp_10.42.42.5(pid=28484) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28484)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:31:21.612560 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:31:21.642333 run osmo-hlr_10.42.42.2(pid=28481): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28481)] 16:31:21.693473 run osmo-hlr_10.42.42.2(pid=28481): stdout: | (launched: 2022-12-12_16:31:18.151796) 16:31:21.746098 run osmo-hlr_10.42.42.2(pid=28481): stderr: | 20221212163118350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163118351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163118351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163118351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163118351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163118351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163118363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163118372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163118372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163118372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:21.799099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28470): Terminating (SIGTERM) 16:31:21.841738 run iperf3-srv_10.42.42.10(pid=28471): Terminating (SIGTERM) 16:31:21.884313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28472): Terminating (SIGTERM) 16:31:21.926908 run iperf3-srv_10.42.42.10(pid=28473): Terminating (SIGTERM) 16:31:21.969220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28474): Terminating (SIGTERM) 16:31:22.011877 run iperf3-srv_10.42.42.10(pid=28475): Terminating (SIGTERM) 16:31:22.054341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28476): Terminating (SIGTERM) 16:31:22.096776 run iperf3-srv_10.42.42.10(pid=28477): Terminating (SIGTERM) 16:31:22.139193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28480): Terminating (SIGTERM) 16:31:22.181672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28483): Terminating (SIGTERM) 16:31:22.224216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28486): Terminating (SIGTERM) 16:31:22.266898 --- ParallelTerminationStrategy: PID 28470 died... 16:31:22.287207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28470): Terminated: ok {rc=0} 16:31:22.335337 --- ParallelTerminationStrategy: PID 28471 died... 16:31:22.355261 run iperf3-srv_10.42.42.10(pid=28471): Terminated {rc=256} 16:31:22.402267 --- ParallelTerminationStrategy: PID 28472 died... 16:31:22.421990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28472): Terminated: ok {rc=0} 16:31:22.469453 --- ParallelTerminationStrategy: PID 28473 died... 16:31:22.488763 run iperf3-srv_10.42.42.10(pid=28473): Terminated {rc=256} 16:31:22.535953 --- ParallelTerminationStrategy: PID 28474 died... 16:31:22.555896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28474): Terminated: ok {rc=0} 16:31:22.602538 --- ParallelTerminationStrategy: PID 28475 died... 16:31:22.622259 run iperf3-srv_10.42.42.10(pid=28475): Terminated {rc=256} 16:31:22.669262 --- ParallelTerminationStrategy: PID 28476 died... 16:31:22.689045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28476): Terminated: ok {rc=0} 16:31:22.736067 --- ParallelTerminationStrategy: PID 28477 died... 16:31:22.755959 run iperf3-srv_10.42.42.10(pid=28477): Terminated {rc=256} 16:31:22.803251 --- ParallelTerminationStrategy: PID 28480 died... 16:31:22.823122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28480): Terminated: ok {rc=0} 16:31:22.870121 --- ParallelTerminationStrategy: PID 28483 died... 16:31:22.890113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28483): Terminated: ok {rc=0} 16:31:22.937204 --- ParallelTerminationStrategy: PID 28486 died... 16:31:22.957119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28486): Terminated: ok {rc=0} 16:31:23.046436 bus /gobi_4: Setting Powered False 16:31:24.146799 bus /gobi_4: Setting Powered False 16:31:25.265311 bus /gobi_1: Setting Powered False 16:31:26.363897 bus /gobi_1: Setting Powered False 16:31:27.479964 bus /gobi_0: Setting Powered False 16:31:28.579673 bus /gobi_0: Setting Powered False 16:31:29.696288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:31:30.815570 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:30.829989 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:31:30.924525 tst ping.py: using LAC 30097 16:31:31.056122 tst ping.py: using RAC 7 16:31:31.215880 tst ping.py: using CellId 30097 16:31:31.346307 tst ping.py: using BVCI 30098 16:31:31.470274 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:31.482952 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:31.495306 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:31.508283 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:31.520835 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:31.533587 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:31.546519 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:31.559276 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:31:31.682727 tst ping.py:19: start network... 16:31:31.933901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:32.419316 run create_hlr_db(pid=28488): Launched 16:31:32.547276 bus /gobi_6: Setting Powered False 16:31:33.607796 run create_hlr_db(pid=28488): Terminated: ok {rc=0} 16:31:34.055375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28490): Launched 16:31:34.383912 run osmo-hlr_10.42.42.2(pid=28491): Launched 16:31:34.510459 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:35.081695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28493): Launched 16:31:35.411105 run osmo-stp_10.42.42.5(pid=28494): Launched 16:31:35.536721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:31:36.101654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28496): Launched 16:31:36.228351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:31:36.506485 run patchelf(pid=28497): Launched 16:31:36.687622 run osmo-stp_10.42.42.5(pid=28494): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28494)] 16:31:36.825611 run osmo-stp_10.42.42.5(pid=28494): stdout: | (launched: 2022-12-12_16:31:35.349575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:36.965037 run osmo-stp_10.42.42.5(pid=28494): stderr: | 20221212163135539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163135539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163135539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163135539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163135540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163135540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163135540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:37.104308 run osmo-stp_10.42.42.5(pid=28494): stdout: | (launched: 2022-12-12_16:31:35.349575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:37.237873 run osmo-stp_10.42.42.5(pid=28494): stderr: | 20221212163135539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163135539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163135539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163135539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163135540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163135540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163135540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:37.395972 run patchelf(pid=28497): Terminating (SIGINT) 16:31:37.578728 run patchelf(pid=28497): Terminated: ok {rc=0} 16:31:37.710646 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28494): Process ended prematurely: osmo-stp_10.42.42.5(pid=28494) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28494)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 16:31:37.720364 tst ping.py:22: Test FAILED (6.9 sec) 16:31:37.749235 run osmo-hlr_10.42.42.2(pid=28491): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28491)] 16:31:37.800186 run osmo-hlr_10.42.42.2(pid=28491): stdout: | (launched: 2022-12-12_16:31:34.322128) 16:31:37.852668 run osmo-hlr_10.42.42.2(pid=28491): stderr: | 20221212163134518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163134518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163134518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163134518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163134518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163134518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163134530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163134539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163134540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163134540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:37.905416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28490): Terminating (SIGTERM) 16:31:37.947541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28493): Terminating (SIGTERM) 16:31:37.989841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28496): Terminating (SIGTERM) 16:31:38.032324 --- ParallelTerminationStrategy: PID 28490 died... 16:31:38.052556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28490): Terminated: ok {rc=0} 16:31:38.100051 --- ParallelTerminationStrategy: PID 28493 died... 16:31:38.119810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28493): Terminated: ok {rc=0} 16:31:38.166839 --- ParallelTerminationStrategy: PID 28496 died... 16:31:38.186616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28496): Terminated: ok {rc=0} 16:31:38.275222 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:31:39.362946 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:39.375149 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:31:39.449244 tst ping_idle_ping.py: using LAC 30098 16:31:39.570843 tst ping_idle_ping.py: using RAC 8 16:31:39.693178 tst ping_idle_ping.py: using CellId 30098 16:31:39.813919 tst ping_idle_ping.py: using BVCI 30099 16:31:39.926656 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:39.937904 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:39.948825 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:39.959750 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:39.970672 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:39.981531 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:39.992424 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:31:40.003326 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:31:40.123152 tst ping_idle_ping.py:24: start network... 16:31:40.345356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:40.863968 run create_hlr_db(pid=28498): Launched 16:31:40.990254 bus /gobi_6: Setting Powered False 16:31:42.054446 run create_hlr_db(pid=28498): Terminated: ok {rc=0} 16:31:42.492473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28500): Launched 16:31:42.801735 run osmo-hlr_10.42.42.2(pid=28501): Launched 16:31:42.918526 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:43.444151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28503): Launched 16:31:43.751916 run osmo-stp_10.42.42.5(pid=28504): Launched 16:31:43.868927 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:31:44.395360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28506): Launched 16:31:44.514253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:31:44.772627 run patchelf(pid=28507): Launched 16:31:44.942984 run osmo-stp_10.42.42.5(pid=28504): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28504)] 16:31:45.071524 run osmo-stp_10.42.42.5(pid=28504): stdout: | (launched: 2022-12-12_16:31:43.693958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:45.201804 run osmo-stp_10.42.42.5(pid=28504): stderr: | 20221212163143864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163143864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163143865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163143865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163143866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163143866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163143866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:45.332063 run osmo-stp_10.42.42.5(pid=28504): stdout: | (launched: 2022-12-12_16:31:43.693958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:45.456588 run osmo-stp_10.42.42.5(pid=28504): stderr: | 20221212163143864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163143864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163143865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163143865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163143866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163143866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163143866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:45.603876 run patchelf(pid=28507): Terminating (SIGINT) 16:31:45.773544 run patchelf(pid=28507): Terminated: ok {rc=0} 16:31:45.904481 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28504): Process ended prematurely: osmo-stp_10.42.42.5(pid=28504) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28504)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:31:45.914160 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:31:45.941594 run osmo-hlr_10.42.42.2(pid=28501): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28501)] 16:31:45.995342 run osmo-hlr_10.42.42.2(pid=28501): stdout: | (launched: 2022-12-12_16:31:42.743682) 16:31:46.046934 run osmo-hlr_10.42.42.2(pid=28501): stderr: | 20221212163142919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163142919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163142919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163142919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163142919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163142919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163142931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163142939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163142940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163142940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:46.098673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28500): Terminating (SIGTERM) 16:31:46.140448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28503): Terminating (SIGTERM) 16:31:46.182348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28506): Terminating (SIGTERM) 16:31:46.224826 --- ParallelTerminationStrategy: PID 28500 died... 16:31:46.244651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28500): Terminated: ok {rc=0} 16:31:46.292528 --- ParallelTerminationStrategy: PID 28503 died... 16:31:46.312094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28503): Terminated: ok {rc=0} 16:31:46.358458 --- ParallelTerminationStrategy: PID 28506 died... 16:31:46.377964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28506): Terminated: ok {rc=0} 16:31:46.465284 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:31:47.765818 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:31:47.772009 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:31:47.804821 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:31:47.843160 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:31:47.929938 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:31:47.962896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:31:48.001272 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:31:48.595326 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:31:48.645251 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:48.656163 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:31:48.725861 tst cs_paging_gprs_active.py: using LAC 30099 16:31:48.849781 tst cs_paging_gprs_active.py: using RAC 9 16:31:48.971634 tst cs_paging_gprs_active.py: using CellId 30099 16:31:49.100015 tst cs_paging_gprs_active.py: using BVCI 30100 16:31:49.213783 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:49.224631 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:49.235482 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:49.246215 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:49.256786 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:49.267497 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:49.278303 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:49.289010 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:31:49.299834 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:31:49.421412 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:31:49.539788 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:31:49.750396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:31:50.064728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28513): Launched 16:31:50.340031 run iperf3-srv_10.42.42.10(pid=28514): Launched 16:31:50.459397 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:31:50.668526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:31:50.982649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28515): Launched 16:31:51.256910 run iperf3-srv_10.42.42.10(pid=28516): Launched 16:31:51.374968 tst cs_paging_gprs_active.py:38: start network... 16:31:51.582808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:31:52.066902 run create_hlr_db(pid=28517): Launched 16:31:52.197165 bus /gobi_6: Setting Powered False 16:31:53.259266 run create_hlr_db(pid=28517): Terminated: ok {rc=0} 16:31:53.713900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28519): Launched 16:31:54.050155 run osmo-hlr_10.42.42.2(pid=28520): Launched 16:31:54.177744 run osmo-stp_10.42.42.5: Starting osmo-stp 16:31:54.752255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28522): Launched 16:31:55.089168 run osmo-stp_10.42.42.5(pid=28523): Launched 16:31:55.217594 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:31:55.794185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28525): Launched 16:31:55.922911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:31:56.213684 run patchelf(pid=28526): Launched 16:31:56.394156 run osmo-stp_10.42.42.5(pid=28523): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28523)] 16:31:56.526465 run osmo-stp_10.42.42.5(pid=28523): stdout: | (launched: 2022-12-12_16:31:55.026572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:56.660326 run osmo-stp_10.42.42.5(pid=28523): stderr: | 20221212163155217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163155217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163155218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163155218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163155219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163155219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163155219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:56.793845 run osmo-stp_10.42.42.5(pid=28523): stdout: | (launched: 2022-12-12_16:31:55.026572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:31:56.921842 run osmo-stp_10.42.42.5(pid=28523): stderr: | 20221212163155217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163155217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163155218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163155218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163155219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163155219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163155219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:31:57.073476 run patchelf(pid=28526): Terminating (SIGINT) 16:31:57.248256 run patchelf(pid=28526): Terminated: ok {rc=0} 16:31:57.374462 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28523): Process ended prematurely: osmo-stp_10.42.42.5(pid=28523) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28523)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:31:57.384192 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 16:31:57.411798 run osmo-hlr_10.42.42.2(pid=28520): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28520)] 16:31:57.460018 run osmo-hlr_10.42.42.2(pid=28520): stdout: | (launched: 2022-12-12_16:31:53.987637) 16:31:57.509894 run osmo-hlr_10.42.42.2(pid=28520): stderr: | 20221212163154185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163154185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163154185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163154185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163154185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163154185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163154198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163154206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163154206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163154206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:31:57.559963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28513): Terminating (SIGTERM) 16:31:57.600181 run iperf3-srv_10.42.42.10(pid=28514): Terminating (SIGTERM) 16:31:57.640165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28515): Terminating (SIGTERM) 16:31:57.680104 run iperf3-srv_10.42.42.10(pid=28516): Terminating (SIGTERM) 16:31:57.719952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28519): Terminating (SIGTERM) 16:31:57.759897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28522): Terminating (SIGTERM) 16:31:57.800059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28525): Terminating (SIGTERM) 16:31:57.840357 --- ParallelTerminationStrategy: PID 28513 died... 16:31:57.859546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28513): Terminated: ok {rc=0} 16:31:57.903923 --- ParallelTerminationStrategy: PID 28514 died... 16:31:57.922658 run iperf3-srv_10.42.42.10(pid=28514): Terminated {rc=256} 16:31:57.967148 --- ParallelTerminationStrategy: PID 28515 died... 16:31:57.985779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28515): Terminated: ok {rc=0} 16:31:58.030049 --- ParallelTerminationStrategy: PID 28516 died... 16:31:58.048580 run iperf3-srv_10.42.42.10(pid=28516): Terminated {rc=256} 16:31:58.092490 --- ParallelTerminationStrategy: PID 28519 died... 16:31:58.111167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28519): Terminated: ok {rc=0} 16:31:58.155144 --- ParallelTerminationStrategy: PID 28522 died... 16:31:58.173788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28522): Terminated: ok {rc=0} 16:31:58.217667 --- ParallelTerminationStrategy: PID 28525 died... 16:31:58.236359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28525): Terminated: ok {rc=0} 16:31:58.323429 bus /gobi_0: Setting Powered False 16:31:59.424317 bus /gobi_0: Setting Powered False 16:32:00.540279 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:32:01.689319 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:01.702002 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:32:01.778677 tst iperf3.py: using LAC 30100 16:32:01.935914 tst iperf3.py: using RAC 10 16:32:02.061789 tst iperf3.py: using CellId 30100 16:32:02.193666 tst iperf3.py: using BVCI 30101 16:32:02.312571 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:02.323551 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:02.334370 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:02.345394 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:02.356001 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:02.366818 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:02.377684 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:02.388262 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:02.399117 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:32:02.515042 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:32:02.725955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:32:03.039672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28527): Launched 16:32:03.341242 run iperf3-srv_10.42.42.10(pid=28528): Launched 16:32:03.467458 tst iperf3.py:8: start network... 16:32:03.692229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:04.209470 run create_hlr_db(pid=28529): Launched 16:32:04.337731 bus /gobi_6: Setting Powered False 16:32:05.402952 run create_hlr_db(pid=28529): Terminated: ok {rc=0} 16:32:05.848865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28531): Launched 16:32:06.160726 run osmo-hlr_10.42.42.2(pid=28532): Launched 16:32:06.279366 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:06.817060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28534): Launched 16:32:07.127981 run osmo-stp_10.42.42.5(pid=28535): Launched 16:32:07.246065 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:32:07.783114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28537): Launched 16:32:07.902170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:32:08.165330 run patchelf(pid=28538): Launched 16:32:08.337486 run osmo-stp_10.42.42.5(pid=28535): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28535)] 16:32:08.468172 run osmo-stp_10.42.42.5(pid=28535): stdout: | (launched: 2022-12-12_16:32:07.069223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:08.601231 run osmo-stp_10.42.42.5(pid=28535): stderr: | 20221212163207243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163207243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163207243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163207244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163207244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163207244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163207245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:08.734973 run osmo-stp_10.42.42.5(pid=28535): stdout: | (launched: 2022-12-12_16:32:07.069223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:08.861497 run osmo-stp_10.42.42.5(pid=28535): stderr: | 20221212163207243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163207243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163207243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163207244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163207244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163207244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163207245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:09.011505 run patchelf(pid=28538): Terminating (SIGINT) 16:32:09.184483 run patchelf(pid=28538): Terminated: ok {rc=0} 16:32:09.308494 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28535): Process ended prematurely: osmo-stp_10.42.42.5(pid=28535) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28535)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 16:32:09.318276 tst iperf3.py:8: Test FAILED (7.7 sec) 16:32:09.345776 run osmo-hlr_10.42.42.2(pid=28532): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28532)] 16:32:09.393385 run osmo-hlr_10.42.42.2(pid=28532): stdout: | (launched: 2022-12-12_16:32:06.102011) 16:32:09.442673 run osmo-hlr_10.42.42.2(pid=28532): stderr: | 20221212163206280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163206280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163206280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163206280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163206280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163206280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163206295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163206304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163206304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163206304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:09.492305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28527): Terminating (SIGTERM) 16:32:09.532335 run iperf3-srv_10.42.42.10(pid=28528): Terminating (SIGTERM) 16:32:09.572394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28531): Terminating (SIGTERM) 16:32:09.612353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28534): Terminating (SIGTERM) 16:32:09.652542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28537): Terminating (SIGTERM) 16:32:09.692760 --- ParallelTerminationStrategy: PID 28527 died... 16:32:09.712087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28527): Terminated: ok {rc=0} 16:32:09.756543 --- ParallelTerminationStrategy: PID 28528 died... 16:32:09.775211 run iperf3-srv_10.42.42.10(pid=28528): Terminated {rc=256} 16:32:09.818873 --- ParallelTerminationStrategy: PID 28531 died... 16:32:09.837413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28531): Terminated: ok {rc=0} 16:32:09.881683 --- ParallelTerminationStrategy: PID 28534 died... 16:32:09.900284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28534): Terminated: ok {rc=0} 16:32:09.943937 --- ParallelTerminationStrategy: PID 28537 died... 16:32:09.962598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28537): Terminated: ok {rc=0} 16:32:10.048610 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:32:11.197588 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:11.209326 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:32:11.280609 tst iperf3m4.py: using LAC 30101 16:32:11.404101 tst iperf3m4.py: using RAC 11 16:32:11.527375 tst iperf3m4.py: using CellId 30101 16:32:11.653949 tst iperf3m4.py: using BVCI 30102 16:32:11.768299 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:11.779419 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:11.790294 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:11.801101 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:11.811880 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:11.822759 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:11.833683 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:11.844369 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:11.855489 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:32:11.972433 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:32:12.096796 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:32:12.214783 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:32:12.334848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:32:12.561474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:32:12.898143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28539): Launched 16:32:13.191112 run iperf3-srv_10.42.42.10(pid=28540): Launched 16:32:13.315791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:32:13.541500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:32:13.877456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28541): Launched 16:32:14.170197 run iperf3-srv_10.42.42.10(pid=28542): Launched 16:32:14.296709 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:32:14.521734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:32:14.857571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28543): Launched 16:32:15.150167 run iperf3-srv_10.42.42.10(pid=28544): Launched 16:32:15.276658 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:32:15.502054 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:32:15.854452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28545): Launched 16:32:16.162125 run iperf3-srv_10.42.42.10(pid=28546): Launched 16:32:16.302801 tst iperf3m4.py:8: start network... 16:32:16.532029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:17.063339 run create_hlr_db(pid=28547): Launched 16:32:17.223153 bus /gobi_6: Setting Powered False 16:32:18.288203 run create_hlr_db(pid=28547): Terminated: ok {rc=0} 16:32:18.733620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28549): Launched 16:32:19.045247 run osmo-hlr_10.42.42.2(pid=28550): Launched 16:32:19.162952 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:19.699550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28552): Launched 16:32:20.012296 run osmo-stp_10.42.42.5(pid=28553): Launched 16:32:20.131807 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:32:20.683319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28555): Launched 16:32:20.802973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:32:21.067170 run patchelf(pid=28556): Launched 16:32:21.240107 run osmo-stp_10.42.42.5(pid=28553): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28553)] 16:32:21.371254 run osmo-stp_10.42.42.5(pid=28553): stdout: | (launched: 2022-12-12_16:32:19.953342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:21.503654 run osmo-stp_10.42.42.5(pid=28553): stderr: | 20221212163220126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163220126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163220126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163220127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163220127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163220127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163220127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:21.636413 run osmo-stp_10.42.42.5(pid=28553): stdout: | (launched: 2022-12-12_16:32:19.953342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:21.763347 run osmo-stp_10.42.42.5(pid=28553): stderr: | 20221212163220126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163220126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163220126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163220127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163220127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163220127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163220127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:21.914444 run patchelf(pid=28556): Terminating (SIGINT) 16:32:22.087241 run patchelf(pid=28556): Terminated: ok {rc=0} 16:32:22.211458 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28553): Process ended prematurely: osmo-stp_10.42.42.5(pid=28553) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28553)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:32:22.221127 tst iperf3m4.py:8: Test FAILED (11.1 sec) 16:32:22.248524 run osmo-hlr_10.42.42.2(pid=28550): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28550)] 16:32:22.296073 run osmo-hlr_10.42.42.2(pid=28550): stdout: | (launched: 2022-12-12_16:32:18.986192) 16:32:22.345427 run osmo-hlr_10.42.42.2(pid=28550): stderr: | 20221212163219166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163219166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163219166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163219166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163219166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163219166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163219178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163219189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163219189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163219189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:22.395224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28539): Terminating (SIGTERM) 16:32:22.435224 run iperf3-srv_10.42.42.10(pid=28540): Terminating (SIGTERM) 16:32:22.475117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28541): Terminating (SIGTERM) 16:32:22.515098 run iperf3-srv_10.42.42.10(pid=28542): Terminating (SIGTERM) 16:32:22.554737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28543): Terminating (SIGTERM) 16:32:22.594275 run iperf3-srv_10.42.42.10(pid=28544): Terminating (SIGTERM) 16:32:22.633854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28545): Terminating (SIGTERM) 16:32:22.673457 run iperf3-srv_10.42.42.10(pid=28546): Terminating (SIGTERM) 16:32:22.712784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28549): Terminating (SIGTERM) 16:32:22.752478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28552): Terminating (SIGTERM) 16:32:22.792428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28555): Terminating (SIGTERM) 16:32:22.832296 --- ParallelTerminationStrategy: PID 28539 died... 16:32:22.851490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28539): Terminated: ok {rc=0} 16:32:22.895293 --- ParallelTerminationStrategy: PID 28540 died... 16:32:22.913825 run iperf3-srv_10.42.42.10(pid=28540): Terminated {rc=256} 16:32:22.957862 --- ParallelTerminationStrategy: PID 28541 died... 16:32:22.976460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28541): Terminated: ok {rc=0} 16:32:23.020021 --- ParallelTerminationStrategy: PID 28542 died... 16:32:23.038459 run iperf3-srv_10.42.42.10(pid=28542): Terminated {rc=256} 16:32:23.082374 --- ParallelTerminationStrategy: PID 28543 died... 16:32:23.100746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28543): Terminated: ok {rc=0} 16:32:23.145118 --- ParallelTerminationStrategy: PID 28544 died... 16:32:23.163434 run iperf3-srv_10.42.42.10(pid=28544): Terminated {rc=256} 16:32:23.206839 --- ParallelTerminationStrategy: PID 28545 died... 16:32:23.225444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28545): Terminated: ok {rc=0} 16:32:23.269152 --- ParallelTerminationStrategy: PID 28546 died... 16:32:23.287619 run iperf3-srv_10.42.42.10(pid=28546): Terminated {rc=256} 16:32:23.331084 --- ParallelTerminationStrategy: PID 28549 died... 16:32:23.349671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28549): Terminated: ok {rc=0} 16:32:23.393525 --- ParallelTerminationStrategy: PID 28552 died... 16:32:23.412159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28552): Terminated: ok {rc=0} 16:32:23.456033 --- ParallelTerminationStrategy: PID 28555 died... 16:32:23.474781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28555): Terminated: ok {rc=0} 16:32:23.560672 bus /gobi_4: Setting Powered False 16:32:24.662203 bus /gobi_4: Setting Powered False 16:32:25.777905 bus /gobi_1: Setting Powered False 16:32:26.878031 bus /gobi_1: Setting Powered False 16:32:27.992823 bus /gobi_0: Setting Powered False 16:32:29.091230 bus /gobi_0: Setting Powered False 16:32:30.202956 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:32:31.307049 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:31.319888 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:32:31.392521 tst ping.py: using LAC 30102 16:32:31.517534 tst ping.py: using RAC 12 16:32:31.667843 tst ping.py: using CellId 30102 16:32:31.793215 tst ping.py: using BVCI 30103 16:32:31.940561 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:31.954133 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:31.966562 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:31.979881 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:31.994541 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:32.008204 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:32.020714 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:32.035723 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:32:32.162362 tst ping.py:19: start network... 16:32:32.384298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:32.890901 run create_hlr_db(pid=28557): Launched 16:32:33.016454 bus /gobi_6: Setting Powered False 16:32:34.080760 run create_hlr_db(pid=28557): Terminated: ok {rc=0} 16:32:34.536149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28559): Launched 16:32:34.864351 run osmo-hlr_10.42.42.2(pid=28560): Launched 16:32:34.990169 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:35.563381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28562): Launched 16:32:35.894296 run osmo-stp_10.42.42.5(pid=28563): Launched 16:32:36.018977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:32:36.585470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28565): Launched 16:32:36.711693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:32:36.989243 run patchelf(pid=28566): Launched 16:32:37.171685 run osmo-stp_10.42.42.5(pid=28563): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28563)] 16:32:37.309832 run osmo-stp_10.42.42.5(pid=28563): stdout: | (launched: 2022-12-12_16:32:35.832419) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:37.449376 run osmo-stp_10.42.42.5(pid=28563): stderr: | 20221212163236022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163236022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163236022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163236023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163236023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163236023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163236023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:37.589603 run osmo-stp_10.42.42.5(pid=28563): stdout: | (launched: 2022-12-12_16:32:35.832419) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:37.723209 run osmo-stp_10.42.42.5(pid=28563): stderr: | 20221212163236022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163236022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163236022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163236023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163236023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163236023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163236023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:37.881581 run patchelf(pid=28566): Terminating (SIGINT) 16:32:38.062850 run patchelf(pid=28566): Terminated: ok {rc=0} 16:32:38.193915 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28563): Process ended prematurely: osmo-stp_10.42.42.5(pid=28563) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28563)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 16:32:38.203686 tst ping.py:22: Test FAILED (6.9 sec) 16:32:38.232552 run osmo-hlr_10.42.42.2(pid=28560): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28560)] 16:32:38.282930 run osmo-hlr_10.42.42.2(pid=28560): stdout: | (launched: 2022-12-12_16:32:34.802316) 16:32:38.334994 run osmo-hlr_10.42.42.2(pid=28560): stderr: | 20221212163234998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163234998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163234998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163234998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163234998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163234998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163235011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163235022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163235022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163235022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:38.387687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28559): Terminating (SIGTERM) 16:32:38.429788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28562): Terminating (SIGTERM) 16:32:38.472172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28565): Terminating (SIGTERM) 16:32:38.515230 --- ParallelTerminationStrategy: PID 28559 died... 16:32:38.535431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28559): Terminated: ok {rc=0} 16:32:38.583065 --- ParallelTerminationStrategy: PID 28562 died... 16:32:38.602716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28562): Terminated: ok {rc=0} 16:32:38.649453 --- ParallelTerminationStrategy: PID 28565 died... 16:32:38.669121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28565): Terminated: ok {rc=0} 16:32:38.756779 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:32:39.845212 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:39.857622 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:32:39.930772 tst ping_idle_ping.py: using LAC 30103 16:32:40.060583 tst ping_idle_ping.py: using RAC 13 16:32:40.190451 tst ping_idle_ping.py: using CellId 30103 16:32:40.320723 tst ping_idle_ping.py: using BVCI 30104 16:32:40.440473 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:40.452130 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:40.463555 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:40.475434 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:40.487049 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:40.498503 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:40.510497 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:32:40.522321 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:32:40.643040 tst ping_idle_ping.py:24: start network... 16:32:40.863834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:41.376881 run create_hlr_db(pid=28567): Launched 16:32:41.503199 bus /gobi_6: Setting Powered False 16:32:42.568101 run create_hlr_db(pid=28567): Terminated: ok {rc=0} 16:32:43.025513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28569): Launched 16:32:43.355760 run osmo-hlr_10.42.42.2(pid=28570): Launched 16:32:43.481946 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:44.046387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28572): Launched 16:32:44.376769 run osmo-stp_10.42.42.5(pid=28573): Launched 16:32:44.503244 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:32:45.068858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28575): Launched 16:32:45.195399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:32:45.473069 run patchelf(pid=28576): Launched 16:32:45.656221 run osmo-stp_10.42.42.5(pid=28573): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28573)] 16:32:45.794834 run osmo-stp_10.42.42.5(pid=28573): stdout: | (launched: 2022-12-12_16:32:44.314975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:45.955400 run osmo-stp_10.42.42.5(pid=28573): stderr: | 20221212163244505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163244505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163244505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163244506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163244506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163244506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163244506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:46.098785 run osmo-stp_10.42.42.5(pid=28573): stdout: | (launched: 2022-12-12_16:32:44.314975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:46.234352 run osmo-stp_10.42.42.5(pid=28573): stderr: | 20221212163244505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163244505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163244505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163244506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163244506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163244506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163244506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:46.388308 run patchelf(pid=28576): Terminating (SIGINT) 16:32:46.604265 run patchelf(pid=28576): Terminated: ok {rc=0} 16:32:46.860510 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28573): Process ended prematurely: osmo-stp_10.42.42.5(pid=28573) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28573)] [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:32:46.875083 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 16:32:46.919289 run osmo-hlr_10.42.42.2(pid=28570): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28570)] 16:32:47.071188 run osmo-hlr_10.42.42.2(pid=28570): stdout: | (launched: 2022-12-12_16:32:43.294109) 16:32:47.208526 run osmo-hlr_10.42.42.2(pid=28570): stderr: | 20221212163243488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163243488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163243488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163243488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163243488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163243488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163243502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163243510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163243511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163243511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:47.324648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28569): Terminating (SIGTERM) 16:32:47.440762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28572): Terminating (SIGTERM) 16:32:47.486476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28575): Terminating (SIGTERM) 16:32:47.530294 --- ParallelTerminationStrategy: PID 28569 died... 16:32:47.551304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28569): Terminated: ok {rc=0} 16:32:47.599930 --- ParallelTerminationStrategy: PID 28572 died... 16:32:47.619598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28572): Terminated: ok {rc=0} 16:32:47.666731 --- ParallelTerminationStrategy: PID 28575 died... 16:32:47.686300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28575): Terminated: ok {rc=0} 16:32:47.775392 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:32:49.083225 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:32:49.090770 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:32:49.126385 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:32:49.166446 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:32:49.256351 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:32:49.291401 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:32:49.331711 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:32:49.930811 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:32:49.985716 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:32:49.997813 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:32:50.052289 tst cs_paging_gprs_active.py: using LAC 30104 16:32:50.184940 tst cs_paging_gprs_active.py: using RAC 14 16:32:50.315797 tst cs_paging_gprs_active.py: using CellId 30104 16:32:50.447082 tst cs_paging_gprs_active.py: using BVCI 30105 16:32:50.569137 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:32:50.581081 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:32:50.592723 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:32:50.604814 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:32:50.617302 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:32:50.629545 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:32:50.642025 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:32:50.654438 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:32:50.667019 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:32:50.787578 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:32:50.908892 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:32:51.135788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:32:51.473502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28580): Launched 16:32:51.768182 run iperf3-srv_10.42.42.10(pid=28581): Launched 16:32:51.895981 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:32:52.122038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:32:52.459420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28582): Launched 16:32:52.752910 run iperf3-srv_10.42.42.10(pid=28583): Launched 16:32:52.879870 tst cs_paging_gprs_active.py:38: start network... 16:32:53.106004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:32:53.625304 run create_hlr_db(pid=28584): Launched 16:32:53.754011 bus /gobi_6: Setting Powered False 16:32:54.819407 run create_hlr_db(pid=28584): Terminated: ok {rc=0} 16:32:55.283116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28586): Launched 16:32:55.619954 run osmo-hlr_10.42.42.2(pid=28587): Launched 16:32:55.748837 run osmo-stp_10.42.42.5: Starting osmo-stp 16:32:56.325163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28589): Launched 16:32:56.662296 run osmo-stp_10.42.42.5(pid=28590): Launched 16:32:56.789539 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:32:57.366547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28592): Launched 16:32:57.495037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:32:57.779421 run patchelf(pid=28593): Launched 16:32:57.965209 run osmo-stp_10.42.42.5(pid=28590): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28590)] 16:32:58.106226 run osmo-stp_10.42.42.5(pid=28590): stdout: | (launched: 2022-12-12_16:32:56.599222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:58.248453 run osmo-stp_10.42.42.5(pid=28590): stderr: | 20221212163256791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163256791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163256791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163256792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163256792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163256792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163256792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:58.390575 run osmo-stp_10.42.42.5(pid=28590): stdout: | (launched: 2022-12-12_16:32:56.599222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:32:58.527659 run osmo-stp_10.42.42.5(pid=28590): stderr: | 20221212163256791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163256791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163256791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163256792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163256792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163256792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163256792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:32:58.690393 run patchelf(pid=28593): Terminating (SIGINT) 16:32:58.875573 run patchelf(pid=28593): Terminated: ok {rc=0} 16:32:59.009609 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28590): Process ended prematurely: osmo-stp_10.42.42.5(pid=28590) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28590)] [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:32:59.020042 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 16:32:59.049855 run osmo-hlr_10.42.42.2(pid=28587): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28587)] 16:32:59.101152 run osmo-hlr_10.42.42.2(pid=28587): stdout: | (launched: 2022-12-12_16:32:55.557198) 16:32:59.153971 run osmo-hlr_10.42.42.2(pid=28587): stderr: | 20221212163255754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163255754 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163255754 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163255754 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163255754 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163255754 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163255766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163255775 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163255775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163255775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:32:59.207108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28580): Terminating (SIGTERM) 16:32:59.250061 run iperf3-srv_10.42.42.10(pid=28581): Terminating (SIGTERM) 16:32:59.292768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28582): Terminating (SIGTERM) 16:32:59.335670 run iperf3-srv_10.42.42.10(pid=28583): Terminating (SIGTERM) 16:32:59.378654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28586): Terminating (SIGTERM) 16:32:59.421541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28589): Terminating (SIGTERM) 16:32:59.464195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28592): Terminating (SIGTERM) 16:32:59.507028 --- ParallelTerminationStrategy: PID 28580 died... 16:32:59.527664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28580): Terminated: ok {rc=0} 16:32:59.575399 --- ParallelTerminationStrategy: PID 28581 died... 16:32:59.595297 run iperf3-srv_10.42.42.10(pid=28581): Terminated {rc=256} 16:32:59.642396 --- ParallelTerminationStrategy: PID 28582 died... 16:32:59.662398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28582): Terminated: ok {rc=0} 16:32:59.709372 --- ParallelTerminationStrategy: PID 28583 died... 16:32:59.729028 run iperf3-srv_10.42.42.10(pid=28583): Terminated {rc=256} 16:32:59.776250 --- ParallelTerminationStrategy: PID 28586 died... 16:32:59.796181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28586): Terminated: ok {rc=0} 16:32:59.843253 --- ParallelTerminationStrategy: PID 28589 died... 16:32:59.863184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28589): Terminated: ok {rc=0} 16:32:59.910505 --- ParallelTerminationStrategy: PID 28592 died... 16:32:59.930491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28592): Terminated: ok {rc=0} 16:33:00.018913 bus /gobi_0: Setting Powered False 16:33:01.118780 bus /gobi_0: Setting Powered False 16:33:02.234204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:33:03.386459 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:03.399183 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:33:03.456883 tst iperf3.py: using LAC 30105 16:33:03.589827 tst iperf3.py: using RAC 15 16:33:03.720084 tst iperf3.py: using CellId 30105 16:33:03.850949 tst iperf3.py: using BVCI 30106 16:33:03.972377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:03.984294 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:03.996116 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:04.008089 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:04.020021 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:04.031909 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:04.044224 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:04.056268 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:04.068392 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:33:04.191850 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:33:04.402527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:04.716586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28595): Launched 16:33:04.991173 run iperf3-srv_10.42.42.10(pid=28596): Launched 16:33:05.109731 tst iperf3.py:8: start network... 16:33:05.318346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:05.803130 run create_hlr_db(pid=28597): Launched 16:33:05.931939 bus /gobi_6: Setting Powered False 16:33:06.993204 run create_hlr_db(pid=28597): Terminated: ok {rc=0} 16:33:07.426445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28599): Launched 16:33:07.739765 run osmo-hlr_10.42.42.2(pid=28600): Launched 16:33:07.859414 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:08.406496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28602): Launched 16:33:08.720165 run osmo-stp_10.42.42.5(pid=28603): Launched 16:33:08.839472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:09.376841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28605): Launched 16:33:09.494924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:09.759290 run patchelf(pid=28606): Launched 16:33:09.932334 run osmo-stp_10.42.42.5(pid=28603): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28603)] 16:33:10.062739 run osmo-stp_10.42.42.5(pid=28603): stdout: | (launched: 2022-12-12_16:33:08.660762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:10.195534 run osmo-stp_10.42.42.5(pid=28603): stderr: | 20221212163308833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163308834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163308834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163308834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163308835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163308835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163308835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:10.327788 run osmo-stp_10.42.42.5(pid=28603): stdout: | (launched: 2022-12-12_16:33:08.660762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:10.454438 run osmo-stp_10.42.42.5(pid=28603): stderr: | 20221212163308833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163308834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163308834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163308834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163308835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163308835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163308835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:10.604434 run patchelf(pid=28606): Terminating (SIGINT) 16:33:10.777606 run patchelf(pid=28606): Terminated: ok {rc=0} 16:33:10.902564 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28603): Process ended prematurely: osmo-stp_10.42.42.5(pid=28603) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28603)] [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:33:10.912592 tst iperf3.py:8: Test FAILED (7.6 sec) 16:33:10.939887 run osmo-hlr_10.42.42.2(pid=28600): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28600)] 16:33:10.987191 run osmo-hlr_10.42.42.2(pid=28600): stdout: | (launched: 2022-12-12_16:33:07.680803) 16:33:11.036460 run osmo-hlr_10.42.42.2(pid=28600): stderr: | 20221212163307859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163307859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163307859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163307859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163307860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163307860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163307882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163307892 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163307893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163307893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:11.086080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28595): Terminating (SIGTERM) 16:33:11.125619 run iperf3-srv_10.42.42.10(pid=28596): Terminating (SIGTERM) 16:33:11.165415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28599): Terminating (SIGTERM) 16:33:11.205130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28602): Terminating (SIGTERM) 16:33:11.244578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28605): Terminating (SIGTERM) 16:33:11.284139 --- ParallelTerminationStrategy: PID 28595 died... 16:33:11.303212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28595): Terminated: ok {rc=0} 16:33:11.346613 --- ParallelTerminationStrategy: PID 28596 died... 16:33:11.364889 run iperf3-srv_10.42.42.10(pid=28596): Terminated {rc=256} 16:33:11.408197 --- ParallelTerminationStrategy: PID 28599 died... 16:33:11.426744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28599): Terminated: ok {rc=0} 16:33:11.470076 --- ParallelTerminationStrategy: PID 28602 died... 16:33:11.488622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28602): Terminated: ok {rc=0} 16:33:11.532584 --- ParallelTerminationStrategy: PID 28605 died... 16:33:11.551151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28605): Terminated: ok {rc=0} 16:33:11.635733 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:33:12.782925 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:12.794992 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:33:12.851726 tst iperf3m4.py: using LAC 30106 16:33:12.972793 tst iperf3m4.py: using RAC 16 16:33:13.094395 tst iperf3m4.py: using CellId 30106 16:33:13.217840 tst iperf3m4.py: using BVCI 30107 16:33:13.330605 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:13.342102 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:13.353315 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:13.364425 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:13.375596 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:13.386783 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:13.398064 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:13.409123 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:13.420353 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:33:13.544362 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:33:13.669984 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:33:13.793521 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:33:13.915466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:33:14.141228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:14.477413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28607): Launched 16:33:14.770138 run iperf3-srv_10.42.42.10(pid=28608): Launched 16:33:14.896776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:33:15.121080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:15.456885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28609): Launched 16:33:15.748554 run iperf3-srv_10.42.42.10(pid=28610): Launched 16:33:15.899018 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:33:16.118035 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:16.439567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28611): Launched 16:33:16.730881 run iperf3-srv_10.42.42.10(pid=28612): Launched 16:33:16.905935 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:33:17.145689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:33:17.464762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28613): Launched 16:33:17.738032 run iperf3-srv_10.42.42.10(pid=28614): Launched 16:33:17.856581 tst iperf3m4.py:8: start network... 16:33:18.064261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:18.550435 run create_hlr_db(pid=28615): Launched 16:33:18.677501 bus /gobi_6: Setting Powered False 16:33:19.739348 run create_hlr_db(pid=28615): Terminated: ok {rc=0} 16:33:20.192717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28617): Launched 16:33:20.528109 run osmo-hlr_10.42.42.2(pid=28618): Launched 16:33:20.656701 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:21.240673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28620): Launched 16:33:21.576195 run osmo-stp_10.42.42.5(pid=28621): Launched 16:33:21.704205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:22.279709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28623): Launched 16:33:22.406603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:22.690232 run patchelf(pid=28624): Launched 16:33:22.874470 run osmo-stp_10.42.42.5(pid=28621): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28621)] 16:33:23.014826 run osmo-stp_10.42.42.5(pid=28621): stdout: | (launched: 2022-12-12_16:33:21.513229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:23.156748 run osmo-stp_10.42.42.5(pid=28621): stderr: | 20221212163321704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163321704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163321704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163321705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163321705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163321705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163321705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:23.299445 run osmo-stp_10.42.42.5(pid=28621): stdout: | (launched: 2022-12-12_16:33:21.513229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:23.435715 run osmo-stp_10.42.42.5(pid=28621): stderr: | 20221212163321704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163321704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163321704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163321705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163321705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163321705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163321705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:23.598085 run patchelf(pid=28624): Terminating (SIGINT) 16:33:23.783248 run patchelf(pid=28624): Terminated: ok {rc=0} 16:33:23.916936 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28621): Process ended prematurely: osmo-stp_10.42.42.5(pid=28621) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28621)] [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:33:23.927568 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:33:23.957028 run osmo-hlr_10.42.42.2(pid=28618): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28618)] 16:33:24.008328 run osmo-hlr_10.42.42.2(pid=28618): stdout: | (launched: 2022-12-12_16:33:20.465315) 16:33:24.061382 run osmo-hlr_10.42.42.2(pid=28618): stderr: | 20221212163320662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163320662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163320662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163320662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163320662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163320662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163320674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163320683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163320684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163320684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:24.114353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28607): Terminating (SIGTERM) 16:33:24.156519 run iperf3-srv_10.42.42.10(pid=28608): Terminating (SIGTERM) 16:33:24.199399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28609): Terminating (SIGTERM) 16:33:24.242016 run iperf3-srv_10.42.42.10(pid=28610): Terminating (SIGTERM) 16:33:24.284490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28611): Terminating (SIGTERM) 16:33:24.327158 run iperf3-srv_10.42.42.10(pid=28612): Terminating (SIGTERM) 16:33:24.369830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28613): Terminating (SIGTERM) 16:33:24.412428 run iperf3-srv_10.42.42.10(pid=28614): Terminating (SIGTERM) 16:33:24.454777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28617): Terminating (SIGTERM) 16:33:24.497303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28620): Terminating (SIGTERM) 16:33:24.540152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28623): Terminating (SIGTERM) 16:33:24.583090 --- ParallelTerminationStrategy: PID 28607 died... 16:33:24.603447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28607): Terminated: ok {rc=0} 16:33:24.650826 --- ParallelTerminationStrategy: PID 28608 died... 16:33:24.670691 run iperf3-srv_10.42.42.10(pid=28608): Terminated {rc=256} 16:33:24.717791 --- ParallelTerminationStrategy: PID 28609 died... 16:33:24.737701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28609): Terminated: ok {rc=0} 16:33:24.784741 --- ParallelTerminationStrategy: PID 28610 died... 16:33:24.804443 run iperf3-srv_10.42.42.10(pid=28610): Terminated {rc=256} 16:33:24.851717 --- ParallelTerminationStrategy: PID 28611 died... 16:33:24.871605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28611): Terminated: ok {rc=0} 16:33:24.919181 --- ParallelTerminationStrategy: PID 28612 died... 16:33:24.939003 run iperf3-srv_10.42.42.10(pid=28612): Terminated {rc=256} 16:33:24.986055 --- ParallelTerminationStrategy: PID 28613 died... 16:33:25.005783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28613): Terminated: ok {rc=0} 16:33:25.052775 --- ParallelTerminationStrategy: PID 28614 died... 16:33:25.072936 run iperf3-srv_10.42.42.10(pid=28614): Terminated {rc=256} 16:33:25.120293 --- ParallelTerminationStrategy: PID 28617 died... 16:33:25.140086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28617): Terminated: ok {rc=0} 16:33:25.187765 --- ParallelTerminationStrategy: PID 28620 died... 16:33:25.207595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28620): Terminated: ok {rc=0} 16:33:25.255034 --- ParallelTerminationStrategy: PID 28623 died... 16:33:25.274939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28623): Terminated: ok {rc=0} 16:33:25.364854 bus /gobi_4: Setting Powered False 16:33:26.465082 bus /gobi_4: Setting Powered False 16:33:27.582014 bus /gobi_1: Setting Powered False 16:33:28.681522 bus /gobi_1: Setting Powered False 16:33:29.799029 bus /gobi_0: Setting Powered False 16:33:30.913191 bus /gobi_0: Setting Powered False 16:33:32.031879 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:33:33.133596 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:33.145554 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:33:33.197637 tst ping.py: using LAC 30107 16:33:33.316345 tst ping.py: using RAC 17 16:33:33.437486 tst ping.py: using CellId 30107 16:33:33.557145 tst ping.py: using BVCI 30108 16:33:33.678334 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:33.690489 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:33.702479 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:33.715419 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:33.727957 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:33.740328 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:33.753335 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:33.765813 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:33:33.886131 tst ping.py:19: start network... 16:33:34.089904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:34.564018 run create_hlr_db(pid=28625): Launched 16:33:34.688222 bus /gobi_6: Setting Powered False 16:33:35.748178 run create_hlr_db(pid=28625): Terminated: ok {rc=0} 16:33:36.174888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28627): Launched 16:33:36.482622 run osmo-hlr_10.42.42.2(pid=28628): Launched 16:33:36.599286 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:37.126460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28630): Launched 16:33:37.433275 run osmo-stp_10.42.42.5(pid=28631): Launched 16:33:37.550267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:38.077344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28633): Launched 16:33:38.193452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:38.452107 run patchelf(pid=28634): Launched 16:33:38.623443 run osmo-stp_10.42.42.5(pid=28631): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28631)] 16:33:38.751902 run osmo-stp_10.42.42.5(pid=28631): stdout: | (launched: 2022-12-12_16:33:37.375073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:38.882425 run osmo-stp_10.42.42.5(pid=28631): stderr: | 20221212163337549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163337549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163337549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163337550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163337550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163337550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163337550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:39.012394 run osmo-stp_10.42.42.5(pid=28631): stdout: | (launched: 2022-12-12_16:33:37.375073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:39.137334 run osmo-stp_10.42.42.5(pid=28631): stderr: | 20221212163337549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163337549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163337549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163337550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163337550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163337550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163337550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:39.284848 run patchelf(pid=28634): Terminating (SIGINT) 16:33:39.455781 run patchelf(pid=28634): Terminated: ok {rc=0} 16:33:39.578644 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28631): Process ended prematurely: osmo-stp_10.42.42.5(pid=28631) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28631)] [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:33:39.587718 tst ping.py:22: Test FAILED (6.4 sec) 16:33:39.614664 run osmo-hlr_10.42.42.2(pid=28628): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28628)] 16:33:39.662026 run osmo-hlr_10.42.42.2(pid=28628): stdout: | (launched: 2022-12-12_16:33:36.424411) 16:33:39.710870 run osmo-hlr_10.42.42.2(pid=28628): stderr: | 20221212163336604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163336604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163336604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163336604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163336604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163336604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163336616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163336625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163336625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163336625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:39.760233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28627): Terminating (SIGTERM) 16:33:39.799814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28630): Terminating (SIGTERM) 16:33:39.839372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28633): Terminating (SIGTERM) 16:33:39.879222 --- ParallelTerminationStrategy: PID 28627 died... 16:33:39.898294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28627): Terminated: ok {rc=0} 16:33:39.941802 --- ParallelTerminationStrategy: PID 28630 died... 16:33:39.960355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28630): Terminated: ok {rc=0} 16:33:40.004813 --- ParallelTerminationStrategy: PID 28633 died... 16:33:40.023970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28633): Terminated: ok {rc=0} 16:33:40.114984 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:33:41.204441 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:41.217354 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:33:41.273372 tst ping_idle_ping.py: using LAC 30108 16:33:41.405701 tst ping_idle_ping.py: using RAC 18 16:33:41.525936 tst ping_idle_ping.py: using CellId 30108 16:33:41.644658 tst ping_idle_ping.py: using BVCI 30109 16:33:41.755814 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:41.767290 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:41.778492 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:41.789792 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:41.800812 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:41.812128 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:41.823519 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:33:41.834716 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:33:41.953290 tst ping_idle_ping.py:24: start network... 16:33:42.176081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:42.690075 run create_hlr_db(pid=28636): Launched 16:33:42.816611 bus /gobi_6: Setting Powered False 16:33:43.881191 run create_hlr_db(pid=28636): Terminated: ok {rc=0} 16:33:44.338900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28638): Launched 16:33:44.670254 run osmo-hlr_10.42.42.2(pid=28639): Launched 16:33:44.796234 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:45.361691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28641): Launched 16:33:45.693127 run osmo-stp_10.42.42.5(pid=28642): Launched 16:33:45.846746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:46.519964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28644): Launched 16:33:46.652776 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:46.925654 run patchelf(pid=28645): Launched 16:33:47.124405 run osmo-stp_10.42.42.5(pid=28642): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28642)] 16:33:47.266881 run osmo-stp_10.42.42.5(pid=28642): stdout: | (launched: 2022-12-12_16:33:45.631454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:47.407866 run osmo-stp_10.42.42.5(pid=28642): stderr: | 20221212163345852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163345852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163345852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163345853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163345853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163345853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163345854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:47.550182 run osmo-stp_10.42.42.5(pid=28642): stdout: | (launched: 2022-12-12_16:33:45.631454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:47.685536 run osmo-stp_10.42.42.5(pid=28642): stderr: | 20221212163345852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163345852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163345852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163345853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163345853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163345853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163345854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:47.845540 run patchelf(pid=28645): Terminating (SIGINT) 16:33:48.028685 run patchelf(pid=28645): Terminated: ok {rc=0} 16:33:48.161573 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28642): Process ended prematurely: osmo-stp_10.42.42.5(pid=28642) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28642)] [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:33:48.171602 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 16:33:48.202045 run osmo-hlr_10.42.42.2(pid=28639): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28639)] 16:33:48.253763 run osmo-hlr_10.42.42.2(pid=28639): stdout: | (launched: 2022-12-12_16:33:44.608411) 16:33:48.307254 run osmo-hlr_10.42.42.2(pid=28639): stderr: | 20221212163344805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163344805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163344805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163344805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163344805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163344805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163344818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163344826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163344826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163344827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:48.361379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28638): Terminating (SIGTERM) 16:33:48.404675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28641): Terminating (SIGTERM) 16:33:48.447983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28644): Terminating (SIGTERM) 16:33:48.491653 --- ParallelTerminationStrategy: PID 28638 died... 16:33:48.511978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28638): Terminated: ok {rc=0} 16:33:48.561090 --- ParallelTerminationStrategy: PID 28641 died... 16:33:48.581124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28641): Terminated: ok {rc=0} 16:33:48.629600 --- ParallelTerminationStrategy: PID 28644 died... 16:33:48.649523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28644): Terminated: ok {rc=0} 16:33:48.740120 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:33:50.049072 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:33:50.056334 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:33:50.090345 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:33:50.124641 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:33:50.185235 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:33:50.219080 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:33:50.253472 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:33:50.809386 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:33:50.815200 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:33:50.827863 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:33:50.900326 tst switch_tch_pdch.py: using LAC 30109 16:33:51.020247 tst switch_tch_pdch.py: using RAC 19 16:33:51.140807 tst switch_tch_pdch.py: using CellId 30109 16:33:51.260264 tst switch_tch_pdch.py: using BVCI 30110 16:33:51.372630 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:33:51.384021 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:33:51.395123 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:33:51.406326 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:33:51.417390 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:33:51.428274 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:33:51.439510 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:33:51.450682 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:33:51.570687 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:33:51.688800 tst switch_tch_pdch.py:51: start network... 16:33:51.893700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:33:52.369181 run create_hlr_db(pid=28649): Launched 16:33:52.495306 bus /gobi_6: Setting Powered False 16:33:53.555595 run create_hlr_db(pid=28649): Terminated: ok {rc=0} 16:33:54.003146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Launched 16:33:54.333150 run osmo-hlr_10.42.42.2(pid=28652): Launched 16:33:54.458337 run osmo-stp_10.42.42.5: Starting osmo-stp 16:33:55.026150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28654): Launched 16:33:55.354468 run osmo-stp_10.42.42.5(pid=28655): Launched 16:33:55.478070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:33:56.044347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28657): Launched 16:33:56.170568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:33:56.447792 run patchelf(pid=28658): Launched 16:33:56.631220 run osmo-stp_10.42.42.5(pid=28655): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28655)] 16:33:56.769577 run osmo-stp_10.42.42.5(pid=28655): stdout: | (launched: 2022-12-12_16:33:55.292520) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:56.909365 run osmo-stp_10.42.42.5(pid=28655): stderr: | 20221212163355483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163355484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163355484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163355484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163355485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163355485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163355485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:57.049819 run osmo-stp_10.42.42.5(pid=28655): stdout: | (launched: 2022-12-12_16:33:55.292520) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:33:57.183519 run osmo-stp_10.42.42.5(pid=28655): stderr: | 20221212163355483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163355484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163355484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163355484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163355485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163355485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163355485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:33:57.342621 run patchelf(pid=28658): Terminating (SIGINT) 16:33:57.524717 run patchelf(pid=28658): Terminated: ok {rc=0} 16:33:57.656708 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28655): Process ended prematurely: osmo-stp_10.42.42.5(pid=28655) [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28655)] [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:33:57.666530 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 16:33:57.695095 run osmo-hlr_10.42.42.2(pid=28652): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28652)] 16:33:57.745937 run osmo-hlr_10.42.42.2(pid=28652): stdout: | (launched: 2022-12-12_16:33:54.271605) 16:33:57.798312 run osmo-hlr_10.42.42.2(pid=28652): stderr: | 20221212163354467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163354467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163354467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163354467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163354467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163354467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163354481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163354492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163354492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163354492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:33:57.851015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Terminating (SIGTERM) 16:33:57.893419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28654): Terminating (SIGTERM) 16:33:57.935956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28657): Terminating (SIGTERM) 16:33:57.978818 --- ParallelTerminationStrategy: PID 28651 died... 16:33:57.999189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Terminated: ok {rc=0} 16:33:58.046278 --- ParallelTerminationStrategy: PID 28654 died... 16:33:58.065987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28654): Terminated: ok {rc=0} 16:33:58.112926 --- ParallelTerminationStrategy: PID 28657 died... 16:33:58.132646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28657): Terminated: ok {rc=0} 16:33:58.221057 bus /gobi_0: Setting Powered False 16:33:59.319536 bus /gobi_0: Setting Powered False 16:34:00.436611 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:34:01.691110 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:01.701379 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:34:01.742670 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:34:01.783999 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:34:01.848570 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:34:01.891107 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:34:01.935800 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:34:02.467499 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:34:02.473081 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:34:02.484160 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:34:02.553581 tst switch_tch_pdch.py: using LAC 30110 16:34:02.673030 tst switch_tch_pdch.py: using RAC 20 16:34:02.792256 tst switch_tch_pdch.py: using CellId 30110 16:34:02.913183 tst switch_tch_pdch.py: using BVCI 30111 16:34:03.023185 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:34:03.034298 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:34:03.045044 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:34:03.055846 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:34:03.066677 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:34:03.077496 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:34:03.088350 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:34:03.099153 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:34:03.218351 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:34:03.335814 tst switch_tch_pdch.py:51: start network... 16:34:03.540156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:03.989708 run create_hlr_db(pid=28662): Launched 16:34:04.113965 bus /gobi_6: Setting Powered False 16:34:05.174529 run create_hlr_db(pid=28662): Terminated: ok {rc=0} 16:34:05.575670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28664): Launched 16:34:05.884880 run osmo-hlr_10.42.42.2(pid=28665): Launched 16:34:06.001789 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:06.501360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28667): Launched 16:34:06.808527 run osmo-stp_10.42.42.5(pid=28668): Launched 16:34:06.925844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:34:07.427320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28670): Launched 16:34:07.544839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:34:07.804454 run patchelf(pid=28671): Launched 16:34:07.976173 run osmo-stp_10.42.42.5(pid=28668): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28668)] 16:34:08.104763 run osmo-stp_10.42.42.5(pid=28668): stdout: | (launched: 2022-12-12_16:34:06.750582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:08.235210 run osmo-stp_10.42.42.5(pid=28668): stderr: | 20221212163406921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163406921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163406921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163406922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163406922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163406922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163406922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:08.365811 run osmo-stp_10.42.42.5(pid=28668): stdout: | (launched: 2022-12-12_16:34:06.750582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:08.490903 run osmo-stp_10.42.42.5(pid=28668): stderr: | 20221212163406921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163406921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163406921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163406922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163406922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163406922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163406922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:08.638731 run patchelf(pid=28671): Terminating (SIGINT) 16:34:08.808778 run patchelf(pid=28671): Terminated: ok {rc=0} 16:34:08.931403 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28668): Process ended prematurely: osmo-stp_10.42.42.5(pid=28668) [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28668)] [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:34:08.940435 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 16:34:08.967193 run osmo-hlr_10.42.42.2(pid=28665): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28665)] 16:34:09.014695 run osmo-hlr_10.42.42.2(pid=28665): stdout: | (launched: 2022-12-12_16:34:05.826717) 16:34:09.064097 run osmo-hlr_10.42.42.2(pid=28665): stderr: | 20221212163406005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163406006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163406006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163406006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163406006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163406006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163406021 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163406031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163406031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163406031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:09.113837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28664): Terminating (SIGTERM) 16:34:09.153608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28667): Terminating (SIGTERM) 16:34:09.193313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28670): Terminating (SIGTERM) 16:34:09.233864 --- ParallelTerminationStrategy: PID 28664 died... 16:34:09.253093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28664): Terminated: ok {rc=0} 16:34:09.297704 --- ParallelTerminationStrategy: PID 28667 died... 16:34:09.316406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28667): Terminated: ok {rc=0} 16:34:09.367193 --- ParallelTerminationStrategy: PID 28670 died... 16:34:09.398982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28670): Terminated: ok {rc=0} 16:34:09.493823 bus /gobi_0: Setting Powered False 16:34:10.589912 bus /gobi_0: Setting Powered False 16:34:11.705004 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 16:34:12.963387 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:12.967894 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:34:13.003802 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 16:34:13.011021 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:34:13.066088 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:34:13.101445 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 16:34:13.108549 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:34:13.644107 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 16:34:13.649691 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 16:34:13.661041 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:34:13.710723 tst mo_mt_sms.py: using LAC 30111 16:34:13.839679 tst mo_mt_sms.py: using RAC 21 16:34:13.966876 tst mo_mt_sms.py: using CellId 30111 16:34:14.086749 tst mo_mt_sms.py: using BVCI 30112 16:34:14.198231 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:34:14.316265 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:34:14.433842 tst mo_mt_sms.py:9: start nitb and bts... 16:34:14.654136 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:34:15.315416 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28676): Launched 16:34:15.642594 run osmo-nitb_10.42.42.2(pid=28677): Launched 16:34:15.851303 run osmo-nitb_10.42.42.2(pid=28677): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28677)] 16:34:15.998275 run osmo-nitb_10.42.42.2(pid=28677): stdout: | (launched: 2022-12-12_16:34:15.582417) 16:34:16.148415 run osmo-nitb_10.42.42.2(pid=28677): stderr: | (launched: 2022-12-12_16:34:15.630809) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:34:16.298954 run osmo-nitb_10.42.42.2(pid=28677): stdout: | (launched: 2022-12-12_16:34:15.582417) 16:34:16.449821 run osmo-nitb_10.42.42.2(pid=28677): stderr: | (launched: 2022-12-12_16:34:15.630809) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28677): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28677) [trial-2379↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28677)] 16:34:16.766712 tst osmo-nitb_10.42.42.2(pid=28677): stdout: | (launched: 2022-12-12_16:34:15.582417) 16:34:16.923930 tst osmo-nitb_10.42.42.2(pid=28677): stderr: | (launched: 2022-12-12_16:34:15.630809) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:34:17.084583 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28677): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28677) [trial-2379↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28677)] [trial-2379↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 16:34:17.094413 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 16:34:17.102047 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28676): Terminating (SIGTERM) 16:34:17.317104 --- ParallelTerminationStrategy: PID 28676 died... 16:34:17.339541 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28676): Terminated: ok {rc=0} 16:34:17.431560 bus /sierra_3: Setting Powered False 16:34:18.535400 bus /sierra_3: Setting Powered False 16:34:19.653240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 sms:trx-sysmocell5000 --------------------------------------------------------------------- 16:34:20.853615 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:20.857500 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:34:20.890834 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:34:20.917291 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 16:34:20.970061 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:34:21.003741 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:34:21.029872 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 16:34:21.579337 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 16:34:21.585297 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:21.596689 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:34:21.648093 tst mo_mt_sms.py: using LAC 30112 16:34:21.767683 tst mo_mt_sms.py: using RAC 22 16:34:21.885430 tst mo_mt_sms.py: using CellId 30112 16:34:22.005428 tst mo_mt_sms.py: using BVCI 30113 16:34:22.117655 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:22.128514 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:22.139118 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:22.149690 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:22.160155 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:22.170798 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:34:22.289595 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 16:34:22.409180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:22.914483 run create_hlr_db(pid=28683): Launched 16:34:23.040192 bus /sierra_2: Setting Powered False 16:34:24.105196 run create_hlr_db(pid=28683): Terminated: ok {rc=0} 16:34:24.558651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28685): Launched 16:34:24.885683 run osmo-hlr_10.42.42.2(pid=28686): Launched 16:34:25.009535 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:25.566575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28688): Launched 16:34:25.893147 run osmo-stp_10.42.42.5(pid=28689): Launched 16:34:26.015668 run osmo-msc_10.42.42.6: Starting osmo-msc 16:34:26.604502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28691): Launched 16:34:26.931621 run osmo-msc_10.42.42.6(pid=28692): Launched 16:34:27.112869 run osmo-stp_10.42.42.5(pid=28689): ERR: Terminated: ERROR {rc=1} [trial-2379↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28689)] 16:34:27.249597 run osmo-stp_10.42.42.5(pid=28689): stdout: | (launched: 2022-12-12_16:34:25.833282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:27.386004 run osmo-stp_10.42.42.5(pid=28689): stderr: | 20221212163426023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163426023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163426023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163426023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163426024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163426024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163426024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:27.521553 run osmo-stp_10.42.42.5(pid=28689): stdout: | (launched: 2022-12-12_16:34:25.833282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:27.651252 run osmo-stp_10.42.42.5(pid=28689): stderr: | 20221212163426023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163426023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163426023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163426023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163426024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163426024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163426024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:27.806052 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28689): Process ended prematurely: osmo-stp_10.42.42.5(pid=28689) [trial-2379↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28689)] [trial-2379↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 16:34:27.815274 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 16:34:27.843046 run osmo-hlr_10.42.42.2(pid=28686): ERR: Terminated: ERROR {rc=237} [trial-2379↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28686)] 16:34:27.893475 run osmo-hlr_10.42.42.2(pid=28686): stdout: | (launched: 2022-12-12_16:34:24.825606) 16:34:27.945302 run osmo-hlr_10.42.42.2(pid=28686): stderr: | 20221212163425019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163425019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163425019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163425019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163425019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163425019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163425033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163425042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163425042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163425042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:28.017603 run osmo-msc_10.42.42.6(pid=28692): ERR: Terminated: ERROR {rc=2} [trial-2379↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28692)] 16:34:28.067469 run osmo-msc_10.42.42.6(pid=28692): stdout: | (launched: 2022-12-12_16:34:26.871544) 16:34:28.118980 run osmo-msc_10.42.42.6(pid=28692): stderr: | 20221212163427194 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163427194 DLGLOBAL DEBUG validating counter group 0x7fd361051c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163427194 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163427194 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163427194 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163427195 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163427196 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163427197 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163427197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163427197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:34:28.171288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28685): Terminating (SIGTERM) 16:34:28.213156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28688): Terminating (SIGTERM) 16:34:28.255080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28691): Terminating (SIGTERM) 16:34:28.297277 --- ParallelTerminationStrategy: PID 28685 died... 16:34:28.317376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28685): Terminated: ok {rc=0} 16:34:28.364338 --- ParallelTerminationStrategy: PID 28688 died... 16:34:28.384011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28688): Terminated: ok {rc=0} 16:34:28.430446 --- ParallelTerminationStrategy: PID 28691 died... 16:34:28.450110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28691): Terminated: ok {rc=0} 16:34:28.537741 bus /sierra_3: Setting Powered False 16:34:29.635694 bus /sierra_3: Setting Powered False 16:34:30.750580 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 16:34:32.038860 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:32.042680 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:34:32.082481 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 16:34:32.089865 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 16:34:32.126982 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:34:32.167178 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 16:34:32.175172 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 16:34:32.687944 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 16:34:32.693234 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 16:34:32.704269 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:34:32.753400 tst assert_extension.py: using LAC 30113 16:34:32.873102 tst assert_extension.py: using RAC 23 16:34:32.992077 tst assert_extension.py: using CellId 30113 16:34:33.121357 tst assert_extension.py: using BVCI 30114 16:34:33.240746 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 16:34:33.356768 tst assert_extension.py:10: start nitb and bts... 16:34:33.559119 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:34:34.181502 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28697): Launched 16:34:34.488198 run osmo-nitb_10.42.42.2(pid=28702): Launched 16:34:34.655879 run osmo-nitb_10.42.42.2(pid=28702): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28702)] 16:34:34.791440 run osmo-nitb_10.42.42.2(pid=28702): stdout: | (launched: 2022-12-12_16:34:34.431575) 16:34:34.929151 run osmo-nitb_10.42.42.2(pid=28702): stderr: | (launched: 2022-12-12_16:34:34.476941) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:34:35.065766 run osmo-nitb_10.42.42.2(pid=28702): stdout: | (launched: 2022-12-12_16:34:34.431575) 16:34:35.197546 run osmo-nitb_10.42.42.2(pid=28702): stderr: | (launched: 2022-12-12_16:34:34.476941) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28702): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28702) [trial-2379↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28702)] 16:34:35.602436 tst osmo-nitb_10.42.42.2(pid=28702): stdout: | (launched: 2022-12-12_16:34:34.431575) 16:34:35.725891 tst osmo-nitb_10.42.42.2(pid=28702): stderr: | (launched: 2022-12-12_16:34:34.476941) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:34:35.871099 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28702): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28702) [trial-2379↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28702)] [trial-2379↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 16:34:35.879831 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:34:35.886717 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28697): Terminating (SIGTERM) 16:34:36.095472 --- ParallelTerminationStrategy: PID 28697 died... 16:34:36.116377 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28697): Terminated: ok {rc=0} 16:34:36.202285 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 16:34:37.384801 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:37.389172 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:34:37.424159 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:34:37.451455 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 16:34:37.490218 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:34:37.525436 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:34:37.553306 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 16:34:38.084586 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 16:34:38.090299 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:38.101800 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:34:38.153492 tst assert_extension.py: using LAC 30114 16:34:38.282508 tst assert_extension.py: using RAC 24 16:34:38.410893 tst assert_extension.py: using CellId 30114 16:34:38.539158 tst assert_extension.py: using BVCI 30115 16:34:38.659752 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:38.671311 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:38.682501 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:38.694112 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:38.705677 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:34:38.717269 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 16:34:38.834687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:39.338121 run create_hlr_db(pid=28706): Launched 16:34:39.462925 bus /sierra_2: Setting Powered False 16:34:40.527359 run create_hlr_db(pid=28706): Terminated: ok {rc=0} 16:34:40.962359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28708): Launched 16:34:41.267004 run osmo-hlr_10.42.42.2(pid=28709): Launched 16:34:41.382270 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:42.011166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28711): Launched 16:34:42.311028 run osmo-stp_10.42.42.5(pid=28712): Launched 16:34:42.424719 run osmo-msc_10.42.42.6: Starting osmo-msc 16:34:42.966518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28714): Launched 16:34:43.267992 run osmo-msc_10.42.42.6(pid=28715): Launched 16:34:43.434611 run osmo-stp_10.42.42.5(pid=28712): ERR: Terminated: ERROR {rc=1} [trial-2379↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28712)] 16:34:43.561237 run osmo-stp_10.42.42.5(pid=28712): stdout: | (launched: 2022-12-12_16:34:42.255121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:43.687107 run osmo-stp_10.42.42.5(pid=28712): stderr: | 20221212163442423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163442423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163442423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163442424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163442424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163442424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163442425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:43.811472 run osmo-stp_10.42.42.5(pid=28712): stdout: | (launched: 2022-12-12_16:34:42.255121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:43.931307 run osmo-stp_10.42.42.5(pid=28712): stderr: | 20221212163442423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163442423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163442423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163442424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163442424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163442424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163442425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:44.073837 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28712): Process ended prematurely: osmo-stp_10.42.42.5(pid=28712) [trial-2379↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28712)] [trial-2379↪ussd:trx-sysmocell5000↪assert_extension.py:17] 16:34:44.082173 tst assert_extension.py:17: Test FAILED (6.0 sec) 16:34:44.108140 run osmo-hlr_10.42.42.2(pid=28709): ERR: Terminated: ERROR {rc=237} [trial-2379↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28709)] 16:34:44.155588 run osmo-hlr_10.42.42.2(pid=28709): stdout: | (launched: 2022-12-12_16:34:41.210627) 16:34:44.204515 run osmo-hlr_10.42.42.2(pid=28709): stderr: | 20221212163441385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163441385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163441386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163441386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163441386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163441386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163441398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163441407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163441407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163441407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:44.272564 run osmo-msc_10.42.42.6(pid=28715): ERR: Terminated: ERROR {rc=2} [trial-2379↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28715)] 16:34:44.319827 run osmo-msc_10.42.42.6(pid=28715): stdout: | (launched: 2022-12-12_16:34:43.211955) 16:34:44.368670 run osmo-msc_10.42.42.6(pid=28715): stderr: | 20221212163443481 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163443481 DLGLOBAL DEBUG validating counter group 0x7f9d58edfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163443481 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163443481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163443482 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163443482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163443484 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163443485 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163443485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163443485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:34:44.418100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28708): Terminating (SIGTERM) 16:34:44.457535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28711): Terminating (SIGTERM) 16:34:44.496873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28714): Terminating (SIGTERM) 16:34:44.536362 --- ParallelTerminationStrategy: PID 28708 died... 16:34:44.555497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28708): Terminated: ok {rc=0} 16:34:44.599302 --- ParallelTerminationStrategy: PID 28711 died... 16:34:44.617558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28711): Terminated: ok {rc=0} 16:34:44.660577 --- ParallelTerminationStrategy: PID 28714 died... 16:34:44.678951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28714): Terminated: ok {rc=0} 16:34:44.761427 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:34:45.990185 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:34:45.998320 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:34:46.038400 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:34:46.068653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:34:46.121978 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:34:46.157701 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:34:46.185540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:34:46.760294 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:34:46.836054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:46.853452 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:34:46.938297 tst mo_mt_call.py: using LAC 30115 16:34:47.102276 tst mo_mt_call.py: using RAC 25 16:34:47.240499 tst mo_mt_call.py: using CellId 30115 16:34:47.362886 tst mo_mt_call.py: using BVCI 30116 16:34:47.476831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:47.488280 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:47.499595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:47.511526 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:47.523495 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:47.535326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:34:47.653569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:34:47.773163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:48.281705 run create_hlr_db(pid=28721): Launched 16:34:48.408369 bus /sierra_2: Setting Powered False 16:34:49.473234 run create_hlr_db(pid=28721): Terminated: ok {rc=0} 16:34:49.927877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28723): Launched 16:34:50.255789 run osmo-hlr_10.42.42.2(pid=28724): Launched 16:34:50.383064 run osmo-stp_10.42.42.5: Starting osmo-stp 16:34:50.946759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28726): Launched 16:34:51.274645 run osmo-stp_10.42.42.5(pid=28727): Launched 16:34:51.401410 run osmo-msc_10.42.42.6: Starting osmo-msc 16:34:51.993417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28729): Launched 16:34:52.321781 run osmo-msc_10.42.42.6(pid=28730): Launched 16:34:52.503617 run osmo-stp_10.42.42.5(pid=28727): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28727)] 16:34:52.642716 run osmo-stp_10.42.42.5(pid=28727): stdout: | (launched: 2022-12-12_16:34:51.214269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:52.781720 run osmo-stp_10.42.42.5(pid=28727): stderr: | 20221212163451403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163451403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163451403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163451403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163451404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163451404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163451404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:52.918171 run osmo-stp_10.42.42.5(pid=28727): stdout: | (launched: 2022-12-12_16:34:51.214269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:34:53.048423 run osmo-stp_10.42.42.5(pid=28727): stderr: | 20221212163451403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163451403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163451403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163451403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163451404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163451404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163451404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:34:53.204690 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28727): Process ended prematurely: osmo-stp_10.42.42.5(pid=28727) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28727)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:34:53.214582 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:34:53.243205 run osmo-hlr_10.42.42.2(pid=28724): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28724)] 16:34:53.293895 run osmo-hlr_10.42.42.2(pid=28724): stdout: | (launched: 2022-12-12_16:34:50.195643) 16:34:53.346343 run osmo-hlr_10.42.42.2(pid=28724): stderr: | 20221212163450390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163450390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163450390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163450390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163450390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163450390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163450403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163450412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163450412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163450412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:34:53.419285 run osmo-msc_10.42.42.6(pid=28730): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28730)] 16:34:53.469941 run osmo-msc_10.42.42.6(pid=28730): stdout: | (launched: 2022-12-12_16:34:52.261102) 16:34:53.522051 run osmo-msc_10.42.42.6(pid=28730): stderr: | 20221212163452582 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163452582 DLGLOBAL DEBUG validating counter group 0x7f4e4b599c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163452582 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163452582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163452583 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163452583 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163452584 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163452585 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163452585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163452585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:34:53.575003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28723): Terminating (SIGTERM) 16:34:53.617022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28726): Terminating (SIGTERM) 16:34:53.659437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28729): Terminating (SIGTERM) 16:34:53.701855 --- ParallelTerminationStrategy: PID 28723 died... 16:34:53.721937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28723): Terminated: ok {rc=0} 16:34:53.768500 --- ParallelTerminationStrategy: PID 28726 died... 16:34:53.788086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28726): Terminated: ok {rc=0} 16:34:53.834599 --- ParallelTerminationStrategy: PID 28729 died... 16:34:53.854002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28729): Terminated: ok {rc=0} 16:34:53.942769 bus /sierra_3: Setting Powered False 16:34:55.043080 bus /sierra_3: Setting Powered False 16:34:56.162027 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:34:57.312395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:57.324939 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:34:57.402970 tst mo_mt_call_osmux.py: using LAC 30116 16:34:57.531327 tst mo_mt_call_osmux.py: using RAC 26 16:34:57.659471 tst mo_mt_call_osmux.py: using CellId 30116 16:34:57.785961 tst mo_mt_call_osmux.py: using BVCI 30117 16:34:57.899383 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:57.910923 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:57.922211 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:57.933284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:57.944587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:34:57.955944 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:34:58.075053 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:34:58.191925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:34:58.669636 run create_hlr_db(pid=28732): Launched 16:34:58.795988 bus /sierra_2: Setting Powered False 16:34:59.860411 run create_hlr_db(pid=28732): Terminated: ok {rc=0} 16:35:00.317519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28734): Launched 16:35:00.646465 run osmo-hlr_10.42.42.2(pid=28735): Launched 16:35:00.772481 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:01.459131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28737): Launched 16:35:01.810005 run osmo-stp_10.42.42.5(pid=28741): Launched 16:35:02.018394 run osmo-msc_10.42.42.6: Starting osmo-msc 16:35:02.657707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28743): Launched 16:35:02.965872 run osmo-msc_10.42.42.6(pid=28744): Launched 16:35:03.136552 run osmo-stp_10.42.42.5(pid=28741): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28741)] 16:35:03.267557 run osmo-stp_10.42.42.5(pid=28741): stdout: | (launched: 2022-12-12_16:35:01.744126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:03.397277 run osmo-stp_10.42.42.5(pid=28741): stderr: | 20221212163502025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163502025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163502025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163502025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163502026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163502026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163502026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:03.524872 run osmo-stp_10.42.42.5(pid=28741): stdout: | (launched: 2022-12-12_16:35:01.744126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:03.646975 run osmo-stp_10.42.42.5(pid=28741): stderr: | 20221212163502025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163502025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163502025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163502025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163502026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163502026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163502026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:03.793325 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28741): Process ended prematurely: osmo-stp_10.42.42.5(pid=28741) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28741)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:35:03.802544 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:35:03.828831 run osmo-hlr_10.42.42.2(pid=28735): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28735)] 16:35:03.876512 run osmo-hlr_10.42.42.2(pid=28735): stdout: | (launched: 2022-12-12_16:35:00.586169) 16:35:03.925904 run osmo-hlr_10.42.42.2(pid=28735): stderr: | 20221212163500780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163500780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163500780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163500780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163500780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163500780 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163500803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163500820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163500820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163500820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:03.994547 run osmo-msc_10.42.42.6(pid=28744): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28744)] 16:35:04.041986 run osmo-msc_10.42.42.6(pid=28744): stdout: | (launched: 2022-12-12_16:35:02.908625) 16:35:04.091110 run osmo-msc_10.42.42.6(pid=28744): stderr: | 20221212163503178 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163503178 DLGLOBAL DEBUG validating counter group 0x7fd590679c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163503179 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163503179 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163503179 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163503179 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163503181 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163503181 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163503181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163503181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:35:04.140467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28734): Terminating (SIGTERM) 16:35:04.179870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28737): Terminating (SIGTERM) 16:35:04.219242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28743): Terminating (SIGTERM) 16:35:04.259084 --- ParallelTerminationStrategy: PID 28734 died... 16:35:04.278165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28734): Terminated: ok {rc=0} 16:35:04.321927 --- ParallelTerminationStrategy: PID 28737 died... 16:35:04.340322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28737): Terminated: ok {rc=0} 16:35:04.384403 --- ParallelTerminationStrategy: PID 28743 died... 16:35:04.402959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28743): Terminated: ok {rc=0} 16:35:04.488287 bus /sierra_3: Setting Powered False 16:35:05.587656 bus /sierra_3: Setting Powered False 16:35:06.699694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:35:07.953737 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:35:07.961638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:35:07.995182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:35:08.021468 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:35:08.074617 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:35:08.108921 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:35:08.135481 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:35:08.685666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:35:08.734735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:08.746035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:35:08.815495 tst mo_mt_call.py: using LAC 30117 16:35:08.936603 tst mo_mt_call.py: using RAC 27 16:35:09.057473 tst mo_mt_call.py: using CellId 30117 16:35:09.188897 tst mo_mt_call.py: using BVCI 30118 16:35:09.310219 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:09.322208 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:09.334035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:09.346511 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:09.359153 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:09.371676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:35:09.489116 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:35:09.606969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:10.085448 run create_hlr_db(pid=28749): Launched 16:35:10.212431 bus /sierra_2: Setting Powered False 16:35:11.272898 run create_hlr_db(pid=28749): Terminated: ok {rc=0} 16:35:11.701240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28751): Launched 16:35:12.008385 run osmo-hlr_10.42.42.2(pid=28752): Launched 16:35:12.125774 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:12.653209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28754): Launched 16:35:12.959644 run osmo-stp_10.42.42.5(pid=28755): Launched 16:35:13.076093 run osmo-msc_10.42.42.6: Starting osmo-msc 16:35:13.636394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28757): Launched 16:35:13.944000 run osmo-msc_10.42.42.6(pid=28758): Launched 16:35:14.115620 run osmo-stp_10.42.42.5(pid=28755): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28755)] 16:35:14.246099 run osmo-stp_10.42.42.5(pid=28755): stdout: | (launched: 2022-12-12_16:35:12.902642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:14.375360 run osmo-stp_10.42.42.5(pid=28755): stderr: | 20221212163513073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163513073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163513073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163513074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163513074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163513074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163513074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:14.503283 run osmo-stp_10.42.42.5(pid=28755): stdout: | (launched: 2022-12-12_16:35:12.902642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:14.625496 run osmo-stp_10.42.42.5(pid=28755): stderr: | 20221212163513073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163513073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163513073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163513074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163513074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163513074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163513074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:14.771769 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28755): Process ended prematurely: osmo-stp_10.42.42.5(pid=28755) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28755)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:35:14.780850 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:35:14.807280 run osmo-hlr_10.42.42.2(pid=28752): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28752)] 16:35:14.854992 run osmo-hlr_10.42.42.2(pid=28752): stdout: | (launched: 2022-12-12_16:35:11.951089) 16:35:14.904516 run osmo-hlr_10.42.42.2(pid=28752): stderr: | 20221212163512127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163512127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163512127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163512127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163512127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163512127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163512139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163512147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163512147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163512148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:14.973641 run osmo-msc_10.42.42.6(pid=28758): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28758)] 16:35:15.021355 run osmo-msc_10.42.42.6(pid=28758): stdout: | (launched: 2022-12-12_16:35:13.886789) 16:35:15.070750 run osmo-msc_10.42.42.6(pid=28758): stderr: | 20221212163514158 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163514158 DLGLOBAL DEBUG validating counter group 0x7f5930249c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163514158 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163514158 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163514159 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163514159 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163514160 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163514161 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163514161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163514161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:35:15.120561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28751): Terminating (SIGTERM) 16:35:15.160344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28754): Terminating (SIGTERM) 16:35:15.199836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28757): Terminating (SIGTERM) 16:35:15.239638 --- ParallelTerminationStrategy: PID 28751 died... 16:35:15.258692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28751): Terminated: ok {rc=0} 16:35:15.302754 --- ParallelTerminationStrategy: PID 28754 died... 16:35:15.321374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28754): Terminated: ok {rc=0} 16:35:15.364779 --- ParallelTerminationStrategy: PID 28757 died... 16:35:15.383829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28757): Terminated: ok {rc=0} 16:35:15.469250 bus /sierra_3: Setting Powered False 16:35:16.571315 bus /sierra_3: Setting Powered False 16:35:17.700248 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:35:18.851019 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:18.863717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:35:18.939503 tst mo_mt_call_osmux.py: using LAC 30118 16:35:19.071654 tst mo_mt_call_osmux.py: using RAC 28 16:35:19.198947 tst mo_mt_call_osmux.py: using CellId 30118 16:35:19.331841 tst mo_mt_call_osmux.py: using BVCI 30119 16:35:19.451349 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:19.463169 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:19.474720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:19.486595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:19.498569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:35:19.510502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:35:19.631880 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:35:19.750738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:20.230023 run create_hlr_db(pid=28760): Launched 16:35:20.357716 bus /sierra_2: Setting Powered False 16:35:21.418743 run create_hlr_db(pid=28760): Terminated: ok {rc=0} 16:35:21.865659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28762): Launched 16:35:22.193458 run osmo-hlr_10.42.42.2(pid=28763): Launched 16:35:22.318390 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:22.884514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28765): Launched 16:35:23.214805 run osmo-stp_10.42.42.5(pid=28766): Launched 16:35:23.341292 run osmo-msc_10.42.42.6: Starting osmo-msc 16:35:23.936285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28768): Launched 16:35:24.268044 run osmo-msc_10.42.42.6(pid=28769): Launched 16:35:24.453222 run osmo-stp_10.42.42.5(pid=28766): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28766)] 16:35:24.592918 run osmo-stp_10.42.42.5(pid=28766): stdout: | (launched: 2022-12-12_16:35:23.154256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:24.732515 run osmo-stp_10.42.42.5(pid=28766): stderr: | 20221212163523342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163523343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163523343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163523343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163523344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163523344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163523344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:24.869763 run osmo-stp_10.42.42.5(pid=28766): stdout: | (launched: 2022-12-12_16:35:23.154256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:25.001077 run osmo-stp_10.42.42.5(pid=28766): stderr: | 20221212163523342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163523343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163523343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163523343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163523344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163523344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163523344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:25.158541 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28766): Process ended prematurely: osmo-stp_10.42.42.5(pid=28766) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28766)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:35:25.168314 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:35:25.196814 run osmo-hlr_10.42.42.2(pid=28763): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28763)] 16:35:25.247595 run osmo-hlr_10.42.42.2(pid=28763): stdout: | (launched: 2022-12-12_16:35:22.133086) 16:35:25.300042 run osmo-hlr_10.42.42.2(pid=28763): stderr: | 20221212163522328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163522328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163522328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163522328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163522328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163522328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163522340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163522350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163522350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163522350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:25.372710 run osmo-msc_10.42.42.6(pid=28769): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28769)] 16:35:25.422885 run osmo-msc_10.42.42.6(pid=28769): stdout: | (launched: 2022-12-12_16:35:24.207013) 16:35:25.474634 run osmo-msc_10.42.42.6(pid=28769): stderr: | 20221212163524527 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163524527 DLGLOBAL DEBUG validating counter group 0x7f8f3adeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163524527 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163524527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163524527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163524527 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163524529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163524530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163524530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163524530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:35:25.527010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28762): Terminating (SIGTERM) 16:35:25.568931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28765): Terminating (SIGTERM) 16:35:25.611731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28768): Terminating (SIGTERM) 16:35:25.654339 --- ParallelTerminationStrategy: PID 28762 died... 16:35:25.674322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28762): Terminated: ok {rc=0} 16:35:25.721452 --- ParallelTerminationStrategy: PID 28765 died... 16:35:25.740908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28765): Terminated: ok {rc=0} 16:35:25.787538 --- ParallelTerminationStrategy: PID 28768 died... 16:35:25.807135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28768): Terminated: ok {rc=0} 16:35:25.895347 bus /sierra_3: Setting Powered False 16:35:26.990043 bus /sierra_3: Setting Powered False 16:35:28.104351 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:35:29.359530 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:35:29.367108 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:35:29.403293 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:35:29.430693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:35:29.486154 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:35:29.521587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:35:29.548910 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:35:30.102781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:35:30.157491 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:30.169294 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:35:30.239196 tst mo_mt_call.py: using LAC 30119 16:35:30.367949 tst mo_mt_call.py: using RAC 29 16:35:30.494186 tst mo_mt_call.py: using CellId 30119 16:35:30.621058 tst mo_mt_call.py: using BVCI 30120 16:35:30.740397 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:30.752266 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:30.763859 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:30.775613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:30.788115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:30.804044 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:35:30.941366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:35:31.072555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:31.627903 run create_hlr_db(pid=28774): Launched 16:35:31.824842 bus /sierra_2: Setting Powered False 16:35:32.886244 run create_hlr_db(pid=28774): Terminated: ok {rc=0} 16:35:33.334541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28776): Launched 16:35:33.664778 run osmo-hlr_10.42.42.2(pid=28777): Launched 16:35:33.791084 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:34.356547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28779): Launched 16:35:34.688780 run osmo-stp_10.42.42.5(pid=28780): Launched 16:35:34.815984 run osmo-msc_10.42.42.6: Starting osmo-msc 16:35:35.411008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28782): Launched 16:35:35.742350 run osmo-msc_10.42.42.6(pid=28783): Launched 16:35:35.926446 run osmo-stp_10.42.42.5(pid=28780): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28780)] 16:35:36.065084 run osmo-stp_10.42.42.5(pid=28780): stdout: | (launched: 2022-12-12_16:35:34.627769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:36.204010 run osmo-stp_10.42.42.5(pid=28780): stderr: | 20221212163534817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163534818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163534818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163534818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163534819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163534819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163534819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:36.341740 run osmo-stp_10.42.42.5(pid=28780): stdout: | (launched: 2022-12-12_16:35:34.627769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:36.473124 run osmo-stp_10.42.42.5(pid=28780): stderr: | 20221212163534817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163534818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163534818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163534818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163534819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163534819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163534819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:36.630058 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28780): Process ended prematurely: osmo-stp_10.42.42.5(pid=28780) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28780)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:35:36.639737 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:35:36.668248 run osmo-hlr_10.42.42.2(pid=28777): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28777)] 16:35:36.718582 run osmo-hlr_10.42.42.2(pid=28777): stdout: | (launched: 2022-12-12_16:35:33.603859) 16:35:36.770593 run osmo-hlr_10.42.42.2(pid=28777): stderr: | 20221212163533800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163533800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163533800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163533800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163533800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163533800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163533813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163533822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163533822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163533822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:36.843065 run osmo-msc_10.42.42.6(pid=28783): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28783)] 16:35:36.893314 run osmo-msc_10.42.42.6(pid=28783): stdout: | (launched: 2022-12-12_16:35:35.681589) 16:35:36.945251 run osmo-msc_10.42.42.6(pid=28783): stderr: | 20221212163536003 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163536003 DLGLOBAL DEBUG validating counter group 0x7f3cc1ef4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163536003 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163536003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163536003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163536003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163536005 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163536006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163536006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163536006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:35:36.997515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28776): Terminating (SIGTERM) 16:35:37.039382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28779): Terminating (SIGTERM) 16:35:37.081310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28782): Terminating (SIGTERM) 16:35:37.123565 --- ParallelTerminationStrategy: PID 28776 died... 16:35:37.143431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28776): Terminated: ok {rc=0} 16:35:37.190539 --- ParallelTerminationStrategy: PID 28779 died... 16:35:37.210110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28779): Terminated: ok {rc=0} 16:35:37.256404 --- ParallelTerminationStrategy: PID 28782 died... 16:35:37.275912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28782): Terminated: ok {rc=0} 16:35:37.363751 bus /sierra_3: Setting Powered False 16:35:38.458278 bus /sierra_3: Setting Powered False 16:35:39.570742 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:35:40.720072 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:40.732460 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:35:40.805430 tst mo_mt_call_osmux.py: using LAC 30120 16:35:40.926984 tst mo_mt_call_osmux.py: using RAC 30 16:35:41.050397 tst mo_mt_call_osmux.py: using CellId 30120 16:35:41.172727 tst mo_mt_call_osmux.py: using BVCI 30121 16:35:41.284302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:41.295645 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:41.306677 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:41.317668 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:41.328771 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:35:41.339770 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:35:41.458069 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:35:41.575201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:42.055883 run create_hlr_db(pid=28785): Launched 16:35:42.184183 bus /sierra_2: Setting Powered False 16:35:43.244864 run create_hlr_db(pid=28785): Terminated: ok {rc=0} 16:35:43.695262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28787): Launched 16:35:44.025670 run osmo-hlr_10.42.42.2(pid=28788): Launched 16:35:44.151949 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:44.722282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28790): Launched 16:35:45.051383 run osmo-stp_10.42.42.5(pid=28791): Launched 16:35:45.176358 run osmo-msc_10.42.42.6: Starting osmo-msc 16:35:45.773673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28793): Launched 16:35:46.126477 run osmo-msc_10.42.42.6(pid=28794): Launched 16:35:46.401995 run osmo-stp_10.42.42.5(pid=28791): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28791)] 16:35:46.736664 run osmo-stp_10.42.42.5(pid=28791): stdout: | (launched: 2022-12-12_16:35:44.990228) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:47.064287 run osmo-stp_10.42.42.5(pid=28791): stderr: | 20221212163545180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163545180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163545180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163545181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163545181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163545181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163545181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:47.232906 run osmo-stp_10.42.42.5(pid=28791): stdout: | (launched: 2022-12-12_16:35:44.990228) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:47.355916 run osmo-stp_10.42.42.5(pid=28791): stderr: | 20221212163545180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163545180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163545180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163545181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163545181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163545181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163545181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:47.503121 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28791): Process ended prematurely: osmo-stp_10.42.42.5(pid=28791) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28791)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:35:47.512192 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 16:35:47.538780 run osmo-hlr_10.42.42.2(pid=28788): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28788)] 16:35:47.586686 run osmo-hlr_10.42.42.2(pid=28788): stdout: | (launched: 2022-12-12_16:35:43.964857) 16:35:47.636193 run osmo-hlr_10.42.42.2(pid=28788): stderr: | 20221212163544161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163544161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163544161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163544161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163544161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163544161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163544174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163544184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163544184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163544184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:47.705421 run osmo-msc_10.42.42.6(pid=28794): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28794)] 16:35:47.753256 run osmo-msc_10.42.42.6(pid=28794): stdout: | (launched: 2022-12-12_16:35:46.066985) 16:35:47.802731 run osmo-msc_10.42.42.6(pid=28794): stderr: | 20221212163546738 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163546740 DLGLOBAL DEBUG validating counter group 0x7f1317e4dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163546740 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163546740 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163546741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163546744 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163546751 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163546753 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163546753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163546755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:35:47.852735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28787): Terminating (SIGTERM) 16:35:47.892382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28790): Terminating (SIGTERM) 16:35:47.932168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28793): Terminating (SIGTERM) 16:35:47.972194 --- ParallelTerminationStrategy: PID 28787 died... 16:35:47.991375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28787): Terminated: ok {rc=0} 16:35:48.035230 --- ParallelTerminationStrategy: PID 28790 died... 16:35:48.053941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28790): Terminated: ok {rc=0} 16:35:48.097776 --- ParallelTerminationStrategy: PID 28793 died... 16:35:48.116346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28793): Terminated: ok {rc=0} 16:35:48.200538 bus /sierra_3: Setting Powered False 16:35:49.298189 bus /sierra_3: Setting Powered False 16:35:50.416190 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:35:51.667307 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:35:51.673922 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:35:51.707697 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:35:51.735391 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:35:51.785814 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:35:51.819315 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:35:51.845728 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:35:52.403184 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:35:52.452877 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:35:52.464257 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:35:52.533953 tst mo_mt_call.py: using LAC 30121 16:35:52.656715 tst mo_mt_call.py: using RAC 31 16:35:52.778654 tst mo_mt_call.py: using CellId 30121 16:35:52.900468 tst mo_mt_call.py: using BVCI 30122 16:35:53.012902 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:35:53.024198 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:35:53.035208 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:35:53.046251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:35:53.057393 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:35:53.068368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:35:53.186295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:35:53.301766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:35:53.778805 run create_hlr_db(pid=28799): Launched 16:35:53.905217 bus /sierra_2: Setting Powered False 16:35:54.966495 run create_hlr_db(pid=28799): Terminated: ok {rc=0} 16:35:55.414700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28801): Launched 16:35:55.744883 run osmo-hlr_10.42.42.2(pid=28802): Launched 16:35:55.870954 run osmo-stp_10.42.42.5: Starting osmo-stp 16:35:56.434952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28804): Launched 16:35:56.765922 run osmo-stp_10.42.42.5(pid=28805): Launched 16:35:56.886714 run osmo-msc_10.42.42.6: Starting osmo-msc 16:35:57.446513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28807): Launched 16:35:57.754721 run osmo-msc_10.42.42.6(pid=28808): Launched 16:35:57.927597 run osmo-stp_10.42.42.5(pid=28805): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28805)] 16:35:58.056388 run osmo-stp_10.42.42.5(pid=28805): stdout: | (launched: 2022-12-12_16:35:56.705521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:58.186547 run osmo-stp_10.42.42.5(pid=28805): stderr: | 20221212163556877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163556877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163556878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163556878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163556879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163556879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163556879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:58.314610 run osmo-stp_10.42.42.5(pid=28805): stdout: | (launched: 2022-12-12_16:35:56.705521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:35:58.436555 run osmo-stp_10.42.42.5(pid=28805): stderr: | 20221212163556877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163556877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163556878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163556878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163556879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163556879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163556879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:35:58.584030 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28805): Process ended prematurely: osmo-stp_10.42.42.5(pid=28805) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28805)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:35:58.593298 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:35:58.619727 run osmo-hlr_10.42.42.2(pid=28802): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28802)] 16:35:58.667610 run osmo-hlr_10.42.42.2(pid=28802): stdout: | (launched: 2022-12-12_16:35:55.684214) 16:35:58.716916 run osmo-hlr_10.42.42.2(pid=28802): stderr: | 20221212163555880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163555880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163555880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163555880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163555880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163555881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163555893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163555903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163555903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163555903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:35:58.785807 run osmo-msc_10.42.42.6(pid=28808): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28808)] 16:35:58.833508 run osmo-msc_10.42.42.6(pid=28808): stdout: | (launched: 2022-12-12_16:35:57.697669) 16:35:58.882673 run osmo-msc_10.42.42.6(pid=28808): stderr: | 20221212163557969 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163557970 DLGLOBAL DEBUG validating counter group 0x7f11195dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163557970 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163557970 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163557970 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163557970 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163557972 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163557972 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163557972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163557972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:35:58.932249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28801): Terminating (SIGTERM) 16:35:58.971479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28804): Terminating (SIGTERM) 16:35:59.010991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28807): Terminating (SIGTERM) 16:35:59.050658 --- ParallelTerminationStrategy: PID 28801 died... 16:35:59.069063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28801): Terminated: ok {rc=0} 16:35:59.112360 --- ParallelTerminationStrategy: PID 28804 died... 16:35:59.130788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28804): Terminated: ok {rc=0} 16:35:59.174061 --- ParallelTerminationStrategy: PID 28807 died... 16:35:59.192515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28807): Terminated: ok {rc=0} 16:35:59.278169 bus /sierra_3: Setting Powered False 16:36:00.376605 bus /sierra_3: Setting Powered False 16:36:01.494965 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:36:02.645260 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:36:02.657211 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:36:02.727984 tst mo_mt_call_osmux.py: using LAC 30122 16:36:02.849924 tst mo_mt_call_osmux.py: using RAC 32 16:36:02.969785 tst mo_mt_call_osmux.py: using CellId 30122 16:36:03.089542 tst mo_mt_call_osmux.py: using BVCI 30123 16:36:03.203060 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:36:03.214368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:36:03.225462 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:36:03.236509 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:36:03.247688 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:36:03.258720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:36:03.379067 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:36:03.498175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:03.978464 run create_hlr_db(pid=28810): Launched 16:36:04.104117 bus /sierra_2: Setting Powered False 16:36:05.164530 run create_hlr_db(pid=28810): Terminated: ok {rc=0} 16:36:05.615011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28812): Launched 16:36:05.946796 run osmo-hlr_10.42.42.2(pid=28813): Launched 16:36:06.073666 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:06.640905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28815): Launched 16:36:06.970867 run osmo-stp_10.42.42.5(pid=28816): Launched 16:36:07.098111 run osmo-msc_10.42.42.6: Starting osmo-msc 16:36:07.698041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28818): Launched 16:36:08.029956 run osmo-msc_10.42.42.6(pid=28819): Launched 16:36:08.213663 run osmo-stp_10.42.42.5(pid=28816): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28816)] 16:36:08.353096 run osmo-stp_10.42.42.5(pid=28816): stdout: | (launched: 2022-12-12_16:36:06.910114) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:08.493042 run osmo-stp_10.42.42.5(pid=28816): stderr: | 20221212163607100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163607100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163607100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163607101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163607101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163607101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163607101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:08.631075 run osmo-stp_10.42.42.5(pid=28816): stdout: | (launched: 2022-12-12_16:36:06.910114) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:08.762925 run osmo-stp_10.42.42.5(pid=28816): stderr: | 20221212163607100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163607100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163607100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163607101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163607101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163607101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163607101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:08.920099 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28816): Process ended prematurely: osmo-stp_10.42.42.5(pid=28816) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28816)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:36:08.930238 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:36:08.958480 run osmo-hlr_10.42.42.2(pid=28813): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28813)] 16:36:09.009332 run osmo-hlr_10.42.42.2(pid=28813): stdout: | (launched: 2022-12-12_16:36:05.886063) 16:36:09.061525 run osmo-hlr_10.42.42.2(pid=28813): stderr: | 20221212163606082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163606082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163606082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163606082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163606082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163606082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163606094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163606104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163606104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163606104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:09.134303 run osmo-msc_10.42.42.6(pid=28819): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28819)] 16:36:09.184834 run osmo-msc_10.42.42.6(pid=28819): stdout: | (launched: 2022-12-12_16:36:07.969394) 16:36:09.236935 run osmo-msc_10.42.42.6(pid=28819): stderr: | 20221212163608289 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163608290 DLGLOBAL DEBUG validating counter group 0x7f37a0be5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163608290 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163608290 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163608290 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163608290 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163608292 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163608292 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163608292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163608292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:36:09.289741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28812): Terminating (SIGTERM) 16:36:09.331696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28815): Terminating (SIGTERM) 16:36:09.373816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28818): Terminating (SIGTERM) 16:36:09.416253 --- ParallelTerminationStrategy: PID 28812 died... 16:36:09.436322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28812): Terminated: ok {rc=0} 16:36:09.483028 --- ParallelTerminationStrategy: PID 28815 died... 16:36:09.502719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28815): Terminated: ok {rc=0} 16:36:09.549295 --- ParallelTerminationStrategy: PID 28818 died... 16:36:09.568848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28818): Terminated: ok {rc=0} 16:36:09.657833 bus /sierra_3: Setting Powered False 16:36:10.756227 bus /sierra_3: Setting Powered False 16:36:11.873110 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:36:13.125090 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:36:13.131458 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:36:13.164745 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:36:13.194851 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:36:13.247837 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:36:13.282861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:36:13.310533 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:36:13.863026 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:36:13.915769 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:13.927467 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:36:13.999220 tst mo_mt_call.py: using LAC 30123 16:36:14.126686 tst mo_mt_call.py: using RAC 33 16:36:14.255449 tst mo_mt_call.py: using CellId 30123 16:36:14.378315 tst mo_mt_call.py: using BVCI 30124 16:36:14.491476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:14.502699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:14.513802 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:14.524895 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:14.535978 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:14.546941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:36:14.662151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:36:14.781314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:15.260864 run create_hlr_db(pid=28825): Launched 16:36:15.386683 bus /sierra_2: Setting Powered False 16:36:16.450795 run create_hlr_db(pid=28825): Terminated: ok {rc=0} 16:36:16.918261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28827): Launched 16:36:17.263429 run osmo-hlr_10.42.42.2(pid=28828): Launched 16:36:17.391451 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:17.962564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28830): Launched 16:36:18.294123 run osmo-stp_10.42.42.5(pid=28831): Launched 16:36:18.421259 run osmo-msc_10.42.42.6: Starting osmo-msc 16:36:19.020140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28833): Launched 16:36:19.352612 run osmo-msc_10.42.42.6(pid=28834): Launched 16:36:19.536028 run osmo-stp_10.42.42.5(pid=28831): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28831)] 16:36:19.675456 run osmo-stp_10.42.42.5(pid=28831): stdout: | (launched: 2022-12-12_16:36:18.233367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:19.815363 run osmo-stp_10.42.42.5(pid=28831): stderr: | 20221212163618423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163618423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163618423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163618423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163618424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163618424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163618424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:19.952921 run osmo-stp_10.42.42.5(pid=28831): stdout: | (launched: 2022-12-12_16:36:18.233367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:20.084462 run osmo-stp_10.42.42.5(pid=28831): stderr: | 20221212163618423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163618423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163618423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163618423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163618424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163618424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163618424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:20.241665 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28831): Process ended prematurely: osmo-stp_10.42.42.5(pid=28831) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28831)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:36:20.251296 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:36:20.279828 run osmo-hlr_10.42.42.2(pid=28828): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28828)] 16:36:20.330698 run osmo-hlr_10.42.42.2(pid=28828): stdout: | (launched: 2022-12-12_16:36:17.202914) 16:36:20.382949 run osmo-hlr_10.42.42.2(pid=28828): stderr: | 20221212163617397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163617397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163617397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163617397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163617397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163617398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163617410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163617420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163617421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163617421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:20.455857 run osmo-msc_10.42.42.6(pid=28834): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28834)] 16:36:20.506309 run osmo-msc_10.42.42.6(pid=28834): stdout: | (launched: 2022-12-12_16:36:19.291663) 16:36:20.558292 run osmo-msc_10.42.42.6(pid=28834): stderr: | 20221212163619612 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163619612 DLGLOBAL DEBUG validating counter group 0x7f94a83fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163619612 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163619612 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163619612 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163619613 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163619614 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163619615 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163619615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163619615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:36:20.610725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28827): Terminating (SIGTERM) 16:36:20.653264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28830): Terminating (SIGTERM) 16:36:20.695691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28833): Terminating (SIGTERM) 16:36:20.738234 --- ParallelTerminationStrategy: PID 28827 died... 16:36:20.758325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28827): Terminated: ok {rc=0} 16:36:20.805351 --- ParallelTerminationStrategy: PID 28830 died... 16:36:20.825004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28830): Terminated: ok {rc=0} 16:36:20.871894 --- ParallelTerminationStrategy: PID 28833 died... 16:36:20.891456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28833): Terminated: ok {rc=0} 16:36:20.980676 bus /sierra_3: Setting Powered False 16:36:22.077690 bus /sierra_3: Setting Powered False 16:36:23.193460 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:36:24.340904 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:24.353368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:36:24.424157 tst mo_mt_call_osmux.py: using LAC 30124 16:36:24.545359 tst mo_mt_call_osmux.py: using RAC 34 16:36:24.668209 tst mo_mt_call_osmux.py: using CellId 30124 16:36:24.791944 tst mo_mt_call_osmux.py: using BVCI 30125 16:36:24.905447 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:24.916666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:24.927894 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:24.939134 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:24.950368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:36:24.961497 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:36:25.083103 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:36:25.201094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:25.680601 run create_hlr_db(pid=28836): Launched 16:36:25.811271 bus /sierra_2: Setting Powered False 16:36:26.876011 run create_hlr_db(pid=28836): Terminated: ok {rc=0} 16:36:27.335542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28838): Launched 16:36:27.667953 run osmo-hlr_10.42.42.2(pid=28839): Launched 16:36:27.792914 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:28.360933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28841): Launched 16:36:28.693611 run osmo-stp_10.42.42.5(pid=28842): Launched 16:36:28.821626 run osmo-msc_10.42.42.6: Starting osmo-msc 16:36:29.418171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28844): Launched 16:36:29.749312 run osmo-msc_10.42.42.6(pid=28845): Launched 16:36:29.934803 run osmo-stp_10.42.42.5(pid=28842): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28842)] 16:36:30.074039 run osmo-stp_10.42.42.5(pid=28842): stdout: | (launched: 2022-12-12_16:36:28.631974) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:30.213855 run osmo-stp_10.42.42.5(pid=28842): stderr: | 20221212163628822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163628822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163628822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163628823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163628823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163628823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163628823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:30.351475 run osmo-stp_10.42.42.5(pid=28842): stdout: | (launched: 2022-12-12_16:36:28.631974) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:30.483428 run osmo-stp_10.42.42.5(pid=28842): stderr: | 20221212163628822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163628822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163628822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163628823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163628823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163628823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163628823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:30.641515 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28842): Process ended prematurely: osmo-stp_10.42.42.5(pid=28842) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28842)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:36:30.651330 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 16:36:30.679755 run osmo-hlr_10.42.42.2(pid=28839): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28839)] 16:36:30.730710 run osmo-hlr_10.42.42.2(pid=28839): stdout: | (launched: 2022-12-12_16:36:27.606502) 16:36:30.783884 run osmo-hlr_10.42.42.2(pid=28839): stderr: | 20221212163627802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163627802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163627802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163627802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163627803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163627803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163627815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163627824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163627824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163627824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:30.858349 run osmo-msc_10.42.42.6(pid=28845): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28845)] 16:36:30.910431 run osmo-msc_10.42.42.6(pid=28845): stdout: | (launched: 2022-12-12_16:36:29.688220) 16:36:30.964341 run osmo-msc_10.42.42.6(pid=28845): stderr: | 20221212163630008 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163630008 DLGLOBAL DEBUG validating counter group 0x7faa18374c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163630008 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163630008 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163630008 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163630009 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163630010 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163630011 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163630011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163630011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:36:31.018699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28838): Terminating (SIGTERM) 16:36:31.063109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28841): Terminating (SIGTERM) 16:36:31.107803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28844): Terminating (SIGTERM) 16:36:31.153603 --- ParallelTerminationStrategy: PID 28838 died... 16:36:31.174219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28838): Terminated: ok {rc=0} 16:36:31.223813 --- ParallelTerminationStrategy: PID 28841 died... 16:36:31.244301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28841): Terminated: ok {rc=0} 16:36:31.293815 --- ParallelTerminationStrategy: PID 28844 died... 16:36:31.314439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28844): Terminated: ok {rc=0} 16:36:31.405790 bus /sierra_3: Setting Powered False 16:36:32.507504 bus /sierra_3: Setting Powered False 16:36:33.624263 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:36:34.889701 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:36:34.897003 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:36:34.932244 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:36:34.959512 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:36:35.012662 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:36:35.047342 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:36:35.074753 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:36:35.631412 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:36:35.684321 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:35.696128 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:36:35.767610 tst mo_mt_call.py: using LAC 30125 16:36:35.893406 tst mo_mt_call.py: using RAC 35 16:36:36.020512 tst mo_mt_call.py: using CellId 30125 16:36:36.146702 tst mo_mt_call.py: using BVCI 30126 16:36:36.265526 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:36.277364 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:36.288747 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:36.300678 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:36.312608 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:36.324557 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:36:36.441290 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:36:36.560232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:37.039035 run create_hlr_db(pid=28850): Launched 16:36:37.166801 bus /sierra_2: Setting Powered False 16:36:38.227998 run create_hlr_db(pid=28850): Terminated: ok {rc=0} 16:36:38.678571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Launched 16:36:39.009287 run osmo-hlr_10.42.42.2(pid=28853): Launched 16:36:39.135442 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:39.705299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Launched 16:36:40.035714 run osmo-stp_10.42.42.5(pid=28856): Launched 16:36:40.161829 run osmo-msc_10.42.42.6: Starting osmo-msc 16:36:40.757951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Launched 16:36:41.087701 run osmo-msc_10.42.42.6(pid=28859): Launched 16:36:41.272080 run osmo-stp_10.42.42.5(pid=28856): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] 16:36:41.410879 run osmo-stp_10.42.42.5(pid=28856): stdout: | (launched: 2022-12-12_16:36:39.975330) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:41.550475 run osmo-stp_10.42.42.5(pid=28856): stderr: | 20221212163640164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163640164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163640164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163640166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163640166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163640167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163640167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:41.687989 run osmo-stp_10.42.42.5(pid=28856): stdout: | (launched: 2022-12-12_16:36:39.975330) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:41.819176 run osmo-stp_10.42.42.5(pid=28856): stderr: | 20221212163640164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163640164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163640164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163640166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163640166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163640167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163640167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:41.976110 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28856): Process ended prematurely: osmo-stp_10.42.42.5(pid=28856) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:36:41.985999 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:36:42.014280 run osmo-hlr_10.42.42.2(pid=28853): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28853)] 16:36:42.064473 run osmo-hlr_10.42.42.2(pid=28853): stdout: | (launched: 2022-12-12_16:36:38.948640) 16:36:42.116525 run osmo-hlr_10.42.42.2(pid=28853): stderr: | 20221212163639143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163639143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163639143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163639143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163639143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163639143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163639155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163639164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163639164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163639164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:42.189122 run osmo-msc_10.42.42.6(pid=28859): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28859)] 16:36:42.239094 run osmo-msc_10.42.42.6(pid=28859): stdout: | (launched: 2022-12-12_16:36:41.027182) 16:36:42.291060 run osmo-msc_10.42.42.6(pid=28859): stderr: | 20221212163641346 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163641346 DLGLOBAL DEBUG validating counter group 0x7f7e34cfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163641346 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163641346 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163641347 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163641347 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163641349 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163641349 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163641349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163641350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:36:42.343318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Terminating (SIGTERM) 16:36:42.385092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Terminating (SIGTERM) 16:36:42.427018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Terminating (SIGTERM) 16:36:42.468835 --- ParallelTerminationStrategy: PID 28852 died... 16:36:42.488878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Terminated: ok {rc=0} 16:36:42.535481 --- ParallelTerminationStrategy: PID 28855 died... 16:36:42.554860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Terminated: ok {rc=0} 16:36:42.601159 --- ParallelTerminationStrategy: PID 28858 died... 16:36:42.620470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Terminated: ok {rc=0} 16:36:42.708291 bus /sierra_3: Setting Powered False 16:36:43.807963 bus /sierra_3: Setting Powered False 16:36:44.923608 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:36:46.090876 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:46.107655 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:36:46.192530 tst mo_mt_call_osmux.py: using LAC 30126 16:36:46.319959 tst mo_mt_call_osmux.py: using RAC 36 16:36:46.445753 tst mo_mt_call_osmux.py: using CellId 30126 16:36:46.577379 tst mo_mt_call_osmux.py: using BVCI 30127 16:36:46.694862 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:46.707138 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:46.718970 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:46.730904 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:46.743060 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:36:46.755152 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:36:46.894700 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:36:47.039559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:47.537659 run create_hlr_db(pid=28861): Launched 16:36:47.663021 bus /sierra_2: Setting Powered False 16:36:48.724122 run create_hlr_db(pid=28861): Terminated: ok {rc=0} 16:36:49.175490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28863): Launched 16:36:49.506182 run osmo-hlr_10.42.42.2(pid=28864): Launched 16:36:49.632779 run osmo-stp_10.42.42.5: Starting osmo-stp 16:36:50.202763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28866): Launched 16:36:50.533386 run osmo-stp_10.42.42.5(pid=28867): Launched 16:36:50.660404 run osmo-msc_10.42.42.6: Starting osmo-msc 16:36:51.256830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28869): Launched 16:36:51.587861 run osmo-msc_10.42.42.6(pid=28870): Launched 16:36:51.772452 run osmo-stp_10.42.42.5(pid=28867): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28867)] 16:36:51.911361 run osmo-stp_10.42.42.5(pid=28867): stdout: | (launched: 2022-12-12_16:36:50.472157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:52.050932 run osmo-stp_10.42.42.5(pid=28867): stderr: | 20221212163650663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163650663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163650663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163650664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163650664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163650664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163650664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:52.188176 run osmo-stp_10.42.42.5(pid=28867): stdout: | (launched: 2022-12-12_16:36:50.472157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:36:52.319526 run osmo-stp_10.42.42.5(pid=28867): stderr: | 20221212163650663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163650663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163650663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163650664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163650664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163650664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163650664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:36:52.476905 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28867): Process ended prematurely: osmo-stp_10.42.42.5(pid=28867) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28867)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:36:52.486892 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:36:52.515466 run osmo-hlr_10.42.42.2(pid=28864): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28864)] 16:36:52.565705 run osmo-hlr_10.42.42.2(pid=28864): stdout: | (launched: 2022-12-12_16:36:49.445528) 16:36:52.617727 run osmo-hlr_10.42.42.2(pid=28864): stderr: | 20221212163649641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163649641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163649641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163649641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163649641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163649641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163649654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163649663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163649664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163649664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:36:52.690443 run osmo-msc_10.42.42.6(pid=28870): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28870)] 16:36:52.740612 run osmo-msc_10.42.42.6(pid=28870): stdout: | (launched: 2022-12-12_16:36:51.527280) 16:36:52.792435 run osmo-msc_10.42.42.6(pid=28870): stderr: | 20221212163651846 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163651847 DLGLOBAL DEBUG validating counter group 0x7ffb0b084c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163651847 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163651847 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163651847 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163651847 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163651849 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163651849 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163651849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163651850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:36:52.844859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28863): Terminating (SIGTERM) 16:36:52.886990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28866): Terminating (SIGTERM) 16:36:52.929336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28869): Terminating (SIGTERM) 16:36:52.971718 --- ParallelTerminationStrategy: PID 28863 died... 16:36:52.991731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28863): Terminated: ok {rc=0} 16:36:53.038714 --- ParallelTerminationStrategy: PID 28866 died... 16:36:53.058395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28866): Terminated: ok {rc=0} 16:36:53.105568 --- ParallelTerminationStrategy: PID 28869 died... 16:36:53.125186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28869): Terminated: ok {rc=0} 16:36:53.216299 bus /sierra_3: Setting Powered False 16:36:54.315341 bus /sierra_3: Setting Powered False 16:36:55.431424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:36:56.690481 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:36:56.697061 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:36:56.731274 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:36:56.757712 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:36:56.810414 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:36:56.844560 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:36:56.870930 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:36:57.419761 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:36:57.469221 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:36:57.480414 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:36:57.550856 tst mo_mt_call.py: using LAC 30127 16:36:57.674007 tst mo_mt_call.py: using RAC 37 16:36:57.794605 tst mo_mt_call.py: using CellId 30127 16:36:57.917018 tst mo_mt_call.py: using BVCI 30128 16:36:58.028504 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:36:58.039649 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:36:58.050590 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:36:58.061545 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:36:58.072516 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:36:58.083446 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:36:58.197550 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:36:58.314343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:36:58.794079 run create_hlr_db(pid=28875): Launched 16:36:58.922186 bus /sierra_2: Setting Powered False 16:36:59.983434 run create_hlr_db(pid=28875): Terminated: ok {rc=0} 16:37:00.435374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Launched 16:37:00.768465 run osmo-hlr_10.42.42.2(pid=28878): Launched 16:37:01.015153 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:01.682002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Launched 16:37:02.030079 run osmo-stp_10.42.42.5(pid=28881): Launched 16:37:02.289677 run osmo-msc_10.42.42.6: Starting osmo-msc 16:37:02.873347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Launched 16:37:03.183844 run osmo-msc_10.42.42.6(pid=28884): Launched 16:37:03.355441 run osmo-stp_10.42.42.5(pid=28881): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] 16:37:03.493602 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-12_16:37:01.969109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:03.635869 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221212163702206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163702207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163702207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163702208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163702208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163702208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163702208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:03.773941 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-12_16:37:01.969109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:03.905856 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221212163702206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163702207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163702207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163702208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163702208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163702208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163702208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:04.062964 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:37:04.072825 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:37:04.101578 run osmo-hlr_10.42.42.2(pid=28878): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28878)] 16:37:04.152355 run osmo-hlr_10.42.42.2(pid=28878): stdout: | (launched: 2022-12-12_16:37:00.707527) 16:37:04.204747 run osmo-hlr_10.42.42.2(pid=28878): stderr: | 20221212163701040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163701040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163701040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163701040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163701040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163701041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163701062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163701093 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163701093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163701095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:04.277473 run osmo-msc_10.42.42.6(pid=28884): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28884)] 16:37:04.328297 run osmo-msc_10.42.42.6(pid=28884): stdout: | (launched: 2022-12-12_16:37:03.126232) 16:37:04.380858 run osmo-msc_10.42.42.6(pid=28884): stderr: | 20221212163703400 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163703400 DLGLOBAL DEBUG validating counter group 0x7f8284ca3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163703400 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163703400 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163703402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163703402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163703404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163703404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163703404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163703404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:37:04.433974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminating (SIGTERM) 16:37:04.476577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminating (SIGTERM) 16:37:04.519227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Terminating (SIGTERM) 16:37:04.562313 --- ParallelTerminationStrategy: PID 28877 died... 16:37:04.582594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminated: ok {rc=0} 16:37:04.630064 --- ParallelTerminationStrategy: PID 28880 died... 16:37:04.650088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminated: ok {rc=0} 16:37:04.697543 --- ParallelTerminationStrategy: PID 28883 died... 16:37:04.717555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Terminated: ok {rc=0} 16:37:04.806931 bus /sierra_3: Setting Powered False 16:37:05.907401 bus /sierra_3: Setting Powered False 16:37:07.026786 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:37:08.175454 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:37:08.187409 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:37:08.258765 tst mo_mt_call_osmux.py: using LAC 30128 16:37:08.381717 tst mo_mt_call_osmux.py: using RAC 38 16:37:08.503459 tst mo_mt_call_osmux.py: using CellId 30128 16:37:08.629031 tst mo_mt_call_osmux.py: using BVCI 30129 16:37:08.743473 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:37:08.754796 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:37:08.765850 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:37:08.777778 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:37:08.789216 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:37:08.800378 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:37:08.919469 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:37:09.046108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:09.558252 run create_hlr_db(pid=28886): Launched 16:37:09.685334 bus /sierra_2: Setting Powered False 16:37:10.749588 run create_hlr_db(pid=28886): Terminated: ok {rc=0} 16:37:11.190387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28888): Launched 16:37:11.498854 run osmo-hlr_10.42.42.2(pid=28889): Launched 16:37:11.616616 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:12.160367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28891): Launched 16:37:12.468431 run osmo-stp_10.42.42.5(pid=28892): Launched 16:37:12.586423 run osmo-msc_10.42.42.6: Starting osmo-msc 16:37:13.145355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28894): Launched 16:37:13.453535 run osmo-msc_10.42.42.6(pid=28895): Launched 16:37:13.625489 run osmo-stp_10.42.42.5(pid=28892): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28892)] 16:37:13.758435 run osmo-stp_10.42.42.5(pid=28892): stdout: | (launched: 2022-12-12_16:37:12.411120) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:13.888504 run osmo-stp_10.42.42.5(pid=28892): stderr: | 20221212163712582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163712582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163712582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163712583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163712583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163712583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163712583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:14.033230 run osmo-stp_10.42.42.5(pid=28892): stdout: | (launched: 2022-12-12_16:37:12.411120) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:14.168525 run osmo-stp_10.42.42.5(pid=28892): stderr: | 20221212163712582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163712582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163712582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163712583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163712583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163712583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163712583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:14.326664 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28892): Process ended prematurely: osmo-stp_10.42.42.5(pid=28892) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28892)] [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:37:14.336906 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:37:14.366374 run osmo-hlr_10.42.42.2(pid=28889): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28889)] 16:37:14.417500 run osmo-hlr_10.42.42.2(pid=28889): stdout: | (launched: 2022-12-12_16:37:11.441388) 16:37:14.470001 run osmo-hlr_10.42.42.2(pid=28889): stderr: | 20221212163711616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163711616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163711616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163711616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163711616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163711617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163711628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163711637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163711637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163711637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:14.543163 run osmo-msc_10.42.42.6(pid=28895): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28895)] 16:37:14.593925 run osmo-msc_10.42.42.6(pid=28895): stdout: | (launched: 2022-12-12_16:37:13.396209) 16:37:14.646677 run osmo-msc_10.42.42.6(pid=28895): stderr: | 20221212163713669 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163713670 DLGLOBAL DEBUG validating counter group 0x7f01be8c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163713670 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163713670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163713670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163713670 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163713672 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163713672 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163713673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163713673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:37:14.699929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28888): Terminating (SIGTERM) 16:37:14.742530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28891): Terminating (SIGTERM) 16:37:14.785684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28894): Terminating (SIGTERM) 16:37:14.828619 --- ParallelTerminationStrategy: PID 28888 died... 16:37:14.848850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28888): Terminated: ok {rc=0} 16:37:14.896606 --- ParallelTerminationStrategy: PID 28891 died... 16:37:14.916493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28891): Terminated: ok {rc=0} 16:37:14.963486 --- ParallelTerminationStrategy: PID 28894 died... 16:37:14.983194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28894): Terminated: ok {rc=0} 16:37:15.073160 bus /sierra_3: Setting Powered False 16:37:16.170234 bus /sierra_3: Setting Powered False 16:37:17.291312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 16:37:18.546860 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:18.551843 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:37:18.587772 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 16:37:18.615680 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 16:37:18.715000 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:37:18.748829 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 16:37:18.775653 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 16:37:19.360634 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2379 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 16:37:19.366898 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:19.378295 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:37:19.427561 tst emergency_mo_mt_call.py: using LAC 30129 16:37:19.544836 tst emergency_mo_mt_call.py: using RAC 39 16:37:19.661747 tst emergency_mo_mt_call.py: using CellId 30129 16:37:19.778316 tst emergency_mo_mt_call.py: using BVCI 30130 16:37:19.889623 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:19.900453 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:19.911074 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:19.921724 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:19.932295 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:19.942990 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:37:20.060611 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:37:20.176723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:20.646353 run create_hlr_db(pid=28903): Launched 16:37:20.772087 bus /sierra_2: Setting Powered False 16:37:21.831773 run create_hlr_db(pid=28903): Terminated: ok {rc=0} 16:37:22.274165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28905): Launched 16:37:22.598592 run osmo-hlr_10.42.42.2(pid=28906): Launched 16:37:22.723221 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:23.286372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28908): Launched 16:37:23.610557 run osmo-stp_10.42.42.5(pid=28909): Launched 16:37:23.745432 tst emergency_mo_mt_call.py: using MSISDN 7866 16:37:23.913234 run osmo-msc_10.42.42.6: Starting osmo-msc 16:37:24.498819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28911): Launched 16:37:24.825410 run osmo-msc_10.42.42.6(pid=28912): Launched 16:37:25.005864 run osmo-stp_10.42.42.5(pid=28909): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28909)] 16:37:25.143217 run osmo-stp_10.42.42.5(pid=28909): stdout: | (launched: 2022-12-12_16:37:23.550548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:25.280665 run osmo-stp_10.42.42.5(pid=28909): stderr: | 20221212163723739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163723739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163723740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163723740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163723741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163723741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163723741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:25.416332 run osmo-stp_10.42.42.5(pid=28909): stdout: | (launched: 2022-12-12_16:37:23.550548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:25.545920 run osmo-stp_10.42.42.5(pid=28909): stderr: | 20221212163723739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163723739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163723740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163723740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163723741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163723741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163723741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:25.700731 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28909): Process ended prematurely: osmo-stp_10.42.42.5(pid=28909) [trial-2379↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28909)] [trial-2379↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 16:37:25.710168 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 16:37:25.738702 run osmo-hlr_10.42.42.2(pid=28906): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28906)] 16:37:25.789544 run osmo-hlr_10.42.42.2(pid=28906): stdout: | (launched: 2022-12-12_16:37:22.538296) 16:37:25.841920 run osmo-hlr_10.42.42.2(pid=28906): stderr: | 20221212163722733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163722733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163722733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163722734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163722734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163722734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163722745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163722754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163722754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163722754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:25.914767 run osmo-msc_10.42.42.6(pid=28912): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28912)] 16:37:25.965289 run osmo-msc_10.42.42.6(pid=28912): stdout: | (launched: 2022-12-12_16:37:24.765414) 16:37:26.017705 run osmo-msc_10.42.42.6(pid=28912): stderr: | 20221212163725084 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163725084 DLGLOBAL DEBUG validating counter group 0x7f647274cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163725084 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163725084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163725084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163725084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163725086 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163725087 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163725087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163725087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:37:26.070468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28905): Terminating (SIGTERM) 16:37:26.113124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28908): Terminating (SIGTERM) 16:37:26.155483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28911): Terminating (SIGTERM) 16:37:26.198115 --- ParallelTerminationStrategy: PID 28905 died... 16:37:26.218288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28905): Terminated: ok {rc=0} 16:37:26.265790 --- ParallelTerminationStrategy: PID 28908 died... 16:37:26.285641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28908): Terminated: ok {rc=0} 16:37:26.332675 --- ParallelTerminationStrategy: PID 28911 died... 16:37:26.352417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28911): Terminated: ok {rc=0} 16:37:26.441964 bus /sierra_3: Setting Powered False 16:37:27.539927 bus /sierra_3: Setting Powered False 16:37:28.656847 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 16:37:29.742845 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:29.755136 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:37:29.810502 tst emergency_preemptive_call.py: using LAC 30130 16:37:29.938177 tst emergency_preemptive_call.py: using RAC 40 16:37:30.070394 tst emergency_preemptive_call.py: using CellId 30130 16:37:30.196899 tst emergency_preemptive_call.py: using BVCI 30131 16:37:30.314571 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:30.326235 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:30.337428 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:30.349027 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:30.360755 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 16:37:30.372451 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:37:30.490606 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:37:30.610672 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:37:30.726897 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:37:30.852314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:31.389637 run create_hlr_db(pid=28914): Launched 16:37:31.550749 bus /sierra_2: Setting Powered False 16:37:32.611497 run create_hlr_db(pid=28914): Terminated: ok {rc=0} 16:37:33.058189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28916): Launched 16:37:33.385268 run osmo-hlr_10.42.42.2(pid=28917): Launched 16:37:33.509658 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:34.068302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28919): Launched 16:37:34.394912 run osmo-stp_10.42.42.5(pid=28920): Launched 16:37:34.532250 tst emergency_preemptive_call.py: using MSISDN 7867 16:37:34.698076 run osmo-msc_10.42.42.6: Starting osmo-msc 16:37:35.282716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28922): Launched 16:37:35.609128 run osmo-msc_10.42.42.6(pid=28923): Launched 16:37:35.791073 run osmo-stp_10.42.42.5(pid=28920): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28920)] 16:37:35.928255 run osmo-stp_10.42.42.5(pid=28920): stdout: | (launched: 2022-12-12_16:37:34.334757) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:36.066023 run osmo-stp_10.42.42.5(pid=28920): stderr: | 20221212163734523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163734523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163734523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163734524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163734524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163734525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163734525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:36.202102 run osmo-stp_10.42.42.5(pid=28920): stdout: | (launched: 2022-12-12_16:37:34.334757) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:36.331494 run osmo-stp_10.42.42.5(pid=28920): stderr: | 20221212163734523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163734523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163734523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163734524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163734524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163734525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163734525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:36.485685 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28920): Process ended prematurely: osmo-stp_10.42.42.5(pid=28920) [trial-2379↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28920)] [trial-2379↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 16:37:36.495005 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 16:37:36.523241 run osmo-hlr_10.42.42.2(pid=28917): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28917)] 16:37:36.573936 run osmo-hlr_10.42.42.2(pid=28917): stdout: | (launched: 2022-12-12_16:37:33.325012) 16:37:36.626386 run osmo-hlr_10.42.42.2(pid=28917): stderr: | 20221212163733518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163733518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163733518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163733518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163733518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163733519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163733531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163733540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163733540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163733540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:36.699861 run osmo-msc_10.42.42.6(pid=28923): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28923)] 16:37:36.750767 run osmo-msc_10.42.42.6(pid=28923): stdout: | (launched: 2022-12-12_16:37:35.548746) 16:37:36.803737 run osmo-msc_10.42.42.6(pid=28923): stderr: | 20221212163735868 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212163735869 DLGLOBAL DEBUG validating counter group 0x7f69b68c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212163735869 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212163735869 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212163735869 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212163735869 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212163735871 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212163735871 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212163735872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212163735872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:37:36.857082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28916): Terminating (SIGTERM) 16:37:36.900293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28919): Terminating (SIGTERM) 16:37:36.943446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28922): Terminating (SIGTERM) 16:37:36.987991 --- ParallelTerminationStrategy: PID 28916 died... 16:37:37.008449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28916): Terminated: ok {rc=0} 16:37:37.058585 --- ParallelTerminationStrategy: PID 28919 died... 16:37:37.079067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28919): Terminated: ok {rc=0} 16:37:37.127360 --- ParallelTerminationStrategy: PID 28922 died... 16:37:37.147697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28922): Terminated: ok {rc=0} 16:37:37.236891 bus /sierra_9: Setting Powered False 16:37:38.336128 bus /sierra_9: Setting Powered False 16:37:39.449044 bus /sierra_8: Setting Powered False 16:37:40.546498 bus /sierra_8: Setting Powered False 16:37:41.663452 bus /sierra_3: Setting Powered False 16:37:42.761567 bus /sierra_3: Setting Powered False 16:37:43.876822 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 16:37:45.157041 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:37:45.161399 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 16:37:45.194723 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 16:37:45.232606 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 16:37:45.318318 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 16:37:45.351924 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 16:37:45.390001 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 16:37:46.003478 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 16:37:46.063713 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:46.076069 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:37:46.130070 tst cs_paging_gprs_active.py: using LAC 30131 16:37:46.302357 tst cs_paging_gprs_active.py: using RAC 41 16:37:46.431582 tst cs_paging_gprs_active.py: using CellId 30131 16:37:46.564936 tst cs_paging_gprs_active.py: using BVCI 30132 16:37:46.711567 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:46.724219 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:46.738086 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:46.751895 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:46.770423 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:46.783991 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:46.796366 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:46.810829 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:46.824407 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:37:46.951114 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:37:47.100637 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:37:47.341293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:37:47.678090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28928): Launched 16:37:47.969373 run iperf3-srv_10.42.42.10(pid=28929): Launched 16:37:48.088062 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:37:48.295713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:37:48.608698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28930): Launched 16:37:48.879543 run iperf3-srv_10.42.42.10(pid=28931): Launched 16:37:48.996139 tst cs_paging_gprs_active.py:38: start network... 16:37:49.204018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:37:49.687458 run create_hlr_db(pid=28932): Launched 16:37:49.815032 bus /sierra_2: Setting Powered False 16:37:50.876824 run create_hlr_db(pid=28932): Terminated: ok {rc=0} 16:37:51.329875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28934): Launched 16:37:51.665409 run osmo-hlr_10.42.42.2(pid=28935): Launched 16:37:51.792367 run osmo-stp_10.42.42.5: Starting osmo-stp 16:37:52.367246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28937): Launched 16:37:52.699294 run osmo-stp_10.42.42.5(pid=28938): Launched 16:37:52.827460 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:37:53.399635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28940): Launched 16:37:53.527954 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:37:53.809173 run patchelf(pid=28941): Launched 16:37:53.994093 run osmo-stp_10.42.42.5(pid=28938): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28938)] 16:37:54.134003 run osmo-stp_10.42.42.5(pid=28938): stdout: | (launched: 2022-12-12_16:37:52.637579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:54.275152 run osmo-stp_10.42.42.5(pid=28938): stderr: | 20221212163752827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163752827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163752828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163752828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163752829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163752829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163752829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:54.416499 run osmo-stp_10.42.42.5(pid=28938): stdout: | (launched: 2022-12-12_16:37:52.637579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:37:54.551969 run osmo-stp_10.42.42.5(pid=28938): stderr: | 20221212163752827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163752827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163752828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163752828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163752829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163752829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163752829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:37:54.714240 run patchelf(pid=28941): Terminating (SIGINT) 16:37:54.898910 run patchelf(pid=28941): Terminated: ok {rc=0} 16:37:55.032707 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28938): Process ended prematurely: osmo-stp_10.42.42.5(pid=28938) [trial-2379↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28938)] [trial-2379↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 16:37:55.043273 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:37:55.072147 run osmo-hlr_10.42.42.2(pid=28935): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28935)] 16:37:55.122521 run osmo-hlr_10.42.42.2(pid=28935): stdout: | (launched: 2022-12-12_16:37:51.603915) 16:37:55.174498 run osmo-hlr_10.42.42.2(pid=28935): stderr: | 20221212163751801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163751801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163751801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163751801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163751801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163751801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163751813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163751822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163751822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163751823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:37:55.226926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28928): Terminating (SIGTERM) 16:37:55.269067 run iperf3-srv_10.42.42.10(pid=28929): Terminating (SIGTERM) 16:37:55.311011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28930): Terminating (SIGTERM) 16:37:55.353025 run iperf3-srv_10.42.42.10(pid=28931): Terminating (SIGTERM) 16:37:55.394779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28934): Terminating (SIGTERM) 16:37:55.437205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28937): Terminating (SIGTERM) 16:37:55.479014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28940): Terminating (SIGTERM) 16:37:55.521088 --- ParallelTerminationStrategy: PID 28928 died... 16:37:55.541090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28928): Terminated: ok {rc=0} 16:37:55.587706 --- ParallelTerminationStrategy: PID 28929 died... 16:37:55.607154 run iperf3-srv_10.42.42.10(pid=28929): Terminated {rc=256} 16:37:55.653386 --- ParallelTerminationStrategy: PID 28930 died... 16:37:55.673223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28930): Terminated: ok {rc=0} 16:37:55.719877 --- ParallelTerminationStrategy: PID 28931 died... 16:37:55.739336 run iperf3-srv_10.42.42.10(pid=28931): Terminated {rc=256} 16:37:55.785827 --- ParallelTerminationStrategy: PID 28934 died... 16:37:55.805403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28934): Terminated: ok {rc=0} 16:37:55.852019 --- ParallelTerminationStrategy: PID 28937 died... 16:37:55.871504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28937): Terminated: ok {rc=0} 16:37:55.918918 --- ParallelTerminationStrategy: PID 28940 died... 16:37:55.938592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28940): Terminated: ok {rc=0} 16:37:56.027552 bus /gobi_0: Setting Powered False 16:37:57.127767 bus /gobi_0: Setting Powered False 16:37:58.244270 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 16:37:59.395783 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:59.407662 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:37:59.462088 tst iperf3.py: using LAC 30132 16:37:59.592708 tst iperf3.py: using RAC 42 16:37:59.724417 tst iperf3.py: using CellId 30132 16:37:59.847238 tst iperf3.py: using BVCI 30133 16:37:59.961859 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:59.972803 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:59.983635 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:37:59.994582 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:00.005145 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:00.015616 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:00.026369 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:00.036824 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:00.047509 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:38:00.165919 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:38:00.390016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:00.724291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28942): Launched 16:38:01.043615 run iperf3-srv_10.42.42.10(pid=28943): Launched 16:38:01.200655 tst iperf3.py:8: start network... 16:38:01.432291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:01.960062 run create_hlr_db(pid=28944): Launched 16:38:02.126177 bus /gobi_6: Setting Powered False 16:38:03.191463 run create_hlr_db(pid=28944): Terminated: ok {rc=0} 16:38:03.635346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28946): Launched 16:38:03.948872 run osmo-hlr_10.42.42.2(pid=28947): Launched 16:38:04.067442 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:04.621169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28949): Launched 16:38:04.933014 run osmo-stp_10.42.42.5(pid=28950): Launched 16:38:05.050949 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:05.589103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28952): Launched 16:38:05.708849 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:38:05.974045 run patchelf(pid=28953): Launched 16:38:06.146665 run osmo-stp_10.42.42.5(pid=28950): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28950)] 16:38:06.277744 run osmo-stp_10.42.42.5(pid=28950): stdout: | (launched: 2022-12-12_16:38:04.874794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:06.410718 run osmo-stp_10.42.42.5(pid=28950): stderr: | 20221212163805046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163805046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163805047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163805047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163805048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163805048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163805048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:06.543740 run osmo-stp_10.42.42.5(pid=28950): stdout: | (launched: 2022-12-12_16:38:04.874794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:06.670768 run osmo-stp_10.42.42.5(pid=28950): stderr: | 20221212163805046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163805046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163805047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163805047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163805048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163805048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163805048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:06.821253 run patchelf(pid=28953): Terminating (SIGINT) 16:38:06.994685 run patchelf(pid=28953): Terminated: ok {rc=0} 16:38:07.119737 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28950): Process ended prematurely: osmo-stp_10.42.42.5(pid=28950) [trial-2379↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28950)] [trial-2379↪gprs:trx-sysmocell5000↪iperf3.py:8] 16:38:07.129505 tst iperf3.py:8: Test FAILED (7.8 sec) 16:38:07.156707 run osmo-hlr_10.42.42.2(pid=28947): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28947)] 16:38:07.205593 run osmo-hlr_10.42.42.2(pid=28947): stdout: | (launched: 2022-12-12_16:38:03.891156) 16:38:07.255352 run osmo-hlr_10.42.42.2(pid=28947): stderr: | 20221212163804066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163804066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163804066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163804066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163804066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163804067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163804079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163804089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163804089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163804089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:07.305173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28942): Terminating (SIGTERM) 16:38:07.345317 run iperf3-srv_10.42.42.10(pid=28943): Terminating (SIGTERM) 16:38:07.385221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28946): Terminating (SIGTERM) 16:38:07.425824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28949): Terminating (SIGTERM) 16:38:07.465932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28952): Terminating (SIGTERM) 16:38:07.507187 --- ParallelTerminationStrategy: PID 28942 died... 16:38:07.526500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28942): Terminated: ok {rc=0} 16:38:07.571077 --- ParallelTerminationStrategy: PID 28943 died... 16:38:07.590024 run iperf3-srv_10.42.42.10(pid=28943): Terminated {rc=256} 16:38:07.633971 --- ParallelTerminationStrategy: PID 28946 died... 16:38:07.652753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28946): Terminated: ok {rc=0} 16:38:07.696881 --- ParallelTerminationStrategy: PID 28949 died... 16:38:07.716111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28949): Terminated: ok {rc=0} 16:38:07.760352 --- ParallelTerminationStrategy: PID 28952 died... 16:38:07.779205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28952): Terminated: ok {rc=0} 16:38:07.865374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 16:38:09.014684 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:09.026261 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:38:09.076776 tst iperf3m4.py: using LAC 30133 16:38:09.198727 tst iperf3m4.py: using RAC 43 16:38:09.320752 tst iperf3m4.py: using CellId 30133 16:38:09.443546 tst iperf3m4.py: using BVCI 30134 16:38:09.566227 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:09.578068 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:09.589859 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:09.601600 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:09.613365 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:09.624804 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:09.636599 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:09.648664 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:09.660755 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:38:09.781588 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:38:09.903091 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:38:10.024466 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:38:10.144658 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:38:10.353967 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:10.665333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28954): Launched 16:38:10.935920 run iperf3-srv_10.42.42.10(pid=28955): Launched 16:38:11.053117 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:38:11.259992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:11.571656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28956): Launched 16:38:11.841939 run iperf3-srv_10.42.42.10(pid=28957): Launched 16:38:11.959043 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:38:12.165881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:12.477598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28958): Launched 16:38:12.749004 run iperf3-srv_10.42.42.10(pid=28959): Launched 16:38:12.864917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:38:13.071778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:13.383764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28960): Launched 16:38:13.656776 run iperf3-srv_10.42.42.10(pid=28961): Launched 16:38:13.775753 tst iperf3m4.py:8: start network... 16:38:13.982630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:14.463495 run create_hlr_db(pid=28962): Launched 16:38:14.592726 bus /gobi_6: Setting Powered False 16:38:15.654675 run create_hlr_db(pid=28962): Terminated: ok {rc=0} 16:38:16.162836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28964): Launched 16:38:16.518259 run osmo-hlr_10.42.42.2(pid=28965): Launched 16:38:16.743489 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:17.463668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28967): Launched 16:38:17.776652 run osmo-stp_10.42.42.5(pid=28968): Launched 16:38:17.896094 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:18.431148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28970): Launched 16:38:18.550989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:38:18.814553 run patchelf(pid=28971): Launched 16:38:18.988642 run osmo-stp_10.42.42.5(pid=28968): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28968)] 16:38:19.119263 run osmo-stp_10.42.42.5(pid=28968): stdout: | (launched: 2022-12-12_16:38:17.718482) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:19.251542 run osmo-stp_10.42.42.5(pid=28968): stderr: | 20221212163817889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163817889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163817889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163817890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163817890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163817890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163817890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:19.383873 run osmo-stp_10.42.42.5(pid=28968): stdout: | (launched: 2022-12-12_16:38:17.718482) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:19.510429 run osmo-stp_10.42.42.5(pid=28968): stderr: | 20221212163817889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163817889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163817889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163817890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163817890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163817890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163817890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:19.660833 run patchelf(pid=28971): Terminating (SIGINT) 16:38:19.833792 run patchelf(pid=28971): Terminated: ok {rc=0} 16:38:19.958204 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28968): Process ended prematurely: osmo-stp_10.42.42.5(pid=28968) [trial-2379↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28968)] [trial-2379↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 16:38:19.967781 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:38:19.995179 run osmo-hlr_10.42.42.2(pid=28965): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28965)] 16:38:20.042555 run osmo-hlr_10.42.42.2(pid=28965): stdout: | (launched: 2022-12-12_16:38:16.454901) 16:38:20.091754 run osmo-hlr_10.42.42.2(pid=28965): stderr: | 20221212163816688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163816688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163816688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163816688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163816688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163816688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163816705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163816720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163816720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163816720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:20.141446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28954): Terminating (SIGTERM) 16:38:20.181052 run iperf3-srv_10.42.42.10(pid=28955): Terminating (SIGTERM) 16:38:20.221873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28956): Terminating (SIGTERM) 16:38:20.261512 run iperf3-srv_10.42.42.10(pid=28957): Terminating (SIGTERM) 16:38:20.300713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28958): Terminating (SIGTERM) 16:38:20.339979 run iperf3-srv_10.42.42.10(pid=28959): Terminating (SIGTERM) 16:38:20.379201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28960): Terminating (SIGTERM) 16:38:20.418445 run iperf3-srv_10.42.42.10(pid=28961): Terminating (SIGTERM) 16:38:20.457695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28964): Terminating (SIGTERM) 16:38:20.497068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28967): Terminating (SIGTERM) 16:38:20.536264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28970): Terminating (SIGTERM) 16:38:20.575882 --- ParallelTerminationStrategy: PID 28954 died... 16:38:20.594870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28954): Terminated: ok {rc=0} 16:38:20.638939 --- ParallelTerminationStrategy: PID 28955 died... 16:38:20.657555 run iperf3-srv_10.42.42.10(pid=28955): Terminated {rc=256} 16:38:20.701769 --- ParallelTerminationStrategy: PID 28956 died... 16:38:20.720250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28956): Terminated: ok {rc=0} 16:38:20.764533 --- ParallelTerminationStrategy: PID 28957 died... 16:38:20.783145 run iperf3-srv_10.42.42.10(pid=28957): Terminated {rc=256} 16:38:20.826711 --- ParallelTerminationStrategy: PID 28958 died... 16:38:20.845122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28958): Terminated: ok {rc=0} 16:38:20.888829 --- ParallelTerminationStrategy: PID 28959 died... 16:38:20.907339 run iperf3-srv_10.42.42.10(pid=28959): Terminated {rc=256} 16:38:20.951005 --- ParallelTerminationStrategy: PID 28960 died... 16:38:20.969545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28960): Terminated: ok {rc=0} 16:38:21.013319 --- ParallelTerminationStrategy: PID 28961 died... 16:38:21.031929 run iperf3-srv_10.42.42.10(pid=28961): Terminated {rc=256} 16:38:21.075473 --- ParallelTerminationStrategy: PID 28964 died... 16:38:21.093897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28964): Terminated: ok {rc=0} 16:38:21.137357 --- ParallelTerminationStrategy: PID 28967 died... 16:38:21.155868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28967): Terminated: ok {rc=0} 16:38:21.199562 --- ParallelTerminationStrategy: PID 28970 died... 16:38:21.218263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28970): Terminated: ok {rc=0} 16:38:21.304281 bus /gobi_4: Setting Powered False 16:38:22.405669 bus /gobi_4: Setting Powered False 16:38:23.521557 bus /gobi_1: Setting Powered False 16:38:24.622744 bus /gobi_1: Setting Powered False 16:38:25.742356 bus /gobi_0: Setting Powered False 16:38:26.843245 bus /gobi_0: Setting Powered False 16:38:27.962361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 16:38:29.065861 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:29.077351 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:38:29.130927 tst ping.py: using LAC 30134 16:38:29.260153 tst ping.py: using RAC 44 16:38:29.386834 tst ping.py: using CellId 30134 16:38:29.515393 tst ping.py: using BVCI 30135 16:38:29.635276 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:29.646821 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:29.658283 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:29.669739 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:29.681145 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:29.692801 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:29.704357 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:29.715908 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:38:29.837613 tst ping.py:19: start network... 16:38:30.057965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:30.562138 run create_hlr_db(pid=28972): Launched 16:38:30.686637 bus /gobi_6: Setting Powered False 16:38:31.764369 run create_hlr_db(pid=28972): Terminated: ok {rc=0} 16:38:32.299178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28974): Launched 16:38:32.609447 run osmo-hlr_10.42.42.2(pid=28975): Launched 16:38:32.726381 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:33.251504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28977): Launched 16:38:33.558957 run osmo-stp_10.42.42.5(pid=28978): Launched 16:38:33.674135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:34.201489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28980): Launched 16:38:34.317475 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:38:34.575777 run patchelf(pid=28981): Launched 16:38:34.746435 run osmo-stp_10.42.42.5(pid=28978): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28978)] 16:38:34.875428 run osmo-stp_10.42.42.5(pid=28978): stdout: | (launched: 2022-12-12_16:38:33.501518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:35.005503 run osmo-stp_10.42.42.5(pid=28978): stderr: | 20221212163833671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163833672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163833672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163833672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163833673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163833673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163833673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:35.136101 run osmo-stp_10.42.42.5(pid=28978): stdout: | (launched: 2022-12-12_16:38:33.501518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:35.260858 run osmo-stp_10.42.42.5(pid=28978): stderr: | 20221212163833671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163833672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163833672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163833672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163833673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163833673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163833673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:35.409316 run patchelf(pid=28981): Terminating (SIGINT) 16:38:35.579528 run patchelf(pid=28981): Terminated: ok {rc=0} 16:38:35.701882 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28978): Process ended prematurely: osmo-stp_10.42.42.5(pid=28978) [trial-2379↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28978)] [trial-2379↪gprs:trx-sysmocell5000↪ping.py:22] 16:38:35.710793 tst ping.py:22: Test FAILED (6.6 sec) 16:38:35.738168 run osmo-hlr_10.42.42.2(pid=28975): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28975)] 16:38:35.786489 run osmo-hlr_10.42.42.2(pid=28975): stdout: | (launched: 2022-12-12_16:38:32.552248) 16:38:35.836206 run osmo-hlr_10.42.42.2(pid=28975): stderr: | 20221212163832727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163832727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163832727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163832727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163832727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163832728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163832743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163832753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163832753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163832753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:35.886356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28974): Terminating (SIGTERM) 16:38:35.926662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28977): Terminating (SIGTERM) 16:38:35.966923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28980): Terminating (SIGTERM) 16:38:36.007483 --- ParallelTerminationStrategy: PID 28974 died... 16:38:36.026729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28974): Terminated: ok {rc=0} 16:38:36.071555 --- ParallelTerminationStrategy: PID 28977 died... 16:38:36.090553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28977): Terminated: ok {rc=0} 16:38:36.135134 --- ParallelTerminationStrategy: PID 28980 died... 16:38:36.154182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28980): Terminated: ok {rc=0} 16:38:36.240901 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 16:38:37.330483 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:37.342088 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 16:38:37.392717 tst ping_idle_ping.py: using LAC 30135 16:38:37.513892 tst ping_idle_ping.py: using RAC 45 16:38:37.633397 tst ping_idle_ping.py: using CellId 30135 16:38:37.755740 tst ping_idle_ping.py: using BVCI 30136 16:38:37.868265 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:37.879168 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:37.889835 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:37.900373 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:37.910943 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:37.921571 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:37.932236 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 16:38:37.942890 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 16:38:38.059272 tst ping_idle_ping.py:24: start network... 16:38:38.263756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:38.740909 run create_hlr_db(pid=28982): Launched 16:38:38.866782 bus /gobi_6: Setting Powered False 16:38:39.928827 run create_hlr_db(pid=28982): Terminated: ok {rc=0} 16:38:40.378698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28984): Launched 16:38:40.708274 run osmo-hlr_10.42.42.2(pid=28985): Launched 16:38:40.833888 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:41.362153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28987): Launched 16:38:41.670619 run osmo-stp_10.42.42.5(pid=28988): Launched 16:38:41.789295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:42.315584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28990): Launched 16:38:42.433505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:38:42.691711 run patchelf(pid=28991): Launched 16:38:42.863368 run osmo-stp_10.42.42.5(pid=28988): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28988)] 16:38:42.992539 run osmo-stp_10.42.42.5(pid=28988): stdout: | (launched: 2022-12-12_16:38:41.612870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:43.123620 run osmo-stp_10.42.42.5(pid=28988): stderr: | 20221212163841782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163841782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163841782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163841783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163841783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163841783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163841783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:43.254681 run osmo-stp_10.42.42.5(pid=28988): stdout: | (launched: 2022-12-12_16:38:41.612870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:43.380000 run osmo-stp_10.42.42.5(pid=28988): stderr: | 20221212163841782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163841782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163841782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163841783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163841783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163841783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163841783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:43.528410 run patchelf(pid=28991): Terminating (SIGINT) 16:38:43.699151 run patchelf(pid=28991): Terminated: ok {rc=0} 16:38:43.822859 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28988): Process ended prematurely: osmo-stp_10.42.42.5(pid=28988) [trial-2379↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28988)] [trial-2379↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 16:38:43.832156 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:38:43.859672 run osmo-hlr_10.42.42.2(pid=28985): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28985)] 16:38:43.908624 run osmo-hlr_10.42.42.2(pid=28985): stdout: | (launched: 2022-12-12_16:38:40.646925) 16:38:43.958518 run osmo-hlr_10.42.42.2(pid=28985): stderr: | 20221212163840842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163840842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163840843 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163840843 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163840843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163840843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163840855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163840864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163840864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163840865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:44.009147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28984): Terminating (SIGTERM) 16:38:44.049669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28987): Terminating (SIGTERM) 16:38:44.090093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28990): Terminating (SIGTERM) 16:38:44.130875 --- ParallelTerminationStrategy: PID 28984 died... 16:38:44.149938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28984): Terminated: ok {rc=0} 16:38:44.194489 --- ParallelTerminationStrategy: PID 28987 died... 16:38:44.213420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28987): Terminated: ok {rc=0} 16:38:44.258015 --- ParallelTerminationStrategy: PID 28990 died... 16:38:44.276888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28990): Terminated: ok {rc=0} 16:38:44.360240 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 16:38:45.668207 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:38:45.674081 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:38:45.707888 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:38:45.746117 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:38:45.851114 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:38:45.889538 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:38:45.932003 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:38:46.588377 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:38:46.685485 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:38:46.700715 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:38:46.764175 tst cs_paging_gprs_active.py: using LAC 30136 16:38:46.935563 tst cs_paging_gprs_active.py: using RAC 46 16:38:47.105289 tst cs_paging_gprs_active.py: using CellId 30136 16:38:47.276799 tst cs_paging_gprs_active.py: using BVCI 30137 16:38:47.436123 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:38:47.449123 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:38:47.461912 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:38:47.477283 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:38:47.491985 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:38:47.509114 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:38:47.527326 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:38:47.541153 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:38:47.555337 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:38:47.696084 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:38:47.847220 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:38:48.122035 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:48.560632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29163): Launched 16:38:48.922053 run iperf3-srv_10.42.42.10(pid=29204): Launched 16:38:49.069707 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:38:49.336206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:38:49.705235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29266): Launched 16:38:50.013471 run iperf3-srv_10.42.42.10(pid=29268): Launched 16:38:50.155584 tst cs_paging_gprs_active.py:38: start network... 16:38:50.390614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:38:50.919749 run create_hlr_db(pid=29269): Launched 16:38:51.089913 bus /gobi_6: Setting Powered False 16:38:52.156815 run create_hlr_db(pid=29269): Terminated: ok {rc=0} 16:38:52.631927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29273): Launched 16:38:52.958586 run osmo-hlr_10.42.42.2(pid=29274): Launched 16:38:53.197858 run osmo-stp_10.42.42.5: Starting osmo-stp 16:38:53.898648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29276): Launched 16:38:54.224809 run osmo-stp_10.42.42.5(pid=29277): Launched 16:38:54.472150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:38:55.151452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29279): Launched 16:38:55.286382 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:38:55.557478 run patchelf(pid=29280): Launched 16:38:55.749687 run osmo-stp_10.42.42.5(pid=29277): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29277)] 16:38:55.885422 run osmo-stp_10.42.42.5(pid=29277): stdout: | (launched: 2022-12-12_16:38:54.165583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:56.022377 run osmo-stp_10.42.42.5(pid=29277): stderr: | 20221212163854487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163854487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163854487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163854488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163854488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163854488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163854488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:56.161287 run osmo-stp_10.42.42.5(pid=29277): stdout: | (launched: 2022-12-12_16:38:54.165583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:38:56.292590 run osmo-stp_10.42.42.5(pid=29277): stderr: | 20221212163854487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163854487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163854487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163854488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163854488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163854488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163854488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:38:56.448133 run patchelf(pid=29280): Terminating (SIGINT) 16:38:56.626086 run patchelf(pid=29280): Terminated: ok {rc=0} 16:38:56.755767 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29277): Process ended prematurely: osmo-stp_10.42.42.5(pid=29277) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29277)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:38:56.766801 tst cs_paging_gprs_active.py:38: Test FAILED (10.2 sec) 16:38:56.796189 run osmo-hlr_10.42.42.2(pid=29274): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29274)] 16:38:56.846226 run osmo-hlr_10.42.42.2(pid=29274): stdout: | (launched: 2022-12-12_16:38:52.899266) 16:38:56.897728 run osmo-hlr_10.42.42.2(pid=29274): stderr: | 20221212163853234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163853234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163853234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163853234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163853234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163853234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163853251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163853268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163853268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163853268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:38:56.950128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29163): Terminating (SIGTERM) 16:38:56.992294 run iperf3-srv_10.42.42.10(pid=29204): Terminating (SIGTERM) 16:38:57.037740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29266): Terminating (SIGTERM) 16:38:57.079959 run iperf3-srv_10.42.42.10(pid=29268): Terminating (SIGTERM) 16:38:57.124655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29273): Terminating (SIGTERM) 16:38:57.167191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29276): Terminating (SIGTERM) 16:38:57.211154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29279): Terminating (SIGTERM) 16:38:57.254914 --- ParallelTerminationStrategy: PID 29163 died... 16:38:57.274970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29163): Terminated: ok {rc=0} 16:38:57.322419 --- ParallelTerminationStrategy: PID 29204 died... 16:38:57.341854 run iperf3-srv_10.42.42.10(pid=29204): Terminated {rc=256} 16:38:57.388374 --- ParallelTerminationStrategy: PID 29266 died... 16:38:57.408398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29266): Terminated: ok {rc=0} 16:38:57.454720 --- ParallelTerminationStrategy: PID 29268 died... 16:38:57.474725 run iperf3-srv_10.42.42.10(pid=29268): Terminated {rc=256} 16:38:57.522074 --- ParallelTerminationStrategy: PID 29273 died... 16:38:57.542229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29273): Terminated: ok {rc=0} 16:38:57.588708 --- ParallelTerminationStrategy: PID 29276 died... 16:38:57.608801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29276): Terminated: ok {rc=0} 16:38:57.655079 --- ParallelTerminationStrategy: PID 29279 died... 16:38:57.675182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29279): Terminated: ok {rc=0} 16:38:57.763255 bus /gobi_0: Setting Powered False 16:38:58.866319 bus /gobi_0: Setting Powered False 16:38:59.984029 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:39:01.167554 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:01.183210 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:39:01.247169 tst iperf3.py: using LAC 30137 16:39:01.398368 tst iperf3.py: using RAC 47 16:39:01.560341 tst iperf3.py: using CellId 30137 16:39:01.709278 tst iperf3.py: using BVCI 30138 16:39:01.834129 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:01.845882 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:01.857854 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:01.870207 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:01.882020 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:01.894117 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:01.905723 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:01.918552 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:01.932020 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:39:02.050893 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:39:02.264349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:39:02.587142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29281): Launched 16:39:02.878086 run iperf3-srv_10.42.42.10(pid=29282): Launched 16:39:03.068601 tst iperf3.py:8: start network... 16:39:03.319428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:03.845326 run create_hlr_db(pid=29283): Launched 16:39:04.009824 bus /gobi_6: Setting Powered False 16:39:05.071225 run create_hlr_db(pid=29283): Terminated: ok {rc=0} 16:39:05.520508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29285): Launched 16:39:05.854967 run osmo-hlr_10.42.42.2(pid=29286): Launched 16:39:06.105181 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:06.823854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29288): Launched 16:39:07.157262 run osmo-stp_10.42.42.5(pid=29289): Launched 16:39:07.396545 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:39:08.102574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29291): Launched 16:39:08.238319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:39:08.512771 run patchelf(pid=29292): Launched 16:39:08.706804 run osmo-stp_10.42.42.5(pid=29289): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29289)] 16:39:08.843685 run osmo-stp_10.42.42.5(pid=29289): stdout: | (launched: 2022-12-12_16:39:07.097388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:08.983222 run osmo-stp_10.42.42.5(pid=29289): stderr: | 20221212163907424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163907424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163907425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163907425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163907425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163907426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163907426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:09.121077 run osmo-stp_10.42.42.5(pid=29289): stdout: | (launched: 2022-12-12_16:39:07.097388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:09.253862 run osmo-stp_10.42.42.5(pid=29289): stderr: | 20221212163907424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163907424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163907425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163907425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163907425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163907426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163907426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:09.411579 run patchelf(pid=29292): Terminating (SIGINT) 16:39:09.592140 run patchelf(pid=29292): Terminated: ok {rc=0} 16:39:09.721722 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29289): Process ended prematurely: osmo-stp_10.42.42.5(pid=29289) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29289)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 16:39:09.732788 tst iperf3.py:8: Test FAILED (8.6 sec) 16:39:09.761976 run osmo-hlr_10.42.42.2(pid=29286): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29286)] 16:39:09.812863 run osmo-hlr_10.42.42.2(pid=29286): stdout: | (launched: 2022-12-12_16:39:05.795996) 16:39:09.864298 run osmo-hlr_10.42.42.2(pid=29286): stderr: | 20221212163906133 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163906134 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163906134 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163906134 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163906134 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163906134 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163906151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163906168 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163906168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163906168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:09.916433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29281): Terminating (SIGTERM) 16:39:09.959480 run iperf3-srv_10.42.42.10(pid=29282): Terminating (SIGTERM) 16:39:10.006176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29285): Terminating (SIGTERM) 16:39:10.049326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29288): Terminating (SIGTERM) 16:39:10.093634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29291): Terminating (SIGTERM) 16:39:10.138547 --- ParallelTerminationStrategy: PID 29281 died... 16:39:10.158786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29281): Terminated: ok {rc=0} 16:39:10.208157 --- ParallelTerminationStrategy: PID 29282 died... 16:39:10.228182 run iperf3-srv_10.42.42.10(pid=29282): Terminated {rc=256} 16:39:10.274037 --- ParallelTerminationStrategy: PID 29285 died... 16:39:10.293905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29285): Terminated: ok {rc=0} 16:39:10.341286 --- ParallelTerminationStrategy: PID 29288 died... 16:39:10.361555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29288): Terminated: ok {rc=0} 16:39:10.408922 --- ParallelTerminationStrategy: PID 29291 died... 16:39:10.429153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29291): Terminated: ok {rc=0} 16:39:10.517504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:39:11.662764 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:11.675027 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:39:11.727170 tst iperf3m4.py: using LAC 30138 16:39:11.859738 tst iperf3m4.py: using RAC 48 16:39:11.996412 tst iperf3m4.py: using CellId 30138 16:39:12.126066 tst iperf3m4.py: using BVCI 30139 16:39:12.246905 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:12.258492 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:12.269834 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:12.281535 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:12.293048 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:12.304572 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:12.316319 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:12.327925 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:12.339605 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:39:12.462186 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:39:12.583448 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:39:12.703957 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:39:12.822231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:39:13.029944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:39:13.343040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29294): Launched 16:39:13.616034 run iperf3-srv_10.42.42.10(pid=29295): Launched 16:39:13.732105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:39:13.939277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:39:14.252718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29296): Launched 16:39:14.523800 run iperf3-srv_10.42.42.10(pid=29297): Launched 16:39:14.641110 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:39:14.847527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:39:15.159279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29298): Launched 16:39:15.431614 run iperf3-srv_10.42.42.10(pid=29299): Launched 16:39:15.548624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:39:15.755861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:39:16.123149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29300): Launched 16:39:16.432758 run iperf3-srv_10.42.42.10(pid=29301): Launched 16:39:16.569587 tst iperf3m4.py:8: start network... 16:39:16.802089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:17.328857 run create_hlr_db(pid=29302): Launched 16:39:17.459008 bus /gobi_6: Setting Powered False 16:39:18.523901 run create_hlr_db(pid=29302): Terminated: ok {rc=0} 16:39:18.986567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29304): Launched 16:39:19.319585 run osmo-hlr_10.42.42.2(pid=29305): Launched 16:39:19.446768 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:20.020278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29307): Launched 16:39:20.355709 run osmo-stp_10.42.42.5(pid=29308): Launched 16:39:20.483585 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:39:21.057229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29310): Launched 16:39:21.185536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:39:21.466644 run patchelf(pid=29311): Launched 16:39:21.651320 run osmo-stp_10.42.42.5(pid=29308): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29308)] 16:39:21.792099 run osmo-stp_10.42.42.5(pid=29308): stdout: | (launched: 2022-12-12_16:39:20.293315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:21.934349 run osmo-stp_10.42.42.5(pid=29308): stderr: | 20221212163920484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163920484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163920485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163920485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163920485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163920486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163920486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:22.076479 run osmo-stp_10.42.42.5(pid=29308): stdout: | (launched: 2022-12-12_16:39:20.293315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:22.212846 run osmo-stp_10.42.42.5(pid=29308): stderr: | 20221212163920484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163920484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163920485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163920485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163920485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163920486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163920486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:22.374567 run patchelf(pid=29311): Terminating (SIGINT) 16:39:22.559748 run patchelf(pid=29311): Terminated: ok {rc=0} 16:39:22.693218 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29308): Process ended prematurely: osmo-stp_10.42.42.5(pid=29308) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29308)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 16:39:22.703659 tst iperf3m4.py:8: Test FAILED (11.1 sec) 16:39:22.733257 run osmo-hlr_10.42.42.2(pid=29305): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29305)] 16:39:22.784261 run osmo-hlr_10.42.42.2(pid=29305): stdout: | (launched: 2022-12-12_16:39:19.258113) 16:39:22.836545 run osmo-hlr_10.42.42.2(pid=29305): stderr: | 20221212163919456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163919456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163919456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163919456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163919456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163919456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163919468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163919477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163919477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163919477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:22.889350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29294): Terminating (SIGTERM) 16:39:22.931465 run iperf3-srv_10.42.42.10(pid=29295): Terminating (SIGTERM) 16:39:22.973508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29296): Terminating (SIGTERM) 16:39:23.015799 run iperf3-srv_10.42.42.10(pid=29297): Terminating (SIGTERM) 16:39:23.057828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29298): Terminating (SIGTERM) 16:39:23.100499 run iperf3-srv_10.42.42.10(pid=29299): Terminating (SIGTERM) 16:39:23.142870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29300): Terminating (SIGTERM) 16:39:23.185067 run iperf3-srv_10.42.42.10(pid=29301): Terminating (SIGTERM) 16:39:23.227015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29304): Terminating (SIGTERM) 16:39:23.269144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29307): Terminating (SIGTERM) 16:39:23.311211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29310): Terminating (SIGTERM) 16:39:23.353641 --- ParallelTerminationStrategy: PID 29294 died... 16:39:23.373710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29294): Terminated: ok {rc=0} 16:39:23.420414 --- ParallelTerminationStrategy: PID 29295 died... 16:39:23.439915 run iperf3-srv_10.42.42.10(pid=29295): Terminated {rc=256} 16:39:23.486441 --- ParallelTerminationStrategy: PID 29296 died... 16:39:23.505914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29296): Terminated: ok {rc=0} 16:39:23.552384 --- ParallelTerminationStrategy: PID 29297 died... 16:39:23.571950 run iperf3-srv_10.42.42.10(pid=29297): Terminated {rc=256} 16:39:23.618291 --- ParallelTerminationStrategy: PID 29298 died... 16:39:23.637787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29298): Terminated: ok {rc=0} 16:39:23.684236 --- ParallelTerminationStrategy: PID 29299 died... 16:39:23.703875 run iperf3-srv_10.42.42.10(pid=29299): Terminated {rc=256} 16:39:23.750619 --- ParallelTerminationStrategy: PID 29300 died... 16:39:23.770534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29300): Terminated: ok {rc=0} 16:39:23.817399 --- ParallelTerminationStrategy: PID 29301 died... 16:39:23.836717 run iperf3-srv_10.42.42.10(pid=29301): Terminated {rc=256} 16:39:23.883226 --- ParallelTerminationStrategy: PID 29304 died... 16:39:23.902729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29304): Terminated: ok {rc=0} 16:39:23.949399 --- ParallelTerminationStrategy: PID 29307 died... 16:39:23.969011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29307): Terminated: ok {rc=0} 16:39:24.015960 --- ParallelTerminationStrategy: PID 29310 died... 16:39:24.035457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29310): Terminated: ok {rc=0} 16:39:24.123519 bus /gobi_4: Setting Powered False 16:39:25.224297 bus /gobi_4: Setting Powered False 16:39:26.342216 bus /gobi_1: Setting Powered False 16:39:27.440706 bus /gobi_1: Setting Powered False 16:39:28.555931 bus /gobi_0: Setting Powered False 16:39:29.653934 bus /gobi_0: Setting Powered False 16:39:30.768360 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 16:39:31.885664 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:31.898064 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:39:31.950523 tst ping.py: using LAC 30139 16:39:32.114830 tst ping.py: using RAC 49 16:39:32.251223 tst ping.py: using CellId 30139 16:39:32.372549 tst ping.py: using BVCI 30140 16:39:32.482842 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:32.494069 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:32.504939 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:32.515879 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:32.526711 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:32.537424 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:32.548354 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:32.559268 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:39:32.678766 tst ping.py:19: start network... 16:39:32.882050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:33.353115 run create_hlr_db(pid=29313): Launched 16:39:33.477445 bus /gobi_6: Setting Powered False 16:39:34.537607 run create_hlr_db(pid=29313): Terminated: ok {rc=0} 16:39:34.983007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29315): Launched 16:39:35.311403 run osmo-hlr_10.42.42.2(pid=29316): Launched 16:39:35.435614 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:36.000884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29318): Launched 16:39:36.328355 run osmo-stp_10.42.42.5(pid=29319): Launched 16:39:36.452605 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:39:37.014640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29321): Launched 16:39:37.139275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:39:37.414759 run patchelf(pid=29322): Launched 16:39:37.598025 run osmo-stp_10.42.42.5(pid=29319): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29319)] 16:39:37.736327 run osmo-stp_10.42.42.5(pid=29319): stdout: | (launched: 2022-12-12_16:39:36.267561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:37.875912 run osmo-stp_10.42.42.5(pid=29319): stderr: | 20221212163936458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163936458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163936459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163936459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163936459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163936459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163936460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:38.015645 run osmo-stp_10.42.42.5(pid=29319): stdout: | (launched: 2022-12-12_16:39:36.267561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:38.149453 run osmo-stp_10.42.42.5(pid=29319): stderr: | 20221212163936458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163936458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163936459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163936459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163936459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163936459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163936460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:38.308006 run patchelf(pid=29322): Terminating (SIGINT) 16:39:38.490142 run patchelf(pid=29322): Terminated: ok {rc=0} 16:39:38.621685 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29319): Process ended prematurely: osmo-stp_10.42.42.5(pid=29319) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29319)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 16:39:38.631433 tst ping.py:22: Test FAILED (6.7 sec) 16:39:38.659932 run osmo-hlr_10.42.42.2(pid=29316): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29316)] 16:39:38.710762 run osmo-hlr_10.42.42.2(pid=29316): stdout: | (launched: 2022-12-12_16:39:35.250775) 16:39:38.763477 run osmo-hlr_10.42.42.2(pid=29316): stderr: | 20221212163935448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163935448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163935448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163935448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163935448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163935448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163935460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163935468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163935469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163935469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:38.816617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29315): Terminating (SIGTERM) 16:39:38.858996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29318): Terminating (SIGTERM) 16:39:38.901239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29321): Terminating (SIGTERM) 16:39:38.943801 --- ParallelTerminationStrategy: PID 29315 died... 16:39:38.964101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29315): Terminated: ok {rc=0} 16:39:39.011254 --- ParallelTerminationStrategy: PID 29318 died... 16:39:39.030915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29318): Terminated: ok {rc=0} 16:39:39.077701 --- ParallelTerminationStrategy: PID 29321 died... 16:39:39.097515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29321): Terminated: ok {rc=0} 16:39:39.185635 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:39:40.272224 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:40.284775 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:39:40.344072 tst ping_idle_ping.py: using LAC 30140 16:39:40.472499 tst ping_idle_ping.py: using RAC 50 16:39:40.598403 tst ping_idle_ping.py: using CellId 30140 16:39:40.725661 tst ping_idle_ping.py: using BVCI 30141 16:39:40.844342 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:40.856022 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:40.867490 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:40.879280 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:40.890885 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:40.902433 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:40.914517 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:39:40.926443 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:39:41.046289 tst ping_idle_ping.py:24: start network... 16:39:41.266526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:41.777554 run create_hlr_db(pid=29323): Launched 16:39:41.902967 bus /gobi_6: Setting Powered False 16:39:42.967476 run create_hlr_db(pid=29323): Terminated: ok {rc=0} 16:39:43.407806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29325): Launched 16:39:43.717048 run osmo-hlr_10.42.42.2(pid=29326): Launched 16:39:43.834756 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:44.382812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29328): Launched 16:39:44.690425 run osmo-stp_10.42.42.5(pid=29329): Launched 16:39:44.806983 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:39:45.335649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29333): Launched 16:39:45.454047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:39:45.713217 run patchelf(pid=29334): Launched 16:39:45.899550 run osmo-stp_10.42.42.5(pid=29329): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29329)] 16:39:46.037172 run osmo-stp_10.42.42.5(pid=29329): stdout: | (launched: 2022-12-12_16:39:44.632801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:46.170410 run osmo-stp_10.42.42.5(pid=29329): stderr: | 20221212163944803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163944804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163944804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163944805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163944805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163944805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163944805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:46.304517 run osmo-stp_10.42.42.5(pid=29329): stdout: | (launched: 2022-12-12_16:39:44.632801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:46.431583 run osmo-stp_10.42.42.5(pid=29329): stderr: | 20221212163944803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163944804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163944804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163944805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163944805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163944805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163944805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:46.582135 run patchelf(pid=29334): Terminating (SIGINT) 16:39:46.754763 run patchelf(pid=29334): Terminated: ok {rc=0} 16:39:46.879536 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29329): Process ended prematurely: osmo-stp_10.42.42.5(pid=29329) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29329)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 16:39:46.889301 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:39:46.917385 run osmo-hlr_10.42.42.2(pid=29326): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29326)] 16:39:46.966587 run osmo-hlr_10.42.42.2(pid=29326): stdout: | (launched: 2022-12-12_16:39:43.659374) 16:39:47.017311 run osmo-hlr_10.42.42.2(pid=29326): stderr: | 20221212163943834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163943834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163943834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163943834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163943834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163943835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163943847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163943855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163943855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163943855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:47.067806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29325): Terminating (SIGTERM) 16:39:47.109185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29328): Terminating (SIGTERM) 16:39:47.151062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29333): Terminating (SIGTERM) 16:39:47.192024 --- ParallelTerminationStrategy: PID 29325 died... 16:39:47.211268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29325): Terminated: ok {rc=0} 16:39:47.258218 --- ParallelTerminationStrategy: PID 29328 died... 16:39:47.276709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29328): Terminated: ok {rc=0} 16:39:47.320770 --- ParallelTerminationStrategy: PID 29333 died... 16:39:47.339541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29333): Terminated: ok {rc=0} 16:39:47.423453 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:39:48.738479 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:39:48.746248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:39:48.779831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:39:48.818002 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:39:48.906504 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:39:48.943484 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:39:48.983726 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:39:49.571661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:39:49.623012 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:39:49.634098 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:39:49.703813 tst cs_paging_gprs_active.py: using LAC 30141 16:39:49.826586 tst cs_paging_gprs_active.py: using RAC 51 16:39:49.949091 tst cs_paging_gprs_active.py: using CellId 30141 16:39:50.071774 tst cs_paging_gprs_active.py: using BVCI 30142 16:39:50.185414 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:39:50.196341 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:39:50.207225 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:39:50.218217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:39:50.229135 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:39:50.239918 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:39:50.250880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:39:50.261678 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:39:50.272717 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:39:50.393482 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:39:50.514141 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:39:50.739906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:39:51.074609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29338): Launched 16:39:51.364202 run iperf3-srv_10.42.42.10(pid=29339): Launched 16:39:51.489949 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:39:51.714516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:39:52.050186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29340): Launched 16:39:52.341365 run iperf3-srv_10.42.42.10(pid=29341): Launched 16:39:52.467644 tst cs_paging_gprs_active.py:38: start network... 16:39:52.691613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:39:53.208038 run create_hlr_db(pid=29342): Launched 16:39:53.337432 bus /gobi_6: Setting Powered False 16:39:54.403636 run create_hlr_db(pid=29342): Terminated: ok {rc=0} 16:39:54.849222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29344): Launched 16:39:55.159834 run osmo-hlr_10.42.42.2(pid=29345): Launched 16:39:55.277400 run osmo-stp_10.42.42.5: Starting osmo-stp 16:39:55.812031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29347): Launched 16:39:56.122848 run osmo-stp_10.42.42.5(pid=29348): Launched 16:39:56.242492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:39:56.779191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29350): Launched 16:39:56.898544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:39:57.160870 run patchelf(pid=29351): Launched 16:39:57.335096 run osmo-stp_10.42.42.5(pid=29348): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29348)] 16:39:57.466111 run osmo-stp_10.42.42.5(pid=29348): stdout: | (launched: 2022-12-12_16:39:56.064688) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:57.599821 run osmo-stp_10.42.42.5(pid=29348): stderr: | 20221212163956234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163956234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163956235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163956235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163956235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163956235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163956236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:57.732177 run osmo-stp_10.42.42.5(pid=29348): stdout: | (launched: 2022-12-12_16:39:56.064688) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:39:57.859188 run osmo-stp_10.42.42.5(pid=29348): stderr: | 20221212163956234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212163956234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212163956235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212163956235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212163956235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212163956235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212163956236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:39:58.009168 run patchelf(pid=29351): Terminating (SIGINT) 16:39:58.181504 run patchelf(pid=29351): Terminated: ok {rc=0} 16:39:58.305975 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29348): Process ended prematurely: osmo-stp_10.42.42.5(pid=29348) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29348)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:39:58.315559 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:39:58.342619 run osmo-hlr_10.42.42.2(pid=29345): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29345)] 16:39:58.390684 run osmo-hlr_10.42.42.2(pid=29345): stdout: | (launched: 2022-12-12_16:39:55.101847) 16:39:58.440142 run osmo-hlr_10.42.42.2(pid=29345): stderr: | 20221212163955276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212163955276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212163955276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212163955276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212163955276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212163955276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212163955288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212163955296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212163955297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212163955297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:39:58.489486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29338): Terminating (SIGTERM) 16:39:58.529441 run iperf3-srv_10.42.42.10(pid=29339): Terminating (SIGTERM) 16:39:58.568903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29340): Terminating (SIGTERM) 16:39:58.608136 run iperf3-srv_10.42.42.10(pid=29341): Terminating (SIGTERM) 16:39:58.647295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29344): Terminating (SIGTERM) 16:39:58.686502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29347): Terminating (SIGTERM) 16:39:58.726012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29350): Terminating (SIGTERM) 16:39:58.765705 --- ParallelTerminationStrategy: PID 29338 died... 16:39:58.784180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29338): Terminated: ok {rc=0} 16:39:58.827723 --- ParallelTerminationStrategy: PID 29339 died... 16:39:58.846092 run iperf3-srv_10.42.42.10(pid=29339): Terminated {rc=256} 16:39:58.889461 --- ParallelTerminationStrategy: PID 29340 died... 16:39:58.907955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29340): Terminated: ok {rc=0} 16:39:58.951344 --- ParallelTerminationStrategy: PID 29341 died... 16:39:58.969745 run iperf3-srv_10.42.42.10(pid=29341): Terminated {rc=256} 16:39:59.013167 --- ParallelTerminationStrategy: PID 29344 died... 16:39:59.031642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29344): Terminated: ok {rc=0} 16:39:59.075262 --- ParallelTerminationStrategy: PID 29347 died... 16:39:59.093901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29347): Terminated: ok {rc=0} 16:39:59.137508 --- ParallelTerminationStrategy: PID 29350 died... 16:39:59.156050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29350): Terminated: ok {rc=0} 16:39:59.239647 bus /gobi_0: Setting Powered False 16:40:00.335839 bus /gobi_0: Setting Powered False 16:40:01.447894 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:40:02.594213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:02.607244 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:40:02.680461 tst iperf3.py: using LAC 30142 16:40:02.801054 tst iperf3.py: using RAC 52 16:40:02.921674 tst iperf3.py: using CellId 30142 16:40:03.045597 tst iperf3.py: using BVCI 30143 16:40:03.157420 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:03.168384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:03.179287 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:03.190704 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:03.201606 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:03.212326 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:03.223268 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:03.234099 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:03.245142 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:40:03.364618 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:40:03.589969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:03.924280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29355): Launched 16:40:04.215087 run iperf3-srv_10.42.42.10(pid=29356): Launched 16:40:04.340586 tst iperf3.py:8: start network... 16:40:04.565052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:05.080251 run create_hlr_db(pid=29357): Launched 16:40:05.209533 bus /gobi_6: Setting Powered False 16:40:06.275067 run create_hlr_db(pid=29357): Terminated: ok {rc=0} 16:40:06.718883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29359): Launched 16:40:07.031438 run osmo-hlr_10.42.42.2(pid=29360): Launched 16:40:07.149288 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:07.687458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29362): Launched 16:40:07.998735 run osmo-stp_10.42.42.5(pid=29363): Launched 16:40:08.118646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:08.652672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29365): Launched 16:40:08.772549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:09.035483 run patchelf(pid=29366): Launched 16:40:09.207510 run osmo-stp_10.42.42.5(pid=29363): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29363)] 16:40:09.338320 run osmo-stp_10.42.42.5(pid=29363): stdout: | (launched: 2022-12-12_16:40:07.940654) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:09.470965 run osmo-stp_10.42.42.5(pid=29363): stderr: | 20221212164008108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164008108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164008109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164008109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164008110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164008110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164008110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:09.603681 run osmo-stp_10.42.42.5(pid=29363): stdout: | (launched: 2022-12-12_16:40:07.940654) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:09.730426 run osmo-stp_10.42.42.5(pid=29363): stderr: | 20221212164008108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164008108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164008109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164008109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164008110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164008110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164008110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:09.881063 run patchelf(pid=29366): Terminating (SIGINT) 16:40:10.054273 run patchelf(pid=29366): Terminated: ok {rc=0} 16:40:10.178984 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29363): Process ended prematurely: osmo-stp_10.42.42.5(pid=29363) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29363)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 16:40:10.188612 tst iperf3.py:8: Test FAILED (7.6 sec) 16:40:10.216041 run osmo-hlr_10.42.42.2(pid=29360): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29360)] 16:40:10.264011 run osmo-hlr_10.42.42.2(pid=29360): stdout: | (launched: 2022-12-12_16:40:06.973638) 16:40:10.313846 run osmo-hlr_10.42.42.2(pid=29360): stderr: | 20221212164007147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164007148 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164007148 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164007148 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164007148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164007148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164007160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164007168 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164007169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164007169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:10.364359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29355): Terminating (SIGTERM) 16:40:10.404835 run iperf3-srv_10.42.42.10(pid=29356): Terminating (SIGTERM) 16:40:10.445082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29359): Terminating (SIGTERM) 16:40:10.485651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29362): Terminating (SIGTERM) 16:40:10.526216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29365): Terminating (SIGTERM) 16:40:10.566684 --- ParallelTerminationStrategy: PID 29355 died... 16:40:10.586081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29355): Terminated: ok {rc=0} 16:40:10.630563 --- ParallelTerminationStrategy: PID 29356 died... 16:40:10.649387 run iperf3-srv_10.42.42.10(pid=29356): Terminated {rc=256} 16:40:10.693268 --- ParallelTerminationStrategy: PID 29359 died... 16:40:10.712082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29359): Terminated: ok {rc=0} 16:40:10.756471 --- ParallelTerminationStrategy: PID 29362 died... 16:40:10.775246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29362): Terminated: ok {rc=0} 16:40:10.819742 --- ParallelTerminationStrategy: PID 29365 died... 16:40:10.838700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29365): Terminated: ok {rc=0} 16:40:10.922638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:40:12.067996 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:12.079910 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:40:12.151607 tst iperf3m4.py: using LAC 30143 16:40:12.274856 tst iperf3m4.py: using RAC 53 16:40:12.397749 tst iperf3m4.py: using CellId 30143 16:40:12.519785 tst iperf3m4.py: using BVCI 30144 16:40:12.634006 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:12.645416 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:12.656378 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:12.667478 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:12.678486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:12.689563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:12.700745 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:12.711516 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:12.722751 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:40:12.839327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:40:12.959778 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:40:13.079828 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:40:13.203324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:40:13.429796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:13.765566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29367): Launched 16:40:14.056332 run iperf3-srv_10.42.42.10(pid=29368): Launched 16:40:14.182526 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:40:14.407206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:14.742945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29369): Launched 16:40:15.035623 run iperf3-srv_10.42.42.10(pid=29370): Launched 16:40:15.161747 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:40:15.386385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:15.721244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29371): Launched 16:40:16.015992 run iperf3-srv_10.42.42.10(pid=29372): Launched 16:40:16.153283 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:40:16.366499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:16.692039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29373): Launched 16:40:16.982028 run iperf3-srv_10.42.42.10(pid=29374): Launched 16:40:17.116448 tst iperf3m4.py:8: start network... 16:40:17.327493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:17.812879 run create_hlr_db(pid=29375): Launched 16:40:17.940880 bus /gobi_6: Setting Powered False 16:40:19.006794 run create_hlr_db(pid=29375): Terminated: ok {rc=0} 16:40:19.452283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29377): Launched 16:40:19.763504 run osmo-hlr_10.42.42.2(pid=29378): Launched 16:40:19.882445 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:20.434768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29380): Launched 16:40:20.745169 run osmo-stp_10.42.42.5(pid=29381): Launched 16:40:20.863510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:21.398573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29383): Launched 16:40:21.518371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:21.781424 run patchelf(pid=29384): Launched 16:40:21.953499 run osmo-stp_10.42.42.5(pid=29381): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29381)] 16:40:22.084430 run osmo-stp_10.42.42.5(pid=29381): stdout: | (launched: 2022-12-12_16:40:20.687126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:22.217065 run osmo-stp_10.42.42.5(pid=29381): stderr: | 20221212164020856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164020856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164020856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164020857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164020857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164020857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164020857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:22.349430 run osmo-stp_10.42.42.5(pid=29381): stdout: | (launched: 2022-12-12_16:40:20.687126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:22.476035 run osmo-stp_10.42.42.5(pid=29381): stderr: | 20221212164020856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164020856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164020856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164020857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164020857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164020857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164020857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:22.626339 run patchelf(pid=29384): Terminating (SIGINT) 16:40:22.799110 run patchelf(pid=29384): Terminated: ok {rc=0} 16:40:22.923612 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29381): Process ended prematurely: osmo-stp_10.42.42.5(pid=29381) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29381)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:40:22.933637 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:40:22.961244 run osmo-hlr_10.42.42.2(pid=29378): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29378)] 16:40:23.009291 run osmo-hlr_10.42.42.2(pid=29378): stdout: | (launched: 2022-12-12_16:40:19.705450) 16:40:23.059148 run osmo-hlr_10.42.42.2(pid=29378): stderr: | 20221212164019881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164019881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164019881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164019881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164019881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164019881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164019894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164019902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164019902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164019902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:23.110104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29367): Terminating (SIGTERM) 16:40:23.149701 run iperf3-srv_10.42.42.10(pid=29368): Terminating (SIGTERM) 16:40:23.188879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29369): Terminating (SIGTERM) 16:40:23.228172 run iperf3-srv_10.42.42.10(pid=29370): Terminating (SIGTERM) 16:40:23.267345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29371): Terminating (SIGTERM) 16:40:23.306701 run iperf3-srv_10.42.42.10(pid=29372): Terminating (SIGTERM) 16:40:23.345925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29373): Terminating (SIGTERM) 16:40:23.385715 run iperf3-srv_10.42.42.10(pid=29374): Terminating (SIGTERM) 16:40:23.425312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29377): Terminating (SIGTERM) 16:40:23.464674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29380): Terminating (SIGTERM) 16:40:23.503844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29383): Terminating (SIGTERM) 16:40:23.543347 --- ParallelTerminationStrategy: PID 29367 died... 16:40:23.561840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29367): Terminated: ok {rc=0} 16:40:23.605430 --- ParallelTerminationStrategy: PID 29368 died... 16:40:23.623724 run iperf3-srv_10.42.42.10(pid=29368): Terminated {rc=256} 16:40:23.667306 --- ParallelTerminationStrategy: PID 29369 died... 16:40:23.685755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29369): Terminated: ok {rc=0} 16:40:23.729712 --- ParallelTerminationStrategy: PID 29370 died... 16:40:23.748227 run iperf3-srv_10.42.42.10(pid=29370): Terminated {rc=256} 16:40:23.791793 --- ParallelTerminationStrategy: PID 29371 died... 16:40:23.810386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29371): Terminated: ok {rc=0} 16:40:23.854893 --- ParallelTerminationStrategy: PID 29372 died... 16:40:23.873453 run iperf3-srv_10.42.42.10(pid=29372): Terminated {rc=256} 16:40:23.917065 --- ParallelTerminationStrategy: PID 29373 died... 16:40:23.935568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29373): Terminated: ok {rc=0} 16:40:23.979939 --- ParallelTerminationStrategy: PID 29374 died... 16:40:23.998975 run iperf3-srv_10.42.42.10(pid=29374): Terminated {rc=256} 16:40:24.042634 --- ParallelTerminationStrategy: PID 29377 died... 16:40:24.061251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29377): Terminated: ok {rc=0} 16:40:24.105129 --- ParallelTerminationStrategy: PID 29380 died... 16:40:24.123739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29380): Terminated: ok {rc=0} 16:40:24.167937 --- ParallelTerminationStrategy: PID 29383 died... 16:40:24.186504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29383): Terminated: ok {rc=0} 16:40:24.272083 bus /gobi_4: Setting Powered False 16:40:25.372932 bus /gobi_4: Setting Powered False 16:40:26.489194 bus /gobi_1: Setting Powered False 16:40:27.588564 bus /gobi_1: Setting Powered False 16:40:28.704089 bus /gobi_0: Setting Powered False 16:40:29.803287 bus /gobi_0: Setting Powered False 16:40:30.926682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:40:32.050544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:32.064104 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:40:32.140572 tst ping.py: using LAC 30144 16:40:32.281929 tst ping.py: using RAC 54 16:40:32.409369 tst ping.py: using CellId 30144 16:40:32.535358 tst ping.py: using BVCI 30145 16:40:32.654354 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:32.666290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:32.677985 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:32.690057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:32.701832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:32.714204 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:32.726005 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:32.737731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:40:32.858619 tst ping.py:19: start network... 16:40:33.077521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:33.581724 run create_hlr_db(pid=29385): Launched 16:40:33.706113 bus /gobi_6: Setting Powered False 16:40:34.770152 run create_hlr_db(pid=29385): Terminated: ok {rc=0} 16:40:35.205986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29387): Launched 16:40:35.512942 run osmo-hlr_10.42.42.2(pid=29388): Launched 16:40:35.629932 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:36.161111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29390): Launched 16:40:36.467616 run osmo-stp_10.42.42.5(pid=29391): Launched 16:40:36.585249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:37.111625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29393): Launched 16:40:37.229357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:37.487222 run patchelf(pid=29394): Launched 16:40:37.656142 run osmo-stp_10.42.42.5(pid=29391): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29391)] 16:40:37.784660 run osmo-stp_10.42.42.5(pid=29391): stdout: | (launched: 2022-12-12_16:40:36.410540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:37.914733 run osmo-stp_10.42.42.5(pid=29391): stderr: | 20221212164036578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164036579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164036579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164036580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164036581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164036581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164036581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:38.044662 run osmo-stp_10.42.42.5(pid=29391): stdout: | (launched: 2022-12-12_16:40:36.410540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:38.169338 run osmo-stp_10.42.42.5(pid=29391): stderr: | 20221212164036578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164036579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164036579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164036580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164036581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164036581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164036581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:38.317133 run patchelf(pid=29394): Terminating (SIGINT) 16:40:38.487079 run patchelf(pid=29394): Terminated: ok {rc=0} 16:40:38.609246 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29391): Process ended prematurely: osmo-stp_10.42.42.5(pid=29391) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29391)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 16:40:38.618205 tst ping.py:22: Test FAILED (6.6 sec) 16:40:38.644942 run osmo-hlr_10.42.42.2(pid=29388): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29388)] 16:40:38.693114 run osmo-hlr_10.42.42.2(pid=29388): stdout: | (launched: 2022-12-12_16:40:35.455960) 16:40:38.743405 run osmo-hlr_10.42.42.2(pid=29388): stderr: | 20221212164035632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164035632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164035632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164035632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164035632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164035632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164035644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164035652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164035653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164035653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:38.793318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29387): Terminating (SIGTERM) 16:40:38.833154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29390): Terminating (SIGTERM) 16:40:38.873454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29393): Terminating (SIGTERM) 16:40:38.913812 --- ParallelTerminationStrategy: PID 29387 died... 16:40:38.933181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29387): Terminated: ok {rc=0} 16:40:38.977420 --- ParallelTerminationStrategy: PID 29390 died... 16:40:38.996229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29390): Terminated: ok {rc=0} 16:40:39.040331 --- ParallelTerminationStrategy: PID 29393 died... 16:40:39.059160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29393): Terminated: ok {rc=0} 16:40:39.145036 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:40:40.235270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:40.247083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:40:40.317916 tst ping_idle_ping.py: using LAC 30145 16:40:40.438404 tst ping_idle_ping.py: using RAC 55 16:40:40.560203 tst ping_idle_ping.py: using CellId 30145 16:40:40.690855 tst ping_idle_ping.py: using BVCI 30146 16:40:40.810559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:40.822498 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:40.834103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:40.846237 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:40.858264 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:40.870257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:40.882080 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:40:40.893772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:40:41.009906 tst ping_idle_ping.py:24: start network... 16:40:41.213838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:41.695366 run create_hlr_db(pid=29395): Launched 16:40:41.820739 bus /gobi_6: Setting Powered False 16:40:42.880514 run create_hlr_db(pid=29395): Terminated: ok {rc=0} 16:40:43.326497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29397): Launched 16:40:43.654085 run osmo-hlr_10.42.42.2(pid=29398): Launched 16:40:43.780150 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:44.342211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29400): Launched 16:40:44.669923 run osmo-stp_10.42.42.5(pid=29401): Launched 16:40:44.795194 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:45.358536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29403): Launched 16:40:45.484239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:45.760083 run patchelf(pid=29404): Launched 16:40:45.952247 run osmo-stp_10.42.42.5(pid=29401): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29401)] 16:40:46.092860 run osmo-stp_10.42.42.5(pid=29401): stdout: | (launched: 2022-12-12_16:40:44.609507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:46.235896 run osmo-stp_10.42.42.5(pid=29401): stderr: | 20221212164044800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164044800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164044800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164044801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164044801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164044801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164044801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:46.379443 run osmo-stp_10.42.42.5(pid=29401): stdout: | (launched: 2022-12-12_16:40:44.609507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:46.516374 run osmo-stp_10.42.42.5(pid=29401): stderr: | 20221212164044800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164044800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164044800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164044801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164044801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164044801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164044801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:46.678679 run patchelf(pid=29404): Terminating (SIGINT) 16:40:46.864912 run patchelf(pid=29404): Terminated: ok {rc=0} 16:40:46.999097 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29401): Process ended prematurely: osmo-stp_10.42.42.5(pid=29401) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29401)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:40:47.009983 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:40:47.040641 run osmo-hlr_10.42.42.2(pid=29398): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29398)] 16:40:47.092843 run osmo-hlr_10.42.42.2(pid=29398): stdout: | (launched: 2022-12-12_16:40:43.593439) 16:40:47.146837 run osmo-hlr_10.42.42.2(pid=29398): stderr: | 20221212164043791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164043791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164043791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164043791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164043791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164043791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164043804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164043814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164043814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164043814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:47.200206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29397): Terminating (SIGTERM) 16:40:47.242563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29400): Terminating (SIGTERM) 16:40:47.285079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29403): Terminating (SIGTERM) 16:40:47.327613 --- ParallelTerminationStrategy: PID 29397 died... 16:40:47.347701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29397): Terminated: ok {rc=0} 16:40:47.394694 --- ParallelTerminationStrategy: PID 29400 died... 16:40:47.414457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29400): Terminated: ok {rc=0} 16:40:47.461278 --- ParallelTerminationStrategy: PID 29403 died... 16:40:47.480809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29403): Terminated: ok {rc=0} 16:40:47.570083 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:40:48.875621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:40:48.882014 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:40:48.915616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:40:48.953855 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:40:49.041698 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:40:49.075440 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:40:49.113359 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:40:49.708245 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:40:49.758001 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:40:49.769143 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:40:49.840021 tst cs_paging_gprs_active.py: using LAC 30146 16:40:49.961383 tst cs_paging_gprs_active.py: using RAC 56 16:40:50.083180 tst cs_paging_gprs_active.py: using CellId 30146 16:40:50.206194 tst cs_paging_gprs_active.py: using BVCI 30147 16:40:50.320466 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:40:50.331608 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:40:50.342491 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:40:50.353679 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:40:50.364430 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:40:50.375347 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:40:50.386407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:40:50.397382 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:40:50.408393 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:40:50.528149 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:40:50.649192 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:40:50.875733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:51.210956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29410): Launched 16:40:51.501704 run iperf3-srv_10.42.42.10(pid=29411): Launched 16:40:51.627327 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:40:51.853129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:40:52.188156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29412): Launched 16:40:52.480110 run iperf3-srv_10.42.42.10(pid=29413): Launched 16:40:52.607000 tst cs_paging_gprs_active.py:38: start network... 16:40:52.832677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:40:53.349665 run create_hlr_db(pid=29414): Launched 16:40:53.477816 bus /gobi_6: Setting Powered False 16:40:54.543090 run create_hlr_db(pid=29414): Terminated: ok {rc=0} 16:40:54.989157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29416): Launched 16:40:55.300846 run osmo-hlr_10.42.42.2(pid=29417): Launched 16:40:55.420069 run osmo-stp_10.42.42.5: Starting osmo-stp 16:40:55.956181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29419): Launched 16:40:56.269454 run osmo-stp_10.42.42.5(pid=29420): Launched 16:40:56.388369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:40:56.923110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29422): Launched 16:40:57.042433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:40:57.304829 run patchelf(pid=29423): Launched 16:40:57.476938 run osmo-stp_10.42.42.5(pid=29420): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29420)] 16:40:57.607670 run osmo-stp_10.42.42.5(pid=29420): stdout: | (launched: 2022-12-12_16:40:56.211160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:57.739709 run osmo-stp_10.42.42.5(pid=29420): stderr: | 20221212164056382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164056382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164056382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164056382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164056383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164056383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164056383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:57.872057 run osmo-stp_10.42.42.5(pid=29420): stdout: | (launched: 2022-12-12_16:40:56.211160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:40:57.998815 run osmo-stp_10.42.42.5(pid=29420): stderr: | 20221212164056382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164056382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164056382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164056382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164056383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164056383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164056383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:40:58.149092 run patchelf(pid=29423): Terminating (SIGINT) 16:40:58.322138 run patchelf(pid=29423): Terminated: ok {rc=0} 16:40:58.446945 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29420): Process ended prematurely: osmo-stp_10.42.42.5(pid=29420) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29420)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:40:58.456490 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:40:58.483657 run osmo-hlr_10.42.42.2(pid=29417): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29417)] 16:40:58.531592 run osmo-hlr_10.42.42.2(pid=29417): stdout: | (launched: 2022-12-12_16:40:55.242608) 16:40:58.580741 run osmo-hlr_10.42.42.2(pid=29417): stderr: | 20221212164055418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164055418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164055418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164055418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164055418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164055418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164055431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164055439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164055440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164055440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:40:58.630376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29410): Terminating (SIGTERM) 16:40:58.670176 run iperf3-srv_10.42.42.10(pid=29411): Terminating (SIGTERM) 16:40:58.709662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29412): Terminating (SIGTERM) 16:40:58.749300 run iperf3-srv_10.42.42.10(pid=29413): Terminating (SIGTERM) 16:40:58.789206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29416): Terminating (SIGTERM) 16:40:58.828792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29419): Terminating (SIGTERM) 16:40:58.868771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29422): Terminating (SIGTERM) 16:40:58.908735 --- ParallelTerminationStrategy: PID 29410 died... 16:40:58.928043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29410): Terminated: ok {rc=0} 16:40:58.971860 --- ParallelTerminationStrategy: PID 29411 died... 16:40:58.990313 run iperf3-srv_10.42.42.10(pid=29411): Terminated {rc=256} 16:40:59.033954 --- ParallelTerminationStrategy: PID 29412 died... 16:40:59.052447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29412): Terminated: ok {rc=0} 16:40:59.095969 --- ParallelTerminationStrategy: PID 29413 died... 16:40:59.114493 run iperf3-srv_10.42.42.10(pid=29413): Terminated {rc=256} 16:40:59.158013 --- ParallelTerminationStrategy: PID 29416 died... 16:40:59.176422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29416): Terminated: ok {rc=0} 16:40:59.220226 --- ParallelTerminationStrategy: PID 29419 died... 16:40:59.238932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29419): Terminated: ok {rc=0} 16:40:59.282644 --- ParallelTerminationStrategy: PID 29422 died... 16:40:59.301208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29422): Terminated: ok {rc=0} 16:40:59.387625 bus /gobi_0: Setting Powered False 16:41:00.488392 bus /gobi_0: Setting Powered False 16:41:01.601186 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:41:02.745942 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:02.757886 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:41:02.831470 tst iperf3.py: using LAC 30147 16:41:02.954319 tst iperf3.py: using RAC 57 16:41:03.079207 tst iperf3.py: using CellId 30147 16:41:03.203378 tst iperf3.py: using BVCI 30148 16:41:03.317846 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:03.328855 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:03.339832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:03.350868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:03.361731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:03.372495 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:03.383461 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:03.394313 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:03.405308 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:41:03.521619 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:41:03.731425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:04.045521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29424): Launched 16:41:04.319814 run iperf3-srv_10.42.42.10(pid=29425): Launched 16:41:04.436475 tst iperf3.py:8: start network... 16:41:04.644236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:05.128732 run create_hlr_db(pid=29426): Launched 16:41:05.255547 bus /gobi_6: Setting Powered False 16:41:06.316535 run create_hlr_db(pid=29426): Terminated: ok {rc=0} 16:41:06.771033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29428): Launched 16:41:07.104871 run osmo-hlr_10.42.42.2(pid=29429): Launched 16:41:07.232292 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:07.807084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29431): Launched 16:41:08.139985 run osmo-stp_10.42.42.5(pid=29432): Launched 16:41:08.267940 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:08.841284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29434): Launched 16:41:08.969664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:09.251700 run patchelf(pid=29435): Launched 16:41:09.436264 run osmo-stp_10.42.42.5(pid=29432): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29432)] 16:41:09.576534 run osmo-stp_10.42.42.5(pid=29432): stdout: | (launched: 2022-12-12_16:41:08.078579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:09.718703 run osmo-stp_10.42.42.5(pid=29432): stderr: | 20221212164108267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164108268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164108268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164108268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164108269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164108269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164108269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:09.861251 run osmo-stp_10.42.42.5(pid=29432): stdout: | (launched: 2022-12-12_16:41:08.078579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:09.997581 run osmo-stp_10.42.42.5(pid=29432): stderr: | 20221212164108267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164108268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164108268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164108268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164108269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164108269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164108269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:10.158834 run patchelf(pid=29435): Terminating (SIGINT) 16:41:10.344806 run patchelf(pid=29435): Terminated: ok {rc=0} 16:41:10.478365 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29432): Process ended prematurely: osmo-stp_10.42.42.5(pid=29432) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29432)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 16:41:10.488664 tst iperf3.py:8: Test FAILED (7.8 sec) 16:41:10.518342 run osmo-hlr_10.42.42.2(pid=29429): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29429)] 16:41:10.569252 run osmo-hlr_10.42.42.2(pid=29429): stdout: | (launched: 2022-12-12_16:41:07.043292) 16:41:10.622338 run osmo-hlr_10.42.42.2(pid=29429): stderr: | 20221212164107241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164107241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164107241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164107241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164107242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164107242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164107254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164107265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164107266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164107266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:10.675417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29424): Terminating (SIGTERM) 16:41:10.717971 run iperf3-srv_10.42.42.10(pid=29425): Terminating (SIGTERM) 16:41:10.760512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29428): Terminating (SIGTERM) 16:41:10.803401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29431): Terminating (SIGTERM) 16:41:10.845975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29434): Terminating (SIGTERM) 16:41:10.888851 --- ParallelTerminationStrategy: PID 29424 died... 16:41:10.909150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29424): Terminated: ok {rc=0} 16:41:10.956148 --- ParallelTerminationStrategy: PID 29425 died... 16:41:10.975767 run iperf3-srv_10.42.42.10(pid=29425): Terminated {rc=256} 16:41:11.022753 --- ParallelTerminationStrategy: PID 29428 died... 16:41:11.042429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29428): Terminated: ok {rc=0} 16:41:11.089506 --- ParallelTerminationStrategy: PID 29431 died... 16:41:11.109335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29431): Terminated: ok {rc=0} 16:41:11.156330 --- ParallelTerminationStrategy: PID 29434 died... 16:41:11.176105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29434): Terminated: ok {rc=0} 16:41:11.266058 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:41:12.419074 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:12.431258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:41:12.512662 tst iperf3m4.py: using LAC 30148 16:41:12.642551 tst iperf3m4.py: using RAC 58 16:41:12.769872 tst iperf3m4.py: using CellId 30148 16:41:12.899404 tst iperf3m4.py: using BVCI 30149 16:41:13.020030 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:13.031563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:13.042902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:13.054695 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:13.066381 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:13.078120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:13.089911 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:13.101558 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:13.113566 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:41:13.232122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:41:13.354624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:41:13.475682 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:41:13.595964 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:41:13.821950 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:14.157585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29436): Launched 16:41:14.450621 run iperf3-srv_10.42.42.10(pid=29437): Launched 16:41:14.575757 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:41:14.800807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:15.135956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29438): Launched 16:41:15.428486 run iperf3-srv_10.42.42.10(pid=29439): Launched 16:41:15.554996 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:41:15.779714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:16.124182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29440): Launched 16:41:16.415908 run iperf3-srv_10.42.42.10(pid=29441): Launched 16:41:16.582427 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:41:16.867460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:41:17.207666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29442): Launched 16:41:17.485941 run iperf3-srv_10.42.42.10(pid=29443): Launched 16:41:17.602772 tst iperf3m4.py:8: start network... 16:41:17.810455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:18.294417 run create_hlr_db(pid=29444): Launched 16:41:18.423220 bus /gobi_6: Setting Powered False 16:41:19.484106 run create_hlr_db(pid=29444): Terminated: ok {rc=0} 16:41:19.917456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29446): Launched 16:41:20.229914 run osmo-hlr_10.42.42.2(pid=29447): Launched 16:41:20.350005 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:20.896554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29449): Launched 16:41:21.208257 run osmo-stp_10.42.42.5(pid=29450): Launched 16:41:21.326013 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:21.859647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29452): Launched 16:41:21.978743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:22.241686 run patchelf(pid=29453): Launched 16:41:22.414071 run osmo-stp_10.42.42.5(pid=29450): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29450)] 16:41:22.544648 run osmo-stp_10.42.42.5(pid=29450): stdout: | (launched: 2022-12-12_16:41:21.149362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:22.676681 run osmo-stp_10.42.42.5(pid=29450): stderr: | 20221212164121317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164121317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164121317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164121318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164121318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164121318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164121318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:22.808734 run osmo-stp_10.42.42.5(pid=29450): stdout: | (launched: 2022-12-12_16:41:21.149362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:22.935060 run osmo-stp_10.42.42.5(pid=29450): stderr: | 20221212164121317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164121317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164121317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164121318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164121318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164121318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164121318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:23.085890 run patchelf(pid=29453): Terminating (SIGINT) 16:41:23.258406 run patchelf(pid=29453): Terminated: ok {rc=0} 16:41:23.382608 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29450): Process ended prematurely: osmo-stp_10.42.42.5(pid=29450) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29450)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:41:23.392261 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:41:23.419480 run osmo-hlr_10.42.42.2(pid=29447): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29447)] 16:41:23.466870 run osmo-hlr_10.42.42.2(pid=29447): stdout: | (launched: 2022-12-12_16:41:20.171520) 16:41:23.516420 run osmo-hlr_10.42.42.2(pid=29447): stderr: | 20221212164120347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164120347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164120347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164120347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164120348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164120348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164120358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164120367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164120367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164120367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:23.565793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29436): Terminating (SIGTERM) 16:41:23.605538 run iperf3-srv_10.42.42.10(pid=29437): Terminating (SIGTERM) 16:41:23.644886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29438): Terminating (SIGTERM) 16:41:23.684326 run iperf3-srv_10.42.42.10(pid=29439): Terminating (SIGTERM) 16:41:23.723736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29440): Terminating (SIGTERM) 16:41:23.763104 run iperf3-srv_10.42.42.10(pid=29441): Terminating (SIGTERM) 16:41:23.802295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29442): Terminating (SIGTERM) 16:41:23.841725 run iperf3-srv_10.42.42.10(pid=29443): Terminating (SIGTERM) 16:41:23.880930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29446): Terminating (SIGTERM) 16:41:23.920289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29449): Terminating (SIGTERM) 16:41:23.959518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29452): Terminating (SIGTERM) 16:41:23.999111 --- ParallelTerminationStrategy: PID 29436 died... 16:41:24.018297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29436): Terminated: ok {rc=0} 16:41:24.062379 --- ParallelTerminationStrategy: PID 29437 died... 16:41:24.080783 run iperf3-srv_10.42.42.10(pid=29437): Terminated {rc=256} 16:41:24.124709 --- ParallelTerminationStrategy: PID 29438 died... 16:41:24.143454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29438): Terminated: ok {rc=0} 16:41:24.187303 --- ParallelTerminationStrategy: PID 29439 died... 16:41:24.205925 run iperf3-srv_10.42.42.10(pid=29439): Terminated {rc=256} 16:41:24.249557 --- ParallelTerminationStrategy: PID 29440 died... 16:41:24.268027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29440): Terminated: ok {rc=0} 16:41:24.311779 --- ParallelTerminationStrategy: PID 29441 died... 16:41:24.330342 run iperf3-srv_10.42.42.10(pid=29441): Terminated {rc=256} 16:41:24.374044 --- ParallelTerminationStrategy: PID 29442 died... 16:41:24.392512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29442): Terminated: ok {rc=0} 16:41:24.436589 --- ParallelTerminationStrategy: PID 29443 died... 16:41:24.455235 run iperf3-srv_10.42.42.10(pid=29443): Terminated {rc=256} 16:41:24.498717 --- ParallelTerminationStrategy: PID 29446 died... 16:41:24.517363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29446): Terminated: ok {rc=0} 16:41:24.561271 --- ParallelTerminationStrategy: PID 29449 died... 16:41:24.579659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29449): Terminated: ok {rc=0} 16:41:24.623637 --- ParallelTerminationStrategy: PID 29452 died... 16:41:24.642376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29452): Terminated: ok {rc=0} 16:41:24.726093 bus /gobi_4: Setting Powered False 16:41:25.822669 bus /gobi_4: Setting Powered False 16:41:26.938899 bus /gobi_1: Setting Powered False 16:41:28.039205 bus /gobi_1: Setting Powered False 16:41:29.153647 bus /gobi_0: Setting Powered False 16:41:30.252544 bus /gobi_0: Setting Powered False 16:41:31.383065 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:41:32.500808 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:32.513377 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:41:32.586297 tst ping.py: using LAC 30149 16:41:32.715921 tst ping.py: using RAC 59 16:41:32.845365 tst ping.py: using CellId 30149 16:41:32.975420 tst ping.py: using BVCI 30150 16:41:33.095792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:33.107530 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:33.118984 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:33.130741 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:33.142357 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:33.154122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:33.165920 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:33.177667 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:41:33.295519 tst ping.py:19: start network... 16:41:33.500096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:33.972452 run create_hlr_db(pid=29454): Launched 16:41:34.096759 bus /gobi_6: Setting Powered False 16:41:35.158045 run create_hlr_db(pid=29454): Terminated: ok {rc=0} 16:41:35.604564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29456): Launched 16:41:35.933445 run osmo-hlr_10.42.42.2(pid=29457): Launched 16:41:36.057049 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:36.627179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29459): Launched 16:41:36.954842 run osmo-stp_10.42.42.5(pid=29460): Launched 16:41:37.079282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:37.640505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29462): Launched 16:41:37.766657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:38.042712 run patchelf(pid=29463): Launched 16:41:38.223384 run osmo-stp_10.42.42.5(pid=29460): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29460)] 16:41:38.361177 run osmo-stp_10.42.42.5(pid=29460): stdout: | (launched: 2022-12-12_16:41:36.894781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:38.500474 run osmo-stp_10.42.42.5(pid=29460): stderr: | 20221212164137084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164137085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164137085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164137085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164137086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164137086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164137086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:38.639743 run osmo-stp_10.42.42.5(pid=29460): stdout: | (launched: 2022-12-12_16:41:36.894781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:38.773320 run osmo-stp_10.42.42.5(pid=29460): stderr: | 20221212164137084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164137085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164137085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164137085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164137086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164137086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164137086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:38.931916 run patchelf(pid=29463): Terminating (SIGINT) 16:41:39.113623 run patchelf(pid=29463): Terminated: ok {rc=0} 16:41:39.244730 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29460): Process ended prematurely: osmo-stp_10.42.42.5(pid=29460) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29460)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 16:41:39.254520 tst ping.py:22: Test FAILED (6.7 sec) 16:41:39.283322 run osmo-hlr_10.42.42.2(pid=29457): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29457)] 16:41:39.334235 run osmo-hlr_10.42.42.2(pid=29457): stdout: | (launched: 2022-12-12_16:41:35.872912) 16:41:39.387031 run osmo-hlr_10.42.42.2(pid=29457): stderr: | 20221212164136069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164136070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164136070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164136070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164136070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164136070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164136082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164136091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164136091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164136091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:39.440269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29456): Terminating (SIGTERM) 16:41:39.483061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29459): Terminating (SIGTERM) 16:41:39.525688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29462): Terminating (SIGTERM) 16:41:39.568619 --- ParallelTerminationStrategy: PID 29456 died... 16:41:39.589093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29456): Terminated: ok {rc=0} 16:41:39.636445 --- ParallelTerminationStrategy: PID 29459 died... 16:41:39.656147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29459): Terminated: ok {rc=0} 16:41:39.703208 --- ParallelTerminationStrategy: PID 29462 died... 16:41:39.722988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29462): Terminated: ok {rc=0} 16:41:39.812005 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:41:40.900901 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:40.912871 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:41:40.985750 tst ping_idle_ping.py: using LAC 30150 16:41:41.104511 tst ping_idle_ping.py: using RAC 60 16:41:41.223666 tst ping_idle_ping.py: using CellId 30150 16:41:41.347276 tst ping_idle_ping.py: using BVCI 30151 16:41:41.459468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:41.470703 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:41.481803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:41.492622 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:41.503402 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:41.514402 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:41.525445 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:41:41.536248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:41:41.654606 tst ping_idle_ping.py:24: start network... 16:41:41.876146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:42.387995 run create_hlr_db(pid=29464): Launched 16:41:42.514687 bus /gobi_6: Setting Powered False 16:41:43.579051 run create_hlr_db(pid=29464): Terminated: ok {rc=0} 16:41:44.018085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Launched 16:41:44.324778 run osmo-hlr_10.42.42.2(pid=29467): Launched 16:41:44.442028 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:44.973784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Launched 16:41:45.281716 run osmo-stp_10.42.42.5(pid=29470): Launched 16:41:45.398950 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:45.964587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29472): Launched 16:41:46.096206 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:46.361684 run patchelf(pid=29473): Launched 16:41:46.548881 run osmo-stp_10.42.42.5(pid=29470): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] 16:41:46.680394 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-12_16:41:45.223843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:46.813617 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221212164145394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164145395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164145395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164145395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164145396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164145396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164145396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:46.946905 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-12_16:41:45.223843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:47.074845 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221212164145394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164145395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164145395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164145395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164145396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164145396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164145396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:47.224800 run patchelf(pid=29473): Terminating (SIGINT) 16:41:47.396679 run patchelf(pid=29473): Terminated: ok {rc=0} 16:41:47.520177 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:41:47.529556 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:41:47.556342 run osmo-hlr_10.42.42.2(pid=29467): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29467)] 16:41:47.603982 run osmo-hlr_10.42.42.2(pid=29467): stdout: | (launched: 2022-12-12_16:41:44.267624) 16:41:47.653393 run osmo-hlr_10.42.42.2(pid=29467): stderr: | 20221212164144441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164144441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164144441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164144441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164144441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164144441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164144454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164144462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164144462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164144462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:47.703350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminating (SIGTERM) 16:41:47.743350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminating (SIGTERM) 16:41:47.783451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29472): Terminating (SIGTERM) 16:41:47.823640 --- ParallelTerminationStrategy: PID 29466 died... 16:41:47.842942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminated: ok {rc=0} 16:41:47.887162 --- ParallelTerminationStrategy: PID 29469 died... 16:41:47.905970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminated: ok {rc=0} 16:41:47.949695 --- ParallelTerminationStrategy: PID 29472 died... 16:41:47.968438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29472): Terminated: ok {rc=0} 16:41:48.055419 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:41:49.365088 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:41:49.372337 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:41:49.406108 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:41:49.440297 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:41:49.495055 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:41:49.528714 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:41:49.562890 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:41:50.121108 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:41:50.126679 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:41:50.138066 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:41:50.208073 tst switch_tch_pdch.py: using LAC 30151 16:41:50.338360 tst switch_tch_pdch.py: using RAC 61 16:41:50.466503 tst switch_tch_pdch.py: using CellId 30151 16:41:50.596877 tst switch_tch_pdch.py: using BVCI 30152 16:41:50.715569 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:41:50.727588 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:41:50.739189 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:41:50.751151 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:41:50.763142 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:41:50.775094 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:41:50.787519 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:41:50.799417 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:41:50.921943 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:41:51.043550 tst switch_tch_pdch.py:51: start network... 16:41:51.263084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:41:51.768915 run create_hlr_db(pid=29478): Launched 16:41:51.895865 bus /gobi_6: Setting Powered False 16:41:52.960656 run create_hlr_db(pid=29478): Terminated: ok {rc=0} 16:41:53.400006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29480): Launched 16:41:53.706880 run osmo-hlr_10.42.42.2(pid=29481): Launched 16:41:53.822622 run osmo-stp_10.42.42.5: Starting osmo-stp 16:41:54.363935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29483): Launched 16:41:54.669211 run osmo-stp_10.42.42.5(pid=29484): Launched 16:41:54.784250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:41:55.309644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29486): Launched 16:41:55.425916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:41:55.683396 run patchelf(pid=29487): Launched 16:41:55.853913 run osmo-stp_10.42.42.5(pid=29484): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29484)] 16:41:55.981954 run osmo-stp_10.42.42.5(pid=29484): stdout: | (launched: 2022-12-12_16:41:54.612304) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:56.111882 run osmo-stp_10.42.42.5(pid=29484): stderr: | 20221212164154780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164154781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164154781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164154781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164154782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164154782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164154782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:56.242110 run osmo-stp_10.42.42.5(pid=29484): stdout: | (launched: 2022-12-12_16:41:54.612304) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:41:56.366398 run osmo-stp_10.42.42.5(pid=29484): stderr: | 20221212164154780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164154781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164154781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164154781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164154782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164154782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164154782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:41:56.513710 run patchelf(pid=29487): Terminating (SIGINT) 16:41:56.683254 run patchelf(pid=29487): Terminated: ok {rc=0} 16:41:56.805403 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29484): Process ended prematurely: osmo-stp_10.42.42.5(pid=29484) [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29484)] [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:41:56.814480 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:41:56.840922 run osmo-hlr_10.42.42.2(pid=29481): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29481)] 16:41:56.888323 run osmo-hlr_10.42.42.2(pid=29481): stdout: | (launched: 2022-12-12_16:41:53.649981) 16:41:56.937350 run osmo-hlr_10.42.42.2(pid=29481): stderr: | 20221212164153823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164153823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164153823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164153823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164153823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164153823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164153835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164153844 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164153844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164153844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:41:56.986978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29480): Terminating (SIGTERM) 16:41:57.026627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29483): Terminating (SIGTERM) 16:41:57.066462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29486): Terminating (SIGTERM) 16:41:57.106453 --- ParallelTerminationStrategy: PID 29480 died... 16:41:57.125422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29480): Terminated: ok {rc=0} 16:41:57.169057 --- ParallelTerminationStrategy: PID 29483 died... 16:41:57.188135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29483): Terminated: ok {rc=0} 16:41:57.231734 --- ParallelTerminationStrategy: PID 29486 died... 16:41:57.250273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29486): Terminated: ok {rc=0} 16:41:57.333530 bus /gobi_0: Setting Powered False 16:41:58.430521 bus /gobi_0: Setting Powered False 16:41:59.546587 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:42:00.819502 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:42:00.850917 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:42:00.921424 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:42:01.002982 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:42:01.094527 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:42:01.167488 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:42:01.279861 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:42:01.718829 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:42:01.724928 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:42:01.736758 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:42:01.809859 tst switch_tch_pdch.py: using LAC 30152 16:42:01.940911 tst switch_tch_pdch.py: using RAC 62 16:42:02.079792 tst switch_tch_pdch.py: using CellId 30152 16:42:02.223495 tst switch_tch_pdch.py: using BVCI 30153 16:42:02.363268 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:42:02.375840 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:42:02.388196 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:42:02.401410 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:42:02.413597 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:42:02.425337 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:42:02.437104 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:42:02.448649 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:42:02.565462 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:42:02.682590 tst switch_tch_pdch.py:51: start network... 16:42:02.887036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:03.334496 run create_hlr_db(pid=29494): Launched 16:42:03.462760 bus /gobi_6: Setting Powered False 16:42:04.524083 run create_hlr_db(pid=29494): Terminated: ok {rc=0} 16:42:04.941607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29496): Launched 16:42:05.269654 run osmo-hlr_10.42.42.2(pid=29497): Launched 16:42:05.393786 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:05.929240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29499): Launched 16:42:06.257079 run osmo-stp_10.42.42.5(pid=29500): Launched 16:42:06.380302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:42:06.886122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29502): Launched 16:42:07.005251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:42:07.262346 run patchelf(pid=29503): Launched 16:42:07.434170 run osmo-stp_10.42.42.5(pid=29500): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29500)] 16:42:07.562882 run osmo-stp_10.42.42.5(pid=29500): stdout: | (launched: 2022-12-12_16:42:06.196371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:07.692675 run osmo-stp_10.42.42.5(pid=29500): stderr: | 20221212164206387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164206387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164206387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164206388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164206388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164206388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164206388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:07.822680 run osmo-stp_10.42.42.5(pid=29500): stdout: | (launched: 2022-12-12_16:42:06.196371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:07.947115 run osmo-stp_10.42.42.5(pid=29500): stderr: | 20221212164206387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164206387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164206387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164206388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164206388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164206388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164206388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:08.094545 run patchelf(pid=29503): Terminating (SIGINT) 16:42:08.264563 run patchelf(pid=29503): Terminated: ok {rc=0} 16:42:08.387219 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29500): Process ended prematurely: osmo-stp_10.42.42.5(pid=29500) [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29500)] [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:42:08.396179 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:42:08.422751 run osmo-hlr_10.42.42.2(pid=29497): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29497)] 16:42:08.469869 run osmo-hlr_10.42.42.2(pid=29497): stdout: | (launched: 2022-12-12_16:42:05.209197) 16:42:08.518945 run osmo-hlr_10.42.42.2(pid=29497): stderr: | 20221212164205406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164205406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164205406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164205406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164205406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164205406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164205419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164205429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164205430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164205430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:08.568368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29496): Terminating (SIGTERM) 16:42:08.607931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29499): Terminating (SIGTERM) 16:42:08.647629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29502): Terminating (SIGTERM) 16:42:08.687573 --- ParallelTerminationStrategy: PID 29496 died... 16:42:08.706725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29496): Terminated: ok {rc=0} 16:42:08.750344 --- ParallelTerminationStrategy: PID 29499 died... 16:42:08.768806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29499): Terminated: ok {rc=0} 16:42:08.812391 --- ParallelTerminationStrategy: PID 29502 died... 16:42:08.830941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29502): Terminated: ok {rc=0} 16:42:08.916128 bus /gobi_0: Setting Powered False 16:42:10.016758 bus /gobi_0: Setting Powered False 16:42:11.132581 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_sms:trx-umtrx --------------------------------------------------------------------- 16:42:12.387506 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:42:12.391311 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:42:12.423659 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 16:42:12.430413 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 16:42:12.483270 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:42:12.515677 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 16:42:12.522413 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 16:42:13.059055 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 16:42:13.063893 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 16:42:13.074665 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 16:42:13.120814 tst mo_mt_sms.py: using LAC 30153 16:42:13.240064 tst mo_mt_sms.py: using RAC 63 16:42:13.361013 tst mo_mt_sms.py: using CellId 30153 16:42:13.481498 tst mo_mt_sms.py: using BVCI 30154 16:42:13.591173 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:42:13.709719 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:42:13.827477 tst mo_mt_sms.py:9: start nitb and bts... 16:42:14.049251 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:42:14.713391 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29507): Launched 16:42:15.042354 run osmo-nitb_10.42.42.2(pid=29508): Launched 16:42:15.225240 run osmo-nitb_10.42.42.2(pid=29508): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29508)] 16:42:15.371767 run osmo-nitb_10.42.42.2(pid=29508): stdout: | (launched: 2022-12-12_16:42:14.981789) 16:42:15.519366 run osmo-nitb_10.42.42.2(pid=29508): stderr: | (launched: 2022-12-12_16:42:15.030300) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:42:15.667087 run osmo-nitb_10.42.42.2(pid=29508): stdout: | (launched: 2022-12-12_16:42:14.981789) 16:42:15.816387 run osmo-nitb_10.42.42.2(pid=29508): stderr: | (launched: 2022-12-12_16:42:15.030300) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29508): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29508) [trial-2379↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29508)] 16:42:16.167235 tst osmo-nitb_10.42.42.2(pid=29508): stdout: | (launched: 2022-12-12_16:42:14.981789) 16:42:16.294478 tst osmo-nitb_10.42.42.2(pid=29508): stderr: | (launched: 2022-12-12_16:42:15.030300) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:42:16.444674 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29508): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29508) [trial-2379↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29508)] [trial-2379↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 16:42:16.453527 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 16:42:16.460241 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29507): Terminating (SIGTERM) 16:42:16.669151 --- ParallelTerminationStrategy: PID 29507 died... 16:42:16.688746 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29507): Terminated: ok {rc=0} 16:42:16.775889 bus /sierra_3: Setting Powered False 16:42:17.875313 bus /sierra_3: Setting Powered False 16:42:18.993111 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 sms:trx-umtrx --------------------------------------------------------------------- 16:42:20.190473 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:42:20.195265 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:42:20.227539 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:42:20.254043 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 16:42:20.306727 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:42:20.340053 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:42:20.366311 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 16:42:20.913957 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 16:42:20.918881 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:20.929515 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 16:42:20.975932 tst mo_mt_sms.py: using LAC 30154 16:42:21.093994 tst mo_mt_sms.py: using RAC 64 16:42:21.212186 tst mo_mt_sms.py: using CellId 30154 16:42:21.339574 tst mo_mt_sms.py: using BVCI 30155 16:42:21.459788 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:21.471164 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:21.482122 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:21.493483 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:21.504729 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:21.516055 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:42:21.632420 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 16:42:21.747862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:22.220693 run create_hlr_db(pid=29512): Launched 16:42:22.345696 bus /sierra_2: Setting Powered False 16:42:23.406812 run create_hlr_db(pid=29512): Terminated: ok {rc=0} 16:42:23.853676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Launched 16:42:24.179686 run osmo-hlr_10.42.42.2(pid=29515): Launched 16:42:24.303020 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:24.865031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Launched 16:42:25.193105 run osmo-stp_10.42.42.5(pid=29518): Launched 16:42:25.316280 run osmo-msc_10.42.42.6: Starting osmo-msc 16:42:25.907584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29520): Launched 16:42:26.235775 run osmo-msc_10.42.42.6(pid=29521): Launched 16:42:26.418555 run osmo-stp_10.42.42.5(pid=29518): ERR: Terminated: ERROR {rc=1} [trial-2379↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] 16:42:26.556166 run osmo-stp_10.42.42.5(pid=29518): stdout: | (launched: 2022-12-12_16:42:25.132341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:26.694252 run osmo-stp_10.42.42.5(pid=29518): stderr: | 20221212164225321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164225321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164225322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164225322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164225322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164225322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164225323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:26.830862 run osmo-stp_10.42.42.5(pid=29518): stdout: | (launched: 2022-12-12_16:42:25.132341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:26.960655 run osmo-stp_10.42.42.5(pid=29518): stderr: | 20221212164225321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164225321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164225322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164225322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164225322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164225322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164225323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:27.116312 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29518): Process ended prematurely: osmo-stp_10.42.42.5(pid=29518) [trial-2379↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] [trial-2379↪sms:trx-umtrx↪mo_mt_sms.py:16] 16:42:27.125539 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 16:42:27.153516 run osmo-hlr_10.42.42.2(pid=29515): ERR: Terminated: ERROR {rc=237} [trial-2379↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29515)] 16:42:27.203880 run osmo-hlr_10.42.42.2(pid=29515): stdout: | (launched: 2022-12-12_16:42:24.119106) 16:42:27.256247 run osmo-hlr_10.42.42.2(pid=29515): stderr: | 20221212164224315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164224315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164224315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164224315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164224315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164224315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164224328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164224336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164224336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164224336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:27.329276 run osmo-msc_10.42.42.6(pid=29521): ERR: Terminated: ERROR {rc=2} [trial-2379↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29521)] 16:42:27.379987 run osmo-msc_10.42.42.6(pid=29521): stdout: | (launched: 2022-12-12_16:42:26.175298) 16:42:27.432049 run osmo-msc_10.42.42.6(pid=29521): stderr: | 20221212164226494 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164226495 DLGLOBAL DEBUG validating counter group 0x7f1c8ad8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164226495 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164226495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164226495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164226495 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164226497 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164226497 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164226497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164226498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:42:27.484574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Terminating (SIGTERM) 16:42:27.526690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Terminating (SIGTERM) 16:42:27.568908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29520): Terminating (SIGTERM) 16:42:27.611468 --- ParallelTerminationStrategy: PID 29514 died... 16:42:27.631522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Terminated: ok {rc=0} 16:42:27.678236 --- ParallelTerminationStrategy: PID 29517 died... 16:42:27.697726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Terminated: ok {rc=0} 16:42:27.744356 --- ParallelTerminationStrategy: PID 29520 died... 16:42:27.763879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29520): Terminated: ok {rc=0} 16:42:27.851806 bus /sierra_3: Setting Powered False 16:42:28.950082 bus /sierra_3: Setting Powered False 16:42:30.063926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 16:42:31.337874 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:42:31.345579 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:42:31.393277 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 16:42:31.401724 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 16:42:31.440825 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:42:31.477443 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 16:42:31.485536 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 16:42:32.036416 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 16:42:32.046917 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 16:42:32.060216 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 16:42:32.125573 tst assert_extension.py: using LAC 30155 16:42:32.257872 tst assert_extension.py: using RAC 65 16:42:32.377135 tst assert_extension.py: using CellId 30155 16:42:32.496609 tst assert_extension.py: using BVCI 30156 16:42:32.608596 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 16:42:32.727958 tst assert_extension.py:10: start nitb and bts... 16:42:32.948556 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:42:33.617064 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29526): Launched 16:42:33.945431 run osmo-nitb_10.42.42.2(pid=29527): Launched 16:42:34.125904 run osmo-nitb_10.42.42.2(pid=29527): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29527)] 16:42:34.271835 run osmo-nitb_10.42.42.2(pid=29527): stdout: | (launched: 2022-12-12_16:42:33.884699) 16:42:34.419265 run osmo-nitb_10.42.42.2(pid=29527): stderr: | (launched: 2022-12-12_16:42:33.933323) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:42:34.566485 run osmo-nitb_10.42.42.2(pid=29527): stdout: | (launched: 2022-12-12_16:42:33.884699) 16:42:34.708166 run osmo-nitb_10.42.42.2(pid=29527): stderr: | (launched: 2022-12-12_16:42:33.933323) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29527): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29527) [trial-2379↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29527)] 16:42:35.068512 tst osmo-nitb_10.42.42.2(pid=29527): stdout: | (launched: 2022-12-12_16:42:33.884699) 16:42:35.200627 tst osmo-nitb_10.42.42.2(pid=29527): stderr: | (launched: 2022-12-12_16:42:33.933323) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:42:35.355987 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29527): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29527) [trial-2379↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29527)] [trial-2379↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 16:42:35.365227 tst assert_extension.py:12: Test FAILED (3.3 sec) 16:42:35.372288 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29526): Terminating (SIGTERM) 16:42:35.584057 --- ParallelTerminationStrategy: PID 29526 died... 16:42:35.607397 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29526): Terminated: ok {rc=0} 16:42:35.697288 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 ussd:trx-umtrx --------------------------------------------------------------------- 16:42:36.877914 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:42:36.882455 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:42:36.914577 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:42:36.940988 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 16:42:36.976076 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:42:37.009074 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:42:37.035544 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 16:42:37.563494 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 16:42:37.568681 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:37.579545 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 16:42:37.628572 tst assert_extension.py: using LAC 30156 16:42:37.751493 tst assert_extension.py: using RAC 66 16:42:37.873337 tst assert_extension.py: using CellId 30156 16:42:37.993008 tst assert_extension.py: using BVCI 30157 16:42:38.103816 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:38.114730 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:38.125325 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:38.136279 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:38.147358 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:42:38.158519 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 16:42:38.276634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:38.782297 run create_hlr_db(pid=29531): Launched 16:42:38.909108 bus /sierra_2: Setting Powered False 16:42:39.973406 run create_hlr_db(pid=29531): Terminated: ok {rc=0} 16:42:40.411148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29533): Launched 16:42:40.716117 run osmo-hlr_10.42.42.2(pid=29534): Launched 16:42:40.831809 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:41.362110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29536): Launched 16:42:41.666657 run osmo-stp_10.42.42.5(pid=29537): Launched 16:42:41.783300 run osmo-msc_10.42.42.6: Starting osmo-msc 16:42:42.331242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29539): Launched 16:42:42.636174 run osmo-msc_10.42.42.6(pid=29540): Launched 16:42:42.806253 run osmo-stp_10.42.42.5(pid=29537): ERR: Terminated: ERROR {rc=1} [trial-2379↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29537)] 16:42:42.934407 run osmo-stp_10.42.42.5(pid=29537): stdout: | (launched: 2022-12-12_16:42:41.609382) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:43.062500 run osmo-stp_10.42.42.5(pid=29537): stderr: | 20221212164241775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164241775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164241775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164241776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164241776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164241776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164241776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:43.188693 run osmo-stp_10.42.42.5(pid=29537): stdout: | (launched: 2022-12-12_16:42:41.609382) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:43.309271 run osmo-stp_10.42.42.5(pid=29537): stderr: | 20221212164241775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164241775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164241775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164241776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164241776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164241776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164241776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:43.453291 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29537): Process ended prematurely: osmo-stp_10.42.42.5(pid=29537) [trial-2379↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29537)] [trial-2379↪ussd:trx-umtrx↪assert_extension.py:17] 16:42:43.461932 tst assert_extension.py:17: Test FAILED (5.9 sec) 16:42:43.488159 run osmo-hlr_10.42.42.2(pid=29534): ERR: Terminated: ERROR {rc=237} [trial-2379↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29534)] 16:42:43.535684 run osmo-hlr_10.42.42.2(pid=29534): stdout: | (launched: 2022-12-12_16:42:40.658990) 16:42:43.584525 run osmo-hlr_10.42.42.2(pid=29534): stderr: | 20221212164240833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164240833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164240833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164240833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164240833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164240833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164240845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164240854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164240854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164240854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:43.653168 run osmo-msc_10.42.42.6(pid=29540): ERR: Terminated: ERROR {rc=2} [trial-2379↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29540)] 16:42:43.700872 run osmo-msc_10.42.42.6(pid=29540): stdout: | (launched: 2022-12-12_16:42:42.579221) 16:42:43.750022 run osmo-msc_10.42.42.6(pid=29540): stderr: | 20221212164242851 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164242851 DLGLOBAL DEBUG validating counter group 0x7fd1a8e3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164242852 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164242852 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164242852 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164242852 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164242854 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164242854 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164242854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164242854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:42:43.799357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29533): Terminating (SIGTERM) 16:42:43.839132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29536): Terminating (SIGTERM) 16:42:43.878822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29539): Terminating (SIGTERM) 16:42:43.918883 --- ParallelTerminationStrategy: PID 29533 died... 16:42:43.938167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29533): Terminated: ok {rc=0} 16:42:43.982740 --- ParallelTerminationStrategy: PID 29536 died... 16:42:44.001221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29536): Terminated: ok {rc=0} 16:42:44.045000 --- ParallelTerminationStrategy: PID 29539 died... 16:42:44.063868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29539): Terminated: ok {rc=0} 16:42:44.149452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:42:45.363229 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:42:45.371359 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:42:45.404218 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:42:45.430685 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:42:45.480362 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:42:45.512562 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:42:45.539033 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:42:46.103887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:42:46.163681 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:46.176470 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:42:46.249375 tst mo_mt_call.py: using LAC 30157 16:42:46.386292 tst mo_mt_call.py: using RAC 67 16:42:46.555309 tst mo_mt_call.py: using CellId 30157 16:42:46.679887 tst mo_mt_call.py: using BVCI 30158 16:42:46.794746 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:46.806476 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:46.818617 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:46.830809 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:46.843032 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:46.854611 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:42:46.971443 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:42:47.124176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:47.612764 run create_hlr_db(pid=29545): Launched 16:42:47.740260 bus /sierra_2: Setting Powered False 16:42:48.801401 run create_hlr_db(pid=29545): Terminated: ok {rc=0} 16:42:49.233116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29547): Launched 16:42:49.543711 run osmo-hlr_10.42.42.2(pid=29548): Launched 16:42:49.660306 run osmo-stp_10.42.42.5: Starting osmo-stp 16:42:50.193836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29550): Launched 16:42:50.504760 run osmo-stp_10.42.42.5(pid=29551): Launched 16:42:50.622276 run osmo-msc_10.42.42.6: Starting osmo-msc 16:42:51.183960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29553): Launched 16:42:51.496449 run osmo-msc_10.42.42.6(pid=29554): Launched 16:42:51.672610 run osmo-stp_10.42.42.5(pid=29551): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29551)] 16:42:51.804268 run osmo-stp_10.42.42.5(pid=29551): stdout: | (launched: 2022-12-12_16:42:50.446720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:51.956598 run osmo-stp_10.42.42.5(pid=29551): stderr: | 20221212164250619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164250619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164250619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164250619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164250620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164250620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164250620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:52.085246 run osmo-stp_10.42.42.5(pid=29551): stdout: | (launched: 2022-12-12_16:42:50.446720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:42:52.208333 run osmo-stp_10.42.42.5(pid=29551): stderr: | 20221212164250619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164250619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164250619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164250619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164250620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164250620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164250620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:42:52.355678 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29551): Process ended prematurely: osmo-stp_10.42.42.5(pid=29551) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29551)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:42:52.364860 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 16:42:52.391177 run osmo-hlr_10.42.42.2(pid=29548): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29548)] 16:42:52.438653 run osmo-hlr_10.42.42.2(pid=29548): stdout: | (launched: 2022-12-12_16:42:49.485379) 16:42:52.487739 run osmo-hlr_10.42.42.2(pid=29548): stderr: | 20221212164249662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164249662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164249662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164249663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164249663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164249663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164249675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164249683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164249684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164249684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:42:52.556595 run osmo-msc_10.42.42.6(pid=29554): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29554)] 16:42:52.604079 run osmo-msc_10.42.42.6(pid=29554): stdout: | (launched: 2022-12-12_16:42:51.438507) 16:42:52.653306 run osmo-msc_10.42.42.6(pid=29554): stderr: | 20221212164251714 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164251714 DLGLOBAL DEBUG validating counter group 0x7f4f74e3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164251714 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164251714 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164251714 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164251715 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164251716 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164251717 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164251717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164251717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:42:52.702619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29547): Terminating (SIGTERM) 16:42:52.742120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29550): Terminating (SIGTERM) 16:42:52.781767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29553): Terminating (SIGTERM) 16:42:52.821536 --- ParallelTerminationStrategy: PID 29547 died... 16:42:52.840418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29547): Terminated: ok {rc=0} 16:42:52.884044 --- ParallelTerminationStrategy: PID 29550 died... 16:42:52.902458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29550): Terminated: ok {rc=0} 16:42:52.945876 --- ParallelTerminationStrategy: PID 29553 died... 16:42:52.964200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29553): Terminated: ok {rc=0} 16:42:53.050174 bus /sierra_3: Setting Powered False 16:42:54.151803 bus /sierra_3: Setting Powered False 16:42:55.267523 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:42:56.418202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:56.430800 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:42:56.502670 tst mo_mt_call_osmux.py: using LAC 30158 16:42:56.635017 tst mo_mt_call_osmux.py: using RAC 68 16:42:56.759924 tst mo_mt_call_osmux.py: using CellId 30158 16:42:56.887859 tst mo_mt_call_osmux.py: using BVCI 30159 16:42:57.002240 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:57.013664 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:57.024681 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:57.035709 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:57.046734 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:42:57.057708 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:42:57.177248 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:42:57.295445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:42:57.777203 run create_hlr_db(pid=29556): Launched 16:42:57.903548 bus /sierra_2: Setting Powered False 16:42:58.964712 run create_hlr_db(pid=29556): Terminated: ok {rc=0} 16:42:59.415688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29558): Launched 16:42:59.750258 run osmo-hlr_10.42.42.2(pid=29559): Launched 16:42:59.878213 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:00.446694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29561): Launched 16:43:00.779798 run osmo-stp_10.42.42.5(pid=29562): Launched 16:43:01.038032 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:01.649634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29564): Launched 16:43:01.998453 run osmo-msc_10.42.42.6(pid=29565): Launched 16:43:02.516449 run osmo-stp_10.42.42.5(pid=29562): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29562)] 16:43:02.668184 run osmo-stp_10.42.42.5(pid=29562): stdout: | (launched: 2022-12-12_16:43:00.718651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:02.797502 run osmo-stp_10.42.42.5(pid=29562): stderr: | 20221212164300966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164300967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164300967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164300967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164300968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164300968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164300968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:02.927074 run osmo-stp_10.42.42.5(pid=29562): stdout: | (launched: 2022-12-12_16:43:00.718651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:03.050702 run osmo-stp_10.42.42.5(pid=29562): stderr: | 20221212164300966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164300967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164300967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164300967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164300968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164300968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164300968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:03.198749 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29562): Process ended prematurely: osmo-stp_10.42.42.5(pid=29562) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29562)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:43:03.208216 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 16:43:03.235267 run osmo-hlr_10.42.42.2(pid=29559): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29559)] 16:43:03.283181 run osmo-hlr_10.42.42.2(pid=29559): stdout: | (launched: 2022-12-12_16:42:59.688716) 16:43:03.333671 run osmo-hlr_10.42.42.2(pid=29559): stderr: | 20221212164259887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164259887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164259887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164259887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164259887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164259887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164259899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164259908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164259909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164259909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:03.403464 run osmo-msc_10.42.42.6(pid=29565): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29565)] 16:43:03.451738 run osmo-msc_10.42.42.6(pid=29565): stdout: | (launched: 2022-12-12_16:43:01.934702) 16:43:03.501674 run osmo-msc_10.42.42.6(pid=29565): stderr: | 20221212164302356 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164302356 DLGLOBAL DEBUG validating counter group 0x7f0287f22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164302357 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164302357 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164302357 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164302358 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164302362 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164302363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164302364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164302364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:03.551688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29558): Terminating (SIGTERM) 16:43:03.591934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29561): Terminating (SIGTERM) 16:43:03.632003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29564): Terminating (SIGTERM) 16:43:03.672540 --- ParallelTerminationStrategy: PID 29558 died... 16:43:03.691772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29558): Terminated: ok {rc=0} 16:43:03.736621 --- ParallelTerminationStrategy: PID 29561 died... 16:43:03.755599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29561): Terminated: ok {rc=0} 16:43:03.799655 --- ParallelTerminationStrategy: PID 29564 died... 16:43:03.818625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29564): Terminated: ok {rc=0} 16:43:03.905254 bus /sierra_3: Setting Powered False 16:43:05.005353 bus /sierra_3: Setting Powered False 16:43:06.120738 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:43:07.375586 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:07.383754 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:43:07.418034 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:43:07.445797 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:43:07.497543 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:43:07.531161 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:43:07.558682 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:43:08.111901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:43:08.165495 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:08.177243 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:43:08.246727 tst mo_mt_call.py: using LAC 30159 16:43:08.374226 tst mo_mt_call.py: using RAC 69 16:43:08.501966 tst mo_mt_call.py: using CellId 30159 16:43:08.629554 tst mo_mt_call.py: using BVCI 30160 16:43:08.751797 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:08.763528 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:08.774990 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:08.786709 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:08.798547 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:08.810326 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:43:08.927849 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:43:09.044261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:09.526922 run create_hlr_db(pid=29570): Launched 16:43:09.656822 bus /sierra_2: Setting Powered False 16:43:10.718620 run create_hlr_db(pid=29570): Terminated: ok {rc=0} 16:43:11.172711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29572): Launched 16:43:11.506943 run osmo-hlr_10.42.42.2(pid=29573): Launched 16:43:11.634716 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:12.207278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29575): Launched 16:43:12.541994 run osmo-stp_10.42.42.5(pid=29576): Launched 16:43:12.668494 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:13.271520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29578): Launched 16:43:13.605485 run osmo-msc_10.42.42.6(pid=29579): Launched 16:43:13.789892 run osmo-stp_10.42.42.5(pid=29576): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29576)] 16:43:13.930551 run osmo-stp_10.42.42.5(pid=29576): stdout: | (launched: 2022-12-12_16:43:12.479970) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:14.071316 run osmo-stp_10.42.42.5(pid=29576): stderr: | 20221212164312674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164312674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164312674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164312675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164312675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164312675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164312675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:14.209896 run osmo-stp_10.42.42.5(pid=29576): stdout: | (launched: 2022-12-12_16:43:12.479970) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:14.342565 run osmo-stp_10.42.42.5(pid=29576): stderr: | 20221212164312674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164312674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164312674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164312675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164312675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164312675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164312675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:14.501106 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29576): Process ended prematurely: osmo-stp_10.42.42.5(pid=29576) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29576)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:43:14.510727 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:43:14.539373 run osmo-hlr_10.42.42.2(pid=29573): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29573)] 16:43:14.590300 run osmo-hlr_10.42.42.2(pid=29573): stdout: | (launched: 2022-12-12_16:43:11.445604) 16:43:14.643126 run osmo-hlr_10.42.42.2(pid=29573): stderr: | 20221212164311642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164311642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164311643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164311643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164311643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164311643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164311675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164311684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164311685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164311685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:14.716138 run osmo-msc_10.42.42.6(pid=29579): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29579)] 16:43:14.766993 run osmo-msc_10.42.42.6(pid=29579): stdout: | (launched: 2022-12-12_16:43:13.543582) 16:43:14.819360 run osmo-msc_10.42.42.6(pid=29579): stderr: | 20221212164313863 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164313863 DLGLOBAL DEBUG validating counter group 0x7f62a54f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164313864 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164313864 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164313864 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164313864 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164313866 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164313866 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164313866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164313866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:14.872600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29572): Terminating (SIGTERM) 16:43:14.915172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29575): Terminating (SIGTERM) 16:43:14.957632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29578): Terminating (SIGTERM) 16:43:15.000293 --- ParallelTerminationStrategy: PID 29572 died... 16:43:15.020553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29572): Terminated: ok {rc=0} 16:43:15.068473 --- ParallelTerminationStrategy: PID 29575 died... 16:43:15.088447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29575): Terminated: ok {rc=0} 16:43:15.135630 --- ParallelTerminationStrategy: PID 29578 died... 16:43:15.155491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29578): Terminated: ok {rc=0} 16:43:15.246730 bus /sierra_3: Setting Powered False 16:43:16.346570 bus /sierra_3: Setting Powered False 16:43:17.463849 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:43:18.615661 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:18.628150 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:43:18.700090 tst mo_mt_call_osmux.py: using LAC 30160 16:43:18.831702 tst mo_mt_call_osmux.py: using RAC 70 16:43:18.959579 tst mo_mt_call_osmux.py: using CellId 30160 16:43:19.081683 tst mo_mt_call_osmux.py: using BVCI 30161 16:43:19.196525 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:19.218705 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:19.229954 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:19.241163 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:19.252134 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:43:19.263173 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:43:19.379939 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:43:19.504071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:20.022285 run create_hlr_db(pid=29581): Launched 16:43:20.149373 bus /sierra_2: Setting Powered False 16:43:21.214447 run create_hlr_db(pid=29581): Terminated: ok {rc=0} 16:43:21.659826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29583): Launched 16:43:21.996044 run osmo-hlr_10.42.42.2(pid=29584): Launched 16:43:22.124045 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:22.698730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29586): Launched 16:43:23.033914 run osmo-stp_10.42.42.5(pid=29587): Launched 16:43:23.159974 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:23.761092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29589): Launched 16:43:24.095038 run osmo-msc_10.42.42.6(pid=29590): Launched 16:43:24.279542 run osmo-stp_10.42.42.5(pid=29587): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29587)] 16:43:24.419878 run osmo-stp_10.42.42.5(pid=29587): stdout: | (launched: 2022-12-12_16:43:22.971852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:24.560091 run osmo-stp_10.42.42.5(pid=29587): stderr: | 20221212164323163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164323163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164323163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164323164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164323164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164323164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164323165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:24.698260 run osmo-stp_10.42.42.5(pid=29587): stdout: | (launched: 2022-12-12_16:43:22.971852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:24.830447 run osmo-stp_10.42.42.5(pid=29587): stderr: | 20221212164323163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164323163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164323163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164323164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164323164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164323164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164323165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:24.988924 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29587): Process ended prematurely: osmo-stp_10.42.42.5(pid=29587) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29587)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:43:24.998884 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:43:25.027561 run osmo-hlr_10.42.42.2(pid=29584): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29584)] 16:43:25.078061 run osmo-hlr_10.42.42.2(pid=29584): stdout: | (launched: 2022-12-12_16:43:21.934050) 16:43:25.130184 run osmo-hlr_10.42.42.2(pid=29584): stderr: | 20221212164322132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164322132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164322132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164322132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164322132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164322132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164322144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164322153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164322153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164322153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:25.203204 run osmo-msc_10.42.42.6(pid=29590): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29590)] 16:43:25.253757 run osmo-msc_10.42.42.6(pid=29590): stdout: | (launched: 2022-12-12_16:43:24.032820) 16:43:25.305861 run osmo-msc_10.42.42.6(pid=29590): stderr: | 20221212164324354 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164324354 DLGLOBAL DEBUG validating counter group 0x7f752192ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164324354 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164324355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164324355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164324355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164324357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164324357 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164324357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164324357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:25.358348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29583): Terminating (SIGTERM) 16:43:25.400382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29586): Terminating (SIGTERM) 16:43:25.442532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29589): Terminating (SIGTERM) 16:43:25.484903 --- ParallelTerminationStrategy: PID 29583 died... 16:43:25.505023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29583): Terminated: ok {rc=0} 16:43:25.551689 --- ParallelTerminationStrategy: PID 29586 died... 16:43:25.571291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29586): Terminated: ok {rc=0} 16:43:25.617717 --- ParallelTerminationStrategy: PID 29589 died... 16:43:25.637252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29589): Terminated: ok {rc=0} 16:43:25.725983 bus /sierra_3: Setting Powered False 16:43:26.825808 bus /sierra_3: Setting Powered False 16:43:27.943186 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:43:29.193491 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:29.200277 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:43:29.233199 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:43:29.259572 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:43:29.311094 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:43:29.343042 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:43:29.369618 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:43:29.920029 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:43:29.969659 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:29.980699 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:43:30.049123 tst mo_mt_call.py: using LAC 30161 16:43:30.171902 tst mo_mt_call.py: using RAC 71 16:43:30.295348 tst mo_mt_call.py: using CellId 30161 16:43:30.418845 tst mo_mt_call.py: using BVCI 30162 16:43:30.533573 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:30.544637 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:30.555544 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:30.566537 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:30.577604 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:30.588696 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:43:30.708080 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:43:30.837885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:31.376489 run create_hlr_db(pid=29595): Launched 16:43:31.552357 bus /sierra_2: Setting Powered False 16:43:32.617494 run create_hlr_db(pid=29595): Terminated: ok {rc=0} 16:43:33.103928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29597): Launched 16:43:33.438002 run osmo-hlr_10.42.42.2(pid=29598): Launched 16:43:33.566330 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:34.142825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29600): Launched 16:43:34.477243 run osmo-stp_10.42.42.5(pid=29601): Launched 16:43:34.605908 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:35.208332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29603): Launched 16:43:35.541844 run osmo-msc_10.42.42.6(pid=29604): Launched 16:43:35.728345 run osmo-stp_10.42.42.5(pid=29601): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29601)] 16:43:35.869123 run osmo-stp_10.42.42.5(pid=29601): stdout: | (launched: 2022-12-12_16:43:34.415594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:36.010401 run osmo-stp_10.42.42.5(pid=29601): stderr: | 20221212164334607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164334607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164334608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164334608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164334608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164334609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164334609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:36.148658 run osmo-stp_10.42.42.5(pid=29601): stdout: | (launched: 2022-12-12_16:43:34.415594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:36.281075 run osmo-stp_10.42.42.5(pid=29601): stderr: | 20221212164334607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164334607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164334608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164334608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164334608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164334609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164334609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:36.439124 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29601): Process ended prematurely: osmo-stp_10.42.42.5(pid=29601) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29601)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:43:36.448859 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:43:36.477393 run osmo-hlr_10.42.42.2(pid=29598): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29598)] 16:43:36.528120 run osmo-hlr_10.42.42.2(pid=29598): stdout: | (launched: 2022-12-12_16:43:33.376344) 16:43:36.580580 run osmo-hlr_10.42.42.2(pid=29598): stderr: | 20221212164333573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164333573 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164333573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164333573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164333573 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164333573 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164333585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164333594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164333594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164333594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:36.653679 run osmo-msc_10.42.42.6(pid=29604): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29604)] 16:43:36.704548 run osmo-msc_10.42.42.6(pid=29604): stdout: | (launched: 2022-12-12_16:43:35.479947) 16:43:36.757123 run osmo-msc_10.42.42.6(pid=29604): stderr: | 20221212164335801 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164335801 DLGLOBAL DEBUG validating counter group 0x7f592698dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164335801 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164335801 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164335801 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164335801 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164335803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164335803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164335804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164335804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:36.809678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29597): Terminating (SIGTERM) 16:43:36.852376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29600): Terminating (SIGTERM) 16:43:36.894877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29603): Terminating (SIGTERM) 16:43:36.937592 --- ParallelTerminationStrategy: PID 29597 died... 16:43:36.957820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29597): Terminated: ok {rc=0} 16:43:37.004862 --- ParallelTerminationStrategy: PID 29600 died... 16:43:37.024555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29600): Terminated: ok {rc=0} 16:43:37.071557 --- ParallelTerminationStrategy: PID 29603 died... 16:43:37.091224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29603): Terminated: ok {rc=0} 16:43:37.180266 bus /sierra_3: Setting Powered False 16:43:38.280156 bus /sierra_3: Setting Powered False 16:43:39.397405 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:43:40.548377 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:40.560739 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:43:40.631685 tst mo_mt_call_osmux.py: using LAC 30162 16:43:40.762536 tst mo_mt_call_osmux.py: using RAC 72 16:43:40.891956 tst mo_mt_call_osmux.py: using CellId 30162 16:43:41.022406 tst mo_mt_call_osmux.py: using BVCI 30163 16:43:41.142909 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:41.154551 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:41.166017 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:41.177763 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:41.189613 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:43:41.201304 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:43:41.318623 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:43:41.440523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:41.956047 run create_hlr_db(pid=29606): Launched 16:43:42.083724 bus /sierra_2: Setting Powered False 16:43:43.149850 run create_hlr_db(pid=29606): Terminated: ok {rc=0} 16:43:43.592417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29608): Launched 16:43:43.903640 run osmo-hlr_10.42.42.2(pid=29609): Launched 16:43:44.023310 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:44.557909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29611): Launched 16:43:44.867941 run osmo-stp_10.42.42.5(pid=29612): Launched 16:43:44.987241 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:45.547370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29614): Launched 16:43:45.881306 run osmo-msc_10.42.42.6(pid=29615): Launched 16:43:46.393258 run osmo-stp_10.42.42.5(pid=29612): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29612)] 16:43:46.578067 run osmo-stp_10.42.42.5(pid=29612): stdout: | (launched: 2022-12-12_16:43:44.809938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:46.709071 run osmo-stp_10.42.42.5(pid=29612): stderr: | 20221212164344979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164344979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164344979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164344980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164344980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164344980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164344980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:46.840379 run osmo-stp_10.42.42.5(pid=29612): stdout: | (launched: 2022-12-12_16:43:44.809938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:46.969866 run osmo-stp_10.42.42.5(pid=29612): stderr: | 20221212164344979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164344979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164344979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164344980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164344980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164344980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164344980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:47.120397 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29612): Process ended prematurely: osmo-stp_10.42.42.5(pid=29612) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29612)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:43:47.130307 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 16:43:47.158416 run osmo-hlr_10.42.42.2(pid=29609): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29609)] 16:43:47.209092 run osmo-hlr_10.42.42.2(pid=29609): stdout: | (launched: 2022-12-12_16:43:43.845669) 16:43:47.259176 run osmo-hlr_10.42.42.2(pid=29609): stderr: | 20221212164344023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164344023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164344023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164344023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164344023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164344023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164344035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164344043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164344043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164344044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:47.328832 run osmo-msc_10.42.42.6(pid=29615): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29615)] 16:43:47.376790 run osmo-msc_10.42.42.6(pid=29615): stdout: | (launched: 2022-12-12_16:43:45.811326) 16:43:47.426040 run osmo-msc_10.42.42.6(pid=29615): stderr: | 20221212164346271 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164346272 DLGLOBAL DEBUG validating counter group 0x7f6311160c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164346272 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164346272 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164346273 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164346273 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164346278 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164346279 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164346279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164346279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:47.475634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29608): Terminating (SIGTERM) 16:43:47.515945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29611): Terminating (SIGTERM) 16:43:47.555908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29614): Terminating (SIGTERM) 16:43:47.596042 --- ParallelTerminationStrategy: PID 29608 died... 16:43:47.615220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29608): Terminated: ok {rc=0} 16:43:47.659650 --- ParallelTerminationStrategy: PID 29611 died... 16:43:47.678433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29611): Terminated: ok {rc=0} 16:43:47.722373 --- ParallelTerminationStrategy: PID 29614 died... 16:43:47.741039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29614): Terminated: ok {rc=0} 16:43:47.824896 bus /sierra_3: Setting Powered False 16:43:48.922585 bus /sierra_3: Setting Powered False 16:43:50.040257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:43:51.288494 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:43:51.295214 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:43:51.327729 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:43:51.354296 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:43:51.407016 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:43:51.439575 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:43:51.465925 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:43:52.015084 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:43:52.064489 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:43:52.075723 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:43:52.143711 tst mo_mt_call.py: using LAC 30163 16:43:52.265566 tst mo_mt_call.py: using RAC 73 16:43:52.388491 tst mo_mt_call.py: using CellId 30163 16:43:52.510290 tst mo_mt_call.py: using BVCI 30164 16:43:52.624348 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:43:52.635510 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:43:52.646548 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:43:52.657544 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:43:52.668533 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:43:52.679430 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:43:52.799276 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:43:52.919561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:43:53.405644 run create_hlr_db(pid=29621): Launched 16:43:53.532164 bus /sierra_2: Setting Powered False 16:43:54.594372 run create_hlr_db(pid=29621): Terminated: ok {rc=0} 16:43:55.049543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29623): Launched 16:43:55.385052 run osmo-hlr_10.42.42.2(pid=29624): Launched 16:43:55.512782 run osmo-stp_10.42.42.5: Starting osmo-stp 16:43:56.086127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29626): Launched 16:43:56.420086 run osmo-stp_10.42.42.5(pid=29627): Launched 16:43:56.549110 run osmo-msc_10.42.42.6: Starting osmo-msc 16:43:57.154455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29629): Launched 16:43:57.488941 run osmo-msc_10.42.42.6(pid=29630): Launched 16:43:57.677329 run osmo-stp_10.42.42.5(pid=29627): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29627)] 16:43:57.817860 run osmo-stp_10.42.42.5(pid=29627): stdout: | (launched: 2022-12-12_16:43:56.358627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:57.959623 run osmo-stp_10.42.42.5(pid=29627): stderr: | 20221212164356548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164356549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164356549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164356549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164356550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164356550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164356550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:58.098232 run osmo-stp_10.42.42.5(pid=29627): stdout: | (launched: 2022-12-12_16:43:56.358627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:43:58.231414 run osmo-stp_10.42.42.5(pid=29627): stderr: | 20221212164356548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164356549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164356549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164356549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164356550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164356550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164356550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:43:58.390513 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29627): Process ended prematurely: osmo-stp_10.42.42.5(pid=29627) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29627)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:43:58.400177 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:43:58.428900 run osmo-hlr_10.42.42.2(pid=29624): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29624)] 16:43:58.480329 run osmo-hlr_10.42.42.2(pid=29624): stdout: | (launched: 2022-12-12_16:43:55.323627) 16:43:58.533638 run osmo-hlr_10.42.42.2(pid=29624): stderr: | 20221212164355521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164355521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164355521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164355521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164355521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164355521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164355534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164355542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164355543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164355543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:43:58.607469 run osmo-msc_10.42.42.6(pid=29630): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29630)] 16:43:58.658569 run osmo-msc_10.42.42.6(pid=29630): stdout: | (launched: 2022-12-12_16:43:57.427485) 16:43:58.711472 run osmo-msc_10.42.42.6(pid=29630): stderr: | 20221212164357748 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164357748 DLGLOBAL DEBUG validating counter group 0x7f733ccabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164357748 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164357748 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164357749 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164357749 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164357750 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164357751 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164357751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164357751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:43:58.764657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29623): Terminating (SIGTERM) 16:43:58.807235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29626): Terminating (SIGTERM) 16:43:58.849973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29629): Terminating (SIGTERM) 16:43:58.892765 --- ParallelTerminationStrategy: PID 29623 died... 16:43:58.913132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29623): Terminated: ok {rc=0} 16:43:58.960171 --- ParallelTerminationStrategy: PID 29626 died... 16:43:58.979835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29626): Terminated: ok {rc=0} 16:43:59.026592 --- ParallelTerminationStrategy: PID 29629 died... 16:43:59.046241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29629): Terminated: ok {rc=0} 16:43:59.135707 bus /sierra_3: Setting Powered False 16:44:00.235500 bus /sierra_3: Setting Powered False 16:44:01.357746 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:44:02.520109 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:44:02.532515 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:44:02.604310 tst mo_mt_call_osmux.py: using LAC 30164 16:44:02.742922 tst mo_mt_call_osmux.py: using RAC 74 16:44:02.870414 tst mo_mt_call_osmux.py: using CellId 30164 16:44:02.994502 tst mo_mt_call_osmux.py: using BVCI 30165 16:44:03.110480 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:44:03.121979 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:44:03.133104 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:44:03.144599 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:44:03.156398 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:44:03.167922 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:44:03.288609 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:44:03.408547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:03.892478 run create_hlr_db(pid=29632): Launched 16:44:04.020551 bus /sierra_2: Setting Powered False 16:44:05.082411 run create_hlr_db(pid=29632): Terminated: ok {rc=0} 16:44:05.536924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29634): Launched 16:44:05.870544 run osmo-hlr_10.42.42.2(pid=29635): Launched 16:44:05.997670 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:06.574661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29637): Launched 16:44:06.909128 run osmo-stp_10.42.42.5(pid=29638): Launched 16:44:07.036165 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:07.638276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29640): Launched 16:44:07.971158 run osmo-msc_10.42.42.6(pid=29641): Launched 16:44:08.156352 run osmo-stp_10.42.42.5(pid=29638): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29638)] 16:44:08.296242 run osmo-stp_10.42.42.5(pid=29638): stdout: | (launched: 2022-12-12_16:44:06.846833) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:08.436505 run osmo-stp_10.42.42.5(pid=29638): stderr: | 20221212164407038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164407039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164407039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164407039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164407040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164407040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164407040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:08.574896 run osmo-stp_10.42.42.5(pid=29638): stdout: | (launched: 2022-12-12_16:44:06.846833) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:08.707045 run osmo-stp_10.42.42.5(pid=29638): stderr: | 20221212164407038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164407039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164407039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164407039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164407040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164407040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164407040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:08.865336 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29638): Process ended prematurely: osmo-stp_10.42.42.5(pid=29638) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29638)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:44:08.875107 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:44:08.903567 run osmo-hlr_10.42.42.2(pid=29635): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29635)] 16:44:08.954268 run osmo-hlr_10.42.42.2(pid=29635): stdout: | (launched: 2022-12-12_16:44:05.808466) 16:44:09.006576 run osmo-hlr_10.42.42.2(pid=29635): stderr: | 20221212164406006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164406006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164406006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164406006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164406006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164406006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164406018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164406027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164406027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164406027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:09.079245 run osmo-msc_10.42.42.6(pid=29641): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29641)] 16:44:09.129671 run osmo-msc_10.42.42.6(pid=29641): stdout: | (launched: 2022-12-12_16:44:07.909434) 16:44:09.181862 run osmo-msc_10.42.42.6(pid=29641): stderr: | 20221212164408231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164408231 DLGLOBAL DEBUG validating counter group 0x7f525b0a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164408231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164408231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164408231 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164408231 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164408233 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164408234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164408234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164408234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:09.234335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29634): Terminating (SIGTERM) 16:44:09.276522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29637): Terminating (SIGTERM) 16:44:09.318702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29640): Terminating (SIGTERM) 16:44:09.361290 --- ParallelTerminationStrategy: PID 29634 died... 16:44:09.381363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29634): Terminated: ok {rc=0} 16:44:09.428227 --- ParallelTerminationStrategy: PID 29637 died... 16:44:09.447880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29637): Terminated: ok {rc=0} 16:44:09.494635 --- ParallelTerminationStrategy: PID 29640 died... 16:44:09.514303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29640): Terminated: ok {rc=0} 16:44:09.603041 bus /sierra_3: Setting Powered False 16:44:10.702368 bus /sierra_3: Setting Powered False 16:44:11.817920 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:44:13.068337 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:44:13.075581 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:44:13.109583 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:44:13.137207 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:44:13.191110 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:44:13.225350 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:44:13.252673 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:44:13.802869 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:44:13.854404 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:13.865845 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:44:13.934523 tst mo_mt_call.py: using LAC 30165 16:44:14.058831 tst mo_mt_call.py: using RAC 75 16:44:14.183017 tst mo_mt_call.py: using CellId 30165 16:44:14.306549 tst mo_mt_call.py: using BVCI 30166 16:44:14.421664 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:14.433112 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:14.443934 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:14.454902 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:14.465978 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:14.476865 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:44:14.597922 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:44:14.719619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:15.237739 run create_hlr_db(pid=29647): Launched 16:44:15.366198 bus /sierra_2: Setting Powered False 16:44:16.431097 run create_hlr_db(pid=29647): Terminated: ok {rc=0} 16:44:16.906335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29649): Launched 16:44:17.256072 run osmo-hlr_10.42.42.2(pid=29650): Launched 16:44:17.385535 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:17.966266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29652): Launched 16:44:18.302341 run osmo-stp_10.42.42.5(pid=29653): Launched 16:44:18.430548 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:19.034927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29655): Launched 16:44:19.370287 run osmo-msc_10.42.42.6(pid=29656): Launched 16:44:19.556892 run osmo-stp_10.42.42.5(pid=29653): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29653)] 16:44:19.697199 run osmo-stp_10.42.42.5(pid=29653): stdout: | (launched: 2022-12-12_16:44:18.240185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:19.837664 run osmo-stp_10.42.42.5(pid=29653): stderr: | 20221212164418432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164418432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164418432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164418433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164418433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164418433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164418433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:19.976223 run osmo-stp_10.42.42.5(pid=29653): stdout: | (launched: 2022-12-12_16:44:18.240185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:20.108801 run osmo-stp_10.42.42.5(pid=29653): stderr: | 20221212164418432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164418432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164418432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164418433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164418433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164418433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164418433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:20.266803 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29653): Process ended prematurely: osmo-stp_10.42.42.5(pid=29653) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29653)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:44:20.276605 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:44:20.304858 run osmo-hlr_10.42.42.2(pid=29650): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29650)] 16:44:20.355918 run osmo-hlr_10.42.42.2(pid=29650): stdout: | (launched: 2022-12-12_16:44:17.194416) 16:44:20.408239 run osmo-hlr_10.42.42.2(pid=29650): stderr: | 20221212164417389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164417389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164417389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164417390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164417390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164417390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164417402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164417410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164417410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164417410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:20.480874 run osmo-msc_10.42.42.6(pid=29656): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29656)] 16:44:20.531936 run osmo-msc_10.42.42.6(pid=29656): stdout: | (launched: 2022-12-12_16:44:19.308165) 16:44:20.584128 run osmo-msc_10.42.42.6(pid=29656): stderr: | 20221212164419630 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164419631 DLGLOBAL DEBUG validating counter group 0x7fd1d90b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164419631 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164419631 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164419631 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164419631 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164419633 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164419633 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164419633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164419634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:20.636369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29649): Terminating (SIGTERM) 16:44:20.678513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29652): Terminating (SIGTERM) 16:44:20.720431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29655): Terminating (SIGTERM) 16:44:20.762798 --- ParallelTerminationStrategy: PID 29649 died... 16:44:20.782956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29649): Terminated: ok {rc=0} 16:44:20.829912 --- ParallelTerminationStrategy: PID 29652 died... 16:44:20.849576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29652): Terminated: ok {rc=0} 16:44:20.896438 --- ParallelTerminationStrategy: PID 29655 died... 16:44:20.916093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29655): Terminated: ok {rc=0} 16:44:21.005544 bus /sierra_3: Setting Powered False 16:44:22.105167 bus /sierra_3: Setting Powered False 16:44:23.224497 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:44:24.372416 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:24.384508 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:44:24.454250 tst mo_mt_call_osmux.py: using LAC 30166 16:44:24.578254 tst mo_mt_call_osmux.py: using RAC 76 16:44:24.700563 tst mo_mt_call_osmux.py: using CellId 30166 16:44:24.823495 tst mo_mt_call_osmux.py: using BVCI 30167 16:44:24.938137 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:24.949434 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:24.960400 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:24.971428 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:24.982530 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:44:24.993505 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:44:25.115053 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:44:25.233427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:25.718387 run create_hlr_db(pid=29659): Launched 16:44:25.847746 bus /sierra_2: Setting Powered False 16:44:26.910138 run create_hlr_db(pid=29659): Terminated: ok {rc=0} 16:44:27.363380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29661): Launched 16:44:27.698565 run osmo-hlr_10.42.42.2(pid=29662): Launched 16:44:27.825424 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:28.402708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29664): Launched 16:44:28.738062 run osmo-stp_10.42.42.5(pid=29665): Launched 16:44:28.866156 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:29.472642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29667): Launched 16:44:29.807854 run osmo-msc_10.42.42.6(pid=29668): Launched 16:44:29.994930 run osmo-stp_10.42.42.5(pid=29665): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29665)] 16:44:30.136521 run osmo-stp_10.42.42.5(pid=29665): stdout: | (launched: 2022-12-12_16:44:28.676371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:30.278940 run osmo-stp_10.42.42.5(pid=29665): stderr: | 20221212164428869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164428869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164428870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164428870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164428871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164428871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164428871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:30.417125 run osmo-stp_10.42.42.5(pid=29665): stdout: | (launched: 2022-12-12_16:44:28.676371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:30.549930 run osmo-stp_10.42.42.5(pid=29665): stderr: | 20221212164428869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164428869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164428870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164428870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164428871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164428871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164428871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:30.708331 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29665): Process ended prematurely: osmo-stp_10.42.42.5(pid=29665) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29665)] [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:44:30.718199 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:44:30.746840 run osmo-hlr_10.42.42.2(pid=29662): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29662)] 16:44:30.798002 run osmo-hlr_10.42.42.2(pid=29662): stdout: | (launched: 2022-12-12_16:44:27.636746) 16:44:30.852102 run osmo-hlr_10.42.42.2(pid=29662): stderr: | 20221212164427833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164427834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164427834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164427834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164427834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164427834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164427849 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164427859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164427860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164427860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:30.931964 run osmo-msc_10.42.42.6(pid=29668): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29668)] 16:44:30.983632 run osmo-msc_10.42.42.6(pid=29668): stdout: | (launched: 2022-12-12_16:44:29.746063) 16:44:31.036784 run osmo-msc_10.42.42.6(pid=29668): stderr: | 20221212164430065 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164430065 DLGLOBAL DEBUG validating counter group 0x7f6de2242c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164430065 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164430065 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164430065 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164430065 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164430067 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164430068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164430068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164430068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:31.090333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29661): Terminating (SIGTERM) 16:44:31.133567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29664): Terminating (SIGTERM) 16:44:31.176517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29667): Terminating (SIGTERM) 16:44:31.219865 --- ParallelTerminationStrategy: PID 29661 died... 16:44:31.240369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29661): Terminated: ok {rc=0} 16:44:31.288478 --- ParallelTerminationStrategy: PID 29664 died... 16:44:31.308908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29664): Terminated: ok {rc=0} 16:44:31.357234 --- ParallelTerminationStrategy: PID 29667 died... 16:44:31.377492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29667): Terminated: ok {rc=0} 16:44:31.470285 bus /sierra_3: Setting Powered False 16:44:32.567945 bus /sierra_3: Setting Powered False 16:44:33.682693 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:44:34.938962 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:44:34.945960 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:44:34.978245 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:44:35.004595 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:44:35.057851 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:44:35.090358 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:44:35.116888 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:44:35.666030 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:44:35.715710 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:35.726878 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:44:35.795809 tst mo_mt_call.py: using LAC 30167 16:44:35.919498 tst mo_mt_call.py: using RAC 77 16:44:36.043140 tst mo_mt_call.py: using CellId 30167 16:44:36.173882 tst mo_mt_call.py: using BVCI 30168 16:44:36.294894 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:36.306765 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:36.318532 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:36.330535 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:36.342398 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:36.354122 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:44:36.470369 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:44:36.587984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:37.073121 run create_hlr_db(pid=29673): Launched 16:44:37.200218 bus /sierra_2: Setting Powered False 16:44:38.261129 run create_hlr_db(pid=29673): Terminated: ok {rc=0} 16:44:38.695438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29675): Launched 16:44:39.009635 run osmo-hlr_10.42.42.2(pid=29676): Launched 16:44:39.129718 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:39.663822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29678): Launched 16:44:39.976475 run osmo-stp_10.42.42.5(pid=29679): Launched 16:44:40.095228 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:40.657175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29681): Launched 16:44:40.971037 run osmo-msc_10.42.42.6(pid=29682): Launched 16:44:41.145583 run osmo-stp_10.42.42.5(pid=29679): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29679)] 16:44:41.277493 run osmo-stp_10.42.42.5(pid=29679): stdout: | (launched: 2022-12-12_16:44:39.918387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:41.408088 run osmo-stp_10.42.42.5(pid=29679): stderr: | 20221212164440089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164440089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164440089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164440090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164440090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164440090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164440090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:41.536590 run osmo-stp_10.42.42.5(pid=29679): stdout: | (launched: 2022-12-12_16:44:39.918387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:41.659744 run osmo-stp_10.42.42.5(pid=29679): stderr: | 20221212164440089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164440089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164440089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164440090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164440090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164440090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164440090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:41.806647 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29679): Process ended prematurely: osmo-stp_10.42.42.5(pid=29679) [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29679)] [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:44:41.815839 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:44:41.842495 run osmo-hlr_10.42.42.2(pid=29676): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29676)] 16:44:41.890016 run osmo-hlr_10.42.42.2(pid=29676): stdout: | (launched: 2022-12-12_16:44:38.951572) 16:44:41.939062 run osmo-hlr_10.42.42.2(pid=29676): stderr: | 20221212164439126 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164439126 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164439126 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164439126 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164439126 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164439126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164439137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164439145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164439145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164439145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:42.007507 run osmo-msc_10.42.42.6(pid=29682): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29682)] 16:44:42.054618 run osmo-msc_10.42.42.6(pid=29682): stdout: | (launched: 2022-12-12_16:44:40.912565) 16:44:42.103568 run osmo-msc_10.42.42.6(pid=29682): stderr: | 20221212164441182 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164441182 DLGLOBAL DEBUG validating counter group 0x7f9dd3f50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164441182 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164441182 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164441182 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164441183 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164441184 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164441185 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164441185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164441185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:42.152618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29675): Terminating (SIGTERM) 16:44:42.192036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29678): Terminating (SIGTERM) 16:44:42.231424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29681): Terminating (SIGTERM) 16:44:42.271142 --- ParallelTerminationStrategy: PID 29675 died... 16:44:42.290309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29675): Terminated: ok {rc=0} 16:44:42.334019 --- ParallelTerminationStrategy: PID 29678 died... 16:44:42.352429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29678): Terminated: ok {rc=0} 16:44:42.395908 --- ParallelTerminationStrategy: PID 29681 died... 16:44:42.414553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29681): Terminated: ok {rc=0} 16:44:42.500515 bus /sierra_3: Setting Powered False 16:44:43.600048 bus /sierra_3: Setting Powered False 16:44:44.713526 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:44:45.890467 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:45.904289 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:44:45.981644 tst mo_mt_call_osmux.py: using LAC 30168 16:44:46.116694 tst mo_mt_call_osmux.py: using RAC 78 16:44:46.289752 tst mo_mt_call_osmux.py: using CellId 30168 16:44:46.425709 tst mo_mt_call_osmux.py: using BVCI 30169 16:44:46.551273 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:46.564273 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:46.576848 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:46.590982 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:46.607027 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:44:46.619715 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:44:46.769577 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:44:46.909352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:47.438648 run create_hlr_db(pid=29685): Launched 16:44:47.569162 bus /sierra_2: Setting Powered False 16:44:48.631253 run create_hlr_db(pid=29685): Terminated: ok {rc=0} 16:44:49.088709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29687): Launched 16:44:49.424512 run osmo-hlr_10.42.42.2(pid=29688): Launched 16:44:49.553205 run osmo-stp_10.42.42.5: Starting osmo-stp 16:44:50.131497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29690): Launched 16:44:50.466249 run osmo-stp_10.42.42.5(pid=29691): Launched 16:44:50.593245 run osmo-msc_10.42.42.6: Starting osmo-msc 16:44:51.196869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29693): Launched 16:44:51.532462 run osmo-msc_10.42.42.6(pid=29694): Launched 16:44:51.720185 run osmo-stp_10.42.42.5(pid=29691): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29691)] 16:44:51.861123 run osmo-stp_10.42.42.5(pid=29691): stdout: | (launched: 2022-12-12_16:44:50.404310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:52.003962 run osmo-stp_10.42.42.5(pid=29691): stderr: | 20221212164450593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164450594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164450594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164450594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164450595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164450595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164450595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:52.143176 run osmo-stp_10.42.42.5(pid=29691): stdout: | (launched: 2022-12-12_16:44:50.404310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:44:52.276292 run osmo-stp_10.42.42.5(pid=29691): stderr: | 20221212164450593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164450594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164450594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164450594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164450595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164450595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164450595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:44:52.435679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29691): Process ended prematurely: osmo-stp_10.42.42.5(pid=29691) [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29691)] [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:44:52.445617 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 16:44:52.474365 run osmo-hlr_10.42.42.2(pid=29688): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29688)] 16:44:52.525288 run osmo-hlr_10.42.42.2(pid=29688): stdout: | (launched: 2022-12-12_16:44:49.362732) 16:44:52.577816 run osmo-hlr_10.42.42.2(pid=29688): stderr: | 20221212164449558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164449558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164449559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164449559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164449559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164449559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164449571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164449580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164449580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164449580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:44:52.651027 run osmo-msc_10.42.42.6(pid=29694): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29694)] 16:44:52.701704 run osmo-msc_10.42.42.6(pid=29694): stdout: | (launched: 2022-12-12_16:44:51.470676) 16:44:52.753955 run osmo-msc_10.42.42.6(pid=29694): stderr: | 20221212164451790 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164451790 DLGLOBAL DEBUG validating counter group 0x7f587bf3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164451790 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164451790 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164451790 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164451790 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164451792 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164451792 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164451793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164451793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:44:52.806866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29687): Terminating (SIGTERM) 16:44:52.849455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29690): Terminating (SIGTERM) 16:44:52.892404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29693): Terminating (SIGTERM) 16:44:52.935436 --- ParallelTerminationStrategy: PID 29687 died... 16:44:52.955854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29687): Terminated: ok {rc=0} 16:44:53.003298 --- ParallelTerminationStrategy: PID 29690 died... 16:44:53.023182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29690): Terminated: ok {rc=0} 16:44:53.070311 --- ParallelTerminationStrategy: PID 29693 died... 16:44:53.090088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29693): Terminated: ok {rc=0} 16:44:53.179389 bus /sierra_3: Setting Powered False 16:44:54.279572 bus /sierra_3: Setting Powered False 16:44:55.398462 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:44:56.647301 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:44:56.653250 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:44:56.685846 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:44:56.712237 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:44:56.763202 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:44:56.795447 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:44:56.821969 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:44:57.371859 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:44:57.421769 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:44:57.432677 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:44:57.501901 tst mo_mt_call.py: using LAC 30169 16:44:57.629656 tst mo_mt_call.py: using RAC 79 16:44:57.751492 tst mo_mt_call.py: using CellId 30169 16:44:57.882349 tst mo_mt_call.py: using BVCI 30170 16:44:58.003673 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:44:58.015319 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:44:58.026806 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:44:58.038917 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:44:58.050968 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:44:58.063365 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:44:58.181418 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:44:58.297373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:44:58.782341 run create_hlr_db(pid=29699): Launched 16:44:58.911632 bus /sierra_2: Setting Powered False 16:44:59.974049 run create_hlr_db(pid=29699): Terminated: ok {rc=0} 16:45:00.430720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29701): Launched 16:45:00.766298 run osmo-hlr_10.42.42.2(pid=29702): Launched 16:45:00.897876 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:01.577468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29704): Launched 16:45:01.927549 run osmo-stp_10.42.42.5(pid=29708): Launched 16:45:02.187354 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:02.784853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29710): Launched 16:45:03.098896 run osmo-msc_10.42.42.6(pid=29711): Launched 16:45:03.272616 run osmo-stp_10.42.42.5(pid=29708): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29708)] 16:45:03.402551 run osmo-stp_10.42.42.5(pid=29708): stdout: | (launched: 2022-12-12_16:45:01.852815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:03.532205 run osmo-stp_10.42.42.5(pid=29708): stderr: | 20221212164502077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164502077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164502078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164502078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164502079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164502079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164502079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:03.661311 run osmo-stp_10.42.42.5(pid=29708): stdout: | (launched: 2022-12-12_16:45:01.852815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:03.784670 run osmo-stp_10.42.42.5(pid=29708): stderr: | 20221212164502077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164502077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164502078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164502078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164502079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164502079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164502079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:03.932805 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29708): Process ended prematurely: osmo-stp_10.42.42.5(pid=29708) [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29708)] [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:45:03.941786 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 16:45:03.968243 run osmo-hlr_10.42.42.2(pid=29702): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29702)] 16:45:04.016217 run osmo-hlr_10.42.42.2(pid=29702): stdout: | (launched: 2022-12-12_16:45:00.704393) 16:45:04.065646 run osmo-hlr_10.42.42.2(pid=29702): stderr: | 20221212164501059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164501059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164501059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164501059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164501059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164501059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164501083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164501099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164501099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164501099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:04.135137 run osmo-msc_10.42.42.6(pid=29711): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29711)] 16:45:04.183118 run osmo-msc_10.42.42.6(pid=29711): stdout: | (launched: 2022-12-12_16:45:03.040749) 16:45:04.232690 run osmo-msc_10.42.42.6(pid=29711): stderr: | 20221212164503313 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164503313 DLGLOBAL DEBUG validating counter group 0x7fba8dea0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164503313 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164503313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164503314 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164503314 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164503315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164503316 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164503316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164503316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:04.282594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29701): Terminating (SIGTERM) 16:45:04.322442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29704): Terminating (SIGTERM) 16:45:04.362262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29710): Terminating (SIGTERM) 16:45:04.402281 --- ParallelTerminationStrategy: PID 29701 died... 16:45:04.421497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29701): Terminated: ok {rc=0} 16:45:04.465638 --- ParallelTerminationStrategy: PID 29704 died... 16:45:04.484041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29704): Terminated: ok {rc=0} 16:45:04.528043 --- ParallelTerminationStrategy: PID 29710 died... 16:45:04.546852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29710): Terminated: ok {rc=0} 16:45:04.631523 bus /sierra_3: Setting Powered False 16:45:05.733851 bus /sierra_3: Setting Powered False 16:45:06.850504 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:45:08.002357 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:45:08.015143 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:45:08.091442 tst mo_mt_call_osmux.py: using LAC 30170 16:45:08.222328 tst mo_mt_call_osmux.py: using RAC 80 16:45:08.353176 tst mo_mt_call_osmux.py: using CellId 30170 16:45:08.482248 tst mo_mt_call_osmux.py: using BVCI 30171 16:45:08.605650 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:45:08.617434 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:45:08.628899 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:45:08.640816 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:45:08.652681 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:45:08.664881 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:45:08.786335 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:45:08.908336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:09.429342 run create_hlr_db(pid=29713): Launched 16:45:09.555935 bus /sierra_2: Setting Powered False 16:45:10.621642 run create_hlr_db(pid=29713): Terminated: ok {rc=0} 16:45:11.067486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29715): Launched 16:45:11.380605 run osmo-hlr_10.42.42.2(pid=29716): Launched 16:45:11.498816 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:12.036763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29718): Launched 16:45:12.348532 run osmo-stp_10.42.42.5(pid=29719): Launched 16:45:12.467699 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:13.037673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29721): Launched 16:45:13.350109 run osmo-msc_10.42.42.6(pid=29722): Launched 16:45:13.525641 run osmo-stp_10.42.42.5(pid=29719): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29719)] 16:45:13.656744 run osmo-stp_10.42.42.5(pid=29719): stdout: | (launched: 2022-12-12_16:45:12.289820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:13.787929 run osmo-stp_10.42.42.5(pid=29719): stderr: | 20221212164512459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164512459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164512460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164512460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164512461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164512461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164512461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:13.917650 run osmo-stp_10.42.42.5(pid=29719): stdout: | (launched: 2022-12-12_16:45:12.289820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:14.041169 run osmo-stp_10.42.42.5(pid=29719): stderr: | 20221212164512459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164512459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164512460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164512460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164512461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164512461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164512461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:14.189477 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29719): Process ended prematurely: osmo-stp_10.42.42.5(pid=29719) [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29719)] [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:45:14.198778 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:45:14.225796 run osmo-hlr_10.42.42.2(pid=29716): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29716)] 16:45:14.273832 run osmo-hlr_10.42.42.2(pid=29716): stdout: | (launched: 2022-12-12_16:45:11.322603) 16:45:14.323757 run osmo-hlr_10.42.42.2(pid=29716): stderr: | 20221212164511496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164511496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164511496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164511497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164511497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164511497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164511509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164511517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164511518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164511518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:14.393338 run osmo-msc_10.42.42.6(pid=29722): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29722)] 16:45:14.442087 run osmo-msc_10.42.42.6(pid=29722): stdout: | (launched: 2022-12-12_16:45:13.291140) 16:45:14.491890 run osmo-msc_10.42.42.6(pid=29722): stderr: | 20221212164513563 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164513564 DLGLOBAL DEBUG validating counter group 0x7f1e00294c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164513564 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164513564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164513564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164513564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164513566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164513567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164513567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164513567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:14.542142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29715): Terminating (SIGTERM) 16:45:14.582757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29718): Terminating (SIGTERM) 16:45:14.622989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29721): Terminating (SIGTERM) 16:45:14.663344 --- ParallelTerminationStrategy: PID 29715 died... 16:45:14.682627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29715): Terminated: ok {rc=0} 16:45:14.727063 --- ParallelTerminationStrategy: PID 29718 died... 16:45:14.746007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29718): Terminated: ok {rc=0} 16:45:14.789965 --- ParallelTerminationStrategy: PID 29721 died... 16:45:14.808848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29721): Terminated: ok {rc=0} 16:45:14.893773 bus /sierra_3: Setting Powered False 16:45:15.997876 bus /sierra_3: Setting Powered False 16:45:17.129695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:45:18.379357 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:18.385455 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:45:18.417721 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 16:45:18.444165 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 16:45:18.495639 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:45:18.527682 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 16:45:18.553830 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 16:45:19.106764 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 16:45:19.156769 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:19.168359 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:45:19.220405 tst mo_mt_call.py: using LAC 30171 16:45:19.345696 tst mo_mt_call.py: using RAC 81 16:45:19.479383 tst mo_mt_call.py: using CellId 30171 16:45:19.607796 tst mo_mt_call.py: using BVCI 30172 16:45:19.728843 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:19.741012 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:19.752666 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:19.764648 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:19.776688 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:19.788693 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:19.909963 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:20.029262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:20.513231 run create_hlr_db(pid=29727): Launched 16:45:20.640691 bus /sierra_2: Setting Powered False 16:45:21.702548 run create_hlr_db(pid=29727): Terminated: ok {rc=0} 16:45:22.156721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29729): Launched 16:45:22.492204 run osmo-hlr_10.42.42.2(pid=29730): Launched 16:45:22.620116 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:23.196125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29732): Launched 16:45:23.531374 run osmo-stp_10.42.42.5(pid=29733): Launched 16:45:23.660054 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:24.264271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29735): Launched 16:45:24.600802 run osmo-msc_10.42.42.6(pid=29736): Launched 16:45:24.787706 run osmo-stp_10.42.42.5(pid=29733): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29733)] 16:45:24.928436 run osmo-stp_10.42.42.5(pid=29733): stdout: | (launched: 2022-12-12_16:45:23.469789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:25.069602 run osmo-stp_10.42.42.5(pid=29733): stderr: | 20221212164523660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164523660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164523660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164523661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164523661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164523661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164523661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:25.209580 run osmo-stp_10.42.42.5(pid=29733): stdout: | (launched: 2022-12-12_16:45:23.469789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:25.342637 run osmo-stp_10.42.42.5(pid=29733): stderr: | 20221212164523660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164523660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164523660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164523661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164523661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164523661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164523661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:25.501754 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29733): Process ended prematurely: osmo-stp_10.42.42.5(pid=29733) [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29733)] [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 16:45:25.511729 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:45:25.540577 run osmo-hlr_10.42.42.2(pid=29730): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29730)] 16:45:25.591390 run osmo-hlr_10.42.42.2(pid=29730): stdout: | (launched: 2022-12-12_16:45:22.430633) 16:45:25.643951 run osmo-hlr_10.42.42.2(pid=29730): stderr: | 20221212164522627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164522627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164522627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164522627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164522627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164522627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164522639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164522650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164522650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164522650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:25.717122 run osmo-msc_10.42.42.6(pid=29736): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29736)] 16:45:25.767979 run osmo-msc_10.42.42.6(pid=29736): stdout: | (launched: 2022-12-12_16:45:24.538767) 16:45:25.820428 run osmo-msc_10.42.42.6(pid=29736): stderr: | 20221212164524861 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164524862 DLGLOBAL DEBUG validating counter group 0x7fa26acfdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164524862 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164524862 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164524862 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164524862 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164524864 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164524864 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164524864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164524864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:25.873423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29729): Terminating (SIGTERM) 16:45:25.916343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29732): Terminating (SIGTERM) 16:45:25.959206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29735): Terminating (SIGTERM) 16:45:26.002210 --- ParallelTerminationStrategy: PID 29729 died... 16:45:26.022517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29729): Terminated: ok {rc=0} 16:45:26.070007 --- ParallelTerminationStrategy: PID 29732 died... 16:45:26.089844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29732): Terminated: ok {rc=0} 16:45:26.137038 --- ParallelTerminationStrategy: PID 29735 died... 16:45:26.156878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29735): Terminated: ok {rc=0} 16:45:26.245865 bus /sierra_3: Setting Powered False 16:45:27.345381 bus /sierra_3: Setting Powered False 16:45:28.461794 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 16:45:29.609133 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:29.621412 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:45:29.674179 tst mo_mt_call_osmux.py: using LAC 30172 16:45:29.797115 tst mo_mt_call_osmux.py: using RAC 82 16:45:29.919818 tst mo_mt_call_osmux.py: using CellId 30172 16:45:30.042635 tst mo_mt_call_osmux.py: using BVCI 30173 16:45:30.157457 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:30.168825 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:30.180002 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:30.191341 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:30.202688 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 16:45:30.214613 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:30.332386 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 16:45:30.455887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:31.013909 run create_hlr_db(pid=29738): Launched 16:45:31.178444 bus /sierra_2: Setting Powered False 16:45:32.240370 run create_hlr_db(pid=29738): Terminated: ok {rc=0} 16:45:32.708384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29740): Launched 16:45:33.044545 run osmo-hlr_10.42.42.2(pid=29741): Launched 16:45:33.172735 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:33.749966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29743): Launched 16:45:34.084639 run osmo-stp_10.42.42.5(pid=29744): Launched 16:45:34.212800 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:34.816019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29746): Launched 16:45:35.151632 run osmo-msc_10.42.42.6(pid=29747): Launched 16:45:35.339921 run osmo-stp_10.42.42.5(pid=29744): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29744)] 16:45:35.483268 run osmo-stp_10.42.42.5(pid=29744): stdout: | (launched: 2022-12-12_16:45:34.022790) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:35.625751 run osmo-stp_10.42.42.5(pid=29744): stderr: | 20221212164534214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164534214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164534214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164534215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164534215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164534215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164534215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:35.764432 run osmo-stp_10.42.42.5(pid=29744): stdout: | (launched: 2022-12-12_16:45:34.022790) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:35.897801 run osmo-stp_10.42.42.5(pid=29744): stderr: | 20221212164534214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164534214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164534214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164534215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164534215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164534215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164534215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:36.057543 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29744): Process ended prematurely: osmo-stp_10.42.42.5(pid=29744) [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29744)] [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 16:45:36.067366 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 16:45:36.095934 run osmo-hlr_10.42.42.2(pid=29741): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29741)] 16:45:36.146414 run osmo-hlr_10.42.42.2(pid=29741): stdout: | (launched: 2022-12-12_16:45:32.983024) 16:45:36.198746 run osmo-hlr_10.42.42.2(pid=29741): stderr: | 20221212164533179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164533179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164533179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164533179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164533179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164533179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164533191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164533202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164533202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164533202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:36.271633 run osmo-msc_10.42.42.6(pid=29747): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29747)] 16:45:36.322091 run osmo-msc_10.42.42.6(pid=29747): stdout: | (launched: 2022-12-12_16:45:35.089451) 16:45:36.374060 run osmo-msc_10.42.42.6(pid=29747): stderr: | 20221212164535411 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164535411 DLGLOBAL DEBUG validating counter group 0x7f789899ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164535411 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164535411 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164535412 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164535412 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164535414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164535414 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164535414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164535414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:36.426505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29740): Terminating (SIGTERM) 16:45:36.468472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29743): Terminating (SIGTERM) 16:45:36.510558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29746): Terminating (SIGTERM) 16:45:36.552728 --- ParallelTerminationStrategy: PID 29740 died... 16:45:36.572825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29740): Terminated: ok {rc=0} 16:45:36.619478 --- ParallelTerminationStrategy: PID 29743 died... 16:45:36.639026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29743): Terminated: ok {rc=0} 16:45:36.685699 --- ParallelTerminationStrategy: PID 29746 died... 16:45:36.705438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29746): Terminated: ok {rc=0} 16:45:36.794446 bus /sierra_3: Setting Powered False 16:45:37.895774 bus /sierra_3: Setting Powered False 16:45:39.011270 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 emergency:trx-umtrx --------------------------------------------------------------------- 16:45:40.257491 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:45:40.261969 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:45:40.294237 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 16:45:40.320699 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 16:45:40.407632 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:45:40.442270 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 16:45:40.470040 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 16:45:41.045750 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2379 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 16:45:41.050732 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:41.061562 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 16:45:41.110805 tst emergency_mo_mt_call.py: using LAC 30173 16:45:41.233326 tst emergency_mo_mt_call.py: using RAC 83 16:45:41.353122 tst emergency_mo_mt_call.py: using CellId 30173 16:45:41.472619 tst emergency_mo_mt_call.py: using BVCI 30174 16:45:41.585096 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:41.595822 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:41.606304 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:41.616809 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:41.627311 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:41.637804 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:45:41.755240 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:45:41.872572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:42.348896 run create_hlr_db(pid=29752): Launched 16:45:42.473726 bus /sierra_2: Setting Powered False 16:45:43.535021 run create_hlr_db(pid=29752): Terminated: ok {rc=0} 16:45:43.962843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29754): Launched 16:45:44.272293 run osmo-hlr_10.42.42.2(pid=29755): Launched 16:45:44.389807 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:44.917535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29757): Launched 16:45:45.227630 run osmo-stp_10.42.42.5(pid=29758): Launched 16:45:45.355558 tst emergency_mo_mt_call.py: using MSISDN 7868 16:45:45.520438 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:46.103568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29760): Launched 16:45:46.431854 run osmo-msc_10.42.42.6(pid=29761): Launched 16:45:46.880060 run osmo-stp_10.42.42.5(pid=29758): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29758)] 16:45:47.280379 run osmo-stp_10.42.42.5(pid=29758): stdout: | (launched: 2022-12-12_16:45:45.169897) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:47.423040 run osmo-stp_10.42.42.5(pid=29758): stderr: | 20221212164545338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164545339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164545339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164545339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164545340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164545340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164545340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:47.552401 run osmo-stp_10.42.42.5(pid=29758): stdout: | (launched: 2022-12-12_16:45:45.169897) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:47.674947 run osmo-stp_10.42.42.5(pid=29758): stderr: | 20221212164545338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164545339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164545339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164545339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164545340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164545340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164545340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:47.821050 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29758): Process ended prematurely: osmo-stp_10.42.42.5(pid=29758) [trial-2379↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29758)] [trial-2379↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 16:45:47.829685 tst emergency_mo_mt_call.py:19: Test FAILED (6.8 sec) 16:45:47.856109 run osmo-hlr_10.42.42.2(pid=29755): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29755)] 16:45:47.904183 run osmo-hlr_10.42.42.2(pid=29755): stdout: | (launched: 2022-12-12_16:45:44.214717) 16:45:47.954350 run osmo-hlr_10.42.42.2(pid=29755): stderr: | 20221212164544391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164544391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164544391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164544391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164544391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164544391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164544404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164544415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164544415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164544415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:48.024326 run osmo-msc_10.42.42.6(pid=29761): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29761)] 16:45:48.072627 run osmo-msc_10.42.42.6(pid=29761): stdout: | (launched: 2022-12-12_16:45:46.372430) 16:45:48.122572 run osmo-msc_10.42.42.6(pid=29761): stderr: | 20221212164546950 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164546950 DLGLOBAL DEBUG validating counter group 0x7efde9958c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164546950 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164546950 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164546950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164546951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164546952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164546953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164546953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164546953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:48.172747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29754): Terminating (SIGTERM) 16:45:48.213026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29757): Terminating (SIGTERM) 16:45:48.253269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29760): Terminating (SIGTERM) 16:45:48.293666 --- ParallelTerminationStrategy: PID 29754 died... 16:45:48.313098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29754): Terminated: ok {rc=0} 16:45:48.357548 --- ParallelTerminationStrategy: PID 29757 died... 16:45:48.376317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29757): Terminated: ok {rc=0} 16:45:48.420637 --- ParallelTerminationStrategy: PID 29760 died... 16:45:48.439487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29760): Terminated: ok {rc=0} 16:45:48.526664 bus /sierra_3: Setting Powered False 16:45:49.628272 bus /sierra_3: Setting Powered False 16:45:50.744625 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 16:45:51.834687 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:51.846912 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 16:45:51.901196 tst emergency_preemptive_call.py: using LAC 30174 16:45:52.034128 tst emergency_preemptive_call.py: using RAC 84 16:45:52.162650 tst emergency_preemptive_call.py: using CellId 30174 16:45:52.289636 tst emergency_preemptive_call.py: using BVCI 30175 16:45:52.401331 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:52.412055 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:52.422749 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:52.433247 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:52.443773 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 16:45:52.454305 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:45:52.573515 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:45:52.695258 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:45:52.812061 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 16:45:52.929785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:45:53.442584 run create_hlr_db(pid=29763): Launched 16:45:53.570813 bus /sierra_2: Setting Powered False 16:45:54.635409 run create_hlr_db(pid=29763): Terminated: ok {rc=0} 16:45:55.074993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29765): Launched 16:45:55.385534 run osmo-hlr_10.42.42.2(pid=29766): Launched 16:45:55.502614 run osmo-stp_10.42.42.5: Starting osmo-stp 16:45:56.032429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29768): Launched 16:45:56.341580 run osmo-stp_10.42.42.5(pid=29769): Launched 16:45:56.467640 tst emergency_preemptive_call.py: using MSISDN 7869 16:45:56.622754 run osmo-msc_10.42.42.6: Starting osmo-msc 16:45:57.174499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29771): Launched 16:45:57.482748 run osmo-msc_10.42.42.6(pid=29772): Launched 16:45:57.654420 run osmo-stp_10.42.42.5(pid=29769): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29769)] 16:45:57.784592 run osmo-stp_10.42.42.5(pid=29769): stdout: | (launched: 2022-12-12_16:45:56.283894) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:57.913444 run osmo-stp_10.42.42.5(pid=29769): stderr: | 20221212164556454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164556454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164556454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164556455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164556455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164556455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164556455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:58.040832 run osmo-stp_10.42.42.5(pid=29769): stdout: | (launched: 2022-12-12_16:45:56.283894) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:45:58.162483 run osmo-stp_10.42.42.5(pid=29769): stderr: | 20221212164556454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164556454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164556454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164556455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164556455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164556455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164556455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:45:58.307759 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29769): Process ended prematurely: osmo-stp_10.42.42.5(pid=29769) [trial-2379↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29769)] [trial-2379↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 16:45:58.316231 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 16:45:58.342618 run osmo-hlr_10.42.42.2(pid=29766): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29766)] 16:45:58.390647 run osmo-hlr_10.42.42.2(pid=29766): stdout: | (launched: 2022-12-12_16:45:55.327911) 16:45:58.440321 run osmo-hlr_10.42.42.2(pid=29766): stderr: | 20221212164555502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164555503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164555503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164555503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164555503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164555503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164555515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164555523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164555523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164555523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:45:58.509895 run osmo-msc_10.42.42.6(pid=29772): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29772)] 16:45:58.557568 run osmo-msc_10.42.42.6(pid=29772): stdout: | (launched: 2022-12-12_16:45:57.424641) 16:45:58.607140 run osmo-msc_10.42.42.6(pid=29772): stderr: | 20221212164557697 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212164557698 DLGLOBAL DEBUG validating counter group 0x7ff576452c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212164557698 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212164557698 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212164557698 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212164557698 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212164557700 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212164557700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212164557701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212164557701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:45:58.656723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29765): Terminating (SIGTERM) 16:45:58.696565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29768): Terminating (SIGTERM) 16:45:58.736242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29771): Terminating (SIGTERM) 16:45:58.776438 --- ParallelTerminationStrategy: PID 29765 died... 16:45:58.795797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29765): Terminated: ok {rc=0} 16:45:58.839884 --- ParallelTerminationStrategy: PID 29768 died... 16:45:58.858697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29768): Terminated: ok {rc=0} 16:45:58.902604 --- ParallelTerminationStrategy: PID 29771 died... 16:45:58.921371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29771): Terminated: ok {rc=0} 16:45:59.008161 bus /sierra_9: Setting Powered False 16:46:00.108473 bus /sierra_9: Setting Powered False 16:46:01.223583 bus /sierra_8: Setting Powered False 16:46:02.325227 bus /sierra_8: Setting Powered False 16:46:03.442922 bus /sierra_3: Setting Powered False 16:46:04.541920 bus /sierra_3: Setting Powered False 16:46:05.659524 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx --------------------------------------------------------------------- 16:46:06.938423 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:46:06.943183 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 16:46:06.977394 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 16:46:07.017224 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 16:46:07.106090 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 16:46:07.139823 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 16:46:07.179732 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 16:46:07.770230 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 16:46:07.824853 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:07.836222 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:46:07.885433 tst cs_paging_gprs_active.py: using LAC 30175 16:46:08.016822 tst cs_paging_gprs_active.py: using RAC 85 16:46:08.148048 tst cs_paging_gprs_active.py: using CellId 30175 16:46:08.280782 tst cs_paging_gprs_active.py: using BVCI 30176 16:46:08.403567 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:08.415174 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:08.426129 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:08.437091 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:08.448288 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:08.459608 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:08.470995 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:08.482146 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:08.493539 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:46:08.611391 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:46:08.732317 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:46:08.960637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:09.298076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29777): Launched 16:46:09.592630 run iperf3-srv_10.42.42.10(pid=29778): Launched 16:46:09.721008 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:46:09.948066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:10.285887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29779): Launched 16:46:10.579963 run iperf3-srv_10.42.42.10(pid=29780): Launched 16:46:10.707497 tst cs_paging_gprs_active.py:38: start network... 16:46:10.934423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:11.455593 run create_hlr_db(pid=29781): Launched 16:46:11.584801 bus /sierra_2: Setting Powered False 16:46:12.651372 run create_hlr_db(pid=29781): Terminated: ok {rc=0} 16:46:13.097693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29783): Launched 16:46:13.413455 run osmo-hlr_10.42.42.2(pid=29784): Launched 16:46:13.533592 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:14.083927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29786): Launched 16:46:14.399347 run osmo-stp_10.42.42.5(pid=29787): Launched 16:46:14.519936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:15.057612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29789): Launched 16:46:15.176363 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:15.441932 run patchelf(pid=29790): Launched 16:46:15.614742 run osmo-stp_10.42.42.5(pid=29787): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)] 16:46:15.746237 run osmo-stp_10.42.42.5(pid=29787): stdout: | (launched: 2022-12-12_16:46:14.340435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:15.899596 run osmo-stp_10.42.42.5(pid=29787): stderr: | 20221212164614511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164614511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164614511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164614512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164614512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164614512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164614513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:16.048584 run osmo-stp_10.42.42.5(pid=29787): stdout: | (launched: 2022-12-12_16:46:14.340435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:16.189869 run osmo-stp_10.42.42.5(pid=29787): stderr: | 20221212164614511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164614511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164614511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164614512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164614512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164614512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164614513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:16.358672 run patchelf(pid=29790): Terminating (SIGINT) 16:46:16.547522 run patchelf(pid=29790): Terminated: ok {rc=0} 16:46:16.676142 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29787): Process ended prematurely: osmo-stp_10.42.42.5(pid=29787) [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)] [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 16:46:16.686543 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 16:46:16.714617 run osmo-hlr_10.42.42.2(pid=29784): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29784)] 16:46:16.763322 run osmo-hlr_10.42.42.2(pid=29784): stdout: | (launched: 2022-12-12_16:46:13.354032) 16:46:16.814172 run osmo-hlr_10.42.42.2(pid=29784): stderr: | 20221212164613529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164613529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164613529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164613529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164613529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164613529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164613541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164613549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164613550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164613550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:16.864843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29777): Terminating (SIGTERM) 16:46:16.906178 run iperf3-srv_10.42.42.10(pid=29778): Terminating (SIGTERM) 16:46:16.950333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29779): Terminating (SIGTERM) 16:46:16.992142 run iperf3-srv_10.42.42.10(pid=29780): Terminating (SIGTERM) 16:46:17.036098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29783): Terminating (SIGTERM) 16:46:17.077469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29786): Terminating (SIGTERM) 16:46:17.117854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29789): Terminating (SIGTERM) 16:46:17.158902 --- ParallelTerminationStrategy: PID 29777 died... 16:46:17.178323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29777): Terminated: ok {rc=0} 16:46:17.222446 --- ParallelTerminationStrategy: PID 29778 died... 16:46:17.240851 run iperf3-srv_10.42.42.10(pid=29778): Terminated {rc=256} 16:46:17.284389 --- ParallelTerminationStrategy: PID 29779 died... 16:46:17.302930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29779): Terminated: ok {rc=0} 16:46:17.346712 --- ParallelTerminationStrategy: PID 29780 died... 16:46:17.365279 run iperf3-srv_10.42.42.10(pid=29780): Terminated {rc=256} 16:46:17.409347 --- ParallelTerminationStrategy: PID 29783 died... 16:46:17.428023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29783): Terminated: ok {rc=0} 16:46:17.471726 --- ParallelTerminationStrategy: PID 29786 died... 16:46:17.490538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29786): Terminated: ok {rc=0} 16:46:17.534196 --- ParallelTerminationStrategy: PID 29789 died... 16:46:17.552792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29789): Terminated: ok {rc=0} 16:46:17.636610 bus /gobi_0: Setting Powered False 16:46:18.735290 bus /gobi_0: Setting Powered False 16:46:19.855394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx iperf3.py ---------------------------------------------- 16:46:21.002805 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:21.014182 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:46:21.064619 tst iperf3.py: using LAC 30176 16:46:21.186812 tst iperf3.py: using RAC 86 16:46:21.312213 tst iperf3.py: using CellId 30176 16:46:21.437090 tst iperf3.py: using BVCI 30177 16:46:21.553595 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:21.564317 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:21.574958 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:21.585574 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:21.595935 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:21.606399 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:21.616922 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:21.627409 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:21.638001 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:46:21.755314 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:46:21.983401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:22.320477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29791): Launched 16:46:22.612569 run iperf3-srv_10.42.42.10(pid=29792): Launched 16:46:22.739415 tst iperf3.py:8: start network... 16:46:22.965423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:23.484693 run create_hlr_db(pid=29793): Launched 16:46:23.614063 bus /gobi_6: Setting Powered False 16:46:24.679548 run create_hlr_db(pid=29793): Terminated: ok {rc=0} 16:46:25.126089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29795): Launched 16:46:25.439667 run osmo-hlr_10.42.42.2(pid=29796): Launched 16:46:25.561508 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:26.114661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29798): Launched 16:46:26.427341 run osmo-stp_10.42.42.5(pid=29799): Launched 16:46:26.546699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:27.083758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29801): Launched 16:46:27.203618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:27.468103 run patchelf(pid=29802): Launched 16:46:27.643064 run osmo-stp_10.42.42.5(pid=29799): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)] 16:46:27.774975 run osmo-stp_10.42.42.5(pid=29799): stdout: | (launched: 2022-12-12_16:46:26.369229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:27.908225 run osmo-stp_10.42.42.5(pid=29799): stderr: | 20221212164626537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164626537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164626537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164626538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164626538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164626538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164626538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:28.041854 run osmo-stp_10.42.42.5(pid=29799): stdout: | (launched: 2022-12-12_16:46:26.369229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:28.169468 run osmo-stp_10.42.42.5(pid=29799): stderr: | 20221212164626537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164626537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164626537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164626538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164626538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164626538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164626538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:28.320368 run patchelf(pid=29802): Terminating (SIGINT) 16:46:28.494346 run patchelf(pid=29802): Terminated: ok {rc=0} 16:46:28.619263 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29799): Process ended prematurely: osmo-stp_10.42.42.5(pid=29799) [trial-2379↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)] [trial-2379↪gprs:trx-umtrx↪iperf3.py:8] 16:46:28.628726 tst iperf3.py:8: Test FAILED (7.7 sec) 16:46:28.655957 run osmo-hlr_10.42.42.2(pid=29796): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29796)] 16:46:28.703469 run osmo-hlr_10.42.42.2(pid=29796): stdout: | (launched: 2022-12-12_16:46:25.381162) 16:46:28.752462 run osmo-hlr_10.42.42.2(pid=29796): stderr: | 20221212164625556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164625556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164625556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164625556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164625556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164625556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164625568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164625576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164625577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164625577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:28.801795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29791): Terminating (SIGTERM) 16:46:28.841789 run iperf3-srv_10.42.42.10(pid=29792): Terminating (SIGTERM) 16:46:28.881398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29795): Terminating (SIGTERM) 16:46:28.921080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29798): Terminating (SIGTERM) 16:46:28.960856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29801): Terminating (SIGTERM) 16:46:29.001072 --- ParallelTerminationStrategy: PID 29791 died... 16:46:29.020174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29791): Terminated: ok {rc=0} 16:46:29.064166 --- ParallelTerminationStrategy: PID 29792 died... 16:46:29.082842 run iperf3-srv_10.42.42.10(pid=29792): Terminated {rc=256} 16:46:29.126569 --- ParallelTerminationStrategy: PID 29795 died... 16:46:29.145270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29795): Terminated: ok {rc=0} 16:46:29.188890 --- ParallelTerminationStrategy: PID 29798 died... 16:46:29.208156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29798): Terminated: ok {rc=0} 16:46:29.252620 --- ParallelTerminationStrategy: PID 29801 died... 16:46:29.271350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29801): Terminated: ok {rc=0} 16:46:29.355509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 16:46:30.506405 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:30.518583 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:46:30.569791 tst iperf3m4.py: using LAC 30177 16:46:30.702779 tst iperf3m4.py: using RAC 87 16:46:30.846462 tst iperf3m4.py: using CellId 30177 16:46:30.997227 tst iperf3m4.py: using BVCI 30178 16:46:31.160166 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:31.176921 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:31.194808 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:31.210741 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:31.225770 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:31.241758 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:31.259478 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:31.277073 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:31.294819 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:46:31.433298 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:46:31.566354 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:46:31.720011 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:46:31.872674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:46:32.102637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:32.425378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29803): Launched 16:46:32.698525 run iperf3-srv_10.42.42.10(pid=29804): Launched 16:46:32.817532 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:46:33.026030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:33.339847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29805): Launched 16:46:33.615028 run iperf3-srv_10.42.42.10(pid=29806): Launched 16:46:33.731600 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:46:33.940610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:34.254638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29807): Launched 16:46:34.528308 run iperf3-srv_10.42.42.10(pid=29808): Launched 16:46:34.647189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:46:34.856313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:46:35.170353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29809): Launched 16:46:35.444864 run iperf3-srv_10.42.42.10(pid=29810): Launched 16:46:35.562118 tst iperf3m4.py:8: start network... 16:46:35.770034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:36.253679 run create_hlr_db(pid=29811): Launched 16:46:36.380112 bus /gobi_6: Setting Powered False 16:46:37.442037 run create_hlr_db(pid=29811): Terminated: ok {rc=0} 16:46:37.897271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29813): Launched 16:46:38.233517 run osmo-hlr_10.42.42.2(pid=29814): Launched 16:46:38.363381 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:38.940597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29816): Launched 16:46:39.276800 run osmo-stp_10.42.42.5(pid=29817): Launched 16:46:39.406626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:39.986134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29819): Launched 16:46:40.115338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:40.400091 run patchelf(pid=29820): Launched 16:46:40.587870 run osmo-stp_10.42.42.5(pid=29817): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29817)] 16:46:40.728806 run osmo-stp_10.42.42.5(pid=29817): stdout: | (launched: 2022-12-12_16:46:39.214989) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:40.872348 run osmo-stp_10.42.42.5(pid=29817): stderr: | 20221212164639405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164639405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164639405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164639406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164639406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164639406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164639406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:41.015872 run osmo-stp_10.42.42.5(pid=29817): stdout: | (launched: 2022-12-12_16:46:39.214989) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:41.153198 run osmo-stp_10.42.42.5(pid=29817): stderr: | 20221212164639405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164639405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164639405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164639406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164639406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164639406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164639406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:41.315513 run patchelf(pid=29820): Terminating (SIGINT) 16:46:41.501590 run patchelf(pid=29820): Terminated: ok {rc=0} 16:46:41.636582 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29817): Process ended prematurely: osmo-stp_10.42.42.5(pid=29817) [trial-2379↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29817)] [trial-2379↪gprs:trx-umtrx↪iperf3m4.py:8] 16:46:41.647151 tst iperf3m4.py:8: Test FAILED (11.2 sec) 16:46:41.676775 run osmo-hlr_10.42.42.2(pid=29814): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29814)] 16:46:41.727637 run osmo-hlr_10.42.42.2(pid=29814): stdout: | (launched: 2022-12-12_16:46:38.171624) 16:46:41.780255 run osmo-hlr_10.42.42.2(pid=29814): stderr: | 20221212164638367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164638367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164638367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164638367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164638367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164638367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164638380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164638390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164638390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164638390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:41.833192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29803): Terminating (SIGTERM) 16:46:41.875519 run iperf3-srv_10.42.42.10(pid=29804): Terminating (SIGTERM) 16:46:41.917826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29805): Terminating (SIGTERM) 16:46:41.960726 run iperf3-srv_10.42.42.10(pid=29806): Terminating (SIGTERM) 16:46:42.006271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29807): Terminating (SIGTERM) 16:46:42.049005 run iperf3-srv_10.42.42.10(pid=29808): Terminating (SIGTERM) 16:46:42.091108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29809): Terminating (SIGTERM) 16:46:42.133226 run iperf3-srv_10.42.42.10(pid=29810): Terminating (SIGTERM) 16:46:42.175196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29813): Terminating (SIGTERM) 16:46:42.217608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29816): Terminating (SIGTERM) 16:46:42.259752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29819): Terminating (SIGTERM) 16:46:42.302355 --- ParallelTerminationStrategy: PID 29803 died... 16:46:42.322478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29803): Terminated: ok {rc=0} 16:46:42.369760 --- ParallelTerminationStrategy: PID 29804 died... 16:46:42.389456 run iperf3-srv_10.42.42.10(pid=29804): Terminated {rc=256} 16:46:42.436023 --- ParallelTerminationStrategy: PID 29805 died... 16:46:42.455756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29805): Terminated: ok {rc=0} 16:46:42.502639 --- ParallelTerminationStrategy: PID 29806 died... 16:46:42.522410 run iperf3-srv_10.42.42.10(pid=29806): Terminated {rc=256} 16:46:42.569515 --- ParallelTerminationStrategy: PID 29807 died... 16:46:42.589241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29807): Terminated: ok {rc=0} 16:46:42.636416 --- ParallelTerminationStrategy: PID 29808 died... 16:46:42.656203 run iperf3-srv_10.42.42.10(pid=29808): Terminated {rc=256} 16:46:42.702862 --- ParallelTerminationStrategy: PID 29809 died... 16:46:42.722592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29809): Terminated: ok {rc=0} 16:46:42.769455 --- ParallelTerminationStrategy: PID 29810 died... 16:46:42.788940 run iperf3-srv_10.42.42.10(pid=29810): Terminated {rc=256} 16:46:42.835771 --- ParallelTerminationStrategy: PID 29813 died... 16:46:42.855558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29813): Terminated: ok {rc=0} 16:46:42.902577 --- ParallelTerminationStrategy: PID 29816 died... 16:46:42.922598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29816): Terminated: ok {rc=0} 16:46:42.969865 --- ParallelTerminationStrategy: PID 29819 died... 16:46:42.989701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29819): Terminated: ok {rc=0} 16:46:43.077957 bus /gobi_4: Setting Powered False 16:46:44.178028 bus /gobi_4: Setting Powered False 16:46:45.294752 bus /gobi_1: Setting Powered False 16:46:46.403728 bus /gobi_1: Setting Powered False 16:46:47.541697 bus /gobi_0: Setting Powered False 16:46:48.640597 bus /gobi_0: Setting Powered False 16:46:49.757061 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx ping.py ---------------------------------------------- 16:46:50.860748 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:50.872154 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:46:50.925820 tst ping.py: using LAC 30178 16:46:51.046771 tst ping.py: using RAC 88 16:46:51.165775 tst ping.py: using CellId 30178 16:46:51.284916 tst ping.py: using BVCI 30179 16:46:51.396284 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:51.406971 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:51.417530 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:51.428547 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:51.439653 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:51.450763 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:51.461941 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:51.473074 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:46:51.588230 tst ping.py:19: start network... 16:46:51.793835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:46:52.267771 run create_hlr_db(pid=29821): Launched 16:46:52.394805 bus /gobi_6: Setting Powered False 16:46:53.455243 run create_hlr_db(pid=29821): Terminated: ok {rc=0} 16:46:53.902672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29823): Launched 16:46:54.232263 run osmo-hlr_10.42.42.2(pid=29824): Launched 16:46:54.358475 run osmo-stp_10.42.42.5: Starting osmo-stp 16:46:54.925722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29826): Launched 16:46:55.256628 run osmo-stp_10.42.42.5(pid=29827): Launched 16:46:55.383367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:46:55.950712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29829): Launched 16:46:56.077176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:46:56.356020 run patchelf(pid=29830): Launched 16:46:56.540103 run osmo-stp_10.42.42.5(pid=29827): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29827)] 16:46:56.679192 run osmo-stp_10.42.42.5(pid=29827): stdout: | (launched: 2022-12-12_16:46:55.195707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:56.819867 run osmo-stp_10.42.42.5(pid=29827): stderr: | 20221212164655384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164655384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164655384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164655385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164655385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164655385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164655385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:56.960632 run osmo-stp_10.42.42.5(pid=29827): stdout: | (launched: 2022-12-12_16:46:55.195707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:46:57.095552 run osmo-stp_10.42.42.5(pid=29827): stderr: | 20221212164655384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164655384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164655384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164655385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164655385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164655385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164655385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:46:57.255059 run patchelf(pid=29830): Terminating (SIGINT) 16:46:57.438691 run patchelf(pid=29830): Terminated: ok {rc=0} 16:46:57.571214 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29827): Process ended prematurely: osmo-stp_10.42.42.5(pid=29827) [trial-2379↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29827)] [trial-2379↪gprs:trx-umtrx↪ping.py:22] 16:46:57.580864 tst ping.py:22: Test FAILED (6.7 sec) 16:46:57.610042 run osmo-hlr_10.42.42.2(pid=29824): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29824)] 16:46:57.660575 run osmo-hlr_10.42.42.2(pid=29824): stdout: | (launched: 2022-12-12_16:46:54.171304) 16:46:57.713061 run osmo-hlr_10.42.42.2(pid=29824): stderr: | 20221212164654367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164654367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164654367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164654367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164654367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164654367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164654409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164654418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164654419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164654419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:46:57.765722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29823): Terminating (SIGTERM) 16:46:57.807926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29826): Terminating (SIGTERM) 16:46:57.850314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29829): Terminating (SIGTERM) 16:46:57.892818 --- ParallelTerminationStrategy: PID 29823 died... 16:46:57.913194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29823): Terminated: ok {rc=0} 16:46:57.960762 --- ParallelTerminationStrategy: PID 29826 died... 16:46:57.980735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29826): Terminated: ok {rc=0} 16:46:58.027922 --- ParallelTerminationStrategy: PID 29829 died... 16:46:58.047764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29829): Terminated: ok {rc=0} 16:46:58.136636 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 16:46:59.224312 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:59.236187 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 16:46:59.291686 tst ping_idle_ping.py: using LAC 30179 16:46:59.411934 tst ping_idle_ping.py: using RAC 89 16:46:59.532276 tst ping_idle_ping.py: using CellId 30179 16:46:59.651970 tst ping_idle_ping.py: using BVCI 30180 16:46:59.764698 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:59.775532 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:59.786202 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:59.797272 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:59.808323 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:59.819407 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:59.830685 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 16:46:59.841954 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 16:46:59.959461 tst ping_idle_ping.py:24: start network... 16:47:00.165906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:00.644897 run create_hlr_db(pid=29831): Launched 16:47:00.772194 bus /gobi_6: Setting Powered False 16:47:01.836928 run create_hlr_db(pid=29831): Terminated: ok {rc=0} 16:47:02.305513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29833): Launched 16:47:02.638545 run osmo-hlr_10.42.42.2(pid=29834): Launched 16:47:02.766392 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:03.334189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29836): Launched 16:47:03.666479 run osmo-stp_10.42.42.5(pid=29837): Launched 16:47:03.793630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:04.363139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29839): Launched 16:47:04.491024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:04.770088 run patchelf(pid=29840): Launched 16:47:04.955197 run osmo-stp_10.42.42.5(pid=29837): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29837)] 16:47:05.094076 run osmo-stp_10.42.42.5(pid=29837): stdout: | (launched: 2022-12-12_16:47:03.605401) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:05.234477 run osmo-stp_10.42.42.5(pid=29837): stderr: | 20221212164703794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164703795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164703795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164703795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164703796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164703796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164703796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:05.375381 run osmo-stp_10.42.42.5(pid=29837): stdout: | (launched: 2022-12-12_16:47:03.605401) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:05.510138 run osmo-stp_10.42.42.5(pid=29837): stderr: | 20221212164703794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164703795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164703795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164703795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164703796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164703796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164703796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:05.669670 run patchelf(pid=29840): Terminating (SIGINT) 16:47:05.852749 run patchelf(pid=29840): Terminated: ok {rc=0} 16:47:05.985229 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29837): Process ended prematurely: osmo-stp_10.42.42.5(pid=29837) [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29837)] [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py:27] 16:47:05.995141 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 16:47:06.023987 run osmo-hlr_10.42.42.2(pid=29834): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29834)] 16:47:06.074565 run osmo-hlr_10.42.42.2(pid=29834): stdout: | (launched: 2022-12-12_16:47:02.577174) 16:47:06.126912 run osmo-hlr_10.42.42.2(pid=29834): stderr: | 20221212164702774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164702774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164702774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164702774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164702774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164702774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164702788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164702796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164702797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164702797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:06.179641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29833): Terminating (SIGTERM) 16:47:06.221895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29836): Terminating (SIGTERM) 16:47:06.264207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29839): Terminating (SIGTERM) 16:47:06.306945 --- ParallelTerminationStrategy: PID 29833 died... 16:47:06.327325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29833): Terminated: ok {rc=0} 16:47:06.374368 --- ParallelTerminationStrategy: PID 29836 died... 16:47:06.393987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29836): Terminated: ok {rc=0} 16:47:06.440714 --- ParallelTerminationStrategy: PID 29839 died... 16:47:06.460486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29839): Terminated: ok {rc=0} 16:47:06.549619 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 16:47:07.854598 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:47:07.861139 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:47:07.894309 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:47:07.932471 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:47:08.019414 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:47:08.053178 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:47:08.093139 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:47:08.685281 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:47:08.739632 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:08.751117 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:08.807675 tst cs_paging_gprs_active.py: using LAC 30180 16:47:08.938064 tst cs_paging_gprs_active.py: using RAC 90 16:47:09.070019 tst cs_paging_gprs_active.py: using CellId 30180 16:47:09.201698 tst cs_paging_gprs_active.py: using BVCI 30181 16:47:09.316784 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:09.327894 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:09.338599 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:09.349722 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:09.360284 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:09.370906 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:09.381825 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:09.392447 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:09.403380 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:09.523973 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:09.645113 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:47:09.873269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:10.212211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29844): Launched 16:47:10.505942 run iperf3-srv_10.42.42.10(pid=29845): Launched 16:47:10.635164 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:47:10.862208 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:11.201909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29846): Launched 16:47:11.495983 run iperf3-srv_10.42.42.10(pid=29847): Launched 16:47:11.623837 tst cs_paging_gprs_active.py:38: start network... 16:47:11.851078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:12.372883 run create_hlr_db(pid=29848): Launched 16:47:12.502912 bus /gobi_6: Setting Powered False 16:47:13.569208 run create_hlr_db(pid=29848): Terminated: ok {rc=0} 16:47:14.036404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29850): Launched 16:47:14.372933 run osmo-hlr_10.42.42.2(pid=29851): Launched 16:47:14.502397 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:15.084627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29853): Launched 16:47:15.422915 run osmo-stp_10.42.42.5(pid=29854): Launched 16:47:15.551113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:16.144108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29856): Launched 16:47:16.283572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:16.571902 run patchelf(pid=29857): Launched 16:47:16.773100 run osmo-stp_10.42.42.5(pid=29854): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29854)] 16:47:16.918594 run osmo-stp_10.42.42.5(pid=29854): stdout: | (launched: 2022-12-12_16:47:15.360418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:17.066052 run osmo-stp_10.42.42.5(pid=29854): stderr: | 20221212164715551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164715552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164715552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164715552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164715553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164715553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164715553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:17.212197 run osmo-stp_10.42.42.5(pid=29854): stdout: | (launched: 2022-12-12_16:47:15.360418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:17.349765 run osmo-stp_10.42.42.5(pid=29854): stderr: | 20221212164715551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164715552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164715552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164715552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164715553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164715553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164715553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:17.512408 run patchelf(pid=29857): Terminating (SIGINT) 16:47:17.699295 run patchelf(pid=29857): Terminated: ok {rc=0} 16:47:17.837186 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29854): Process ended prematurely: osmo-stp_10.42.42.5(pid=29854) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29854)] [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:47:17.848589 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 16:47:17.878267 run osmo-hlr_10.42.42.2(pid=29851): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29851)] 16:47:17.929151 run osmo-hlr_10.42.42.2(pid=29851): stdout: | (launched: 2022-12-12_16:47:14.310382) 16:47:17.981938 run osmo-hlr_10.42.42.2(pid=29851): stderr: | 20221212164714509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164714509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164714509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164714509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164714509 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164714509 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164714521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164714530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164714531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164714531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:18.034668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29844): Terminating (SIGTERM) 16:47:18.076936 run iperf3-srv_10.42.42.10(pid=29845): Terminating (SIGTERM) 16:47:18.119061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29846): Terminating (SIGTERM) 16:47:18.161301 run iperf3-srv_10.42.42.10(pid=29847): Terminating (SIGTERM) 16:47:18.203396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29850): Terminating (SIGTERM) 16:47:18.245893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29853): Terminating (SIGTERM) 16:47:18.288150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29856): Terminating (SIGTERM) 16:47:18.330760 --- ParallelTerminationStrategy: PID 29844 died... 16:47:18.351010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29844): Terminated: ok {rc=0} 16:47:18.397922 --- ParallelTerminationStrategy: PID 29845 died... 16:47:18.417541 run iperf3-srv_10.42.42.10(pid=29845): Terminated {rc=256} 16:47:18.464199 --- ParallelTerminationStrategy: PID 29846 died... 16:47:18.483781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29846): Terminated: ok {rc=0} 16:47:18.530405 --- ParallelTerminationStrategy: PID 29847 died... 16:47:18.550009 run iperf3-srv_10.42.42.10(pid=29847): Terminated {rc=256} 16:47:18.596584 --- ParallelTerminationStrategy: PID 29850 died... 16:47:18.616332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29850): Terminated: ok {rc=0} 16:47:18.663345 --- ParallelTerminationStrategy: PID 29853 died... 16:47:18.682884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29853): Terminated: ok {rc=0} 16:47:18.729432 --- ParallelTerminationStrategy: PID 29856 died... 16:47:18.749035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29856): Terminated: ok {rc=0} 16:47:18.838727 bus /gobi_0: Setting Powered False 16:47:19.935755 bus /gobi_0: Setting Powered False 16:47:21.051007 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:47:22.198637 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.210276 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:22.262617 tst iperf3.py: using LAC 30181 16:47:22.386771 tst iperf3.py: using RAC 91 16:47:22.511566 tst iperf3.py: using CellId 30181 16:47:22.635918 tst iperf3.py: using BVCI 30182 16:47:22.749501 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.760429 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.771273 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.782104 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.792695 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.803398 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.814278 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.824870 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:22.835859 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:22.952469 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:47:23.162431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:23.477196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29858): Launched 16:47:23.752020 run iperf3-srv_10.42.42.10(pid=29859): Launched 16:47:23.870521 tst iperf3.py:8: start network... 16:47:24.080330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:24.565330 run create_hlr_db(pid=29860): Launched 16:47:24.692058 bus /gobi_6: Setting Powered False 16:47:25.754151 run create_hlr_db(pid=29860): Terminated: ok {rc=0} 16:47:26.210257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29862): Launched 16:47:26.545796 run osmo-hlr_10.42.42.2(pid=29863): Launched 16:47:26.675117 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:27.259070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29865): Launched 16:47:27.594788 run osmo-stp_10.42.42.5(pid=29866): Launched 16:47:27.722213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:28.303062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29868): Launched 16:47:28.431161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:28.716060 run patchelf(pid=29869): Launched 16:47:28.900901 run osmo-stp_10.42.42.5(pid=29866): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29866)] 16:47:29.042802 run osmo-stp_10.42.42.5(pid=29866): stdout: | (launched: 2022-12-12_16:47:27.532564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:29.185369 run osmo-stp_10.42.42.5(pid=29866): stderr: | 20221212164727723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164727723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164727723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164727724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164727724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164727724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164727724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:29.327830 run osmo-stp_10.42.42.5(pid=29866): stdout: | (launched: 2022-12-12_16:47:27.532564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:29.464137 run osmo-stp_10.42.42.5(pid=29866): stderr: | 20221212164727723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164727723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164727723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164727724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164727724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164727724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164727724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:29.626202 run patchelf(pid=29869): Terminating (SIGINT) 16:47:29.811526 run patchelf(pid=29869): Terminated: ok {rc=0} 16:47:29.945354 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29866): Process ended prematurely: osmo-stp_10.42.42.5(pid=29866) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29866)] [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 16:47:29.956272 tst iperf3.py:8: Test FAILED (7.8 sec) 16:47:29.986196 run osmo-hlr_10.42.42.2(pid=29863): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29863)] 16:47:30.036730 run osmo-hlr_10.42.42.2(pid=29863): stdout: | (launched: 2022-12-12_16:47:26.483434) 16:47:30.088724 run osmo-hlr_10.42.42.2(pid=29863): stderr: | 20221212164726680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164726680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164726680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164726680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164726680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164726680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164726692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164726702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164726702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164726702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:30.141249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29858): Terminating (SIGTERM) 16:47:30.183317 run iperf3-srv_10.42.42.10(pid=29859): Terminating (SIGTERM) 16:47:30.225406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29862): Terminating (SIGTERM) 16:47:30.267384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29865): Terminating (SIGTERM) 16:47:30.309412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29868): Terminating (SIGTERM) 16:47:30.351852 --- ParallelTerminationStrategy: PID 29858 died... 16:47:30.372060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29858): Terminated: ok {rc=0} 16:47:30.418946 --- ParallelTerminationStrategy: PID 29859 died... 16:47:30.438732 run iperf3-srv_10.42.42.10(pid=29859): Terminated {rc=256} 16:47:30.485477 --- ParallelTerminationStrategy: PID 29862 died... 16:47:30.505351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29862): Terminated: ok {rc=0} 16:47:30.551993 --- ParallelTerminationStrategy: PID 29865 died... 16:47:30.571829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29865): Terminated: ok {rc=0} 16:47:30.618652 --- ParallelTerminationStrategy: PID 29868 died... 16:47:30.638451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29868): Terminated: ok {rc=0} 16:47:30.726933 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:47:31.874709 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:31.887269 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:31.937225 tst iperf3m4.py: using LAC 30182 16:47:32.085624 tst iperf3m4.py: using RAC 92 16:47:32.242764 tst iperf3m4.py: using CellId 30182 16:47:32.377529 tst iperf3m4.py: using BVCI 30183 16:47:32.492144 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.503185 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.514003 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.524731 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.535510 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.546219 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.557053 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.568374 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:32.579271 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:32.697782 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:32.818952 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:32.937646 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:33.055067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:47:33.266207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:33.580512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29870): Launched 16:47:33.855184 run iperf3-srv_10.42.42.10(pid=29871): Launched 16:47:33.974352 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:47:34.184169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:34.499305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29872): Launched 16:47:34.773688 run iperf3-srv_10.42.42.10(pid=29873): Launched 16:47:34.890407 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:47:35.099456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:35.414559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29874): Launched 16:47:35.689243 run iperf3-srv_10.42.42.10(pid=29875): Launched 16:47:35.807196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:47:36.015725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:47:36.330358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29876): Launched 16:47:36.604918 run iperf3-srv_10.42.42.10(pid=29877): Launched 16:47:36.723772 tst iperf3m4.py:8: start network... 16:47:36.932744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:37.419402 run create_hlr_db(pid=29878): Launched 16:47:37.548928 bus /gobi_6: Setting Powered False 16:47:38.611095 run create_hlr_db(pid=29878): Terminated: ok {rc=0} 16:47:39.069987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29880): Launched 16:47:39.408547 run osmo-hlr_10.42.42.2(pid=29881): Launched 16:47:39.537999 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:40.122475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29883): Launched 16:47:40.459559 run osmo-stp_10.42.42.5(pid=29884): Launched 16:47:40.589241 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:41.169511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29886): Launched 16:47:41.299243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:41.584291 run patchelf(pid=29887): Launched 16:47:41.771138 run osmo-stp_10.42.42.5(pid=29884): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29884)] 16:47:41.912840 run osmo-stp_10.42.42.5(pid=29884): stdout: | (launched: 2022-12-12_16:47:40.396938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:42.056743 run osmo-stp_10.42.42.5(pid=29884): stderr: | 20221212164740587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164740587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164740587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164740588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164740588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164740588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164740588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:42.200727 run osmo-stp_10.42.42.5(pid=29884): stdout: | (launched: 2022-12-12_16:47:40.396938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:42.338052 run osmo-stp_10.42.42.5(pid=29884): stderr: | 20221212164740587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164740587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164740587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164740588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164740588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164740588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164740588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:42.501167 run patchelf(pid=29887): Terminating (SIGINT) 16:47:42.687704 run patchelf(pid=29887): Terminated: ok {rc=0} 16:47:42.822547 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29884): Process ended prematurely: osmo-stp_10.42.42.5(pid=29884) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29884)] [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 16:47:42.833038 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:47:42.862668 run osmo-hlr_10.42.42.2(pid=29881): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29881)] 16:47:42.912863 run osmo-hlr_10.42.42.2(pid=29881): stdout: | (launched: 2022-12-12_16:47:39.346106) 16:47:42.965063 run osmo-hlr_10.42.42.2(pid=29881): stderr: | 20221212164739541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164739541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164739541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164739542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164739542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164739542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164739554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164739565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164739565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164739565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:43.017596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29870): Terminating (SIGTERM) 16:47:43.059756 run iperf3-srv_10.42.42.10(pid=29871): Terminating (SIGTERM) 16:47:43.102337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29872): Terminating (SIGTERM) 16:47:43.144864 run iperf3-srv_10.42.42.10(pid=29873): Terminating (SIGTERM) 16:47:43.187327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29874): Terminating (SIGTERM) 16:47:43.229919 run iperf3-srv_10.42.42.10(pid=29875): Terminating (SIGTERM) 16:47:43.272345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29876): Terminating (SIGTERM) 16:47:43.314933 run iperf3-srv_10.42.42.10(pid=29877): Terminating (SIGTERM) 16:47:43.358468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29880): Terminating (SIGTERM) 16:47:43.401229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29883): Terminating (SIGTERM) 16:47:43.443504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29886): Terminating (SIGTERM) 16:47:43.485909 --- ParallelTerminationStrategy: PID 29870 died... 16:47:43.506220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29870): Terminated: ok {rc=0} 16:47:43.553370 --- ParallelTerminationStrategy: PID 29871 died... 16:47:43.572827 run iperf3-srv_10.42.42.10(pid=29871): Terminated {rc=256} 16:47:43.619581 --- ParallelTerminationStrategy: PID 29872 died... 16:47:43.639302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29872): Terminated: ok {rc=0} 16:47:43.686065 --- ParallelTerminationStrategy: PID 29873 died... 16:47:43.705672 run iperf3-srv_10.42.42.10(pid=29873): Terminated {rc=256} 16:47:43.752289 --- ParallelTerminationStrategy: PID 29874 died... 16:47:43.771944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29874): Terminated: ok {rc=0} 16:47:43.818714 --- ParallelTerminationStrategy: PID 29875 died... 16:47:43.838468 run iperf3-srv_10.42.42.10(pid=29875): Terminated {rc=256} 16:47:43.885171 --- ParallelTerminationStrategy: PID 29876 died... 16:47:43.904913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29876): Terminated: ok {rc=0} 16:47:43.951805 --- ParallelTerminationStrategy: PID 29877 died... 16:47:43.971934 run iperf3-srv_10.42.42.10(pid=29877): Terminated {rc=256} 16:47:44.018686 --- ParallelTerminationStrategy: PID 29880 died... 16:47:44.038494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29880): Terminated: ok {rc=0} 16:47:44.085798 --- ParallelTerminationStrategy: PID 29883 died... 16:47:44.105687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29883): Terminated: ok {rc=0} 16:47:44.152750 --- ParallelTerminationStrategy: PID 29886 died... 16:47:44.172448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29886): Terminated: ok {rc=0} 16:47:44.261511 bus /gobi_4: Setting Powered False 16:47:45.361616 bus /gobi_4: Setting Powered False 16:47:46.494334 bus /gobi_1: Setting Powered False 16:47:47.595874 bus /gobi_1: Setting Powered False 16:47:48.711692 bus /gobi_0: Setting Powered False 16:47:49.807766 bus /gobi_0: Setting Powered False 16:47:50.923085 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 16:47:52.024234 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.036158 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:47:52.091032 tst ping.py: using LAC 30183 16:47:52.215088 tst ping.py: using RAC 93 16:47:52.333189 tst ping.py: using CellId 30183 16:47:52.448055 tst ping.py: using BVCI 30184 16:47:52.555912 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.566759 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.577411 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.588510 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.599581 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.610570 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.621851 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:47:52.632874 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:47:52.746665 tst ping.py:19: start network... 16:47:52.943387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:47:53.401483 run create_hlr_db(pid=29888): Launched 16:47:53.524131 bus /gobi_6: Setting Powered False 16:47:54.584780 run create_hlr_db(pid=29888): Terminated: ok {rc=0} 16:47:55.026999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29890): Launched 16:47:55.351203 run osmo-hlr_10.42.42.2(pid=29891): Launched 16:47:55.473567 run osmo-stp_10.42.42.5: Starting osmo-stp 16:47:56.036608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29893): Launched 16:47:56.359120 run osmo-stp_10.42.42.5(pid=29894): Launched 16:47:56.481639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:47:57.038971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29896): Launched 16:47:57.164290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:47:57.438310 run patchelf(pid=29897): Launched 16:47:57.618441 run osmo-stp_10.42.42.5(pid=29894): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29894)] 16:47:57.754732 run osmo-stp_10.42.42.5(pid=29894): stdout: | (launched: 2022-12-12_16:47:56.298927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:57.893095 run osmo-stp_10.42.42.5(pid=29894): stderr: | 20221212164756487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164756487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164756488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164756488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164756488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164756489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164756489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:58.031956 run osmo-stp_10.42.42.5(pid=29894): stdout: | (launched: 2022-12-12_16:47:56.298927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:47:58.164654 run osmo-stp_10.42.42.5(pid=29894): stderr: | 20221212164756487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164756487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164756488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164756488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164756488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164756489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164756489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:47:58.322442 run patchelf(pid=29897): Terminating (SIGINT) 16:47:58.502202 run patchelf(pid=29897): Terminated: ok {rc=0} 16:47:58.631555 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29894): Process ended prematurely: osmo-stp_10.42.42.5(pid=29894) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29894)] [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 16:47:58.641074 tst ping.py:22: Test FAILED (6.6 sec) 16:47:58.669419 run osmo-hlr_10.42.42.2(pid=29891): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29891)] 16:47:58.719915 run osmo-hlr_10.42.42.2(pid=29891): stdout: | (launched: 2022-12-12_16:47:55.291036) 16:47:58.771913 run osmo-hlr_10.42.42.2(pid=29891): stderr: | 20221212164755486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164755486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164755486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164755486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164755486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164755486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164755500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164755510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164755510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164755510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:47:58.824287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29890): Terminating (SIGTERM) 16:47:58.866525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29893): Terminating (SIGTERM) 16:47:58.908647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29896): Terminating (SIGTERM) 16:47:58.950953 --- ParallelTerminationStrategy: PID 29890 died... 16:47:58.971418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29890): Terminated: ok {rc=0} 16:47:59.018144 --- ParallelTerminationStrategy: PID 29893 died... 16:47:59.037610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29893): Terminated: ok {rc=0} 16:47:59.084234 --- ParallelTerminationStrategy: PID 29896 died... 16:47:59.103942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29896): Terminated: ok {rc=0} 16:47:59.192391 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:48:00.278337 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.290564 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:48:00.343228 tst ping_idle_ping.py: using LAC 30184 16:48:00.463106 tst ping_idle_ping.py: using RAC 94 16:48:00.583190 tst ping_idle_ping.py: using CellId 30184 16:48:00.703118 tst ping_idle_ping.py: using BVCI 30185 16:48:00.824574 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.838699 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.857888 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.882323 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.895719 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.908916 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.922575 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:48:00.934977 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:48:01.058945 tst ping_idle_ping.py:24: start network... 16:48:01.268224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:01.754021 run create_hlr_db(pid=29898): Launched 16:48:01.908105 bus /gobi_6: Setting Powered False 16:48:02.968430 run create_hlr_db(pid=29898): Terminated: ok {rc=0} 16:48:03.391424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29900): Launched 16:48:03.695945 run osmo-hlr_10.42.42.2(pid=29901): Launched 16:48:03.810134 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:04.346194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29903): Launched 16:48:04.648282 run osmo-stp_10.42.42.5(pid=29904): Launched 16:48:04.762441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:05.284627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29906): Launched 16:48:05.400383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:05.656874 run patchelf(pid=29907): Launched 16:48:05.825415 run osmo-stp_10.42.42.5(pid=29904): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29904)] 16:48:05.952839 run osmo-stp_10.42.42.5(pid=29904): stdout: | (launched: 2022-12-12_16:48:04.591582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:06.081957 run osmo-stp_10.42.42.5(pid=29904): stderr: | 20221212164804759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164804759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164804759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164804760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164804760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164804760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164804760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:06.211395 run osmo-stp_10.42.42.5(pid=29904): stdout: | (launched: 2022-12-12_16:48:04.591582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:06.335739 run osmo-stp_10.42.42.5(pid=29904): stderr: | 20221212164804759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164804759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164804759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164804760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164804760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164804760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164804760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:06.482264 run patchelf(pid=29907): Terminating (SIGINT) 16:48:06.650718 run patchelf(pid=29907): Terminated: ok {rc=0} 16:48:06.772129 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29904): Process ended prematurely: osmo-stp_10.42.42.5(pid=29904) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29904)] [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 16:48:06.781201 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:48:06.807911 run osmo-hlr_10.42.42.2(pid=29901): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29901)] 16:48:06.855175 run osmo-hlr_10.42.42.2(pid=29901): stdout: | (launched: 2022-12-12_16:48:03.638731) 16:48:06.904121 run osmo-hlr_10.42.42.2(pid=29901): stderr: | 20221212164803814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164803814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164803814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164803814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164803814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164803814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164803826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164803835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164803836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164803836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:06.953637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29900): Terminating (SIGTERM) 16:48:06.993397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29903): Terminating (SIGTERM) 16:48:07.033119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29906): Terminating (SIGTERM) 16:48:07.073035 --- ParallelTerminationStrategy: PID 29900 died... 16:48:07.092079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29900): Terminated: ok {rc=0} 16:48:07.135788 --- ParallelTerminationStrategy: PID 29903 died... 16:48:07.154322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29903): Terminated: ok {rc=0} 16:48:07.197824 --- ParallelTerminationStrategy: PID 29906 died... 16:48:07.216404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29906): Terminated: ok {rc=0} 16:48:07.299610 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:48:08.602563 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:48:08.609450 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:48:08.643429 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:48:08.682612 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:48:08.771009 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:48:08.803106 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:48:08.840941 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:48:09.432272 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:48:09.487032 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:09.498321 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:09.566147 tst cs_paging_gprs_active.py: using LAC 30185 16:48:09.693284 tst cs_paging_gprs_active.py: using RAC 95 16:48:09.820519 tst cs_paging_gprs_active.py: using CellId 30185 16:48:09.951992 tst cs_paging_gprs_active.py: using BVCI 30186 16:48:10.064819 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.075707 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.086398 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.097032 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.107512 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.118093 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.128699 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.139295 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:10.150044 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:10.269315 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:10.388743 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:48:10.611924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:10.943322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29911): Launched 16:48:11.231523 run iperf3-srv_10.42.42.10(pid=29912): Launched 16:48:11.355549 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:48:11.578890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:11.910798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29913): Launched 16:48:12.199203 run iperf3-srv_10.42.42.10(pid=29914): Launched 16:48:12.323041 tst cs_paging_gprs_active.py:38: start network... 16:48:12.545056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:13.057236 run create_hlr_db(pid=29915): Launched 16:48:13.184036 bus /gobi_6: Setting Powered False 16:48:14.248455 run create_hlr_db(pid=29915): Terminated: ok {rc=0} 16:48:14.689236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29917): Launched 16:48:14.996766 run osmo-hlr_10.42.42.2(pid=29918): Launched 16:48:15.113409 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:15.641905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29920): Launched 16:48:15.976611 run osmo-stp_10.42.42.5(pid=29921): Launched 16:48:16.212146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:16.805503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29923): Launched 16:48:16.968747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:17.249527 run patchelf(pid=29924): Launched 16:48:17.422411 run osmo-stp_10.42.42.5(pid=29921): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29921)] 16:48:17.552873 run osmo-stp_10.42.42.5(pid=29921): stdout: | (launched: 2022-12-12_16:48:15.914579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:17.684714 run osmo-stp_10.42.42.5(pid=29921): stderr: | 20221212164816239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164816239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164816239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164816240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164816240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164816240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164816240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:17.815877 run osmo-stp_10.42.42.5(pid=29921): stdout: | (launched: 2022-12-12_16:48:15.914579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:17.942257 run osmo-stp_10.42.42.5(pid=29921): stderr: | 20221212164816239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164816239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164816239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164816240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164816240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164816240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164816240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:18.091789 run patchelf(pid=29924): Terminating (SIGINT) 16:48:18.263280 run patchelf(pid=29924): Terminated: ok {rc=0} 16:48:18.387718 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29921): Process ended prematurely: osmo-stp_10.42.42.5(pid=29921) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29921)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:48:18.397393 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:48:18.424558 run osmo-hlr_10.42.42.2(pid=29918): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29918)] 16:48:18.471568 run osmo-hlr_10.42.42.2(pid=29918): stdout: | (launched: 2022-12-12_16:48:14.939232) 16:48:18.520323 run osmo-hlr_10.42.42.2(pid=29918): stderr: | 20221212164815115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164815115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164815115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164815115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164815115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164815115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164815126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164815134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164815134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164815134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:18.569638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29911): Terminating (SIGTERM) 16:48:18.608835 run iperf3-srv_10.42.42.10(pid=29912): Terminating (SIGTERM) 16:48:18.648037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29913): Terminating (SIGTERM) 16:48:18.687327 run iperf3-srv_10.42.42.10(pid=29914): Terminating (SIGTERM) 16:48:18.726396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29917): Terminating (SIGTERM) 16:48:18.765563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29920): Terminating (SIGTERM) 16:48:18.804763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29923): Terminating (SIGTERM) 16:48:18.844395 --- ParallelTerminationStrategy: PID 29911 died... 16:48:18.863444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29911): Terminated: ok {rc=0} 16:48:18.907466 --- ParallelTerminationStrategy: PID 29912 died... 16:48:18.925950 run iperf3-srv_10.42.42.10(pid=29912): Terminated {rc=256} 16:48:18.969124 --- ParallelTerminationStrategy: PID 29913 died... 16:48:18.987613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29913): Terminated: ok {rc=0} 16:48:19.031650 --- ParallelTerminationStrategy: PID 29914 died... 16:48:19.050231 run iperf3-srv_10.42.42.10(pid=29914): Terminated {rc=256} 16:48:19.093378 --- ParallelTerminationStrategy: PID 29917 died... 16:48:19.111756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29917): Terminated: ok {rc=0} 16:48:19.155463 --- ParallelTerminationStrategy: PID 29920 died... 16:48:19.174114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29920): Terminated: ok {rc=0} 16:48:19.217606 --- ParallelTerminationStrategy: PID 29923 died... 16:48:19.236237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29923): Terminated: ok {rc=0} 16:48:19.331515 bus /gobi_0: Setting Powered False 16:48:20.430570 bus /gobi_0: Setting Powered False 16:48:21.542509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:48:22.690365 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:22.702290 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:22.773397 tst iperf3.py: using LAC 30186 16:48:22.902423 tst iperf3.py: using RAC 96 16:48:23.029622 tst iperf3.py: using CellId 30186 16:48:23.151866 tst iperf3.py: using BVCI 30187 16:48:23.264929 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.275931 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.286775 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.297592 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.308050 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.318652 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.329318 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.339769 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:23.350669 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:23.464348 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:48:23.667727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:23.977093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29925): Launched 16:48:24.244768 run iperf3-srv_10.42.42.10(pid=29926): Launched 16:48:24.360149 tst iperf3.py:8: start network... 16:48:24.564156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:25.041945 run create_hlr_db(pid=29927): Launched 16:48:25.167864 bus /gobi_6: Setting Powered False 16:48:26.227563 run create_hlr_db(pid=29927): Terminated: ok {rc=0} 16:48:26.676919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29929): Launched 16:48:27.006920 run osmo-hlr_10.42.42.2(pid=29930): Launched 16:48:27.131598 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:27.790388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29932): Launched 16:48:28.113440 run osmo-stp_10.42.42.5(pid=29933): Launched 16:48:28.236104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:28.789089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29935): Launched 16:48:28.911976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:29.187273 run patchelf(pid=29936): Launched 16:48:29.366336 run osmo-stp_10.42.42.5(pid=29933): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29933)] 16:48:29.513013 run osmo-stp_10.42.42.5(pid=29933): stdout: | (launched: 2022-12-12_16:48:28.051540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:29.653401 run osmo-stp_10.42.42.5(pid=29933): stderr: | 20221212164828241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164828241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164828241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164828242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164828242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164828242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164828242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:29.789262 run osmo-stp_10.42.42.5(pid=29933): stdout: | (launched: 2022-12-12_16:48:28.051540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:29.919090 run osmo-stp_10.42.42.5(pid=29933): stderr: | 20221212164828241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164828241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164828241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164828242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164828242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164828242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164828242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:30.073887 run patchelf(pid=29936): Terminating (SIGINT) 16:48:30.250980 run patchelf(pid=29936): Terminated: ok {rc=0} 16:48:30.378806 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29933): Process ended prematurely: osmo-stp_10.42.42.5(pid=29933) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29933)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 16:48:30.389115 tst iperf3.py:8: Test FAILED (7.7 sec) 16:48:30.418023 run osmo-hlr_10.42.42.2(pid=29930): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29930)] 16:48:30.467601 run osmo-hlr_10.42.42.2(pid=29930): stdout: | (launched: 2022-12-12_16:48:26.943369) 16:48:30.519281 run osmo-hlr_10.42.42.2(pid=29930): stderr: | 20221212164827141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164827141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164827141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164827141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164827141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164827141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164827154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164827162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164827163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164827163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:30.570973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29925): Terminating (SIGTERM) 16:48:30.612452 run iperf3-srv_10.42.42.10(pid=29926): Terminating (SIGTERM) 16:48:30.653839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29929): Terminating (SIGTERM) 16:48:30.695398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29932): Terminating (SIGTERM) 16:48:30.737012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29935): Terminating (SIGTERM) 16:48:30.779154 --- ParallelTerminationStrategy: PID 29925 died... 16:48:30.800296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29925): Terminated: ok {rc=0} 16:48:30.865714 --- ParallelTerminationStrategy: PID 29926 died... 16:48:30.893444 run iperf3-srv_10.42.42.10(pid=29926): Terminated {rc=256} 16:48:30.939426 --- ParallelTerminationStrategy: PID 29929 died... 16:48:30.958595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29929): Terminated: ok {rc=0} 16:48:31.003261 --- ParallelTerminationStrategy: PID 29932 died... 16:48:31.023550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29932): Terminated: ok {rc=0} 16:48:31.069128 --- ParallelTerminationStrategy: PID 29935 died... 16:48:31.088843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29935): Terminated: ok {rc=0} 16:48:31.178740 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:48:32.333453 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.344774 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:32.413149 tst iperf3m4.py: using LAC 30187 16:48:32.539552 tst iperf3m4.py: using RAC 97 16:48:32.664122 tst iperf3m4.py: using CellId 30187 16:48:32.787639 tst iperf3m4.py: using BVCI 30188 16:48:32.898990 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.909966 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.920641 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.931239 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.941811 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.952307 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.962990 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.973445 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:32.984060 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:33.098199 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:33.214263 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:33.330153 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:33.443791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:48:33.640685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:33.941548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29937): Launched 16:48:34.200933 run iperf3-srv_10.42.42.10(pid=29938): Launched 16:48:34.313578 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:48:34.511451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:34.811749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29939): Launched 16:48:35.075909 run iperf3-srv_10.42.42.10(pid=29940): Launched 16:48:35.187385 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:48:35.387250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:35.691164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29941): Launched 16:48:35.957543 run iperf3-srv_10.42.42.10(pid=29942): Launched 16:48:36.069091 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:48:36.269110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:48:36.572615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29943): Launched 16:48:36.838629 run iperf3-srv_10.42.42.10(pid=29944): Launched 16:48:36.950107 tst iperf3m4.py:8: start network... 16:48:37.149600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:37.620021 run create_hlr_db(pid=29945): Launched 16:48:37.743297 bus /gobi_6: Setting Powered False 16:48:38.802544 run create_hlr_db(pid=29945): Terminated: ok {rc=0} 16:48:39.224678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29947): Launched 16:48:39.529431 run osmo-hlr_10.42.42.2(pid=29948): Launched 16:48:39.643814 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:40.167748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29950): Launched 16:48:40.473131 run osmo-stp_10.42.42.5(pid=29951): Launched 16:48:40.587585 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:41.111188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29953): Launched 16:48:41.225181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:41.483597 run patchelf(pid=29954): Launched 16:48:41.649894 run osmo-stp_10.42.42.5(pid=29951): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29951)] 16:48:41.777860 run osmo-stp_10.42.42.5(pid=29951): stdout: | (launched: 2022-12-12_16:48:40.412232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:41.906680 run osmo-stp_10.42.42.5(pid=29951): stderr: | 20221212164840585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164840585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164840585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164840586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164840586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164840586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164840586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:42.035955 run osmo-stp_10.42.42.5(pid=29951): stdout: | (launched: 2022-12-12_16:48:40.412232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:42.159122 run osmo-stp_10.42.42.5(pid=29951): stderr: | 20221212164840585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164840585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164840585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164840586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164840586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164840586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164840586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:42.305209 run patchelf(pid=29954): Terminating (SIGINT) 16:48:42.472845 run patchelf(pid=29954): Terminated: ok {rc=0} 16:48:42.594757 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29951): Process ended prematurely: osmo-stp_10.42.42.5(pid=29951) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29951)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:48:42.604372 tst iperf3m4.py:8: Test FAILED (10.3 sec) 16:48:42.631631 run osmo-hlr_10.42.42.2(pid=29948): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29948)] 16:48:42.678900 run osmo-hlr_10.42.42.2(pid=29948): stdout: | (launched: 2022-12-12_16:48:39.469139) 16:48:42.727739 run osmo-hlr_10.42.42.2(pid=29948): stderr: | 20221212164839647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164839647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164839647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164839647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164839647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164839647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164839659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164839669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164839669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164839669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:42.777660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29937): Terminating (SIGTERM) 16:48:42.817354 run iperf3-srv_10.42.42.10(pid=29938): Terminating (SIGTERM) 16:48:42.856740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29939): Terminating (SIGTERM) 16:48:42.895848 run iperf3-srv_10.42.42.10(pid=29940): Terminating (SIGTERM) 16:48:42.934839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29941): Terminating (SIGTERM) 16:48:42.973824 run iperf3-srv_10.42.42.10(pid=29942): Terminating (SIGTERM) 16:48:43.013052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29943): Terminating (SIGTERM) 16:48:43.052048 run iperf3-srv_10.42.42.10(pid=29944): Terminating (SIGTERM) 16:48:43.091060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29947): Terminating (SIGTERM) 16:48:43.130524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29950): Terminating (SIGTERM) 16:48:43.169619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29953): Terminating (SIGTERM) 16:48:43.209111 --- ParallelTerminationStrategy: PID 29937 died... 16:48:43.227665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29937): Terminated: ok {rc=0} 16:48:43.271134 --- ParallelTerminationStrategy: PID 29938 died... 16:48:43.289292 run iperf3-srv_10.42.42.10(pid=29938): Terminated {rc=256} 16:48:43.332114 --- ParallelTerminationStrategy: PID 29939 died... 16:48:43.350228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29939): Terminated: ok {rc=0} 16:48:43.393182 --- ParallelTerminationStrategy: PID 29940 died... 16:48:43.411279 run iperf3-srv_10.42.42.10(pid=29940): Terminated {rc=256} 16:48:43.454136 --- ParallelTerminationStrategy: PID 29941 died... 16:48:43.472348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29941): Terminated: ok {rc=0} 16:48:43.515596 --- ParallelTerminationStrategy: PID 29942 died... 16:48:43.533851 run iperf3-srv_10.42.42.10(pid=29942): Terminated {rc=256} 16:48:43.576541 --- ParallelTerminationStrategy: PID 29943 died... 16:48:43.594867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29943): Terminated: ok {rc=0} 16:48:43.637904 --- ParallelTerminationStrategy: PID 29944 died... 16:48:43.656108 run iperf3-srv_10.42.42.10(pid=29944): Terminated {rc=256} 16:48:43.699561 --- ParallelTerminationStrategy: PID 29947 died... 16:48:43.717865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29947): Terminated: ok {rc=0} 16:48:43.761626 --- ParallelTerminationStrategy: PID 29950 died... 16:48:43.779970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29950): Terminated: ok {rc=0} 16:48:43.823091 --- ParallelTerminationStrategy: PID 29953 died... 16:48:43.841343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29953): Terminated: ok {rc=0} 16:48:43.923978 bus /gobi_4: Setting Powered False 16:48:45.021836 bus /gobi_4: Setting Powered False 16:48:46.157727 bus /gobi_1: Setting Powered False 16:48:47.261477 bus /gobi_1: Setting Powered False 16:48:48.372018 bus /gobi_0: Setting Powered False 16:48:49.469737 bus /gobi_0: Setting Powered False 16:48:50.586550 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:48:51.689277 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:51.700731 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:51.770251 tst ping.py: using LAC 30188 16:48:51.891797 tst ping.py: using RAC 98 16:48:52.021849 tst ping.py: using CellId 30188 16:48:52.139500 tst ping.py: using BVCI 30189 16:48:52.246683 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.257703 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.268545 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.279419 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.290216 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.300890 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.311667 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:52.322277 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:48:52.439762 tst ping.py:19: start network... 16:48:52.652389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:48:53.150336 run create_hlr_db(pid=29955): Launched 16:48:53.273304 bus /gobi_6: Setting Powered False 16:48:54.336126 run create_hlr_db(pid=29955): Terminated: ok {rc=0} 16:48:54.763786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29957): Launched 16:48:55.064169 run osmo-hlr_10.42.42.2(pid=29958): Launched 16:48:55.176725 run osmo-stp_10.42.42.5: Starting osmo-stp 16:48:55.691066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29960): Launched 16:48:55.990372 run osmo-stp_10.42.42.5(pid=29961): Launched 16:48:56.101689 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:48:56.617730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29963): Launched 16:48:56.731110 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:48:56.984678 run patchelf(pid=29964): Launched 16:48:57.148410 run osmo-stp_10.42.42.5(pid=29961): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29961)] 16:48:57.273526 run osmo-stp_10.42.42.5(pid=29961): stdout: | (launched: 2022-12-12_16:48:55.931041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:57.400097 run osmo-stp_10.42.42.5(pid=29961): stderr: | 20221212164856103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164856103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164856103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164856104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164856104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164856104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164856104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:57.527043 run osmo-stp_10.42.42.5(pid=29961): stdout: | (launched: 2022-12-12_16:48:55.931041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:48:57.648074 run osmo-stp_10.42.42.5(pid=29961): stderr: | 20221212164856103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164856103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164856103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164856104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164856104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164856104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164856104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:48:57.791361 run patchelf(pid=29964): Terminating (SIGINT) 16:48:57.956591 run patchelf(pid=29964): Terminated: ok {rc=0} 16:48:58.075785 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29961): Process ended prematurely: osmo-stp_10.42.42.5(pid=29961) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29961)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 16:48:58.084885 tst ping.py:22: Test FAILED (6.4 sec) 16:48:58.111450 run osmo-hlr_10.42.42.2(pid=29958): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29958)] 16:48:58.158574 run osmo-hlr_10.42.42.2(pid=29958): stdout: | (launched: 2022-12-12_16:48:55.004493) 16:48:58.207537 run osmo-hlr_10.42.42.2(pid=29958): stderr: | 20221212164855182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164855182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164855182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164855182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164855182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164855183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164855195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164855206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164855206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164855206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:48:58.256918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29957): Terminating (SIGTERM) 16:48:58.296280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29960): Terminating (SIGTERM) 16:48:58.335610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29963): Terminating (SIGTERM) 16:48:58.375123 --- ParallelTerminationStrategy: PID 29957 died... 16:48:58.394012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29957): Terminated: ok {rc=0} 16:48:58.437443 --- ParallelTerminationStrategy: PID 29960 died... 16:48:58.455634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29960): Terminated: ok {rc=0} 16:48:58.498981 --- ParallelTerminationStrategy: PID 29963 died... 16:48:58.517374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29963): Terminated: ok {rc=0} 16:48:58.600015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:48:59.686016 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:48:59.698757 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:48:59.775740 tst ping_idle_ping.py: using LAC 30189 16:48:59.895885 tst ping_idle_ping.py: using RAC 99 16:49:00.013588 tst ping_idle_ping.py: using CellId 30189 16:49:00.130889 tst ping_idle_ping.py: using BVCI 30190 16:49:00.239888 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.251000 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.261675 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.272286 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.282933 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.293664 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.304303 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:49:00.314894 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:49:00.430349 tst ping_idle_ping.py:24: start network... 16:49:00.644642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:01.158304 run create_hlr_db(pid=29965): Launched 16:49:01.319584 bus /gobi_6: Setting Powered False 16:49:02.378769 run create_hlr_db(pid=29965): Terminated: ok {rc=0} 16:49:02.831776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29967): Launched 16:49:03.152793 run osmo-hlr_10.42.42.2(pid=29968): Launched 16:49:03.274376 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:03.825354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29970): Launched 16:49:04.149096 run osmo-stp_10.42.42.5(pid=29971): Launched 16:49:04.270427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:04.819797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29973): Launched 16:49:04.940846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:05.212869 run patchelf(pid=29974): Launched 16:49:05.390805 run osmo-stp_10.42.42.5(pid=29971): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29971)] 16:49:05.525863 run osmo-stp_10.42.42.5(pid=29971): stdout: | (launched: 2022-12-12_16:49:04.086083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:05.661984 run osmo-stp_10.42.42.5(pid=29971): stderr: | 20221212164904278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164904278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164904279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164904279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164904279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164904280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164904280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:05.798562 run osmo-stp_10.42.42.5(pid=29971): stdout: | (launched: 2022-12-12_16:49:04.086083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:05.929270 run osmo-stp_10.42.42.5(pid=29971): stderr: | 20221212164904278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164904278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164904279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164904279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164904279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164904280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164904280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:06.084491 run patchelf(pid=29974): Terminating (SIGINT) 16:49:06.262607 run patchelf(pid=29974): Terminated: ok {rc=0} 16:49:06.391064 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29971): Process ended prematurely: osmo-stp_10.42.42.5(pid=29971) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29971)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:49:06.400807 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:49:06.429687 run osmo-hlr_10.42.42.2(pid=29968): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29968)] 16:49:06.479838 run osmo-hlr_10.42.42.2(pid=29968): stdout: | (launched: 2022-12-12_16:49:03.090637) 16:49:06.531871 run osmo-hlr_10.42.42.2(pid=29968): stderr: | 20221212164903288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164903288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164903288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164903288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164903288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164903288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164903300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164903308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164903309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164903309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:06.584249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29967): Terminating (SIGTERM) 16:49:06.626343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29970): Terminating (SIGTERM) 16:49:06.668233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29973): Terminating (SIGTERM) 16:49:06.710537 --- ParallelTerminationStrategy: PID 29967 died... 16:49:06.730566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29967): Terminated: ok {rc=0} 16:49:06.777495 --- ParallelTerminationStrategy: PID 29970 died... 16:49:06.796896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29970): Terminated: ok {rc=0} 16:49:06.843326 --- ParallelTerminationStrategy: PID 29973 died... 16:49:06.862827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29973): Terminated: ok {rc=0} 16:49:06.950512 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:49:08.257690 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:49:08.264762 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:49:08.299282 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:49:08.338756 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:49:08.427877 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:49:08.461532 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:49:08.501102 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:49:09.095274 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:49:09.148171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:09.159767 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:49:09.230814 tst cs_paging_gprs_active.py: using LAC 30190 16:49:09.358650 tst cs_paging_gprs_active.py: using RAC 100 16:49:09.485478 tst cs_paging_gprs_active.py: using CellId 30190 16:49:09.605471 tst cs_paging_gprs_active.py: using BVCI 30191 16:49:09.715447 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:09.726366 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:09.737125 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:09.747864 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:09.758532 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:09.769270 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:09.779998 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:09.790684 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:09.801579 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:49:09.922878 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:49:10.046894 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:49:10.268005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:10.597642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29978): Launched 16:49:10.882760 run iperf3-srv_10.42.42.10(pid=29979): Launched 16:49:11.007490 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:49:11.227333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:11.554778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29980): Launched 16:49:11.841629 run iperf3-srv_10.42.42.10(pid=29981): Launched 16:49:11.987572 tst cs_paging_gprs_active.py:38: start network... 16:49:12.193356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:12.667795 run create_hlr_db(pid=29982): Launched 16:49:12.794047 bus /gobi_6: Setting Powered False 16:49:13.855340 run create_hlr_db(pid=29982): Terminated: ok {rc=0} 16:49:14.280669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29984): Launched 16:49:14.586274 run osmo-hlr_10.42.42.2(pid=29985): Launched 16:49:14.702462 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:15.231527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29987): Launched 16:49:15.536113 run osmo-stp_10.42.42.5(pid=29988): Launched 16:49:15.653801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:16.220527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29990): Launched 16:49:16.359333 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:16.660120 run patchelf(pid=29991): Launched 16:49:16.854520 run osmo-stp_10.42.42.5(pid=29988): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29988)] 16:49:16.984680 run osmo-stp_10.42.42.5(pid=29988): stdout: | (launched: 2022-12-12_16:49:15.479987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:17.118398 run osmo-stp_10.42.42.5(pid=29988): stderr: | 20221212164915650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164915650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164915650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164915651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164915651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164915651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164915651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:17.249408 run osmo-stp_10.42.42.5(pid=29988): stdout: | (launched: 2022-12-12_16:49:15.479987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:17.374096 run osmo-stp_10.42.42.5(pid=29988): stderr: | 20221212164915650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164915650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164915650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164915651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164915651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164915651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164915651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:17.522168 run patchelf(pid=29991): Terminating (SIGINT) 16:49:17.692249 run patchelf(pid=29991): Terminated: ok {rc=0} 16:49:17.815788 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29988): Process ended prematurely: osmo-stp_10.42.42.5(pid=29988) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29988)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:49:17.825561 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:49:17.852760 run osmo-hlr_10.42.42.2(pid=29985): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29985)] 16:49:17.900455 run osmo-hlr_10.42.42.2(pid=29985): stdout: | (launched: 2022-12-12_16:49:14.528662) 16:49:17.949681 run osmo-hlr_10.42.42.2(pid=29985): stderr: | 20221212164914705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164914705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164914705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164914705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164914705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164914706 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164914718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164914726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164914727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164914727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:17.999345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29978): Terminating (SIGTERM) 16:49:18.039313 run iperf3-srv_10.42.42.10(pid=29979): Terminating (SIGTERM) 16:49:18.079013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29980): Terminating (SIGTERM) 16:49:18.118831 run iperf3-srv_10.42.42.10(pid=29981): Terminating (SIGTERM) 16:49:18.158220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29984): Terminating (SIGTERM) 16:49:18.198111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29987): Terminating (SIGTERM) 16:49:18.237608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29990): Terminating (SIGTERM) 16:49:18.277640 --- ParallelTerminationStrategy: PID 29978 died... 16:49:18.296839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29978): Terminated: ok {rc=0} 16:49:18.340782 --- ParallelTerminationStrategy: PID 29979 died... 16:49:18.359279 run iperf3-srv_10.42.42.10(pid=29979): Terminated {rc=256} 16:49:18.403588 --- ParallelTerminationStrategy: PID 29980 died... 16:49:18.422226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29980): Terminated: ok {rc=0} 16:49:18.466004 --- ParallelTerminationStrategy: PID 29981 died... 16:49:18.484461 run iperf3-srv_10.42.42.10(pid=29981): Terminated {rc=256} 16:49:18.528124 --- ParallelTerminationStrategy: PID 29984 died... 16:49:18.546728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29984): Terminated: ok {rc=0} 16:49:18.590606 --- ParallelTerminationStrategy: PID 29987 died... 16:49:18.609289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29987): Terminated: ok {rc=0} 16:49:18.653583 --- ParallelTerminationStrategy: PID 29990 died... 16:49:18.672225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29990): Terminated: ok {rc=0} 16:49:18.755447 bus /gobi_0: Setting Powered False 16:49:19.849459 bus /gobi_0: Setting Powered False 16:49:20.963785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:49:22.109875 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:22.121508 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:49:22.191805 tst iperf3.py: using LAC 30191 16:49:22.312735 tst iperf3.py: using RAC 101 16:49:22.432033 tst iperf3.py: using CellId 30191 16:49:22.553021 tst iperf3.py: using BVCI 30192 16:49:22.663191 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:22.674243 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:22.684933 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:22.695675 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:22.706294 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:22.716941 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:22.727796 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:22.739222 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:22.750055 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:49:22.869183 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:49:23.088212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:23.413118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29992): Launched 16:49:23.696630 run iperf3-srv_10.42.42.10(pid=29993): Launched 16:49:23.818358 tst iperf3.py:8: start network... 16:49:24.036671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:24.539124 run create_hlr_db(pid=29994): Launched 16:49:24.664055 bus /gobi_6: Setting Powered False 16:49:25.728680 run create_hlr_db(pid=29994): Terminated: ok {rc=0} 16:49:26.162409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29996): Launched 16:49:26.467757 run osmo-hlr_10.42.42.2(pid=29997): Launched 16:49:26.584298 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:27.111419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29999): Launched 16:49:27.415710 run osmo-stp_10.42.42.5(pid=30000): Launched 16:49:27.531110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:28.055756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30002): Launched 16:49:28.172165 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:28.428586 run patchelf(pid=30003): Launched 16:49:28.598144 run osmo-stp_10.42.42.5(pid=30000): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30000)] 16:49:28.726626 run osmo-stp_10.42.42.5(pid=30000): stdout: | (launched: 2022-12-12_16:49:27.359319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:28.856886 run osmo-stp_10.42.42.5(pid=30000): stderr: | 20221212164927527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164927527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164927527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164927528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164927528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164927528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164927528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:28.987568 run osmo-stp_10.42.42.5(pid=30000): stdout: | (launched: 2022-12-12_16:49:27.359319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:29.112032 run osmo-stp_10.42.42.5(pid=30000): stderr: | 20221212164927527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164927527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164927527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164927528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164927528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164927528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164927528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:29.259410 run patchelf(pid=30003): Terminating (SIGINT) 16:49:29.429403 run patchelf(pid=30003): Terminated: ok {rc=0} 16:49:29.551791 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30000): Process ended prematurely: osmo-stp_10.42.42.5(pid=30000) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30000)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 16:49:29.561560 tst iperf3.py:8: Test FAILED (7.5 sec) 16:49:29.588839 run osmo-hlr_10.42.42.2(pid=29997): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29997)] 16:49:29.637013 run osmo-hlr_10.42.42.2(pid=29997): stdout: | (launched: 2022-12-12_16:49:26.410860) 16:49:29.686845 run osmo-hlr_10.42.42.2(pid=29997): stderr: | 20221212164926583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164926583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164926583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164926583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164926583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164926583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164926596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164926604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164926604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164926605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:29.737162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29992): Terminating (SIGTERM) 16:49:29.777361 run iperf3-srv_10.42.42.10(pid=29993): Terminating (SIGTERM) 16:49:29.817459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29996): Terminating (SIGTERM) 16:49:29.857588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29999): Terminating (SIGTERM) 16:49:29.897784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30002): Terminating (SIGTERM) 16:49:29.938090 --- ParallelTerminationStrategy: PID 29992 died... 16:49:29.957233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29992): Terminated: ok {rc=0} 16:49:30.001554 --- ParallelTerminationStrategy: PID 29993 died... 16:49:30.020226 run iperf3-srv_10.42.42.10(pid=29993): Terminated {rc=256} 16:49:30.064623 --- ParallelTerminationStrategy: PID 29996 died... 16:49:30.083243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29996): Terminated: ok {rc=0} 16:49:30.127196 --- ParallelTerminationStrategy: PID 29999 died... 16:49:30.145792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29999): Terminated: ok {rc=0} 16:49:30.189653 --- ParallelTerminationStrategy: PID 30002 died... 16:49:30.208417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30002): Terminated: ok {rc=0} 16:49:30.295444 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:49:31.469693 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:31.485882 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:49:31.567563 tst iperf3m4.py: using LAC 30192 16:49:31.687780 tst iperf3m4.py: using RAC 102 16:49:31.806903 tst iperf3m4.py: using CellId 30192 16:49:31.931825 tst iperf3m4.py: using BVCI 30193 16:49:32.046444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:32.058058 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:32.069507 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:32.081590 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:32.092779 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:32.104229 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:32.115797 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:32.127019 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:32.138624 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:49:32.259621 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:49:32.385682 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:49:32.502089 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:49:32.624120 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:49:32.843714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:33.171956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30005): Launched 16:49:33.454909 run iperf3-srv_10.42.42.10(pid=30006): Launched 16:49:33.578500 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:49:33.796770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:34.122830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30007): Launched 16:49:34.409101 run iperf3-srv_10.42.42.10(pid=30012): Launched 16:49:34.538958 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:49:34.756892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:35.083763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30017): Launched 16:49:35.367384 run iperf3-srv_10.42.42.10(pid=30018): Launched 16:49:35.491205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:49:35.709586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:49:36.035344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30019): Launched 16:49:36.319806 run iperf3-srv_10.42.42.10(pid=30020): Launched 16:49:36.441653 tst iperf3m4.py:8: start network... 16:49:36.659066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:37.162761 run create_hlr_db(pid=30021): Launched 16:49:37.288143 bus /gobi_6: Setting Powered False 16:49:38.351322 run create_hlr_db(pid=30021): Terminated: ok {rc=0} 16:49:38.803242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30023): Launched 16:49:39.131636 run osmo-hlr_10.42.42.2(pid=30024): Launched 16:49:39.258297 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:39.817098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30026): Launched 16:49:40.144010 run osmo-stp_10.42.42.5(pid=30027): Launched 16:49:40.268410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:40.829745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30029): Launched 16:49:40.955668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:41.231681 run patchelf(pid=30030): Launched 16:49:41.413743 run osmo-stp_10.42.42.5(pid=30027): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30027)] 16:49:41.550650 run osmo-stp_10.42.42.5(pid=30027): stdout: | (launched: 2022-12-12_16:49:40.084168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:41.689229 run osmo-stp_10.42.42.5(pid=30027): stderr: | 20221212164940274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164940275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164940275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164940275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164940276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164940276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164940276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:41.828043 run osmo-stp_10.42.42.5(pid=30027): stdout: | (launched: 2022-12-12_16:49:40.084168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:41.961207 run osmo-stp_10.42.42.5(pid=30027): stderr: | 20221212164940274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164940275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164940275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164940275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164940276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164940276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164940276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:42.119033 run patchelf(pid=30030): Terminating (SIGINT) 16:49:42.299722 run patchelf(pid=30030): Terminated: ok {rc=0} 16:49:42.429806 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30027): Process ended prematurely: osmo-stp_10.42.42.5(pid=30027) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30027)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:49:42.440282 tst iperf3m4.py:8: Test FAILED (11.0 sec) 16:49:42.470117 run osmo-hlr_10.42.42.2(pid=30024): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30024)] 16:49:42.520356 run osmo-hlr_10.42.42.2(pid=30024): stdout: | (launched: 2022-12-12_16:49:39.071714) 16:49:42.572670 run osmo-hlr_10.42.42.2(pid=30024): stderr: | 20221212164939267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164939267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164939268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164939268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164939268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164939268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164939280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164939288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164939289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164939289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:42.625381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30005): Terminating (SIGTERM) 16:49:42.667624 run iperf3-srv_10.42.42.10(pid=30006): Terminating (SIGTERM) 16:49:42.709803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30007): Terminating (SIGTERM) 16:49:42.752005 run iperf3-srv_10.42.42.10(pid=30012): Terminating (SIGTERM) 16:49:42.794136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30017): Terminating (SIGTERM) 16:49:42.836648 run iperf3-srv_10.42.42.10(pid=30018): Terminating (SIGTERM) 16:49:42.878913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30019): Terminating (SIGTERM) 16:49:42.921556 run iperf3-srv_10.42.42.10(pid=30020): Terminating (SIGTERM) 16:49:42.963922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30023): Terminating (SIGTERM) 16:49:43.006530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30026): Terminating (SIGTERM) 16:49:43.049619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30029): Terminating (SIGTERM) 16:49:43.092531 --- ParallelTerminationStrategy: PID 30005 died... 16:49:43.112834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30005): Terminated: ok {rc=0} 16:49:43.160011 --- ParallelTerminationStrategy: PID 30006 died... 16:49:43.179657 run iperf3-srv_10.42.42.10(pid=30006): Terminated {rc=256} 16:49:43.226696 --- ParallelTerminationStrategy: PID 30007 died... 16:49:43.246286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30007): Terminated: ok {rc=0} 16:49:43.293273 --- ParallelTerminationStrategy: PID 30012 died... 16:49:43.312761 run iperf3-srv_10.42.42.10(pid=30012): Terminated {rc=256} 16:49:43.359489 --- ParallelTerminationStrategy: PID 30017 died... 16:49:43.379134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30017): Terminated: ok {rc=0} 16:49:43.426121 --- ParallelTerminationStrategy: PID 30018 died... 16:49:43.445765 run iperf3-srv_10.42.42.10(pid=30018): Terminated {rc=256} 16:49:43.492473 --- ParallelTerminationStrategy: PID 30019 died... 16:49:43.512112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30019): Terminated: ok {rc=0} 16:49:43.559035 --- ParallelTerminationStrategy: PID 30020 died... 16:49:43.578657 run iperf3-srv_10.42.42.10(pid=30020): Terminated {rc=256} 16:49:43.625662 --- ParallelTerminationStrategy: PID 30023 died... 16:49:43.645290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30023): Terminated: ok {rc=0} 16:49:43.691995 --- ParallelTerminationStrategy: PID 30026 died... 16:49:43.711565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30026): Terminated: ok {rc=0} 16:49:43.758435 --- ParallelTerminationStrategy: PID 30029 died... 16:49:43.778180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30029): Terminated: ok {rc=0} 16:49:43.868365 bus /gobi_4: Setting Powered False 16:49:44.969256 bus /gobi_4: Setting Powered False 16:49:46.097640 bus /gobi_1: Setting Powered False 16:49:47.206515 bus /gobi_1: Setting Powered False 16:49:48.322482 bus /gobi_0: Setting Powered False 16:49:49.422411 bus /gobi_0: Setting Powered False 16:49:50.540092 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:49:51.645305 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:51.657197 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:49:51.728267 tst ping.py: using LAC 30193 16:49:51.846348 tst ping.py: using RAC 103 16:49:51.962937 tst ping.py: using CellId 30193 16:49:52.079663 tst ping.py: using BVCI 30194 16:49:52.189410 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:52.200249 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:52.211008 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:52.221918 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:52.232603 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:52.243354 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:52.254231 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:52.264864 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:49:52.382556 tst ping.py:19: start network... 16:49:52.595952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:49:53.090461 run create_hlr_db(pid=30031): Launched 16:49:53.214418 bus /gobi_6: Setting Powered False 16:49:54.277748 run create_hlr_db(pid=30031): Terminated: ok {rc=0} 16:49:54.725087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30033): Launched 16:49:55.045533 run osmo-hlr_10.42.42.2(pid=30034): Launched 16:49:55.169420 run osmo-stp_10.42.42.5: Starting osmo-stp 16:49:55.725774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30036): Launched 16:49:56.047032 run osmo-stp_10.42.42.5(pid=30037): Launched 16:49:56.168998 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:49:56.720426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30039): Launched 16:49:56.844926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:49:57.115381 run patchelf(pid=30040): Launched 16:49:57.294653 run osmo-stp_10.42.42.5(pid=30037): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30037)] 16:49:57.430096 run osmo-stp_10.42.42.5(pid=30037): stdout: | (launched: 2022-12-12_16:49:55.987694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:57.567282 run osmo-stp_10.42.42.5(pid=30037): stderr: | 20221212164956175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164956176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164956176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164956176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164956177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164956177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164956177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:57.704452 run osmo-stp_10.42.42.5(pid=30037): stdout: | (launched: 2022-12-12_16:49:55.987694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:49:57.835554 run osmo-stp_10.42.42.5(pid=30037): stderr: | 20221212164956175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212164956176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212164956176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212164956176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212164956177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212164956177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212164956177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:49:57.991191 run patchelf(pid=30040): Terminating (SIGINT) 16:49:58.170000 run patchelf(pid=30040): Terminated: ok {rc=0} 16:49:58.298604 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30037): Process ended prematurely: osmo-stp_10.42.42.5(pid=30037) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30037)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 16:49:58.308443 tst ping.py:22: Test FAILED (6.7 sec) 16:49:58.337566 run osmo-hlr_10.42.42.2(pid=30034): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30034)] 16:49:58.388703 run osmo-hlr_10.42.42.2(pid=30034): stdout: | (launched: 2022-12-12_16:49:54.985996) 16:49:58.441442 run osmo-hlr_10.42.42.2(pid=30034): stderr: | 20221212164955181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212164955181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212164955181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212164955181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212164955181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212164955181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212164955194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212164955202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212164955202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212164955202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:49:58.494615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30033): Terminating (SIGTERM) 16:49:58.537135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30036): Terminating (SIGTERM) 16:49:58.579675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30039): Terminating (SIGTERM) 16:49:58.622517 --- ParallelTerminationStrategy: PID 30033 died... 16:49:58.642563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30033): Terminated: ok {rc=0} 16:49:58.689790 --- ParallelTerminationStrategy: PID 30036 died... 16:49:58.709635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30036): Terminated: ok {rc=0} 16:49:58.756580 --- ParallelTerminationStrategy: PID 30039 died... 16:49:58.776354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30039): Terminated: ok {rc=0} 16:49:58.864202 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:49:59.952641 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:49:59.965424 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:50:00.044416 tst ping_idle_ping.py: using LAC 30194 16:50:00.172054 tst ping_idle_ping.py: using RAC 104 16:50:00.295469 tst ping_idle_ping.py: using CellId 30194 16:50:00.424145 tst ping_idle_ping.py: using BVCI 30195 16:50:00.535971 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:50:00.547197 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:50:00.558298 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:50:00.569872 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:50:00.581281 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:50:00.592928 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:50:00.604397 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:50:00.615732 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:50:00.731350 tst ping_idle_ping.py:24: start network... 16:50:00.934840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:01.418893 run create_hlr_db(pid=30044): Launched 16:50:01.573133 bus /gobi_6: Setting Powered False 16:50:02.633274 run create_hlr_db(pid=30044): Terminated: ok {rc=0} 16:50:03.051061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30046): Launched 16:50:03.351432 run osmo-hlr_10.42.42.2(pid=30047): Launched 16:50:03.465784 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:03.995024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30049): Launched 16:50:04.296838 run osmo-stp_10.42.42.5(pid=30050): Launched 16:50:04.410557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:04.928713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30052): Launched 16:50:05.043315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:05.296477 run patchelf(pid=30053): Launched 16:50:05.463468 run osmo-stp_10.42.42.5(pid=30050): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30050)] 16:50:05.590155 run osmo-stp_10.42.42.5(pid=30050): stdout: | (launched: 2022-12-12_16:50:04.240741) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:05.718611 run osmo-stp_10.42.42.5(pid=30050): stderr: | 20221212165004407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165004407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165004408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165004408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165004409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165004409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165004409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:05.847021 run osmo-stp_10.42.42.5(pid=30050): stdout: | (launched: 2022-12-12_16:50:04.240741) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:05.969688 run osmo-stp_10.42.42.5(pid=30050): stderr: | 20221212165004407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165004407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165004408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165004408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165004409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165004409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165004409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:06.115118 run patchelf(pid=30053): Terminating (SIGINT) 16:50:06.282376 run patchelf(pid=30053): Terminated: ok {rc=0} 16:50:06.402960 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30050): Process ended prematurely: osmo-stp_10.42.42.5(pid=30050) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30050)] [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:50:06.412101 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:50:06.439130 run osmo-hlr_10.42.42.2(pid=30047): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30047)] 16:50:06.486804 run osmo-hlr_10.42.42.2(pid=30047): stdout: | (launched: 2022-12-12_16:50:03.296007) 16:50:06.536347 run osmo-hlr_10.42.42.2(pid=30047): stderr: | 20221212165003469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165003469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165003469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165003469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165003469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165003469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165003481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165003490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165003490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165003490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:06.586280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30046): Terminating (SIGTERM) 16:50:06.626193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30049): Terminating (SIGTERM) 16:50:06.666072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30052): Terminating (SIGTERM) 16:50:06.706216 --- ParallelTerminationStrategy: PID 30046 died... 16:50:06.725437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30046): Terminated: ok {rc=0} 16:50:06.769904 --- ParallelTerminationStrategy: PID 30049 died... 16:50:06.788415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30049): Terminated: ok {rc=0} 16:50:06.832550 --- ParallelTerminationStrategy: PID 30052 died... 16:50:06.851297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30052): Terminated: ok {rc=0} 16:50:06.935236 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 16:50:08.240750 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:50:08.248504 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 16:50:08.283000 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 16:50:08.322421 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 16:50:08.411524 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 16:50:08.445061 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 16:50:08.484563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 16:50:09.091058 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 16:50:09.143589 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:09.155377 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:50:09.208425 tst cs_paging_gprs_active.py: using LAC 30195 16:50:09.341423 tst cs_paging_gprs_active.py: using RAC 105 16:50:09.460764 tst cs_paging_gprs_active.py: using CellId 30195 16:50:09.578587 tst cs_paging_gprs_active.py: using BVCI 30196 16:50:09.690300 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:09.701707 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:09.712899 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:09.724372 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:09.735371 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:09.746602 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:09.757831 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:09.768905 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:09.780358 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:09.899896 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:10.020133 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:50:10.240110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:10.567124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30057): Launched 16:50:10.853103 run iperf3-srv_10.42.42.10(pid=30058): Launched 16:50:10.975522 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:50:11.195055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:11.521815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30059): Launched 16:50:11.805184 run iperf3-srv_10.42.42.10(pid=30060): Launched 16:50:11.928034 tst cs_paging_gprs_active.py:38: start network... 16:50:12.147805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:12.652354 run create_hlr_db(pid=30061): Launched 16:50:12.779511 bus /gobi_6: Setting Powered False 16:50:13.844363 run create_hlr_db(pid=30061): Terminated: ok {rc=0} 16:50:14.279731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30063): Launched 16:50:14.608057 run osmo-hlr_10.42.42.2(pid=30064): Launched 16:50:14.734031 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:15.295994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30066): Launched 16:50:15.621543 run osmo-stp_10.42.42.5(pid=30067): Launched 16:50:15.748142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:16.449743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30069): Launched 16:50:16.585224 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:16.865777 run patchelf(pid=30070): Launched 16:50:17.062961 run osmo-stp_10.42.42.5(pid=30067): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30067)] 16:50:17.204014 run osmo-stp_10.42.42.5(pid=30067): stdout: | (launched: 2022-12-12_16:50:15.561590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:17.343634 run osmo-stp_10.42.42.5(pid=30067): stderr: | 20221212165015752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165015752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165015752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165015753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165015753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165015753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165015753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:17.483024 run osmo-stp_10.42.42.5(pid=30067): stdout: | (launched: 2022-12-12_16:50:15.561590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:17.616843 run osmo-stp_10.42.42.5(pid=30067): stderr: | 20221212165015752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165015752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165015752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165015753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165015753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165015753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165015753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:17.774969 run patchelf(pid=30070): Terminating (SIGINT) 16:50:17.955871 run patchelf(pid=30070): Terminated: ok {rc=0} 16:50:18.087626 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30067): Process ended prematurely: osmo-stp_10.42.42.5(pid=30067) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30067)] [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 16:50:18.098037 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 16:50:18.127484 run osmo-hlr_10.42.42.2(pid=30064): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30064)] 16:50:18.178006 run osmo-hlr_10.42.42.2(pid=30064): stdout: | (launched: 2022-12-12_16:50:14.548063) 16:50:18.230540 run osmo-hlr_10.42.42.2(pid=30064): stderr: | 20221212165014743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165014744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165014744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165014744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165014744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165014744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165014756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165014764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165014765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165014765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:18.283722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30057): Terminating (SIGTERM) 16:50:18.326329 run iperf3-srv_10.42.42.10(pid=30058): Terminating (SIGTERM) 16:50:18.368737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30059): Terminating (SIGTERM) 16:50:18.411222 run iperf3-srv_10.42.42.10(pid=30060): Terminating (SIGTERM) 16:50:18.453569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30063): Terminating (SIGTERM) 16:50:18.495947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30066): Terminating (SIGTERM) 16:50:18.538459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30069): Terminating (SIGTERM) 16:50:18.581076 --- ParallelTerminationStrategy: PID 30057 died... 16:50:18.600693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30057): Terminated: ok {rc=0} 16:50:18.647653 --- ParallelTerminationStrategy: PID 30058 died... 16:50:18.667205 run iperf3-srv_10.42.42.10(pid=30058): Terminated {rc=256} 16:50:18.714272 --- ParallelTerminationStrategy: PID 30059 died... 16:50:18.733724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30059): Terminated: ok {rc=0} 16:50:18.780268 --- ParallelTerminationStrategy: PID 30060 died... 16:50:18.799771 run iperf3-srv_10.42.42.10(pid=30060): Terminated {rc=256} 16:50:18.846498 --- ParallelTerminationStrategy: PID 30063 died... 16:50:18.866100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30063): Terminated: ok {rc=0} 16:50:18.913500 --- ParallelTerminationStrategy: PID 30066 died... 16:50:18.933272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30066): Terminated: ok {rc=0} 16:50:18.980038 --- ParallelTerminationStrategy: PID 30069 died... 16:50:18.999761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30069): Terminated: ok {rc=0} 16:50:19.089659 bus /gobi_0: Setting Powered False 16:50:20.189197 bus /gobi_0: Setting Powered False 16:50:21.305078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 16:50:22.453212 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:22.465351 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:50:22.523472 tst iperf3.py: using LAC 30196 16:50:22.651500 tst iperf3.py: using RAC 106 16:50:22.777577 tst iperf3.py: using CellId 30196 16:50:22.895582 tst iperf3.py: using BVCI 30197 16:50:23.005836 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:23.017192 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:23.028101 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:23.039178 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:23.050299 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:23.061439 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:23.072558 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:23.083579 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:23.094876 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:23.210103 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:50:23.413956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:23.719666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30071): Launched 16:50:23.984855 run iperf3-srv_10.42.42.10(pid=30072): Launched 16:50:24.099135 tst iperf3.py:8: start network... 16:50:24.302527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:24.774898 run create_hlr_db(pid=30073): Launched 16:50:24.901335 bus /gobi_6: Setting Powered False 16:50:25.961683 run create_hlr_db(pid=30073): Terminated: ok {rc=0} 16:50:26.405348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30075): Launched 16:50:26.730609 run osmo-hlr_10.42.42.2(pid=30076): Launched 16:50:26.856147 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:27.416343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30078): Launched 16:50:27.742681 run osmo-stp_10.42.42.5(pid=30079): Launched 16:50:27.866199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:28.426234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30081): Launched 16:50:28.551718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:28.826450 run patchelf(pid=30082): Launched 16:50:29.007843 run osmo-stp_10.42.42.5(pid=30079): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30079)] 16:50:29.145842 run osmo-stp_10.42.42.5(pid=30079): stdout: | (launched: 2022-12-12_16:50:27.682510) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:29.285137 run osmo-stp_10.42.42.5(pid=30079): stderr: | 20221212165027871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165027871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165027872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165027872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165027873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165027873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165027873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:29.424521 run osmo-stp_10.42.42.5(pid=30079): stdout: | (launched: 2022-12-12_16:50:27.682510) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:29.557596 run osmo-stp_10.42.42.5(pid=30079): stderr: | 20221212165027871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165027871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165027872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165027872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165027873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165027873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165027873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:29.715263 run patchelf(pid=30082): Terminating (SIGINT) 16:50:29.896432 run patchelf(pid=30082): Terminated: ok {rc=0} 16:50:30.027560 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30079): Process ended prematurely: osmo-stp_10.42.42.5(pid=30079) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30079)] [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 16:50:30.038010 tst iperf3.py:8: Test FAILED (7.6 sec) 16:50:30.067402 run osmo-hlr_10.42.42.2(pid=30076): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30076)] 16:50:30.118106 run osmo-hlr_10.42.42.2(pid=30076): stdout: | (launched: 2022-12-12_16:50:26.671039) 16:50:30.170328 run osmo-hlr_10.42.42.2(pid=30076): stderr: | 20221212165026865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165026865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165026865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165026866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165026866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165026866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165026878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165026889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165026889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165026889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:30.222863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30071): Terminating (SIGTERM) 16:50:30.265151 run iperf3-srv_10.42.42.10(pid=30072): Terminating (SIGTERM) 16:50:30.307138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30075): Terminating (SIGTERM) 16:50:30.349301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30078): Terminating (SIGTERM) 16:50:30.391441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30081): Terminating (SIGTERM) 16:50:30.433652 --- ParallelTerminationStrategy: PID 30071 died... 16:50:30.453673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30071): Terminated: ok {rc=0} 16:50:30.500480 --- ParallelTerminationStrategy: PID 30072 died... 16:50:30.520416 run iperf3-srv_10.42.42.10(pid=30072): Terminated {rc=256} 16:50:30.566767 --- ParallelTerminationStrategy: PID 30075 died... 16:50:30.586224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30075): Terminated: ok {rc=0} 16:50:30.632621 --- ParallelTerminationStrategy: PID 30078 died... 16:50:30.652157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30078): Terminated: ok {rc=0} 16:50:30.698547 --- ParallelTerminationStrategy: PID 30081 died... 16:50:30.718081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30081): Terminated: ok {rc=0} 16:50:30.817538 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 16:50:31.995874 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:32.009728 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:50:32.067066 tst iperf3m4.py: using LAC 30197 16:50:32.227788 tst iperf3m4.py: using RAC 107 16:50:32.347481 tst iperf3m4.py: using CellId 30197 16:50:32.468918 tst iperf3m4.py: using BVCI 30198 16:50:32.580003 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:32.591439 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:32.602764 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:32.614734 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:32.626595 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:32.638368 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:32.650351 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:32.662258 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:32.674304 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:32.793498 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:32.912285 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:33.028491 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:33.145590 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:50:33.349821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:33.656380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30083): Launched 16:50:33.923034 run iperf3-srv_10.42.42.10(pid=30084): Launched 16:50:34.038043 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:50:34.241113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:34.546730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30085): Launched 16:50:34.811620 run iperf3-srv_10.42.42.10(pid=30086): Launched 16:50:34.925759 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:50:35.130487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:35.437128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Launched 16:50:35.702816 run iperf3-srv_10.42.42.10(pid=30088): Launched 16:50:35.816388 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:50:36.018647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:50:36.323459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30089): Launched 16:50:36.588757 run iperf3-srv_10.42.42.10(pid=30090): Launched 16:50:36.702676 tst iperf3m4.py:8: start network... 16:50:36.904801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:37.377736 run create_hlr_db(pid=30091): Launched 16:50:37.504076 bus /gobi_6: Setting Powered False 16:50:38.565195 run create_hlr_db(pid=30091): Terminated: ok {rc=0} 16:50:39.009379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30093): Launched 16:50:39.335568 run osmo-hlr_10.42.42.2(pid=30094): Launched 16:50:39.460017 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:40.022312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30096): Launched 16:50:40.347263 run osmo-stp_10.42.42.5(pid=30097): Launched 16:50:40.471418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:41.033687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30099): Launched 16:50:41.161289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:41.437210 run patchelf(pid=30100): Launched 16:50:41.619591 run osmo-stp_10.42.42.5(pid=30097): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30097)] 16:50:41.757455 run osmo-stp_10.42.42.5(pid=30097): stdout: | (launched: 2022-12-12_16:50:40.287667) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:41.897086 run osmo-stp_10.42.42.5(pid=30097): stderr: | 20221212165040479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165040479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165040479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165040480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165040480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165040480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165040480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:42.036280 run osmo-stp_10.42.42.5(pid=30097): stdout: | (launched: 2022-12-12_16:50:40.287667) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:42.170186 run osmo-stp_10.42.42.5(pid=30097): stderr: | 20221212165040479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165040479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165040479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165040480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165040480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165040480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165040480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:42.328117 run patchelf(pid=30100): Terminating (SIGINT) 16:50:42.509630 run patchelf(pid=30100): Terminated: ok {rc=0} 16:50:42.640219 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30097): Process ended prematurely: osmo-stp_10.42.42.5(pid=30097) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30097)] [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 16:50:42.650645 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:50:42.680465 run osmo-hlr_10.42.42.2(pid=30094): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30094)] 16:50:42.730734 run osmo-hlr_10.42.42.2(pid=30094): stdout: | (launched: 2022-12-12_16:50:39.275726) 16:50:42.782840 run osmo-hlr_10.42.42.2(pid=30094): stderr: | 20221212165039473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165039473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165039473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165039473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165039473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165039473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165039486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165039494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165039494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165039494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:42.835930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30083): Terminating (SIGTERM) 16:50:42.878223 run iperf3-srv_10.42.42.10(pid=30084): Terminating (SIGTERM) 16:50:42.920233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30085): Terminating (SIGTERM) 16:50:42.962180 run iperf3-srv_10.42.42.10(pid=30086): Terminating (SIGTERM) 16:50:43.003625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Terminating (SIGTERM) 16:50:43.046195 run iperf3-srv_10.42.42.10(pid=30088): Terminating (SIGTERM) 16:50:43.088003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30089): Terminating (SIGTERM) 16:50:43.130216 run iperf3-srv_10.42.42.10(pid=30090): Terminating (SIGTERM) 16:50:43.172040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30093): Terminating (SIGTERM) 16:50:43.214107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30096): Terminating (SIGTERM) 16:50:43.256057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30099): Terminating (SIGTERM) 16:50:43.298330 --- ParallelTerminationStrategy: PID 30083 died... 16:50:43.318008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30083): Terminated: ok {rc=0} 16:50:43.364709 --- ParallelTerminationStrategy: PID 30084 died... 16:50:43.384205 run iperf3-srv_10.42.42.10(pid=30084): Terminated {rc=256} 16:50:43.430488 --- ParallelTerminationStrategy: PID 30085 died... 16:50:43.449964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30085): Terminated: ok {rc=0} 16:50:43.496380 --- ParallelTerminationStrategy: PID 30086 died... 16:50:43.515789 run iperf3-srv_10.42.42.10(pid=30086): Terminated {rc=256} 16:50:43.562123 --- ParallelTerminationStrategy: PID 30087 died... 16:50:43.581648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Terminated: ok {rc=0} 16:50:43.627991 --- ParallelTerminationStrategy: PID 30088 died... 16:50:43.647447 run iperf3-srv_10.42.42.10(pid=30088): Terminated {rc=256} 16:50:43.693683 --- ParallelTerminationStrategy: PID 30089 died... 16:50:43.713278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30089): Terminated: ok {rc=0} 16:50:43.759785 --- ParallelTerminationStrategy: PID 30090 died... 16:50:43.779280 run iperf3-srv_10.42.42.10(pid=30090): Terminated {rc=256} 16:50:43.825643 --- ParallelTerminationStrategy: PID 30093 died... 16:50:43.845295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30093): Terminated: ok {rc=0} 16:50:43.891832 --- ParallelTerminationStrategy: PID 30096 died... 16:50:43.911395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30096): Terminated: ok {rc=0} 16:50:43.957854 --- ParallelTerminationStrategy: PID 30099 died... 16:50:43.977438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30099): Terminated: ok {rc=0} 16:50:44.066612 bus /gobi_4: Setting Powered False 16:50:45.166803 bus /gobi_4: Setting Powered False 16:50:46.286151 bus /gobi_1: Setting Powered False 16:50:47.386964 bus /gobi_1: Setting Powered False 16:50:48.503330 bus /gobi_0: Setting Powered False 16:50:49.601750 bus /gobi_0: Setting Powered False 16:50:50.718374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 16:50:51.822199 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:51.834631 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:50:51.889425 tst ping.py: using LAC 30198 16:50:52.015715 tst ping.py: using RAC 108 16:50:52.141608 tst ping.py: using CellId 30198 16:50:52.266405 tst ping.py: using BVCI 30199 16:50:52.383982 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:52.395860 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:52.407408 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:52.419388 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:52.431235 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:52.443071 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:52.455028 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:52.466893 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:50:52.582854 tst ping.py:19: start network... 16:50:52.781811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:50:53.244277 run create_hlr_db(pid=30101): Launched 16:50:53.359264 bus /gobi_6: Setting Powered False 16:50:54.418997 run create_hlr_db(pid=30101): Terminated: ok {rc=0} 16:50:54.834747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30103): Launched 16:50:55.132883 run osmo-hlr_10.42.42.2(pid=30104): Launched 16:50:55.245801 run osmo-stp_10.42.42.5: Starting osmo-stp 16:50:55.761103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30106): Launched 16:50:56.060386 run osmo-stp_10.42.42.5(pid=30107): Launched 16:50:56.174352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:50:56.689498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30109): Launched 16:50:56.803623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:50:57.057238 run patchelf(pid=30110): Launched 16:50:57.225130 run osmo-stp_10.42.42.5(pid=30107): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30107)] 16:50:57.351313 run osmo-stp_10.42.42.5(pid=30107): stdout: | (launched: 2022-12-12_16:50:56.005096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:57.479189 run osmo-stp_10.42.42.5(pid=30107): stderr: | 20221212165056171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165056171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165056172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165056172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165056173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165056173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165056173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:57.607793 run osmo-stp_10.42.42.5(pid=30107): stdout: | (launched: 2022-12-12_16:50:56.005096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:50:57.731282 run osmo-stp_10.42.42.5(pid=30107): stderr: | 20221212165056171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165056171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165056172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165056172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165056173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165056173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165056173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:50:57.876799 run patchelf(pid=30110): Terminating (SIGINT) 16:50:58.044050 run patchelf(pid=30110): Terminated: ok {rc=0} 16:50:58.164643 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30107): Process ended prematurely: osmo-stp_10.42.42.5(pid=30107) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30107)] [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 16:50:58.173785 tst ping.py:22: Test FAILED (6.3 sec) 16:50:58.201145 run osmo-hlr_10.42.42.2(pid=30104): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30104)] 16:50:58.248675 run osmo-hlr_10.42.42.2(pid=30104): stdout: | (launched: 2022-12-12_16:50:55.077593) 16:50:58.297941 run osmo-hlr_10.42.42.2(pid=30104): stderr: | 20221212165055252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165055252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165055252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165055252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165055252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165055252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165055265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165055274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165055274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165055274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:50:58.347799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30103): Terminating (SIGTERM) 16:50:58.387438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30106): Terminating (SIGTERM) 16:50:58.427198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30109): Terminating (SIGTERM) 16:50:58.467209 --- ParallelTerminationStrategy: PID 30103 died... 16:50:58.486205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30103): Terminated: ok {rc=0} 16:50:58.530214 --- ParallelTerminationStrategy: PID 30106 died... 16:50:58.548606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30106): Terminated: ok {rc=0} 16:50:58.592888 --- ParallelTerminationStrategy: PID 30109 died... 16:50:58.612163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30109): Terminated: ok {rc=0} 16:50:58.695861 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 16:50:59.782690 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:50:59.795766 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 16:50:59.853822 tst ping_idle_ping.py: using LAC 30199 16:50:59.974932 tst ping_idle_ping.py: using RAC 109 16:51:00.094331 tst ping_idle_ping.py: using CellId 30199 16:51:00.211985 tst ping_idle_ping.py: using BVCI 30200 16:51:00.322444 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:00.334100 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:00.345481 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:00.357135 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:00.368595 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:00.380249 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:00.391779 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 16:51:00.403281 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 16:51:00.523504 tst ping_idle_ping.py:24: start network... 16:51:00.739661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:01.253332 run create_hlr_db(pid=30111): Launched 16:51:01.406119 bus /gobi_6: Setting Powered False 16:51:02.469609 run create_hlr_db(pid=30111): Terminated: ok {rc=0} 16:51:02.898446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30113): Launched 16:51:03.198182 run osmo-hlr_10.42.42.2(pid=30114): Launched 16:51:03.312497 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:03.833053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30116): Launched 16:51:04.134153 run osmo-stp_10.42.42.5(pid=30117): Launched 16:51:04.248881 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:51:04.767129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30119): Launched 16:51:04.882664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:51:05.136610 run patchelf(pid=30120): Launched 16:51:05.303860 run osmo-stp_10.42.42.5(pid=30117): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30117)] 16:51:05.431062 run osmo-stp_10.42.42.5(pid=30117): stdout: | (launched: 2022-12-12_16:51:04.078360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:05.560158 run osmo-stp_10.42.42.5(pid=30117): stderr: | 20221212165104246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165104246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165104247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165104247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165104248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165104248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165104248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:05.689857 run osmo-stp_10.42.42.5(pid=30117): stdout: | (launched: 2022-12-12_16:51:04.078360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:05.813563 run osmo-stp_10.42.42.5(pid=30117): stderr: | 20221212165104246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165104246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165104247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165104247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165104248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165104248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165104248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:05.959209 run patchelf(pid=30120): Terminating (SIGINT) 16:51:06.126999 run patchelf(pid=30120): Terminated: ok {rc=0} 16:51:06.247867 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30117): Process ended prematurely: osmo-stp_10.42.42.5(pid=30117) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30117)] [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 16:51:06.257041 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 16:51:06.284601 run osmo-hlr_10.42.42.2(pid=30114): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30114)] 16:51:06.332862 run osmo-hlr_10.42.42.2(pid=30114): stdout: | (launched: 2022-12-12_16:51:03.142654) 16:51:06.382705 run osmo-hlr_10.42.42.2(pid=30114): stderr: | 20221212165103316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165103317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165103317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165103317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165103317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165103317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165103329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165103339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165103339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165103339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:06.433211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30113): Terminating (SIGTERM) 16:51:06.473571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30116): Terminating (SIGTERM) 16:51:06.513909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30119): Terminating (SIGTERM) 16:51:06.555009 --- ParallelTerminationStrategy: PID 30113 died... 16:51:06.574172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30113): Terminated: ok {rc=0} 16:51:06.619288 --- ParallelTerminationStrategy: PID 30116 died... 16:51:06.638189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30116): Terminated: ok {rc=0} 16:51:06.682792 --- ParallelTerminationStrategy: PID 30119 died... 16:51:06.701767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30119): Terminated: ok {rc=0} 16:51:06.788439 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:51:08.093880 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:08.101112 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:51:08.134832 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:51:08.169297 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:51:08.223473 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:51:08.259093 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:51:08.295350 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:51:08.856885 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:51:08.862399 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:51:08.874243 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:51:08.946188 tst switch_tch_pdch.py: using LAC 30200 16:51:09.073930 tst switch_tch_pdch.py: using RAC 110 16:51:09.198704 tst switch_tch_pdch.py: using CellId 30200 16:51:09.323704 tst switch_tch_pdch.py: using BVCI 30201 16:51:09.439039 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:51:09.450726 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:51:09.462169 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:51:09.473746 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:51:09.485214 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:51:09.496556 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:51:09.508130 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:51:09.519740 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:51:09.640401 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:51:09.755843 tst switch_tch_pdch.py:51: start network... 16:51:09.955342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:10.416755 run create_hlr_db(pid=30124): Launched 16:51:10.531044 bus /gobi_6: Setting Powered False 16:51:11.591163 run create_hlr_db(pid=30124): Terminated: ok {rc=0} 16:51:12.027223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30126): Launched 16:51:12.346577 run osmo-hlr_10.42.42.2(pid=30127): Launched 16:51:12.469853 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:13.015657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30129): Launched 16:51:13.336594 run osmo-stp_10.42.42.5(pid=30130): Launched 16:51:13.458336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:51:14.013398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30132): Launched 16:51:14.137754 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:51:14.407271 run patchelf(pid=30133): Launched 16:51:14.586658 run osmo-stp_10.42.42.5(pid=30130): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30130)] 16:51:14.722058 run osmo-stp_10.42.42.5(pid=30130): stdout: | (launched: 2022-12-12_16:51:13.277905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:14.858630 run osmo-stp_10.42.42.5(pid=30130): stderr: | 20221212165113468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165113468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165113468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165113469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165113469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165113469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165113469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:14.995874 run osmo-stp_10.42.42.5(pid=30130): stdout: | (launched: 2022-12-12_16:51:13.277905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:15.127473 run osmo-stp_10.42.42.5(pid=30130): stderr: | 20221212165113468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165113468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165113468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165113469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165113469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165113469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165113469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:15.282590 run patchelf(pid=30133): Terminating (SIGINT) 16:51:15.460262 run patchelf(pid=30133): Terminated: ok {rc=0} 16:51:15.589179 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30130): Process ended prematurely: osmo-stp_10.42.42.5(pid=30130) [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30130)] [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:51:15.599232 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:51:15.628239 run osmo-hlr_10.42.42.2(pid=30127): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30127)] 16:51:15.678835 run osmo-hlr_10.42.42.2(pid=30127): stdout: | (launched: 2022-12-12_16:51:12.288238) 16:51:15.731595 run osmo-hlr_10.42.42.2(pid=30127): stderr: | 20221212165112483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165112483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165112483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165112483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165112483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165112483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165112495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165112505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165112506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165112506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:15.785067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30126): Terminating (SIGTERM) 16:51:15.829341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30129): Terminating (SIGTERM) 16:51:15.873939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30132): Terminating (SIGTERM) 16:51:15.917401 --- ParallelTerminationStrategy: PID 30126 died... 16:51:15.937325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30126): Terminated: ok {rc=0} 16:51:15.985533 --- ParallelTerminationStrategy: PID 30129 died... 16:51:16.005564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30129): Terminated: ok {rc=0} 16:51:16.053409 --- ParallelTerminationStrategy: PID 30132 died... 16:51:16.073902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30132): Terminated: ok {rc=0} 16:51:16.166015 bus /gobi_0: Setting Powered False 16:51:17.279559 bus /gobi_0: Setting Powered False 16:51:18.396761 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:51:19.645931 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:19.651991 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:51:19.687774 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:51:19.723091 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:51:19.777500 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:51:19.810853 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:51:19.845789 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:51:20.400898 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:51:20.406379 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:51:20.417792 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:51:20.488359 tst switch_tch_pdch.py: using LAC 30201 16:51:20.617513 tst switch_tch_pdch.py: using RAC 111 16:51:20.741548 tst switch_tch_pdch.py: using CellId 30201 16:51:20.859404 tst switch_tch_pdch.py: using BVCI 30202 16:51:20.968695 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:51:20.979878 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:51:20.990849 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:51:21.002883 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:51:21.014653 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:51:21.026532 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:51:21.038414 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:51:21.050084 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:51:21.169657 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:51:21.289667 tst switch_tch_pdch.py:51: start network... 16:51:21.494799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:21.938246 run create_hlr_db(pid=30138): Launched 16:51:22.073108 bus /gobi_6: Setting Powered False 16:51:23.135694 run create_hlr_db(pid=30138): Terminated: ok {rc=0} 16:51:23.537531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30140): Launched 16:51:23.839355 run osmo-hlr_10.42.42.2(pid=30141): Launched 16:51:23.953446 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:24.447074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30143): Launched 16:51:24.747369 run osmo-stp_10.42.42.5(pid=30144): Launched 16:51:24.861672 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:51:25.349626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30146): Launched 16:51:25.464505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:51:25.717116 run patchelf(pid=30147): Launched 16:51:25.883889 run osmo-stp_10.42.42.5(pid=30144): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30144)] 16:51:26.010226 run osmo-stp_10.42.42.5(pid=30144): stdout: | (launched: 2022-12-12_16:51:24.692085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:26.138391 run osmo-stp_10.42.42.5(pid=30144): stderr: | 20221212165124858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165124858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165124858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165124859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165124859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165124859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165124859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:26.266383 run osmo-stp_10.42.42.5(pid=30144): stdout: | (launched: 2022-12-12_16:51:24.692085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:26.388574 run osmo-stp_10.42.42.5(pid=30144): stderr: | 20221212165124858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165124858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165124858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165124859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165124859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165124859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165124859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:26.533491 run patchelf(pid=30147): Terminating (SIGINT) 16:51:26.699917 run patchelf(pid=30147): Terminated: ok {rc=0} 16:51:26.819885 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30144): Process ended prematurely: osmo-stp_10.42.42.5(pid=30144) [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30144)] [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:51:26.829175 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 16:51:26.856107 run osmo-hlr_10.42.42.2(pid=30141): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30141)] 16:51:26.904180 run osmo-hlr_10.42.42.2(pid=30141): stdout: | (launched: 2022-12-12_16:51:23.783686) 16:51:26.953603 run osmo-hlr_10.42.42.2(pid=30141): stderr: | 20221212165123956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165123956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165123956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165123956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165123956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165123956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165123968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165123977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165123978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165123978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:27.003804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30140): Terminating (SIGTERM) 16:51:27.043957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30143): Terminating (SIGTERM) 16:51:27.084083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30146): Terminating (SIGTERM) 16:51:27.124296 --- ParallelTerminationStrategy: PID 30140 died... 16:51:27.143367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30140): Terminated: ok {rc=0} 16:51:27.187605 --- ParallelTerminationStrategy: PID 30143 died... 16:51:27.206236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30143): Terminated: ok {rc=0} 16:51:27.250783 --- ParallelTerminationStrategy: PID 30146 died... 16:51:27.269264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30146): Terminated: ok {rc=0} 16:51:27.355651 bus /gobi_0: Setting Powered False 16:51:28.455890 bus /gobi_0: Setting Powered False 16:51:29.569275 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_sms:trx-lms --------------------------------------------------------------------- 16:51:30.825102 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:30.834669 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 16:51:30.874354 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 16:51:30.881659 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 16:51:30.941810 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 16:51:30.984144 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 16:51:30.991529 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 16:51:31.516434 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 16:51:31.523014 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 16:51:31.538052 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 16:51:31.596689 tst mo_mt_sms.py: using LAC 30202 16:51:31.753421 tst mo_mt_sms.py: using RAC 112 16:51:31.909576 tst mo_mt_sms.py: using CellId 30202 16:51:32.062335 tst mo_mt_sms.py: using BVCI 30203 16:51:32.205860 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 16:51:32.336154 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 16:51:32.454587 tst mo_mt_sms.py:9: start nitb and bts... 16:51:32.670847 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:51:33.321161 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30151): Launched 16:51:33.640056 run osmo-nitb_10.42.42.2(pid=30152): Launched 16:51:33.817022 run osmo-nitb_10.42.42.2(pid=30152): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30152)] 16:51:33.960533 run osmo-nitb_10.42.42.2(pid=30152): stdout: | (launched: 2022-12-12_16:51:33.581485) 16:51:34.105214 run osmo-nitb_10.42.42.2(pid=30152): stderr: | (launched: 2022-12-12_16:51:33.628750) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:51:34.249320 run osmo-nitb_10.42.42.2(pid=30152): stdout: | (launched: 2022-12-12_16:51:33.581485) 16:51:34.387998 run osmo-nitb_10.42.42.2(pid=30152): stderr: | (launched: 2022-12-12_16:51:33.628750) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30152): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30152) [trial-2379↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30152)] 16:51:34.760472 tst osmo-nitb_10.42.42.2(pid=30152): stdout: | (launched: 2022-12-12_16:51:33.581485) 16:51:34.888831 tst osmo-nitb_10.42.42.2(pid=30152): stderr: | (launched: 2022-12-12_16:51:33.628750) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:51:35.039980 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30152): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30152) [trial-2379↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30152)] [trial-2379↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 16:51:35.049217 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 16:51:35.056343 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30151): Terminating (SIGTERM) 16:51:35.266808 --- ParallelTerminationStrategy: PID 30151 died... 16:51:35.288416 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30151): Terminated: ok {rc=0} 16:51:35.375788 bus /sierra_3: Setting Powered False 16:51:36.472154 bus /sierra_3: Setting Powered False 16:51:37.589492 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 sms:trx-lms --------------------------------------------------------------------- 16:51:38.787802 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:38.792340 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 16:51:38.826525 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:51:38.853849 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 16:51:38.907567 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 16:51:38.941754 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:51:38.969270 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 16:51:39.514765 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 16:51:39.519872 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:39.530917 tst sms:trx-lms: Using 1 x bts (candidates: 1) 16:51:39.579021 tst mo_mt_sms.py: using LAC 30203 16:51:39.704633 tst mo_mt_sms.py: using RAC 113 16:51:39.828852 tst mo_mt_sms.py: using CellId 30203 16:51:39.952417 tst mo_mt_sms.py: using BVCI 30204 16:51:40.062448 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:40.073162 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:40.083722 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:40.094925 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:40.106044 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:40.117141 tst sms:trx-lms: Using 1 x modem (candidates: 2) 16:51:40.234956 tst sms:trx-lms: Using 1 x modem (candidates: 2) 16:51:40.354899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:40.819612 run create_hlr_db(pid=30156): Launched 16:51:40.934387 bus /sierra_2: Setting Powered False 16:51:41.995365 run create_hlr_db(pid=30156): Terminated: ok {rc=0} 16:51:42.432216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30158): Launched 16:51:42.751346 run osmo-hlr_10.42.42.2(pid=30159): Launched 16:51:42.873979 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:43.423852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30161): Launched 16:51:43.742583 run osmo-stp_10.42.42.5(pid=30162): Launched 16:51:43.865626 run osmo-msc_10.42.42.6: Starting osmo-msc 16:51:44.445205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30164): Launched 16:51:44.765760 run osmo-msc_10.42.42.6(pid=30165): Launched 16:51:44.944625 run osmo-stp_10.42.42.5(pid=30162): ERR: Terminated: ERROR {rc=1} [trial-2379↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30162)] 16:51:45.079309 run osmo-stp_10.42.42.5(pid=30162): stdout: | (launched: 2022-12-12_16:51:43.683812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:45.213873 run osmo-stp_10.42.42.5(pid=30162): stderr: | 20221212165143873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165143873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165143873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165143874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165143874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165143874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165143874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:45.347415 run osmo-stp_10.42.42.5(pid=30162): stdout: | (launched: 2022-12-12_16:51:43.683812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:51:45.474209 run osmo-stp_10.42.42.5(pid=30162): stderr: | 20221212165143873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165143873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165143873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165143874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165143874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165143874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165143874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:51:45.625893 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30162): Process ended prematurely: osmo-stp_10.42.42.5(pid=30162) [trial-2379↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30162)] [trial-2379↪sms:trx-lms↪mo_mt_sms.py:16] 16:51:45.634860 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 16:51:45.662091 run osmo-hlr_10.42.42.2(pid=30159): ERR: Terminated: ERROR {rc=237} [trial-2379↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30159)] 16:51:45.711945 run osmo-hlr_10.42.42.2(pid=30159): stdout: | (launched: 2022-12-12_16:51:42.692716) 16:51:45.763226 run osmo-hlr_10.42.42.2(pid=30159): stderr: | 20221212165142889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165142889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165142889 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165142889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165142889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165142889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165142901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165142910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165142910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165142910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:51:45.845347 run osmo-msc_10.42.42.6(pid=30165): ERR: Terminated: ERROR {rc=2} [trial-2379↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30165)] 16:51:45.909373 run osmo-msc_10.42.42.6(pid=30165): stdout: | (launched: 2022-12-12_16:51:44.707235) 16:51:45.961649 run osmo-msc_10.42.42.6(pid=30165): stderr: | 20221212165145027 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165145027 DLGLOBAL DEBUG validating counter group 0x7f6500e7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165145027 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165145027 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165145028 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165145028 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165145030 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165145030 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165145030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165145030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:51:46.019141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30158): Terminating (SIGTERM) 16:51:46.075193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30161): Terminating (SIGTERM) 16:51:46.119609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30164): Terminating (SIGTERM) 16:51:46.164675 --- ParallelTerminationStrategy: PID 30158 died... 16:51:46.184756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30158): Terminated: ok {rc=0} 16:51:46.233881 --- ParallelTerminationStrategy: PID 30161 died... 16:51:46.254713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30161): Terminated: ok {rc=0} 16:51:46.302208 --- ParallelTerminationStrategy: PID 30164 died... 16:51:46.321914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30164): Terminated: ok {rc=0} 16:51:46.415287 bus /sierra_3: Setting Powered False 16:51:47.526583 bus /sierra_3: Setting Powered False 16:51:48.642526 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-lms --------------------------------------------------------------------- 16:51:49.874148 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:49.878057 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 16:51:49.912588 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 16:51:49.919561 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 16:51:49.953918 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 16:51:49.987204 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 16:51:49.993987 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 16:51:50.513995 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 16:51:50.519191 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 16:51:50.529967 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 16:51:50.582042 tst assert_extension.py: using LAC 30204 16:51:50.699780 tst assert_extension.py: using RAC 114 16:51:50.815145 tst assert_extension.py: using CellId 30204 16:51:50.931364 tst assert_extension.py: using BVCI 30205 16:51:51.039649 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 16:51:51.154832 tst assert_extension.py:10: start nitb and bts... 16:51:51.354401 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:51:51.966694 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30170): Launched 16:51:52.266549 run osmo-nitb_10.42.42.2(pid=30171): Launched 16:51:52.432243 run osmo-nitb_10.42.42.2(pid=30171): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30171)] 16:51:52.565922 run osmo-nitb_10.42.42.2(pid=30171): stdout: | (launched: 2022-12-12_16:51:52.211008) 16:51:52.701222 run osmo-nitb_10.42.42.2(pid=30171): stderr: | (launched: 2022-12-12_16:51:52.255183) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:51:52.836521 run osmo-nitb_10.42.42.2(pid=30171): stdout: | (launched: 2022-12-12_16:51:52.211008) 16:51:52.966274 run osmo-nitb_10.42.42.2(pid=30171): stderr: | (launched: 2022-12-12_16:51:52.255183) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30171): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30171) [trial-2379↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30171)] 16:51:53.379674 tst osmo-nitb_10.42.42.2(pid=30171): stdout: | (launched: 2022-12-12_16:51:52.211008) 16:51:53.501032 tst osmo-nitb_10.42.42.2(pid=30171): stderr: | (launched: 2022-12-12_16:51:52.255183) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:51:53.643426 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30171): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30171) [trial-2379↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30171)] [trial-2379↪nitb_ussd:trx-lms↪assert_extension.py:12] 16:51:53.652034 tst assert_extension.py:12: Test FAILED (3.1 sec) 16:51:53.658762 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30170): Terminating (SIGTERM) 16:51:53.869823 --- ParallelTerminationStrategy: PID 30170 died... 16:51:53.890752 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30170): Terminated: ok {rc=0} 16:51:53.979022 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 ussd:trx-lms --------------------------------------------------------------------- 16:51:55.160739 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:51:55.165283 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 16:51:55.199784 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:51:55.227257 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 16:51:55.263567 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 16:51:55.297403 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:51:55.324574 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 16:51:55.853858 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 ussd:trx-lms assert_extension.py ---------------------------------------------- 16:51:55.859729 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:55.871232 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 16:51:55.918912 tst assert_extension.py: using LAC 30205 16:51:56.038332 tst assert_extension.py: using RAC 115 16:51:56.166150 tst assert_extension.py: using CellId 30205 16:51:56.291600 tst assert_extension.py: using BVCI 30206 16:51:56.407123 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:56.418359 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:56.429431 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:56.440574 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:56.451784 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 16:51:56.462914 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 16:51:56.582402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:51:57.077443 run create_hlr_db(pid=30175): Launched 16:51:57.207514 bus /sierra_2: Setting Powered False 16:51:58.270622 run create_hlr_db(pid=30175): Terminated: ok {rc=0} 16:51:58.699270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30177): Launched 16:51:58.999602 run osmo-hlr_10.42.42.2(pid=30178): Launched 16:51:59.113876 run osmo-stp_10.42.42.5: Starting osmo-stp 16:51:59.643295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30180): Launched 16:51:59.942803 run osmo-stp_10.42.42.5(pid=30181): Launched 16:52:00.057929 run osmo-msc_10.42.42.6: Starting osmo-msc 16:52:00.597981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30183): Launched 16:52:00.910193 run osmo-msc_10.42.42.6(pid=30184): Launched 16:52:01.274402 run osmo-stp_10.42.42.5(pid=30181): ERR: Terminated: ERROR {rc=1} [trial-2379↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30181)] 16:52:01.407300 run osmo-stp_10.42.42.5(pid=30181): stdout: | (launched: 2022-12-12_16:51:59.887356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:01.595609 run osmo-stp_10.42.42.5(pid=30181): stderr: | 20221212165200056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165200056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165200056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165200057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165200057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165200057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165200058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:01.802762 run osmo-stp_10.42.42.5(pid=30181): stdout: | (launched: 2022-12-12_16:51:59.887356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:01.925742 run osmo-stp_10.42.42.5(pid=30181): stderr: | 20221212165200056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165200056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165200056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165200057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165200057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165200057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165200058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:02.072304 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30181): Process ended prematurely: osmo-stp_10.42.42.5(pid=30181) [trial-2379↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30181)] [trial-2379↪ussd:trx-lms↪assert_extension.py:17] 16:52:02.082048 tst assert_extension.py:17: Test FAILED (6.2 sec) 16:52:02.111922 run osmo-hlr_10.42.42.2(pid=30178): ERR: Terminated: ERROR {rc=237} [trial-2379↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30178)] 16:52:02.162556 run osmo-hlr_10.42.42.2(pid=30178): stdout: | (launched: 2022-12-12_16:51:58.944157) 16:52:02.214806 run osmo-hlr_10.42.42.2(pid=30178): stderr: | 20221212165159118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165159118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165159118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165159118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165159118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165159118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165159130 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165159141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165159142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165159142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:02.286825 run osmo-msc_10.42.42.6(pid=30184): ERR: Terminated: ERROR {rc=2} [trial-2379↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30184)] 16:52:02.337344 run osmo-msc_10.42.42.6(pid=30184): stdout: | (launched: 2022-12-12_16:52:00.843366) 16:52:02.389121 run osmo-msc_10.42.42.6(pid=30184): stderr: | 20221212165201439 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165201439 DLGLOBAL DEBUG validating counter group 0x7f0ecbc62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165201441 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165201441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165201441 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165201441 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165201443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165201443 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165201444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165201444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:52:02.441675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30177): Terminating (SIGTERM) 16:52:02.484571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30180): Terminating (SIGTERM) 16:52:02.525532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30183): Terminating (SIGTERM) 16:52:02.566884 --- ParallelTerminationStrategy: PID 30177 died... 16:52:02.586338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30177): Terminated: ok {rc=0} 16:52:02.632447 --- ParallelTerminationStrategy: PID 30180 died... 16:52:02.651229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30180): Terminated: ok {rc=0} 16:52:02.697121 --- ParallelTerminationStrategy: PID 30183 died... 16:52:02.715948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30183): Terminated: ok {rc=0} 16:52:02.804852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:52:04.018499 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:52:04.025939 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 16:52:04.060072 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 16:52:04.088060 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 16:52:04.141559 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 16:52:04.175596 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 16:52:04.203103 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 16:52:04.754255 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 16:52:04.807381 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:04.819179 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:52:04.891086 tst mo_mt_call.py: using LAC 30206 16:52:05.019431 tst mo_mt_call.py: using RAC 116 16:52:05.147643 tst mo_mt_call.py: using CellId 30206 16:52:05.276303 tst mo_mt_call.py: using BVCI 30207 16:52:05.394087 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:05.405613 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:05.416780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:05.428449 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:05.440099 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:05.451707 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:52:05.568229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:52:05.683439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:06.158392 run create_hlr_db(pid=30189): Launched 16:52:06.274200 bus /sierra_2: Setting Powered False 16:52:07.335141 run create_hlr_db(pid=30189): Terminated: ok {rc=0} 16:52:07.781694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30191): Launched 16:52:08.107664 run osmo-hlr_10.42.42.2(pid=30192): Launched 16:52:08.232127 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:08.791972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30194): Launched 16:52:09.118636 run osmo-stp_10.42.42.5(pid=30195): Launched 16:52:09.245240 run osmo-msc_10.42.42.6: Starting osmo-msc 16:52:09.833962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30197): Launched 16:52:10.159627 run osmo-msc_10.42.42.6(pid=30198): Launched 16:52:10.341694 run osmo-stp_10.42.42.5(pid=30195): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30195)] 16:52:10.478119 run osmo-stp_10.42.42.5(pid=30195): stdout: | (launched: 2022-12-12_16:52:09.058533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:10.614318 run osmo-stp_10.42.42.5(pid=30195): stderr: | 20221212165209248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165209248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165209248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165209249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165209249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165209250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165209250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:10.749935 run osmo-stp_10.42.42.5(pid=30195): stdout: | (launched: 2022-12-12_16:52:09.058533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:10.878909 run osmo-stp_10.42.42.5(pid=30195): stderr: | 20221212165209248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165209248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165209248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165209249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165209249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165209250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165209250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:11.033576 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30195): Process ended prematurely: osmo-stp_10.42.42.5(pid=30195) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30195)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 16:52:11.043495 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 16:52:11.071928 run osmo-hlr_10.42.42.2(pid=30192): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30192)] 16:52:11.122920 run osmo-hlr_10.42.42.2(pid=30192): stdout: | (launched: 2022-12-12_16:52:08.047537) 16:52:11.175256 run osmo-hlr_10.42.42.2(pid=30192): stderr: | 20221212165208244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165208244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165208244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165208244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165208244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165208244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165208257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165208265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165208266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165208266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:11.247774 run osmo-msc_10.42.42.6(pid=30198): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30198)] 16:52:11.297974 run osmo-msc_10.42.42.6(pid=30198): stdout: | (launched: 2022-12-12_16:52:10.099414) 16:52:11.349794 run osmo-msc_10.42.42.6(pid=30198): stderr: | 20221212165210421 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165210421 DLGLOBAL DEBUG validating counter group 0x7fb67f9e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165210421 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165210421 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165210421 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165210421 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165210423 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165210423 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165210424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165210424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:52:11.402022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30191): Terminating (SIGTERM) 16:52:11.443978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30194): Terminating (SIGTERM) 16:52:11.485939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30197): Terminating (SIGTERM) 16:52:11.528162 --- ParallelTerminationStrategy: PID 30191 died... 16:52:11.548275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30191): Terminated: ok {rc=0} 16:52:11.595181 --- ParallelTerminationStrategy: PID 30194 died... 16:52:11.615035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30194): Terminated: ok {rc=0} 16:52:11.661727 --- ParallelTerminationStrategy: PID 30197 died... 16:52:11.681690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30197): Terminated: ok {rc=0} 16:52:11.770844 bus /sierra_3: Setting Powered False 16:52:12.870798 bus /sierra_3: Setting Powered False 16:52:13.989376 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 16:52:15.139632 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:15.152150 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 16:52:15.224374 tst mo_mt_call_osmux.py: using LAC 30207 16:52:15.354841 tst mo_mt_call_osmux.py: using RAC 117 16:52:15.481322 tst mo_mt_call_osmux.py: using CellId 30207 16:52:15.610647 tst mo_mt_call_osmux.py: using BVCI 30208 16:52:15.729668 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:15.741585 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:15.752917 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:15.765254 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:15.777151 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 16:52:15.788918 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:52:15.933458 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 16:52:16.064170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:16.582019 run create_hlr_db(pid=30200): Launched 16:52:16.746545 bus /sierra_2: Setting Powered False 16:52:17.806974 run create_hlr_db(pid=30200): Terminated: ok {rc=0} 16:52:18.266892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Launched 16:52:18.594103 run osmo-hlr_10.42.42.2(pid=30203): Launched 16:52:18.718176 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:19.280583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Launched 16:52:19.606012 run osmo-stp_10.42.42.5(pid=30206): Launched 16:52:19.731812 run osmo-msc_10.42.42.6: Starting osmo-msc 16:52:20.321915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Launched 16:52:20.649139 run osmo-msc_10.42.42.6(pid=30209): Launched 16:52:20.829641 run osmo-stp_10.42.42.5(pid=30206): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] 16:52:20.965768 run osmo-stp_10.42.42.5(pid=30206): stdout: | (launched: 2022-12-12_16:52:19.546279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:21.102967 run osmo-stp_10.42.42.5(pid=30206): stderr: | 20221212165219737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165219737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165219738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165219738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165219738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165219739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165219739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:21.238724 run osmo-stp_10.42.42.5(pid=30206): stdout: | (launched: 2022-12-12_16:52:19.546279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:21.368263 run osmo-stp_10.42.42.5(pid=30206): stderr: | 20221212165219737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165219737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165219738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165219738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165219738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165219739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165219739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:21.523002 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30206): Process ended prematurely: osmo-stp_10.42.42.5(pid=30206) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 16:52:21.532884 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:52:21.561521 run osmo-hlr_10.42.42.2(pid=30203): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30203)] 16:52:21.611796 run osmo-hlr_10.42.42.2(pid=30203): stdout: | (launched: 2022-12-12_16:52:18.534201) 16:52:21.663743 run osmo-hlr_10.42.42.2(pid=30203): stderr: | 20221212165218731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165218731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165218731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165218731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165218731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165218732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165218792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165218802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165218802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165218802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:21.736328 run osmo-msc_10.42.42.6(pid=30209): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30209)] 16:52:21.786264 run osmo-msc_10.42.42.6(pid=30209): stdout: | (launched: 2022-12-12_16:52:20.588890) 16:52:21.838017 run osmo-msc_10.42.42.6(pid=30209): stderr: | 20221212165220909 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165220909 DLGLOBAL DEBUG validating counter group 0x7f4adada7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165220909 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165220909 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165220910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165220910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165220911 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165220912 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165220912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165220912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:52:21.890457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Terminating (SIGTERM) 16:52:21.932221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Terminating (SIGTERM) 16:52:21.974379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Terminating (SIGTERM) 16:52:22.016653 --- ParallelTerminationStrategy: PID 30202 died... 16:52:22.036857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Terminated: ok {rc=0} 16:52:22.083409 --- ParallelTerminationStrategy: PID 30205 died... 16:52:22.103397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Terminated: ok {rc=0} 16:52:22.149979 --- ParallelTerminationStrategy: PID 30208 died... 16:52:22.169681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Terminated: ok {rc=0} 16:52:22.258332 bus /sierra_3: Setting Powered False 16:52:23.357870 bus /sierra_3: Setting Powered False 16:52:24.476161 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 16:52:25.731908 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:52:25.739319 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 16:52:25.773662 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 16:52:25.801037 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 16:52:25.853317 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 16:52:25.887566 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 16:52:25.914703 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 16:52:26.462984 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 16:52:26.512286 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:26.523359 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:52:26.591137 tst mo_mt_call.py: using LAC 30208 16:52:26.711067 tst mo_mt_call.py: using RAC 118 16:52:26.830880 tst mo_mt_call.py: using CellId 30208 16:52:26.952277 tst mo_mt_call.py: using BVCI 30209 16:52:27.062352 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:27.073450 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:27.084388 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:27.095554 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:27.106852 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:27.118164 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:52:27.235794 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:52:27.356382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:27.861687 run create_hlr_db(pid=30214): Launched 16:52:27.984286 bus /sierra_2: Setting Powered False 16:52:29.045781 run create_hlr_db(pid=30214): Terminated: ok {rc=0} 16:52:29.471708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30216): Launched 16:52:29.777261 run osmo-hlr_10.42.42.2(pid=30217): Launched 16:52:29.894778 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:30.424414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30219): Launched 16:52:30.728887 run osmo-stp_10.42.42.5(pid=30220): Launched 16:52:30.903207 run osmo-msc_10.42.42.6: Starting osmo-msc 16:52:31.679005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30222): Launched 16:52:32.023189 run osmo-msc_10.42.42.6(pid=30223): Launched 16:52:32.248064 run osmo-stp_10.42.42.5(pid=30220): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30220)] 16:52:32.396134 run osmo-stp_10.42.42.5(pid=30220): stdout: | (launched: 2022-12-12_16:52:30.672773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:32.535721 run osmo-stp_10.42.42.5(pid=30220): stderr: | 20221212165230905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165230905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165230905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165230906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165230906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165230907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165230907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:32.673574 run osmo-stp_10.42.42.5(pid=30220): stdout: | (launched: 2022-12-12_16:52:30.672773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:32.803002 run osmo-stp_10.42.42.5(pid=30220): stderr: | 20221212165230905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165230905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165230905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165230906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165230906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165230907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165230907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:32.957575 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30220): Process ended prematurely: osmo-stp_10.42.42.5(pid=30220) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30220)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 16:52:32.967505 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 16:52:32.995663 run osmo-hlr_10.42.42.2(pid=30217): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30217)] 16:52:33.045501 run osmo-hlr_10.42.42.2(pid=30217): stdout: | (launched: 2022-12-12_16:52:29.720843) 16:52:33.097338 run osmo-hlr_10.42.42.2(pid=30217): stderr: | 20221212165229896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165229896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165229896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165229896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165229896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165229896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165229908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165229917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165229917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165229917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:33.169665 run osmo-msc_10.42.42.6(pid=30223): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30223)] 16:52:33.219467 run osmo-msc_10.42.42.6(pid=30223): stdout: | (launched: 2022-12-12_16:52:31.961669) 16:52:33.271198 run osmo-msc_10.42.42.6(pid=30223): stderr: | 20221212165232395 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165232395 DLGLOBAL DEBUG validating counter group 0x7f83180c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165232395 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165232395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165232396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165232396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165232398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165232398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165232398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165232398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:52:33.323107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30216): Terminating (SIGTERM) 16:52:33.364792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30219): Terminating (SIGTERM) 16:52:33.407046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30222): Terminating (SIGTERM) 16:52:33.449085 --- ParallelTerminationStrategy: PID 30216 died... 16:52:33.469126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30216): Terminated: ok {rc=0} 16:52:33.515116 --- ParallelTerminationStrategy: PID 30219 died... 16:52:33.534751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30219): Terminated: ok {rc=0} 16:52:33.581371 --- ParallelTerminationStrategy: PID 30222 died... 16:52:33.601110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30222): Terminated: ok {rc=0} 16:52:33.688928 bus /sierra_3: Setting Powered False 16:52:34.788717 bus /sierra_3: Setting Powered False 16:52:35.906998 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 16:52:37.057562 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:37.069974 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 16:52:37.146165 tst mo_mt_call_osmux.py: using LAC 30209 16:52:37.274082 tst mo_mt_call_osmux.py: using RAC 119 16:52:37.402375 tst mo_mt_call_osmux.py: using CellId 30209 16:52:37.529098 tst mo_mt_call_osmux.py: using BVCI 30210 16:52:37.647512 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:37.659125 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:37.670585 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:37.682102 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:37.693517 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 16:52:37.704799 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:52:37.823992 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 16:52:37.941662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:38.415315 run create_hlr_db(pid=30225): Launched 16:52:38.532756 bus /sierra_2: Setting Powered False 16:52:39.593604 run create_hlr_db(pid=30225): Terminated: ok {rc=0} 16:52:40.018566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30227): Launched 16:52:40.324609 run osmo-hlr_10.42.42.2(pid=30228): Launched 16:52:40.442169 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:40.979271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30230): Launched 16:52:41.284308 run osmo-stp_10.42.42.5(pid=30231): Launched 16:52:41.401349 run osmo-msc_10.42.42.6: Starting osmo-msc 16:52:41.952551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30233): Launched 16:52:42.257783 run osmo-msc_10.42.42.6(pid=30234): Launched 16:52:42.427929 run osmo-stp_10.42.42.5(pid=30231): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30231)] 16:52:42.557541 run osmo-stp_10.42.42.5(pid=30231): stdout: | (launched: 2022-12-12_16:52:41.228029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:42.687064 run osmo-stp_10.42.42.5(pid=30231): stderr: | 20221212165241394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165241395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165241395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165241395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165241396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165241396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165241396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:42.813485 run osmo-stp_10.42.42.5(pid=30231): stdout: | (launched: 2022-12-12_16:52:41.228029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:42.934164 run osmo-stp_10.42.42.5(pid=30231): stderr: | 20221212165241394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165241395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165241395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165241395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165241396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165241396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165241396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:43.078714 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30231): Process ended prematurely: osmo-stp_10.42.42.5(pid=30231) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30231)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 16:52:43.087737 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 16:52:43.115023 run osmo-hlr_10.42.42.2(pid=30228): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30228)] 16:52:43.163039 run osmo-hlr_10.42.42.2(pid=30228): stdout: | (launched: 2022-12-12_16:52:40.268061) 16:52:43.212497 run osmo-hlr_10.42.42.2(pid=30228): stderr: | 20221212165240445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165240445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165240445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165240445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165240445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165240445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165240458 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165240468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165240469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165240469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:43.281632 run osmo-msc_10.42.42.6(pid=30234): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30234)] 16:52:43.329339 run osmo-msc_10.42.42.6(pid=30234): stdout: | (launched: 2022-12-12_16:52:42.201707) 16:52:43.378674 run osmo-msc_10.42.42.6(pid=30234): stderr: | 20221212165242474 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165242475 DLGLOBAL DEBUG validating counter group 0x7f2dd1816c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165242475 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165242475 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165242475 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165242475 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165242477 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165242477 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165242477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165242477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:52:43.428396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30227): Terminating (SIGTERM) 16:52:43.467864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30230): Terminating (SIGTERM) 16:52:43.507991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30233): Terminating (SIGTERM) 16:52:43.548019 --- ParallelTerminationStrategy: PID 30227 died... 16:52:43.567093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30227): Terminated: ok {rc=0} 16:52:43.611414 --- ParallelTerminationStrategy: PID 30230 died... 16:52:43.629838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30230): Terminated: ok {rc=0} 16:52:43.673915 --- ParallelTerminationStrategy: PID 30233 died... 16:52:43.692393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30233): Terminated: ok {rc=0} 16:52:43.778231 bus /sierra_3: Setting Powered False 16:52:44.875312 bus /sierra_3: Setting Powered False 16:52:46.000602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 16:52:47.278296 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:52:47.284746 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 16:52:47.317907 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 16:52:47.344106 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 16:52:47.396588 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 16:52:47.431323 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 16:52:47.458936 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 16:52:48.010017 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 16:52:48.063096 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:48.074920 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:52:48.147748 tst mo_mt_call.py: using LAC 30210 16:52:48.277144 tst mo_mt_call.py: using RAC 120 16:52:48.404419 tst mo_mt_call.py: using CellId 30210 16:52:48.532325 tst mo_mt_call.py: using BVCI 30211 16:52:48.653138 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:48.664626 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:48.675875 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:48.687687 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:48.699549 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:48.711360 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:52:48.833402 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:52:48.955688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:49.462269 run create_hlr_db(pid=30240): Launched 16:52:49.595856 bus /sierra_2: Setting Powered False 16:52:50.660600 run create_hlr_db(pid=30240): Terminated: ok {rc=0} 16:52:51.114876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30242): Launched 16:52:51.443241 run osmo-hlr_10.42.42.2(pid=30243): Launched 16:52:51.569449 run osmo-stp_10.42.42.5: Starting osmo-stp 16:52:52.131268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30245): Launched 16:52:52.457413 run osmo-stp_10.42.42.5(pid=30246): Launched 16:52:52.583825 run osmo-msc_10.42.42.6: Starting osmo-msc 16:52:53.173893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30248): Launched 16:52:53.500458 run osmo-msc_10.42.42.6(pid=30249): Launched 16:52:53.683211 run osmo-stp_10.42.42.5(pid=30246): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30246)] 16:52:53.819692 run osmo-stp_10.42.42.5(pid=30246): stdout: | (launched: 2022-12-12_16:52:52.397911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:53.955803 run osmo-stp_10.42.42.5(pid=30246): stderr: | 20221212165252587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165252588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165252588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165252588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165252589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165252589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165252589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:54.091184 run osmo-stp_10.42.42.5(pid=30246): stdout: | (launched: 2022-12-12_16:52:52.397911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:52:54.220175 run osmo-stp_10.42.42.5(pid=30246): stderr: | 20221212165252587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165252588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165252588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165252588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165252589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165252589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165252589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:52:54.374279 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30246): Process ended prematurely: osmo-stp_10.42.42.5(pid=30246) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30246)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 16:52:54.384022 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:52:54.412058 run osmo-hlr_10.42.42.2(pid=30243): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30243)] 16:52:54.462181 run osmo-hlr_10.42.42.2(pid=30243): stdout: | (launched: 2022-12-12_16:52:51.383473) 16:52:54.513711 run osmo-hlr_10.42.42.2(pid=30243): stderr: | 20221212165251580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165251580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165251580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165251580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165251580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165251580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165251593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165251604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165251604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165251604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:52:54.586338 run osmo-msc_10.42.42.6(pid=30249): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30249)] 16:52:54.636161 run osmo-msc_10.42.42.6(pid=30249): stdout: | (launched: 2022-12-12_16:52:53.440905) 16:52:54.687893 run osmo-msc_10.42.42.6(pid=30249): stderr: | 20221212165253762 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165253762 DLGLOBAL DEBUG validating counter group 0x7f49af1d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165253762 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165253762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165253762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165253762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165253764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165253765 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165253765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165253765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:52:54.740067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30242): Terminating (SIGTERM) 16:52:54.781638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30245): Terminating (SIGTERM) 16:52:54.823297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30248): Terminating (SIGTERM) 16:52:54.865031 --- ParallelTerminationStrategy: PID 30242 died... 16:52:54.885005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30242): Terminated: ok {rc=0} 16:52:54.930997 --- ParallelTerminationStrategy: PID 30245 died... 16:52:54.950566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30245): Terminated: ok {rc=0} 16:52:54.996469 --- ParallelTerminationStrategy: PID 30248 died... 16:52:55.015935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30248): Terminated: ok {rc=0} 16:52:55.104590 bus /sierra_3: Setting Powered False 16:52:56.204526 bus /sierra_3: Setting Powered False 16:52:57.322262 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 16:52:58.468642 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:58.480403 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 16:52:58.552281 tst mo_mt_call_osmux.py: using LAC 30211 16:52:58.673311 tst mo_mt_call_osmux.py: using RAC 121 16:52:58.794410 tst mo_mt_call_osmux.py: using CellId 30211 16:52:58.917345 tst mo_mt_call_osmux.py: using BVCI 30212 16:52:59.036730 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:59.048554 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:59.060239 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:59.071820 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:59.083444 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 16:52:59.095194 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:52:59.209320 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 16:52:59.325844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:52:59.800041 run create_hlr_db(pid=30251): Launched 16:52:59.918322 bus /sierra_2: Setting Powered False 16:53:00.999379 run create_hlr_db(pid=30251): Terminated: ok {rc=0} 16:53:01.440558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30253): Launched 16:53:01.766117 run osmo-hlr_10.42.42.2(pid=30254): Launched 16:53:02.003113 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:02.607687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30256): Launched 16:53:02.934516 run osmo-stp_10.42.42.5(pid=30257): Launched 16:53:03.059383 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:03.649094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30259): Launched 16:53:03.974654 run osmo-msc_10.42.42.6(pid=30260): Launched 16:53:04.158077 run osmo-stp_10.42.42.5(pid=30257): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30257)] 16:53:04.295503 run osmo-stp_10.42.42.5(pid=30257): stdout: | (launched: 2022-12-12_16:53:02.874781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:04.433155 run osmo-stp_10.42.42.5(pid=30257): stderr: | 20221212165303066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165303066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165303066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165303067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165303067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165303067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165303067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:04.569122 run osmo-stp_10.42.42.5(pid=30257): stdout: | (launched: 2022-12-12_16:53:02.874781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:04.698851 run osmo-stp_10.42.42.5(pid=30257): stderr: | 20221212165303066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165303066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165303066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165303067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165303067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165303067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165303067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:04.853883 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30257): Process ended prematurely: osmo-stp_10.42.42.5(pid=30257) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30257)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 16:53:04.863746 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 16:53:04.892128 run osmo-hlr_10.42.42.2(pid=30254): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30254)] 16:53:04.942371 run osmo-hlr_10.42.42.2(pid=30254): stdout: | (launched: 2022-12-12_16:53:01.708630) 16:53:04.994494 run osmo-hlr_10.42.42.2(pid=30254): stderr: | 20221212165302052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165302052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165302052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165302065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165302065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165302065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165302079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165302091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165302092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165302092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:05.067224 run osmo-msc_10.42.42.6(pid=30260): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30260)] 16:53:05.117779 run osmo-msc_10.42.42.6(pid=30260): stdout: | (launched: 2022-12-12_16:53:03.914791) 16:53:05.169687 run osmo-msc_10.42.42.6(pid=30260): stderr: | 20221212165304235 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165304235 DLGLOBAL DEBUG validating counter group 0x7f15096f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165304236 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165304236 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165304236 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165304236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165304238 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165304238 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165304238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165304238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:53:05.221953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30253): Terminating (SIGTERM) 16:53:05.263762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30256): Terminating (SIGTERM) 16:53:05.305684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30259): Terminating (SIGTERM) 16:53:05.348122 --- ParallelTerminationStrategy: PID 30253 died... 16:53:05.368316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30253): Terminated: ok {rc=0} 16:53:05.415304 --- ParallelTerminationStrategy: PID 30256 died... 16:53:05.435152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30256): Terminated: ok {rc=0} 16:53:05.481289 --- ParallelTerminationStrategy: PID 30259 died... 16:53:05.500940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30259): Terminated: ok {rc=0} 16:53:05.589315 bus /sierra_3: Setting Powered False 16:53:06.688423 bus /sierra_3: Setting Powered False 16:53:07.805249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 16:53:09.054970 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:53:09.061740 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 16:53:09.095280 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 16:53:09.121978 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 16:53:09.175434 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 16:53:09.208583 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 16:53:09.235124 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 16:53:09.785540 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 16:53:09.834912 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:09.846046 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:53:09.913305 tst mo_mt_call.py: using LAC 30212 16:53:10.031764 tst mo_mt_call.py: using RAC 122 16:53:10.149968 tst mo_mt_call.py: using CellId 30212 16:53:10.269788 tst mo_mt_call.py: using BVCI 30213 16:53:10.382545 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:10.393656 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:10.404484 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:10.415679 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:10.426965 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:10.438306 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:53:10.557330 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:53:10.675413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:11.183655 run create_hlr_db(pid=30276): Launched 16:53:11.317903 bus /sierra_2: Setting Powered False 16:53:12.381939 run create_hlr_db(pid=30276): Terminated: ok {rc=0} 16:53:12.817693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30278): Launched 16:53:13.123888 run osmo-hlr_10.42.42.2(pid=30279): Launched 16:53:13.240048 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:13.775879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30281): Launched 16:53:14.080509 run osmo-stp_10.42.42.5(pid=30282): Launched 16:53:14.198052 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:14.749130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30284): Launched 16:53:15.055073 run osmo-msc_10.42.42.6(pid=30285): Launched 16:53:15.228089 run osmo-stp_10.42.42.5(pid=30282): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30282)] 16:53:15.357756 run osmo-stp_10.42.42.5(pid=30282): stdout: | (launched: 2022-12-12_16:53:14.024192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:15.486306 run osmo-stp_10.42.42.5(pid=30282): stderr: | 20221212165314192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165314192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165314192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165314193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165314193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165314193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165314193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:15.613159 run osmo-stp_10.42.42.5(pid=30282): stdout: | (launched: 2022-12-12_16:53:14.024192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:15.734203 run osmo-stp_10.42.42.5(pid=30282): stderr: | 20221212165314192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165314192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165314192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165314193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165314193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165314193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165314193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:15.881156 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30282): Process ended prematurely: osmo-stp_10.42.42.5(pid=30282) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30282)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 16:53:15.890924 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 16:53:15.918897 run osmo-hlr_10.42.42.2(pid=30279): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30279)] 16:53:15.969176 run osmo-hlr_10.42.42.2(pid=30279): stdout: | (launched: 2022-12-12_16:53:13.067171) 16:53:16.020475 run osmo-hlr_10.42.42.2(pid=30279): stderr: | 20221212165313241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165313241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165313241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165313241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165313241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165313241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165313255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165313263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165313264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165313264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:16.091808 run osmo-msc_10.42.42.6(pid=30285): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30285)] 16:53:16.142118 run osmo-msc_10.42.42.6(pid=30285): stdout: | (launched: 2022-12-12_16:53:14.997777) 16:53:16.194081 run osmo-msc_10.42.42.6(pid=30285): stderr: | 20221212165315267 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165315267 DLGLOBAL DEBUG validating counter group 0x7f7fe56ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165315267 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165315267 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165315267 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165315268 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165315269 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165315270 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165315270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165315270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:53:16.248236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30278): Terminating (SIGTERM) 16:53:16.290992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30281): Terminating (SIGTERM) 16:53:16.335344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30284): Terminating (SIGTERM) 16:53:16.379833 --- ParallelTerminationStrategy: PID 30278 died... 16:53:16.399751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30278): Terminated: ok {rc=0} 16:53:16.448248 --- ParallelTerminationStrategy: PID 30281 died... 16:53:16.467718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30281): Terminated: ok {rc=0} 16:53:16.514796 --- ParallelTerminationStrategy: PID 30284 died... 16:53:16.534445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30284): Terminated: ok {rc=0} 16:53:16.622653 bus /sierra_3: Setting Powered False 16:53:17.721294 bus /sierra_3: Setting Powered False 16:53:18.837987 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 16:53:19.987861 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:20.000218 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 16:53:20.073460 tst mo_mt_call_osmux.py: using LAC 30213 16:53:20.203845 tst mo_mt_call_osmux.py: using RAC 123 16:53:20.332911 tst mo_mt_call_osmux.py: using CellId 30213 16:53:20.467248 tst mo_mt_call_osmux.py: using BVCI 30214 16:53:20.587227 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:20.598962 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:20.610436 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:20.621922 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:20.633348 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 16:53:20.644665 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:53:20.766289 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 16:53:20.887569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:21.396536 run create_hlr_db(pid=30287): Launched 16:53:21.530834 bus /sierra_2: Setting Powered False 16:53:22.596009 run create_hlr_db(pid=30287): Terminated: ok {rc=0} 16:53:23.034101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30289): Launched 16:53:23.343965 run osmo-hlr_10.42.42.2(pid=30290): Launched 16:53:23.462592 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:24.000233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30292): Launched 16:53:24.307288 run osmo-stp_10.42.42.5(pid=30293): Launched 16:53:24.424932 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:24.979671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30295): Launched 16:53:25.288287 run osmo-msc_10.42.42.6(pid=30296): Launched 16:53:25.462075 run osmo-stp_10.42.42.5(pid=30293): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30293)] 16:53:25.592383 run osmo-stp_10.42.42.5(pid=30293): stdout: | (launched: 2022-12-12_16:53:24.250541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:25.722293 run osmo-stp_10.42.42.5(pid=30293): stderr: | 20221212165324418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165324418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165324418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165324419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165324419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165324419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165324419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:25.850088 run osmo-stp_10.42.42.5(pid=30293): stdout: | (launched: 2022-12-12_16:53:24.250541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:25.972478 run osmo-stp_10.42.42.5(pid=30293): stderr: | 20221212165324418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165324418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165324418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165324419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165324419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165324419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165324419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:26.119340 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30293): Process ended prematurely: osmo-stp_10.42.42.5(pid=30293) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30293)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 16:53:26.128559 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 16:53:26.156379 run osmo-hlr_10.42.42.2(pid=30290): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30290)] 16:53:26.204733 run osmo-hlr_10.42.42.2(pid=30290): stdout: | (launched: 2022-12-12_16:53:23.286883) 16:53:26.254790 run osmo-hlr_10.42.42.2(pid=30290): stderr: | 20221212165323461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165323461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165323461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165323461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165323461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165323462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165323477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165323488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165323488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165323488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:26.324572 run osmo-msc_10.42.42.6(pid=30296): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30296)] 16:53:26.373264 run osmo-msc_10.42.42.6(pid=30296): stdout: | (launched: 2022-12-12_16:53:25.231576) 16:53:26.423414 run osmo-msc_10.42.42.6(pid=30296): stderr: | 20221212165325501 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165325501 DLGLOBAL DEBUG validating counter group 0x7f86590c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165325501 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165325501 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165325502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165325502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165325503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165325504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165325504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165325504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:53:26.473919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30289): Terminating (SIGTERM) 16:53:26.514400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30292): Terminating (SIGTERM) 16:53:26.554881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30295): Terminating (SIGTERM) 16:53:26.595767 --- ParallelTerminationStrategy: PID 30289 died... 16:53:26.615260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30289): Terminated: ok {rc=0} 16:53:26.660290 --- ParallelTerminationStrategy: PID 30292 died... 16:53:26.679013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30292): Terminated: ok {rc=0} 16:53:26.724508 --- ParallelTerminationStrategy: PID 30295 died... 16:53:26.743496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30295): Terminated: ok {rc=0} 16:53:26.828440 bus /sierra_3: Setting Powered False 16:53:27.925732 bus /sierra_3: Setting Powered False 16:53:29.044999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 16:53:30.308278 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:53:30.316352 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 16:53:30.349856 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 16:53:30.376075 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 16:53:30.427681 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 16:53:30.460265 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 16:53:30.486221 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 16:53:31.042981 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 16:53:31.109293 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:31.122922 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:53:31.205279 tst mo_mt_call.py: using LAC 30214 16:53:31.364721 tst mo_mt_call.py: using RAC 124 16:53:31.496014 tst mo_mt_call.py: using CellId 30214 16:53:31.619766 tst mo_mt_call.py: using BVCI 30215 16:53:31.751428 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:31.763570 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:31.775596 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:31.788874 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:31.803553 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:31.816601 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:53:31.952612 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:53:32.106290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:32.592486 run create_hlr_db(pid=30301): Launched 16:53:32.711432 bus /sierra_2: Setting Powered False 16:53:33.772365 run create_hlr_db(pid=30301): Terminated: ok {rc=0} 16:53:34.219732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30303): Launched 16:53:34.548918 run osmo-hlr_10.42.42.2(pid=30304): Launched 16:53:34.674732 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:35.235603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30306): Launched 16:53:35.563013 run osmo-stp_10.42.42.5(pid=30307): Launched 16:53:35.688565 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:36.277618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30309): Launched 16:53:36.602926 run osmo-msc_10.42.42.6(pid=30310): Launched 16:53:36.785934 run osmo-stp_10.42.42.5(pid=30307): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30307)] 16:53:36.923055 run osmo-stp_10.42.42.5(pid=30307): stdout: | (launched: 2022-12-12_16:53:35.503315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:37.059855 run osmo-stp_10.42.42.5(pid=30307): stderr: | 20221212165335694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165335694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165335694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165335695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165335695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165335695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165335695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:37.196815 run osmo-stp_10.42.42.5(pid=30307): stdout: | (launched: 2022-12-12_16:53:35.503315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:37.326601 run osmo-stp_10.42.42.5(pid=30307): stderr: | 20221212165335694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165335694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165335694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165335695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165335695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165335695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165335695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:37.481318 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30307): Process ended prematurely: osmo-stp_10.42.42.5(pid=30307) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30307)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 16:53:37.491199 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:53:37.519406 run osmo-hlr_10.42.42.2(pid=30304): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30304)] 16:53:37.569928 run osmo-hlr_10.42.42.2(pid=30304): stdout: | (launched: 2022-12-12_16:53:34.489312) 16:53:37.622101 run osmo-hlr_10.42.42.2(pid=30304): stderr: | 20221212165334685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165334685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165334685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165334685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165334685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165334685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165334697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165334709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165334709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165334709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:37.694626 run osmo-msc_10.42.42.6(pid=30310): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30310)] 16:53:37.744574 run osmo-msc_10.42.42.6(pid=30310): stdout: | (launched: 2022-12-12_16:53:36.543335) 16:53:37.796440 run osmo-msc_10.42.42.6(pid=30310): stderr: | 20221212165336867 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165336867 DLGLOBAL DEBUG validating counter group 0x7f32510a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165336867 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165336868 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165336868 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165336868 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165336870 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165336870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165336870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165336870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:53:37.848595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30303): Terminating (SIGTERM) 16:53:37.890467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30306): Terminating (SIGTERM) 16:53:37.932223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30309): Terminating (SIGTERM) 16:53:37.974499 --- ParallelTerminationStrategy: PID 30303 died... 16:53:37.994657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30303): Terminated: ok {rc=0} 16:53:38.041183 --- ParallelTerminationStrategy: PID 30306 died... 16:53:38.060908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30306): Terminated: ok {rc=0} 16:53:38.107435 --- ParallelTerminationStrategy: PID 30309 died... 16:53:38.127204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30309): Terminated: ok {rc=0} 16:53:38.217233 bus /sierra_3: Setting Powered False 16:53:39.317746 bus /sierra_3: Setting Powered False 16:53:40.434294 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 16:53:41.585232 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:41.597579 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 16:53:41.669321 tst mo_mt_call_osmux.py: using LAC 30215 16:53:41.799282 tst mo_mt_call_osmux.py: using RAC 125 16:53:41.929503 tst mo_mt_call_osmux.py: using CellId 30215 16:53:42.057050 tst mo_mt_call_osmux.py: using BVCI 30216 16:53:42.175683 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:42.187260 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:42.198612 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:42.210034 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:42.221496 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 16:53:42.232827 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:53:42.350880 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 16:53:42.471039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:42.979421 run create_hlr_db(pid=30312): Launched 16:53:43.114346 bus /sierra_2: Setting Powered False 16:53:44.179509 run create_hlr_db(pid=30312): Terminated: ok {rc=0} 16:53:44.615875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30314): Launched 16:53:44.944055 run osmo-hlr_10.42.42.2(pid=30315): Launched 16:53:45.067971 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:45.633573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30317): Launched 16:53:45.970487 run osmo-stp_10.42.42.5(pid=30318): Launched 16:53:46.173258 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:47.011507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30368): Launched 16:53:47.382165 run osmo-msc_10.42.42.6(pid=30376): Launched 16:53:47.769140 run osmo-stp_10.42.42.5(pid=30318): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30318)] 16:53:48.098747 run osmo-stp_10.42.42.5(pid=30318): stdout: | (launched: 2022-12-12_16:53:45.912431) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:48.393544 run osmo-stp_10.42.42.5(pid=30318): stderr: | 20221212165346252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165346252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165346254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165346254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165346254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165346255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165346255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:48.574788 run osmo-stp_10.42.42.5(pid=30318): stdout: | (launched: 2022-12-12_16:53:45.912431) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:53:48.747598 run osmo-stp_10.42.42.5(pid=30318): stderr: | 20221212165346252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165346252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165346254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165346254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165346254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165346255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165346255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:53:48.928647 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30318): Process ended prematurely: osmo-stp_10.42.42.5(pid=30318) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30318)] [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 16:53:48.942035 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 16:53:48.977442 run osmo-hlr_10.42.42.2(pid=30315): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30315)] 16:53:49.041158 run osmo-hlr_10.42.42.2(pid=30315): stdout: | (launched: 2022-12-12_16:53:44.883467) 16:53:49.104870 run osmo-hlr_10.42.42.2(pid=30315): stderr: | 20221212165345081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165345081 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165345081 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165345081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165345081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165345081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165345094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165345102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165345102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165345102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:53:49.192918 run osmo-msc_10.42.42.6(pid=30376): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30376)] 16:53:49.254046 run osmo-msc_10.42.42.6(pid=30376): stdout: | (launched: 2022-12-12_16:53:47.318410) 16:53:49.316759 run osmo-msc_10.42.42.6(pid=30376): stderr: | 20221212165347912 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165347912 DLGLOBAL DEBUG validating counter group 0x7f2fefda9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165347912 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165347912 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165347912 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165347918 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165347920 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165347920 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165347920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165347920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:53:49.386078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30314): Terminating (SIGTERM) 16:53:49.437704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30317): Terminating (SIGTERM) 16:53:49.486792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30368): Terminating (SIGTERM) 16:53:49.541419 --- ParallelTerminationStrategy: PID 30314 died... 16:53:49.564588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30314): Terminated: ok {rc=0} 16:53:49.619881 --- ParallelTerminationStrategy: PID 30317 died... 16:53:49.642593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30317): Terminated: ok {rc=0} 16:53:49.704511 --- ParallelTerminationStrategy: PID 30368 died... 16:53:49.730336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30368): Terminated: ok {rc=0} 16:53:49.843422 bus /sierra_3: Setting Powered False 16:53:50.953785 bus /sierra_3: Setting Powered False 16:53:52.071465 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:53:53.324716 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:53:53.332207 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:53:53.369807 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 16:53:53.398644 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:53:53.454022 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:53:53.489900 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 16:53:53.518567 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:53:54.061257 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 16:53:54.115401 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:53:54.127575 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:53:54.198424 tst mo_mt_call.py: using LAC 30216 16:53:54.320859 tst mo_mt_call.py: using RAC 126 16:53:54.449187 tst mo_mt_call.py: using CellId 30216 16:53:54.573193 tst mo_mt_call.py: using BVCI 30217 16:53:54.689662 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:53:54.702086 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:53:54.715171 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:53:54.728445 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:53:54.740530 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:53:54.753505 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:53:54.876722 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:53:54.989463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:53:55.482438 run create_hlr_db(pid=30597): Launched 16:53:55.619469 bus /sierra_2: Setting Powered False 16:53:56.683065 run create_hlr_db(pid=30597): Terminated: ok {rc=0} 16:53:57.123714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30599): Launched 16:53:57.453573 run osmo-hlr_10.42.42.2(pid=30600): Launched 16:53:57.703155 run osmo-stp_10.42.42.5: Starting osmo-stp 16:53:58.413363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30602): Launched 16:53:58.753812 run osmo-stp_10.42.42.5(pid=30603): Launched 16:53:58.996676 run osmo-msc_10.42.42.6: Starting osmo-msc 16:53:59.675609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30605): Launched 16:54:00.015477 run osmo-msc_10.42.42.6(pid=30606): Launched 16:54:00.385759 run osmo-stp_10.42.42.5(pid=30603): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30603)] 16:54:00.656569 run osmo-stp_10.42.42.5(pid=30603): stdout: | (launched: 2022-12-12_16:53:58.693871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:00.842172 run osmo-stp_10.42.42.5(pid=30603): stderr: | 20221212165358982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165358982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165358983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165358983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165358984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165358984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165358984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:00.993042 run osmo-stp_10.42.42.5(pid=30603): stdout: | (launched: 2022-12-12_16:53:58.693871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:01.125567 run osmo-stp_10.42.42.5(pid=30603): stderr: | 20221212165358982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165358982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165358983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165358983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165358984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165358984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165358984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:01.284589 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30603): Process ended prematurely: osmo-stp_10.42.42.5(pid=30603) [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30603)] [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 16:54:01.294981 tst mo_mt_call.py:8: Test FAILED (7.2 sec) 16:54:01.324905 run osmo-hlr_10.42.42.2(pid=30600): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30600)] 16:54:01.376678 run osmo-hlr_10.42.42.2(pid=30600): stdout: | (launched: 2022-12-12_16:53:57.395134) 16:54:01.430237 run osmo-hlr_10.42.42.2(pid=30600): stderr: | 20221212165357736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165357736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165357736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165357736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165357736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165357736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165357751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165357763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165357763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165357763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:01.504793 run osmo-msc_10.42.42.6(pid=30606): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30606)] 16:54:01.556574 run osmo-msc_10.42.42.6(pid=30606): stdout: | (launched: 2022-12-12_16:53:59.955557) 16:54:01.609642 run osmo-msc_10.42.42.6(pid=30606): stderr: | 20221212165400450 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165400450 DLGLOBAL DEBUG validating counter group 0x7f615166dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165400451 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165400451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165400451 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165400451 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165400461 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165400461 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165400462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165400462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:01.662876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30599): Terminating (SIGTERM) 16:54:01.705792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30602): Terminating (SIGTERM) 16:54:01.748934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30605): Terminating (SIGTERM) 16:54:01.794189 --- ParallelTerminationStrategy: PID 30599 died... 16:54:01.814608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30599): Terminated: ok {rc=0} 16:54:01.863243 --- ParallelTerminationStrategy: PID 30602 died... 16:54:01.883500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30602): Terminated: ok {rc=0} 16:54:01.930720 --- ParallelTerminationStrategy: PID 30605 died... 16:54:01.950904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30605): Terminated: ok {rc=0} 16:54:02.050893 bus /sierra_3: Setting Powered False 16:54:03.157817 bus /sierra_3: Setting Powered False 16:54:04.274826 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 16:54:05.424721 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:54:05.437790 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:54:05.517783 tst mo_mt_call_osmux.py: using LAC 30217 16:54:05.645479 tst mo_mt_call_osmux.py: using RAC 127 16:54:05.770072 tst mo_mt_call_osmux.py: using CellId 30217 16:54:05.893720 tst mo_mt_call_osmux.py: using BVCI 30218 16:54:06.010374 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:54:06.022879 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:54:06.035106 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:54:06.048717 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:54:06.064230 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 16:54:06.076563 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:54:06.198942 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:54:06.321214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:06.816007 run create_hlr_db(pid=30608): Launched 16:54:06.979157 bus /sierra_2: Setting Powered False 16:54:08.041518 run create_hlr_db(pid=30608): Terminated: ok {rc=0} 16:54:08.488621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30610): Launched 16:54:08.820501 run osmo-hlr_10.42.42.2(pid=30611): Launched 16:54:09.071724 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:09.795311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30613): Launched 16:54:10.134126 run osmo-stp_10.42.42.5(pid=30615): Launched 16:54:10.260134 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:10.859498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30617): Launched 16:54:11.188557 run osmo-msc_10.42.42.6(pid=30618): Launched 16:54:11.371380 run osmo-stp_10.42.42.5(pid=30615): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30615)] 16:54:11.508931 run osmo-stp_10.42.42.5(pid=30615): stdout: | (launched: 2022-12-12_16:54:10.072625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:11.646447 run osmo-stp_10.42.42.5(pid=30615): stderr: | 20221212165410269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165410269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165410270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165410270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165410271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165410271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165410271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:11.782999 run osmo-stp_10.42.42.5(pid=30615): stdout: | (launched: 2022-12-12_16:54:10.072625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:11.912872 run osmo-stp_10.42.42.5(pid=30615): stderr: | 20221212165410269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165410269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165410270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165410270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165410271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165410271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165410271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:12.068404 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30615): Process ended prematurely: osmo-stp_10.42.42.5(pid=30615) [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30615)] [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 16:54:12.078163 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 16:54:12.106369 run osmo-hlr_10.42.42.2(pid=30611): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30611)] 16:54:12.156777 run osmo-hlr_10.42.42.2(pid=30611): stdout: | (launched: 2022-12-12_16:54:08.762055) 16:54:12.208571 run osmo-hlr_10.42.42.2(pid=30611): stderr: | 20221212165409108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165409109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165409109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165409109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165409109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165409109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165409123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165409136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165409136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165409136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:12.280814 run osmo-msc_10.42.42.6(pid=30618): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30618)] 16:54:12.330728 run osmo-msc_10.42.42.6(pid=30618): stdout: | (launched: 2022-12-12_16:54:11.127732) 16:54:12.382336 run osmo-msc_10.42.42.6(pid=30618): stderr: | 20221212165411450 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165411450 DLGLOBAL DEBUG validating counter group 0x7f8b20ae1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165411450 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165411450 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165411450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165411450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165411452 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165411452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165411452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165411453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:12.434333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30610): Terminating (SIGTERM) 16:54:12.476068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30613): Terminating (SIGTERM) 16:54:12.518185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30617): Terminating (SIGTERM) 16:54:12.561814 --- ParallelTerminationStrategy: PID 30610 died... 16:54:12.581866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30610): Terminated: ok {rc=0} 16:54:12.627868 --- ParallelTerminationStrategy: PID 30613 died... 16:54:12.647439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30613): Terminated: ok {rc=0} 16:54:12.693254 --- ParallelTerminationStrategy: PID 30617 died... 16:54:12.712882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30617): Terminated: ok {rc=0} 16:54:12.800691 bus /sierra_3: Setting Powered False 16:54:13.898854 bus /sierra_3: Setting Powered False 16:54:15.016170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:54:16.278284 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:16.287701 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:54:16.332531 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 16:54:16.367750 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 16:54:16.424528 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:54:16.470208 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 16:54:16.502164 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 16:54:17.033296 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 16:54:17.088452 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:17.102209 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:54:17.173783 tst mo_mt_call.py: using LAC 30218 16:54:17.303212 tst mo_mt_call.py: using RAC 128 16:54:17.446087 tst mo_mt_call.py: using CellId 30218 16:54:17.579773 tst mo_mt_call.py: using BVCI 30219 16:54:17.699470 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:17.711059 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:17.722223 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:17.733349 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:17.744457 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:17.755724 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:54:17.871563 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:54:17.991816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:18.499589 run create_hlr_db(pid=30623): Launched 16:54:18.633240 bus /sierra_2: Setting Powered False 16:54:19.696834 run create_hlr_db(pid=30623): Terminated: ok {rc=0} 16:54:20.149606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30625): Launched 16:54:20.475720 run osmo-hlr_10.42.42.2(pid=30626): Launched 16:54:20.602059 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:21.161799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30628): Launched 16:54:21.487825 run osmo-stp_10.42.42.5(pid=30629): Launched 16:54:21.613385 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:22.203426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30631): Launched 16:54:22.532031 run osmo-msc_10.42.42.6(pid=30632): Launched 16:54:22.713837 run osmo-stp_10.42.42.5(pid=30629): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30629)] 16:54:22.851215 run osmo-stp_10.42.42.5(pid=30629): stdout: | (launched: 2022-12-12_16:54:21.428208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:22.988773 run osmo-stp_10.42.42.5(pid=30629): stderr: | 20221212165421620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165421620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165421621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165421621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165421622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165421622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165421622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:23.125373 run osmo-stp_10.42.42.5(pid=30629): stdout: | (launched: 2022-12-12_16:54:21.428208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:23.255788 run osmo-stp_10.42.42.5(pid=30629): stderr: | 20221212165421620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165421620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165421621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165421621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165421622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165421622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165421622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:23.411574 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30629): Process ended prematurely: osmo-stp_10.42.42.5(pid=30629) [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30629)] [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 16:54:23.421376 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 16:54:23.449182 run osmo-hlr_10.42.42.2(pid=30626): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30626)] 16:54:23.499078 run osmo-hlr_10.42.42.2(pid=30626): stdout: | (launched: 2022-12-12_16:54:20.415704) 16:54:23.550597 run osmo-hlr_10.42.42.2(pid=30626): stderr: | 20221212165420613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165420613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165420613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165420613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165420613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165420613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165420626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165420637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165420637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165420637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:23.622863 run osmo-msc_10.42.42.6(pid=30632): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30632)] 16:54:23.672549 run osmo-msc_10.42.42.6(pid=30632): stdout: | (launched: 2022-12-12_16:54:22.472125) 16:54:23.724139 run osmo-msc_10.42.42.6(pid=30632): stderr: | 20221212165422795 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165422795 DLGLOBAL DEBUG validating counter group 0x7fd477d3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165422795 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165422795 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165422795 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165422795 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165422797 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165422798 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165422798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165422798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:23.775803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30625): Terminating (SIGTERM) 16:54:23.817257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30628): Terminating (SIGTERM) 16:54:23.858826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30631): Terminating (SIGTERM) 16:54:23.900506 --- ParallelTerminationStrategy: PID 30625 died... 16:54:23.920576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30625): Terminated: ok {rc=0} 16:54:23.966279 --- ParallelTerminationStrategy: PID 30628 died... 16:54:23.985590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30628): Terminated: ok {rc=0} 16:54:24.031031 --- ParallelTerminationStrategy: PID 30631 died... 16:54:24.050554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30631): Terminated: ok {rc=0} 16:54:24.138465 bus /sierra_3: Setting Powered False 16:54:25.237483 bus /sierra_3: Setting Powered False 16:54:26.355304 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 16:54:27.502189 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:27.514085 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:54:27.586101 tst mo_mt_call_osmux.py: using LAC 30219 16:54:27.716758 tst mo_mt_call_osmux.py: using RAC 129 16:54:27.845735 tst mo_mt_call_osmux.py: using CellId 30219 16:54:27.977224 tst mo_mt_call_osmux.py: using BVCI 30220 16:54:28.097398 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:28.108926 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:28.120306 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:28.131504 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:28.142801 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 16:54:28.154381 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:54:28.271286 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 16:54:28.389351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:28.863291 run create_hlr_db(pid=30634): Launched 16:54:28.981387 bus /sierra_2: Setting Powered False 16:54:30.042089 run create_hlr_db(pid=30634): Terminated: ok {rc=0} 16:54:30.487453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30636): Launched 16:54:30.819621 run osmo-hlr_10.42.42.2(pid=30637): Launched 16:54:31.143468 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:31.831408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30639): Launched 16:54:32.168346 run osmo-stp_10.42.42.5(pid=30640): Launched 16:54:32.327884 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:32.920564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30642): Launched 16:54:33.246870 run osmo-msc_10.42.42.6(pid=30643): Launched 16:54:33.430949 run osmo-stp_10.42.42.5(pid=30640): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30640)] 16:54:33.567697 run osmo-stp_10.42.42.5(pid=30640): stdout: | (launched: 2022-12-12_16:54:32.108393) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:33.704876 run osmo-stp_10.42.42.5(pid=30640): stderr: | 20221212165432358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165432358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165432359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165432359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165432360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165432360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165432360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:33.841386 run osmo-stp_10.42.42.5(pid=30640): stdout: | (launched: 2022-12-12_16:54:32.108393) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:33.970948 run osmo-stp_10.42.42.5(pid=30640): stderr: | 20221212165432358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165432358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165432359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165432359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165432360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165432360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165432360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:34.126449 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30640): Process ended prematurely: osmo-stp_10.42.42.5(pid=30640) [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30640)] [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 16:54:34.136028 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 16:54:34.164393 run osmo-hlr_10.42.42.2(pid=30637): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30637)] 16:54:34.214541 run osmo-hlr_10.42.42.2(pid=30637): stdout: | (launched: 2022-12-12_16:54:30.753810) 16:54:34.266267 run osmo-hlr_10.42.42.2(pid=30637): stderr: | 20221212165431080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165431080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165431080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165431080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165431080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165431080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165431098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165431122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165431122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165431123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:34.338483 run osmo-msc_10.42.42.6(pid=30643): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30643)] 16:54:34.388496 run osmo-msc_10.42.42.6(pid=30643): stdout: | (launched: 2022-12-12_16:54:33.187013) 16:54:34.440747 run osmo-msc_10.42.42.6(pid=30643): stderr: | 20221212165433510 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165433510 DLGLOBAL DEBUG validating counter group 0x7f444e3f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165433510 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165433510 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165433510 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165433510 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165433512 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165433512 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165433513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165433513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:34.491160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30636): Terminating (SIGTERM) 16:54:34.531328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30639): Terminating (SIGTERM) 16:54:34.571957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30642): Terminating (SIGTERM) 16:54:34.613626 --- ParallelTerminationStrategy: PID 30636 died... 16:54:34.632644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30636): Terminated: ok {rc=0} 16:54:34.677369 --- ParallelTerminationStrategy: PID 30639 died... 16:54:34.696020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30639): Terminated: ok {rc=0} 16:54:34.741030 --- ParallelTerminationStrategy: PID 30642 died... 16:54:34.759968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30642): Terminated: ok {rc=0} 16:54:34.848299 bus /sierra_3: Setting Powered False 16:54:35.948047 bus /sierra_3: Setting Powered False 16:54:37.064665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 emergency:trx-lms --------------------------------------------------------------------- 16:54:38.312743 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:54:38.318722 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 16:54:38.352637 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 16:54:38.378875 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 16:54:38.461537 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 16:54:38.494142 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 16:54:38.521369 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 16:54:39.104362 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2379 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 16:54:39.109481 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:39.120143 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 16:54:39.169941 tst emergency_mo_mt_call.py: using LAC 30220 16:54:39.287556 tst emergency_mo_mt_call.py: using RAC 130 16:54:39.403369 tst emergency_mo_mt_call.py: using CellId 30220 16:54:39.519230 tst emergency_mo_mt_call.py: using BVCI 30221 16:54:39.627139 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:39.637873 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:39.648272 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:39.659095 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:39.669997 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:39.680605 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:54:39.800917 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:54:39.923331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:40.420104 run create_hlr_db(pid=30655): Launched 16:54:40.550853 bus /sierra_2: Setting Powered False 16:54:41.614268 run create_hlr_db(pid=30655): Terminated: ok {rc=0} 16:54:42.042340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30657): Launched 16:54:42.342878 run osmo-hlr_10.42.42.2(pid=30658): Launched 16:54:42.457196 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:42.985560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30660): Launched 16:54:43.286321 run osmo-stp_10.42.42.5(pid=30661): Launched 16:54:43.413791 tst emergency_mo_mt_call.py: using MSISDN 7870 16:54:43.566229 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:44.105708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30663): Launched 16:54:44.405594 run osmo-msc_10.42.42.6(pid=30664): Launched 16:54:44.573557 run osmo-stp_10.42.42.5(pid=30661): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30661)] 16:54:44.700541 run osmo-stp_10.42.42.5(pid=30661): stdout: | (launched: 2022-12-12_16:54:43.229874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:44.827714 run osmo-stp_10.42.42.5(pid=30661): stderr: | 20221212165443399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165443399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165443400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165443400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165443401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165443401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165443401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:44.952289 run osmo-stp_10.42.42.5(pid=30661): stdout: | (launched: 2022-12-12_16:54:43.229874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:45.070988 run osmo-stp_10.42.42.5(pid=30661): stderr: | 20221212165443399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165443399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165443400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165443400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165443401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165443401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165443401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:45.213864 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30661): Process ended prematurely: osmo-stp_10.42.42.5(pid=30661) [trial-2379↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30661)] [trial-2379↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 16:54:45.222301 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 16:54:45.248583 run osmo-hlr_10.42.42.2(pid=30658): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30658)] 16:54:45.296721 run osmo-hlr_10.42.42.2(pid=30658): stdout: | (launched: 2022-12-12_16:54:42.287216) 16:54:45.346382 run osmo-hlr_10.42.42.2(pid=30658): stderr: | 20221212165442461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165442461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165442461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165442461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165442461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165442461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165442475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165442486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165442486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165442486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:45.414916 run osmo-msc_10.42.42.6(pid=30664): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30664)] 16:54:45.463063 run osmo-msc_10.42.42.6(pid=30664): stdout: | (launched: 2022-12-12_16:54:44.349887) 16:54:45.512120 run osmo-msc_10.42.42.6(pid=30664): stderr: | 20221212165444619 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165444620 DLGLOBAL DEBUG validating counter group 0x7f20231c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165444620 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165444620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165444620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165444620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165444622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165444622 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165444623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165444623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:45.561964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30657): Terminating (SIGTERM) 16:54:45.601503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30660): Terminating (SIGTERM) 16:54:45.641038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30663): Terminating (SIGTERM) 16:54:45.680732 --- ParallelTerminationStrategy: PID 30657 died... 16:54:45.699596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30657): Terminated: ok {rc=0} 16:54:45.743506 --- ParallelTerminationStrategy: PID 30660 died... 16:54:45.761952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30660): Terminated: ok {rc=0} 16:54:45.815046 --- ParallelTerminationStrategy: PID 30663 died... 16:54:45.843572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30663): Terminated: ok {rc=0} 16:54:45.945397 bus /sierra_3: Setting Powered False 16:54:47.045763 bus /sierra_3: Setting Powered False 16:54:48.166518 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 16:54:49.251216 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:49.262563 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 16:54:49.313539 tst emergency_preemptive_call.py: using LAC 30221 16:54:49.442942 tst emergency_preemptive_call.py: using RAC 131 16:54:49.572529 tst emergency_preemptive_call.py: using CellId 30221 16:54:49.692296 tst emergency_preemptive_call.py: using BVCI 30222 16:54:49.802415 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:49.813124 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:49.823570 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:49.834507 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:49.845343 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 16:54:49.855985 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:54:49.974093 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:54:50.090269 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:54:50.205355 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 16:54:50.323040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:54:50.820470 run create_hlr_db(pid=30666): Launched 16:54:50.952327 bus /sierra_2: Setting Powered False 16:54:52.015897 run create_hlr_db(pid=30666): Terminated: ok {rc=0} 16:54:52.461618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30668): Launched 16:54:52.783065 run osmo-hlr_10.42.42.2(pid=30669): Launched 16:54:52.905684 run osmo-stp_10.42.42.5: Starting osmo-stp 16:54:53.460169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30671): Launched 16:54:53.783848 run osmo-stp_10.42.42.5(pid=30672): Launched 16:54:53.917751 tst emergency_preemptive_call.py: using MSISDN 7871 16:54:54.082146 run osmo-msc_10.42.42.6: Starting osmo-msc 16:54:54.656931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30674): Launched 16:54:54.977190 run osmo-msc_10.42.42.6(pid=30675): Launched 16:54:55.156681 run osmo-stp_10.42.42.5(pid=30672): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30672)] 16:54:55.292605 run osmo-stp_10.42.42.5(pid=30672): stdout: | (launched: 2022-12-12_16:54:53.724726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:55.427863 run osmo-stp_10.42.42.5(pid=30672): stderr: | 20221212165453916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165453916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165453916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165453917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165453917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165453917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165453917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:55.563279 run osmo-stp_10.42.42.5(pid=30672): stdout: | (launched: 2022-12-12_16:54:53.724726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:54:55.690130 run osmo-stp_10.42.42.5(pid=30672): stderr: | 20221212165453916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165453916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165453916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165453917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165453917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165453917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165453917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:54:55.842449 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30672): Process ended prematurely: osmo-stp_10.42.42.5(pid=30672) [trial-2379↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30672)] [trial-2379↪emergency:trx-lms↪emergency_preemptive_call.py:32] 16:54:55.851526 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 16:54:55.879116 run osmo-hlr_10.42.42.2(pid=30669): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30669)] 16:54:55.929387 run osmo-hlr_10.42.42.2(pid=30669): stdout: | (launched: 2022-12-12_16:54:52.724215) 16:54:55.981361 run osmo-hlr_10.42.42.2(pid=30669): stderr: | 20221212165452921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165452921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165452921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165452921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165452921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165452921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165452933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165452942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165452942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165452942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:54:56.053958 run osmo-msc_10.42.42.6(pid=30675): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30675)] 16:54:56.104343 run osmo-msc_10.42.42.6(pid=30675): stdout: | (launched: 2022-12-12_16:54:54.918066) 16:54:56.156243 run osmo-msc_10.42.42.6(pid=30675): stderr: | 20221212165455240 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165455240 DLGLOBAL DEBUG validating counter group 0x7f9dcc468c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165455240 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165455240 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165455240 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165455240 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165455242 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165455243 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165455243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165455243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:54:56.209117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30668): Terminating (SIGTERM) 16:54:56.251074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30671): Terminating (SIGTERM) 16:54:56.292897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30674): Terminating (SIGTERM) 16:54:56.335110 --- ParallelTerminationStrategy: PID 30668 died... 16:54:56.355286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30668): Terminated: ok {rc=0} 16:54:56.401632 --- ParallelTerminationStrategy: PID 30671 died... 16:54:56.421207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30671): Terminated: ok {rc=0} 16:54:56.467168 --- ParallelTerminationStrategy: PID 30674 died... 16:54:56.486659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30674): Terminated: ok {rc=0} 16:54:56.575124 bus /sierra_9: Setting Powered False 16:54:57.676805 bus /sierra_9: Setting Powered False 16:54:58.791741 bus /sierra_8: Setting Powered False 16:54:59.891305 bus /sierra_8: Setting Powered False 16:55:01.007725 bus /sierra_3: Setting Powered False 16:55:02.108067 bus /sierra_3: Setting Powered False 16:55:03.226913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-lms --------------------------------------------------------------------- 16:55:04.496932 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:55:04.501326 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 16:55:04.534478 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 16:55:04.572611 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 16:55:04.658817 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 16:55:04.692928 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 16:55:04.732204 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 16:55:05.323387 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 16:55:05.376612 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:05.387843 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:55:05.436430 tst cs_paging_gprs_active.py: using LAC 30222 16:55:05.557954 tst cs_paging_gprs_active.py: using RAC 132 16:55:05.680401 tst cs_paging_gprs_active.py: using CellId 30222 16:55:05.798973 tst cs_paging_gprs_active.py: using BVCI 30223 16:55:05.909141 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:05.919752 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:05.930164 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:05.940812 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:05.951484 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:05.962268 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:05.972929 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:05.983527 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:05.994322 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:55:06.114587 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:55:06.231229 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:55:06.436447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:55:06.744449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30683): Launched 16:55:07.012016 run iperf3-srv_10.42.42.10(pid=30684): Launched 16:55:07.127713 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:55:07.332199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:55:07.641570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30685): Launched 16:55:07.909237 run iperf3-srv_10.42.42.10(pid=30686): Launched 16:55:08.024613 tst cs_paging_gprs_active.py:38: start network... 16:55:08.229380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:08.703738 run create_hlr_db(pid=30687): Launched 16:55:08.821360 bus /sierra_2: Setting Powered False 16:55:09.882385 run create_hlr_db(pid=30687): Terminated: ok {rc=0} 16:55:10.328627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30689): Launched 16:55:10.657421 run osmo-hlr_10.42.42.2(pid=30690): Launched 16:55:10.783989 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:11.347156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30692): Launched 16:55:11.677718 run osmo-stp_10.42.42.5(pid=30693): Launched 16:55:11.804238 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:55:12.368486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30695): Launched 16:55:12.495553 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:55:12.771976 run patchelf(pid=30696): Launched 16:55:12.953508 run osmo-stp_10.42.42.5(pid=30693): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30693)] 16:55:13.091486 run osmo-stp_10.42.42.5(pid=30693): stdout: | (launched: 2022-12-12_16:55:11.616524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:13.231696 run osmo-stp_10.42.42.5(pid=30693): stderr: | 20221212165511809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165511809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165511809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165511809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165511810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165511810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165511810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:13.371528 run osmo-stp_10.42.42.5(pid=30693): stdout: | (launched: 2022-12-12_16:55:11.616524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:13.505548 run osmo-stp_10.42.42.5(pid=30693): stderr: | 20221212165511809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165511809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165511809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165511809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165511810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165511810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165511810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:13.664797 run patchelf(pid=30696): Terminating (SIGINT) 16:55:13.846732 run patchelf(pid=30696): Terminated: ok {rc=0} 16:55:13.978512 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30693): Process ended prematurely: osmo-stp_10.42.42.5(pid=30693) [trial-2379↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30693)] [trial-2379↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 16:55:13.988845 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:55:14.017828 run osmo-hlr_10.42.42.2(pid=30690): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30690)] 16:55:14.068233 run osmo-hlr_10.42.42.2(pid=30690): stdout: | (launched: 2022-12-12_16:55:10.597138) 16:55:14.120360 run osmo-hlr_10.42.42.2(pid=30690): stderr: | 20221212165510795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165510796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165510796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165510796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165510796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165510796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165510808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165510817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165510817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165510817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:14.172917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30683): Terminating (SIGTERM) 16:55:14.215548 run iperf3-srv_10.42.42.10(pid=30684): Terminating (SIGTERM) 16:55:14.257792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30685): Terminating (SIGTERM) 16:55:14.300143 run iperf3-srv_10.42.42.10(pid=30686): Terminating (SIGTERM) 16:55:14.342355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30689): Terminating (SIGTERM) 16:55:14.384572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30692): Terminating (SIGTERM) 16:55:14.426736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30695): Terminating (SIGTERM) 16:55:14.469256 --- ParallelTerminationStrategy: PID 30683 died... 16:55:14.489547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30683): Terminated: ok {rc=0} 16:55:14.536166 --- ParallelTerminationStrategy: PID 30684 died... 16:55:14.555782 run iperf3-srv_10.42.42.10(pid=30684): Terminated {rc=256} 16:55:14.601854 --- ParallelTerminationStrategy: PID 30685 died... 16:55:14.621757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30685): Terminated: ok {rc=0} 16:55:14.667608 --- ParallelTerminationStrategy: PID 30686 died... 16:55:14.687139 run iperf3-srv_10.42.42.10(pid=30686): Terminated {rc=256} 16:55:14.732650 --- ParallelTerminationStrategy: PID 30689 died... 16:55:14.752305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30689): Terminated: ok {rc=0} 16:55:14.797994 --- ParallelTerminationStrategy: PID 30692 died... 16:55:14.817507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30692): Terminated: ok {rc=0} 16:55:14.863063 --- ParallelTerminationStrategy: PID 30695 died... 16:55:14.882638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30695): Terminated: ok {rc=0} 16:55:14.970026 bus /gobi_0: Setting Powered False 16:55:16.075393 bus /gobi_0: Setting Powered False 16:55:17.203601 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms iperf3.py ---------------------------------------------- 16:55:18.353163 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:18.364421 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:55:18.420933 tst iperf3.py: using LAC 30223 16:55:18.538969 tst iperf3.py: using RAC 133 16:55:18.656661 tst iperf3.py: using CellId 30223 16:55:18.774198 tst iperf3.py: using BVCI 30224 16:55:18.884678 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:18.895316 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:18.905792 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:18.916405 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:18.926987 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:18.937591 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:18.948249 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:18.958884 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:18.970139 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:55:19.093713 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:55:19.316733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:55:19.645145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30697): Launched 16:55:19.931318 run iperf3-srv_10.42.42.10(pid=30698): Launched 16:55:20.055364 tst iperf3.py:8: start network... 16:55:20.275386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:20.782644 run create_hlr_db(pid=30699): Launched 16:55:20.909204 bus /gobi_6: Setting Powered False 16:55:21.969943 run create_hlr_db(pid=30699): Terminated: ok {rc=0} 16:55:22.396649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30701): Launched 16:55:22.703456 run osmo-hlr_10.42.42.2(pid=30702): Launched 16:55:22.820469 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:23.363081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30704): Launched 16:55:23.670385 run osmo-stp_10.42.42.5(pid=30705): Launched 16:55:23.787774 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:55:24.315705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30707): Launched 16:55:24.435389 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:55:24.694291 run patchelf(pid=30708): Launched 16:55:24.866496 run osmo-stp_10.42.42.5(pid=30705): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30705)] 16:55:24.996174 run osmo-stp_10.42.42.5(pid=30705): stdout: | (launched: 2022-12-12_16:55:23.613762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:25.127492 run osmo-stp_10.42.42.5(pid=30705): stderr: | 20221212165523782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165523783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165523783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165523783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165523784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165523784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165523784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:25.259481 run osmo-stp_10.42.42.5(pid=30705): stdout: | (launched: 2022-12-12_16:55:23.613762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:25.385177 run osmo-stp_10.42.42.5(pid=30705): stderr: | 20221212165523782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165523783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165523783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165523783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165523784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165523784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165523784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:25.534550 run patchelf(pid=30708): Terminating (SIGINT) 16:55:25.705864 run patchelf(pid=30708): Terminated: ok {rc=0} 16:55:25.829545 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30705): Process ended prematurely: osmo-stp_10.42.42.5(pid=30705) [trial-2379↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30705)] [trial-2379↪gprs:trx-lms↪iperf3.py:8] 16:55:25.839128 tst iperf3.py:8: Test FAILED (7.5 sec) 16:55:25.867035 run osmo-hlr_10.42.42.2(pid=30702): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30702)] 16:55:25.914840 run osmo-hlr_10.42.42.2(pid=30702): stdout: | (launched: 2022-12-12_16:55:22.647013) 16:55:25.964281 run osmo-hlr_10.42.42.2(pid=30702): stderr: | 20221212165522823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165522823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165522823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165522823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165522823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165522823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165522835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165522845 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165522846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165522846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:26.014027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30697): Terminating (SIGTERM) 16:55:26.053816 run iperf3-srv_10.42.42.10(pid=30698): Terminating (SIGTERM) 16:55:26.093379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30701): Terminating (SIGTERM) 16:55:26.133043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30704): Terminating (SIGTERM) 16:55:26.172618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30707): Terminating (SIGTERM) 16:55:26.212338 --- ParallelTerminationStrategy: PID 30697 died... 16:55:26.231537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30697): Terminated: ok {rc=0} 16:55:26.275680 --- ParallelTerminationStrategy: PID 30698 died... 16:55:26.294049 run iperf3-srv_10.42.42.10(pid=30698): Terminated {rc=256} 16:55:26.337823 --- ParallelTerminationStrategy: PID 30701 died... 16:55:26.356286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30701): Terminated: ok {rc=0} 16:55:26.400358 --- ParallelTerminationStrategy: PID 30704 died... 16:55:26.418887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30704): Terminated: ok {rc=0} 16:55:26.462895 --- ParallelTerminationStrategy: PID 30707 died... 16:55:26.481495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30707): Terminated: ok {rc=0} 16:55:26.565035 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms iperf3m4.py ---------------------------------------------- 16:55:27.714411 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:27.726390 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:55:27.778409 tst iperf3m4.py: using LAC 30224 16:55:27.907754 tst iperf3m4.py: using RAC 134 16:55:28.038154 tst iperf3m4.py: using CellId 30224 16:55:28.165715 tst iperf3m4.py: using BVCI 30225 16:55:28.279015 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:28.289799 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:28.300270 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:28.311133 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:28.321863 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:28.332552 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:28.343413 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:28.354314 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:28.365453 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:55:28.486912 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:55:28.612671 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:55:28.728715 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:55:28.845076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:55:29.049980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:55:29.356354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30709): Launched 16:55:29.622636 run iperf3-srv_10.42.42.10(pid=30710): Launched 16:55:29.739042 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:55:29.943441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:55:30.249728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30711): Launched 16:55:30.516040 run iperf3-srv_10.42.42.10(pid=30712): Launched 16:55:30.630957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:55:30.839899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:55:31.193654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30713): Launched 16:55:31.494908 run iperf3-srv_10.42.42.10(pid=30714): Launched 16:55:31.635167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:55:31.862250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:55:32.198559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30715): Launched 16:55:32.484279 run iperf3-srv_10.42.42.10(pid=30716): Launched 16:55:32.609090 tst iperf3m4.py:8: start network... 16:55:32.828494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:33.338041 run create_hlr_db(pid=30717): Launched 16:55:33.471875 bus /gobi_6: Setting Powered False 16:55:34.535720 run create_hlr_db(pid=30717): Terminated: ok {rc=0} 16:55:34.971042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30719): Launched 16:55:35.278245 run osmo-hlr_10.42.42.2(pid=30720): Launched 16:55:35.396067 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:35.939721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30722): Launched 16:55:36.246896 run osmo-stp_10.42.42.5(pid=30723): Launched 16:55:36.366288 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:55:36.893456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30725): Launched 16:55:37.010339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:55:37.268893 run patchelf(pid=30726): Launched 16:55:37.438588 run osmo-stp_10.42.42.5(pid=30723): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30723)] 16:55:37.567864 run osmo-stp_10.42.42.5(pid=30723): stdout: | (launched: 2022-12-12_16:55:36.190091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:37.698667 run osmo-stp_10.42.42.5(pid=30723): stderr: | 20221212165536359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165536359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165536359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165536360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165536360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165536360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165536360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:37.829461 run osmo-stp_10.42.42.5(pid=30723): stdout: | (launched: 2022-12-12_16:55:36.190091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:37.955138 run osmo-stp_10.42.42.5(pid=30723): stderr: | 20221212165536359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165536359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165536359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165536360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165536360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165536360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165536360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:38.102915 run patchelf(pid=30726): Terminating (SIGINT) 16:55:38.272577 run patchelf(pid=30726): Terminated: ok {rc=0} 16:55:38.395204 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30723): Process ended prematurely: osmo-stp_10.42.42.5(pid=30723) [trial-2379↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30723)] [trial-2379↪gprs:trx-lms↪iperf3m4.py:8] 16:55:38.404753 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:55:38.432909 run osmo-hlr_10.42.42.2(pid=30720): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30720)] 16:55:38.481112 run osmo-hlr_10.42.42.2(pid=30720): stdout: | (launched: 2022-12-12_16:55:35.221731) 16:55:38.530954 run osmo-hlr_10.42.42.2(pid=30720): stderr: | 20221212165535397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165535397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165535397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165535397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165535397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165535397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165535408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165535416 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165535417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165535417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:38.581201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30709): Terminating (SIGTERM) 16:55:38.621371 run iperf3-srv_10.42.42.10(pid=30710): Terminating (SIGTERM) 16:55:38.661341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30711): Terminating (SIGTERM) 16:55:38.701776 run iperf3-srv_10.42.42.10(pid=30712): Terminating (SIGTERM) 16:55:38.741564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30713): Terminating (SIGTERM) 16:55:38.781550 run iperf3-srv_10.42.42.10(pid=30714): Terminating (SIGTERM) 16:55:38.821551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30715): Terminating (SIGTERM) 16:55:38.861488 run iperf3-srv_10.42.42.10(pid=30716): Terminating (SIGTERM) 16:55:38.901950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30719): Terminating (SIGTERM) 16:55:38.941885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30722): Terminating (SIGTERM) 16:55:38.981845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30725): Terminating (SIGTERM) 16:55:39.022087 --- ParallelTerminationStrategy: PID 30709 died... 16:55:39.041150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30709): Terminated: ok {rc=0} 16:55:39.085720 --- ParallelTerminationStrategy: PID 30710 died... 16:55:39.104263 run iperf3-srv_10.42.42.10(pid=30710): Terminated {rc=256} 16:55:39.148529 --- ParallelTerminationStrategy: PID 30711 died... 16:55:39.167186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30711): Terminated: ok {rc=0} 16:55:39.211554 --- ParallelTerminationStrategy: PID 30712 died... 16:55:39.230185 run iperf3-srv_10.42.42.10(pid=30712): Terminated {rc=256} 16:55:39.274212 --- ParallelTerminationStrategy: PID 30713 died... 16:55:39.292869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30713): Terminated: ok {rc=0} 16:55:39.337408 --- ParallelTerminationStrategy: PID 30714 died... 16:55:39.355890 run iperf3-srv_10.42.42.10(pid=30714): Terminated {rc=256} 16:55:39.400103 --- ParallelTerminationStrategy: PID 30715 died... 16:55:39.418727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30715): Terminated: ok {rc=0} 16:55:39.462880 --- ParallelTerminationStrategy: PID 30716 died... 16:55:39.481521 run iperf3-srv_10.42.42.10(pid=30716): Terminated {rc=256} 16:55:39.525858 --- ParallelTerminationStrategy: PID 30719 died... 16:55:39.544497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30719): Terminated: ok {rc=0} 16:55:39.588925 --- ParallelTerminationStrategy: PID 30722 died... 16:55:39.607681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30722): Terminated: ok {rc=0} 16:55:39.652439 --- ParallelTerminationStrategy: PID 30725 died... 16:55:39.671222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30725): Terminated: ok {rc=0} 16:55:39.758116 bus /gobi_4: Setting Powered False 16:55:40.857416 bus /gobi_4: Setting Powered False 16:55:41.967456 bus /gobi_1: Setting Powered False 16:55:43.061877 bus /gobi_1: Setting Powered False 16:55:44.177221 bus /gobi_0: Setting Powered False 16:55:45.276049 bus /gobi_0: Setting Powered False 16:55:46.395930 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms ping.py ---------------------------------------------- 16:55:47.507785 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:47.519379 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:55:47.571768 tst ping.py: using LAC 30225 16:55:47.700859 tst ping.py: using RAC 135 16:55:47.825386 tst ping.py: using CellId 30225 16:55:47.948612 tst ping.py: using BVCI 30226 16:55:48.064068 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:48.075128 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:48.086089 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:48.096853 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:48.107701 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:48.118533 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:48.129475 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:48.140291 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:55:48.259224 tst ping.py:19: start network... 16:55:48.473541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:48.970045 run create_hlr_db(pid=30727): Launched 16:55:49.101423 bus /gobi_6: Setting Powered False 16:55:50.161749 run create_hlr_db(pid=30727): Terminated: ok {rc=0} 16:55:50.590549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30729): Launched 16:55:50.892080 run osmo-hlr_10.42.42.2(pid=30730): Launched 16:55:51.006723 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:51.528070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30732): Launched 16:55:51.830987 run osmo-stp_10.42.42.5(pid=30733): Launched 16:55:51.946796 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:55:52.465328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30735): Launched 16:55:52.581236 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:55:52.835773 run patchelf(pid=30736): Launched 16:55:53.004106 run osmo-stp_10.42.42.5(pid=30733): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30733)] 16:55:53.131901 run osmo-stp_10.42.42.5(pid=30733): stdout: | (launched: 2022-12-12_16:55:51.774303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:53.261093 run osmo-stp_10.42.42.5(pid=30733): stderr: | 20221212165551943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165551943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165551943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165551943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165551944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165551944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165551944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:53.390368 run osmo-stp_10.42.42.5(pid=30733): stdout: | (launched: 2022-12-12_16:55:51.774303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:55:53.513886 run osmo-stp_10.42.42.5(pid=30733): stderr: | 20221212165551943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165551943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165551943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165551943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165551944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165551944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165551944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:55:53.660301 run patchelf(pid=30736): Terminating (SIGINT) 16:55:53.828720 run patchelf(pid=30736): Terminated: ok {rc=0} 16:55:53.950134 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30733): Process ended prematurely: osmo-stp_10.42.42.5(pid=30733) [trial-2379↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30733)] [trial-2379↪gprs:trx-lms↪ping.py:22] 16:55:53.959144 tst ping.py:22: Test FAILED (6.4 sec) 16:55:53.987270 run osmo-hlr_10.42.42.2(pid=30730): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30730)] 16:55:54.035921 run osmo-hlr_10.42.42.2(pid=30730): stdout: | (launched: 2022-12-12_16:55:50.836469) 16:55:54.086251 run osmo-hlr_10.42.42.2(pid=30730): stderr: | 20221212165551011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165551011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165551011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165551011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165551011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165551011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165551073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165551082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165551082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165551082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:55:54.136886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30729): Terminating (SIGTERM) 16:55:54.177425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30732): Terminating (SIGTERM) 16:55:54.218002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30735): Terminating (SIGTERM) 16:55:54.258804 --- ParallelTerminationStrategy: PID 30729 died... 16:55:54.278273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30729): Terminated: ok {rc=0} 16:55:54.323717 --- ParallelTerminationStrategy: PID 30732 died... 16:55:54.342728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30732): Terminated: ok {rc=0} 16:55:54.387907 --- ParallelTerminationStrategy: PID 30735 died... 16:55:54.406763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30735): Terminated: ok {rc=0} 16:55:54.495331 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 16:55:55.585686 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:55.597565 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 16:55:55.649339 tst ping_idle_ping.py: using LAC 30226 16:55:55.769393 tst ping_idle_ping.py: using RAC 136 16:55:55.889412 tst ping_idle_ping.py: using CellId 30226 16:55:56.017880 tst ping_idle_ping.py: using BVCI 30227 16:55:56.137264 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:56.148479 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:56.159499 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:56.171090 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:56.182562 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:56.193999 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:56.205922 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 16:55:56.217475 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 16:55:56.337784 tst ping_idle_ping.py:24: start network... 16:55:56.554838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:55:57.055911 run create_hlr_db(pid=30737): Launched 16:55:57.187792 bus /gobi_6: Setting Powered False 16:55:58.251497 run create_hlr_db(pid=30737): Terminated: ok {rc=0} 16:55:58.683072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30739): Launched 16:55:58.986090 run osmo-hlr_10.42.42.2(pid=30740): Launched 16:55:59.104095 run osmo-stp_10.42.42.5: Starting osmo-stp 16:55:59.632120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30742): Launched 16:55:59.934159 run osmo-stp_10.42.42.5(pid=30743): Launched 16:56:00.051399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:56:00.573315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30745): Launched 16:56:00.688581 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:56:00.985802 run patchelf(pid=30746): Launched 16:56:01.163517 run osmo-stp_10.42.42.5(pid=30743): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30743)] 16:56:01.294691 run osmo-stp_10.42.42.5(pid=30743): stdout: | (launched: 2022-12-12_16:55:59.878151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:01.427687 run osmo-stp_10.42.42.5(pid=30743): stderr: | 20221212165600048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165600048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165600049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165600049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165600049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165600050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165600050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:01.560799 run osmo-stp_10.42.42.5(pid=30743): stdout: | (launched: 2022-12-12_16:55:59.878151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:01.687773 run osmo-stp_10.42.42.5(pid=30743): stderr: | 20221212165600048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165600048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165600049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165600049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165600049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165600050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165600050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:01.838251 run patchelf(pid=30746): Terminating (SIGINT) 16:56:02.011248 run patchelf(pid=30746): Terminated: ok {rc=0} 16:56:02.136707 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30743): Process ended prematurely: osmo-stp_10.42.42.5(pid=30743) [trial-2379↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30743)] [trial-2379↪gprs:trx-lms↪ping_idle_ping.py:27] 16:56:02.147129 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:56:02.177615 run osmo-hlr_10.42.42.2(pid=30740): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30740)] 16:56:02.225789 run osmo-hlr_10.42.42.2(pid=30740): stdout: | (launched: 2022-12-12_16:55:58.930001) 16:56:02.275545 run osmo-hlr_10.42.42.2(pid=30740): stderr: | 20221212165559104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165559104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165559104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165559105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165559105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165559105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165559116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165559125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165559125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165559125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:02.325683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30739): Terminating (SIGTERM) 16:56:02.365953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30742): Terminating (SIGTERM) 16:56:02.406209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30745): Terminating (SIGTERM) 16:56:02.446682 --- ParallelTerminationStrategy: PID 30739 died... 16:56:02.465802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30739): Terminated: ok {rc=0} 16:56:02.510716 --- ParallelTerminationStrategy: PID 30742 died... 16:56:02.529425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30742): Terminated: ok {rc=0} 16:56:02.574178 --- ParallelTerminationStrategy: PID 30745 died... 16:56:02.592827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30745): Terminated: ok {rc=0} 16:56:02.680084 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 16:56:03.980487 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:56:03.986132 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 16:56:04.020060 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 16:56:04.058924 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 16:56:04.145592 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 16:56:04.178925 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 16:56:04.217561 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 16:56:04.813569 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 16:56:04.866838 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:04.878365 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:56:04.930409 tst cs_paging_gprs_active.py: using LAC 30227 16:56:05.059725 tst cs_paging_gprs_active.py: using RAC 137 16:56:05.191911 tst cs_paging_gprs_active.py: using CellId 30227 16:56:05.320601 tst cs_paging_gprs_active.py: using BVCI 30228 16:56:05.439477 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:05.450957 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:05.462254 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:05.473676 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:05.485111 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:05.496044 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:05.507349 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:05.518356 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:05.529796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:56:05.645634 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:56:05.764576 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:56:05.970312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:56:06.280880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30750): Launched 16:56:06.550445 run iperf3-srv_10.42.42.10(pid=30751): Launched 16:56:06.668502 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:56:06.874526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:56:07.184432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30752): Launched 16:56:07.453237 run iperf3-srv_10.42.42.10(pid=30753): Launched 16:56:07.569402 tst cs_paging_gprs_active.py:38: start network... 16:56:07.774525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:08.250498 run create_hlr_db(pid=30754): Launched 16:56:08.372021 bus /gobi_6: Setting Powered False 16:56:09.432462 run create_hlr_db(pid=30754): Terminated: ok {rc=0} 16:56:09.880138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Launched 16:56:10.209390 run osmo-hlr_10.42.42.2(pid=30757): Launched 16:56:10.336500 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:10.903402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Launched 16:56:11.232821 run osmo-stp_10.42.42.5(pid=30760): Launched 16:56:11.358346 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:56:11.929567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30762): Launched 16:56:12.054614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:56:12.332840 run patchelf(pid=30763): Launched 16:56:12.518298 run osmo-stp_10.42.42.5(pid=30760): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] 16:56:12.656649 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-12_16:56:11.171947) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:12.796310 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221212165611363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165611364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165611364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165611364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165611365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165611365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165611365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:12.936168 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-12_16:56:11.171947) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:13.070571 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221212165611363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165611364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165611364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165611364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165611365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165611365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165611365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:13.230504 run patchelf(pid=30763): Terminating (SIGINT) 16:56:13.413405 run patchelf(pid=30763): Terminated: ok {rc=0} 16:56:13.545832 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30760): Process ended prematurely: osmo-stp_10.42.42.5(pid=30760) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 16:56:13.556150 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:56:13.584886 run osmo-hlr_10.42.42.2(pid=30757): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30757)] 16:56:13.635159 run osmo-hlr_10.42.42.2(pid=30757): stdout: | (launched: 2022-12-12_16:56:10.148850) 16:56:13.687266 run osmo-hlr_10.42.42.2(pid=30757): stderr: | 20221212165610350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165610350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165610350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165610350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165610351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165610351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165610363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165610371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165610372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165610372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:13.739900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30750): Terminating (SIGTERM) 16:56:13.781853 run iperf3-srv_10.42.42.10(pid=30751): Terminating (SIGTERM) 16:56:13.823697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30752): Terminating (SIGTERM) 16:56:13.866167 run iperf3-srv_10.42.42.10(pid=30753): Terminating (SIGTERM) 16:56:13.908109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminating (SIGTERM) 16:56:13.950120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminating (SIGTERM) 16:56:13.992023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30762): Terminating (SIGTERM) 16:56:14.034202 --- ParallelTerminationStrategy: PID 30750 died... 16:56:14.054350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30750): Terminated: ok {rc=0} 16:56:14.100595 --- ParallelTerminationStrategy: PID 30751 died... 16:56:14.120239 run iperf3-srv_10.42.42.10(pid=30751): Terminated {rc=256} 16:56:14.166690 --- ParallelTerminationStrategy: PID 30752 died... 16:56:14.186441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30752): Terminated: ok {rc=0} 16:56:14.233059 --- ParallelTerminationStrategy: PID 30753 died... 16:56:14.252643 run iperf3-srv_10.42.42.10(pid=30753): Terminated {rc=256} 16:56:14.298583 --- ParallelTerminationStrategy: PID 30756 died... 16:56:14.318290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminated: ok {rc=0} 16:56:14.364605 --- ParallelTerminationStrategy: PID 30759 died... 16:56:14.384348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminated: ok {rc=0} 16:56:14.430541 --- ParallelTerminationStrategy: PID 30762 died... 16:56:14.450433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30762): Terminated: ok {rc=0} 16:56:14.538258 bus /gobi_0: Setting Powered False 16:56:15.639070 bus /gobi_0: Setting Powered False 16:56:16.752320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 16:56:17.898559 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:17.910559 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:56:17.961920 tst iperf3.py: using LAC 30228 16:56:18.083629 tst iperf3.py: using RAC 138 16:56:18.206124 tst iperf3.py: using CellId 30228 16:56:18.328484 tst iperf3.py: using BVCI 30229 16:56:18.441507 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:18.452338 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:18.462988 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:18.474170 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:18.485127 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:18.495931 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:18.507049 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:18.518034 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:18.529230 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:56:18.648821 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:56:18.870465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:56:19.199581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30764): Launched 16:56:19.488016 run iperf3-srv_10.42.42.10(pid=30765): Launched 16:56:19.612737 tst iperf3.py:8: start network... 16:56:19.833072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:20.342613 run create_hlr_db(pid=30766): Launched 16:56:20.477203 bus /gobi_6: Setting Powered False 16:56:21.542559 run create_hlr_db(pid=30766): Terminated: ok {rc=0} 16:56:21.983194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30768): Launched 16:56:22.292821 run osmo-hlr_10.42.42.2(pid=30769): Launched 16:56:22.410910 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:22.939144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30771): Launched 16:56:23.246493 run osmo-stp_10.42.42.5(pid=30772): Launched 16:56:23.364453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:56:23.893803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30774): Launched 16:56:24.012789 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:56:24.272273 run patchelf(pid=30775): Launched 16:56:24.442740 run osmo-stp_10.42.42.5(pid=30772): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30772)] 16:56:24.581910 run osmo-stp_10.42.42.5(pid=30772): stdout: | (launched: 2022-12-12_16:56:23.189825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:24.721597 run osmo-stp_10.42.42.5(pid=30772): stderr: | 20221212165623358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165623358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165623358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165623359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165623359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165623359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165623359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:24.861536 run osmo-stp_10.42.42.5(pid=30772): stdout: | (launched: 2022-12-12_16:56:23.189825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:24.995691 run osmo-stp_10.42.42.5(pid=30772): stderr: | 20221212165623358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165623358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165623358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165623359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165623359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165623359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165623359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:25.154406 run patchelf(pid=30775): Terminating (SIGINT) 16:56:25.337267 run patchelf(pid=30775): Terminated: ok {rc=0} 16:56:25.469049 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30772): Process ended prematurely: osmo-stp_10.42.42.5(pid=30772) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30772)] [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 16:56:25.479465 tst iperf3.py:8: Test FAILED (7.6 sec) 16:56:25.508294 run osmo-hlr_10.42.42.2(pid=30769): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30769)] 16:56:25.558375 run osmo-hlr_10.42.42.2(pid=30769): stdout: | (launched: 2022-12-12_16:56:22.235931) 16:56:25.609981 run osmo-hlr_10.42.42.2(pid=30769): stderr: | 20221212165622412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165622413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165622413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165622413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165622413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165622413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165622425 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165622434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165622434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165622434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:25.662663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30764): Terminating (SIGTERM) 16:56:25.704330 run iperf3-srv_10.42.42.10(pid=30765): Terminating (SIGTERM) 16:56:25.745930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30768): Terminating (SIGTERM) 16:56:25.787439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30771): Terminating (SIGTERM) 16:56:25.829267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30774): Terminating (SIGTERM) 16:56:25.871169 --- ParallelTerminationStrategy: PID 30764 died... 16:56:25.891300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30764): Terminated: ok {rc=0} 16:56:25.938097 --- ParallelTerminationStrategy: PID 30765 died... 16:56:25.957933 run iperf3-srv_10.42.42.10(pid=30765): Terminated {rc=256} 16:56:26.003967 --- ParallelTerminationStrategy: PID 30768 died... 16:56:26.023863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30768): Terminated: ok {rc=0} 16:56:26.070508 --- ParallelTerminationStrategy: PID 30771 died... 16:56:26.090397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30771): Terminated: ok {rc=0} 16:56:26.136877 --- ParallelTerminationStrategy: PID 30774 died... 16:56:26.157073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30774): Terminated: ok {rc=0} 16:56:26.246698 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 16:56:27.394841 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:27.406462 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:56:27.457692 tst iperf3m4.py: using LAC 30229 16:56:27.587491 tst iperf3m4.py: using RAC 139 16:56:27.716560 tst iperf3m4.py: using CellId 30229 16:56:27.846383 tst iperf3m4.py: using BVCI 30230 16:56:27.966599 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:27.978121 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:27.989476 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:28.000483 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:28.011476 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:28.022598 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:28.033916 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:28.044891 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:28.056222 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:56:28.172416 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:56:28.294036 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:56:28.411877 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:56:28.527750 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:56:28.734853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:56:29.043324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30776): Launched 16:56:29.313427 run iperf3-srv_10.42.42.10(pid=30777): Launched 16:56:29.429069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:56:29.634586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:56:29.943198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30778): Launched 16:56:30.212056 run iperf3-srv_10.42.42.10(pid=30779): Launched 16:56:30.328830 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:56:30.534431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:56:30.848064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30780): Launched 16:56:31.178185 run iperf3-srv_10.42.42.10(pid=30781): Launched 16:56:31.297712 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:56:31.508432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:56:31.825103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30782): Launched 16:56:32.114283 run iperf3-srv_10.42.42.10(pid=30783): Launched 16:56:32.242542 tst iperf3m4.py:8: start network... 16:56:32.450060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:32.927258 run create_hlr_db(pid=30784): Launched 16:56:33.044369 bus /gobi_6: Setting Powered False 16:56:34.106034 run create_hlr_db(pid=30784): Terminated: ok {rc=0} 16:56:34.534025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30786): Launched 16:56:34.841734 run osmo-hlr_10.42.42.2(pid=30787): Launched 16:56:34.959651 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:35.491506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30789): Launched 16:56:35.799777 run osmo-stp_10.42.42.5(pid=30790): Launched 16:56:35.917503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:56:36.457961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30792): Launched 16:56:36.576176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:56:36.835271 run patchelf(pid=30793): Launched 16:56:37.008150 run osmo-stp_10.42.42.5(pid=30790): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30790)] 16:56:37.137778 run osmo-stp_10.42.42.5(pid=30790): stdout: | (launched: 2022-12-12_16:56:35.742759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:37.269318 run osmo-stp_10.42.42.5(pid=30790): stderr: | 20221212165635916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165635916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165635917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165635917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165635917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165635918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165635918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:37.400448 run osmo-stp_10.42.42.5(pid=30790): stdout: | (launched: 2022-12-12_16:56:35.742759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:37.526044 run osmo-stp_10.42.42.5(pid=30790): stderr: | 20221212165635916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165635916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165635917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165635917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165635917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165635918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165635918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:37.674795 run patchelf(pid=30793): Terminating (SIGINT) 16:56:37.845724 run patchelf(pid=30793): Terminated: ok {rc=0} 16:56:37.969369 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30790): Process ended prematurely: osmo-stp_10.42.42.5(pid=30790) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30790)] [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 16:56:37.978968 tst iperf3m4.py:8: Test FAILED (10.6 sec) 16:56:38.007126 run osmo-hlr_10.42.42.2(pid=30787): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30787)] 16:56:38.055610 run osmo-hlr_10.42.42.2(pid=30787): stdout: | (launched: 2022-12-12_16:56:34.784442) 16:56:38.105551 run osmo-hlr_10.42.42.2(pid=30787): stderr: | 20221212165634961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165634961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165634961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165634962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165634962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165634962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165634974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165634982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165634983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165634983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:38.155900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30776): Terminating (SIGTERM) 16:56:38.196086 run iperf3-srv_10.42.42.10(pid=30777): Terminating (SIGTERM) 16:56:38.236616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30778): Terminating (SIGTERM) 16:56:38.282496 run iperf3-srv_10.42.42.10(pid=30779): Terminating (SIGTERM) 16:56:38.325615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30780): Terminating (SIGTERM) 16:56:38.368770 run iperf3-srv_10.42.42.10(pid=30781): Terminating (SIGTERM) 16:56:38.411517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30782): Terminating (SIGTERM) 16:56:38.454696 run iperf3-srv_10.42.42.10(pid=30783): Terminating (SIGTERM) 16:56:38.497448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30786): Terminating (SIGTERM) 16:56:38.540464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30789): Terminating (SIGTERM) 16:56:38.583445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30792): Terminating (SIGTERM) 16:56:38.626642 --- ParallelTerminationStrategy: PID 30776 died... 16:56:38.646995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30776): Terminated: ok {rc=0} 16:56:38.694996 --- ParallelTerminationStrategy: PID 30777 died... 16:56:38.714809 run iperf3-srv_10.42.42.10(pid=30777): Terminated {rc=256} 16:56:38.761843 --- ParallelTerminationStrategy: PID 30778 died... 16:56:38.781819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30778): Terminated: ok {rc=0} 16:56:38.828344 --- ParallelTerminationStrategy: PID 30779 died... 16:56:38.848120 run iperf3-srv_10.42.42.10(pid=30779): Terminated {rc=256} 16:56:38.894677 --- ParallelTerminationStrategy: PID 30780 died... 16:56:38.914513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30780): Terminated: ok {rc=0} 16:56:38.961596 --- ParallelTerminationStrategy: PID 30781 died... 16:56:38.981455 run iperf3-srv_10.42.42.10(pid=30781): Terminated {rc=256} 16:56:39.027820 --- ParallelTerminationStrategy: PID 30782 died... 16:56:39.047747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30782): Terminated: ok {rc=0} 16:56:39.094171 --- ParallelTerminationStrategy: PID 30783 died... 16:56:39.114076 run iperf3-srv_10.42.42.10(pid=30783): Terminated {rc=256} 16:56:39.160206 --- ParallelTerminationStrategy: PID 30786 died... 16:56:39.180225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30786): Terminated: ok {rc=0} 16:56:39.227081 --- ParallelTerminationStrategy: PID 30789 died... 16:56:39.246896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30789): Terminated: ok {rc=0} 16:56:39.293479 --- ParallelTerminationStrategy: PID 30792 died... 16:56:39.313437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30792): Terminated: ok {rc=0} 16:56:39.401921 bus /gobi_4: Setting Powered False 16:56:40.501123 bus /gobi_4: Setting Powered False 16:56:41.616726 bus /gobi_1: Setting Powered False 16:56:42.715371 bus /gobi_1: Setting Powered False 16:56:43.831731 bus /gobi_0: Setting Powered False 16:56:44.932895 bus /gobi_0: Setting Powered False 16:56:46.066080 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 16:56:47.187810 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:47.200314 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:56:47.255094 tst ping.py: using LAC 30230 16:56:47.383576 tst ping.py: using RAC 140 16:56:47.510691 tst ping.py: using CellId 30230 16:56:47.636681 tst ping.py: using BVCI 30231 16:56:47.754750 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:47.766161 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:47.777265 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:47.788339 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:47.799454 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:47.810549 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:47.822011 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:47.833192 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:56:47.951795 tst ping.py:19: start network... 16:56:48.167259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:48.665255 run create_hlr_db(pid=30794): Launched 16:56:48.796784 bus /gobi_6: Setting Powered False 16:56:49.860894 run create_hlr_db(pid=30794): Terminated: ok {rc=0} 16:56:50.291224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30796): Launched 16:56:50.593917 run osmo-hlr_10.42.42.2(pid=30797): Launched 16:56:50.709530 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:51.242059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30799): Launched 16:56:51.545152 run osmo-stp_10.42.42.5(pid=30800): Launched 16:56:51.660538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:56:52.180682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30802): Launched 16:56:52.296735 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:56:52.551927 run patchelf(pid=30803): Launched 16:56:52.720010 run osmo-stp_10.42.42.5(pid=30800): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30800)] 16:56:52.846768 run osmo-stp_10.42.42.5(pid=30800): stdout: | (launched: 2022-12-12_16:56:51.489325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:52.975239 run osmo-stp_10.42.42.5(pid=30800): stderr: | 20221212165651657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165651657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165651657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165651658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165651658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165651658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165651658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:53.103957 run osmo-stp_10.42.42.5(pid=30800): stdout: | (launched: 2022-12-12_16:56:51.489325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:56:53.227162 run osmo-stp_10.42.42.5(pid=30800): stderr: | 20221212165651657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165651657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165651657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165651658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165651658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165651658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165651658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:56:53.373231 run patchelf(pid=30803): Terminating (SIGINT) 16:56:53.541248 run patchelf(pid=30803): Terminated: ok {rc=0} 16:56:53.662473 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30800): Process ended prematurely: osmo-stp_10.42.42.5(pid=30800) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30800)] [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 16:56:53.671507 tst ping.py:22: Test FAILED (6.5 sec) 16:56:53.699144 run osmo-hlr_10.42.42.2(pid=30797): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30797)] 16:56:53.746983 run osmo-hlr_10.42.42.2(pid=30797): stdout: | (launched: 2022-12-12_16:56:50.538045) 16:56:53.796429 run osmo-hlr_10.42.42.2(pid=30797): stderr: | 20221212165650713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165650713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165650713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165650713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165650713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165650713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165650726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165650735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165650735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165650735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:56:53.846256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30796): Terminating (SIGTERM) 16:56:53.886069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30799): Terminating (SIGTERM) 16:56:53.925987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30802): Terminating (SIGTERM) 16:56:53.966097 --- ParallelTerminationStrategy: PID 30796 died... 16:56:53.985041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30796): Terminated: ok {rc=0} 16:56:54.029379 --- ParallelTerminationStrategy: PID 30799 died... 16:56:54.047841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30799): Terminated: ok {rc=0} 16:56:54.091926 --- ParallelTerminationStrategy: PID 30802 died... 16:56:54.110553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30802): Terminated: ok {rc=0} 16:56:54.197818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 16:56:55.287777 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:55.299245 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 16:56:55.351643 tst ping_idle_ping.py: using LAC 30231 16:56:55.470242 tst ping_idle_ping.py: using RAC 141 16:56:55.589979 tst ping_idle_ping.py: using CellId 30231 16:56:55.708239 tst ping_idle_ping.py: using BVCI 30232 16:56:55.818648 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:55.829525 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:55.840074 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:55.851072 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:55.861994 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:55.872745 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:55.883789 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 16:56:55.894748 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 16:56:56.014358 tst ping_idle_ping.py:24: start network... 16:56:56.231456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:56:56.733374 run create_hlr_db(pid=30804): Launched 16:56:56.865797 bus /gobi_6: Setting Powered False 16:56:57.925367 run create_hlr_db(pid=30804): Terminated: ok {rc=0} 16:56:58.375584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30806): Launched 16:56:58.700274 run osmo-hlr_10.42.42.2(pid=30807): Launched 16:56:58.824165 run osmo-stp_10.42.42.5: Starting osmo-stp 16:56:59.376669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30809): Launched 16:56:59.698489 run osmo-stp_10.42.42.5(pid=30810): Launched 16:56:59.822071 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:57:00.380116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30812): Launched 16:57:00.505908 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:57:00.778483 run patchelf(pid=30813): Launched 16:57:00.982755 run osmo-stp_10.42.42.5(pid=30810): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30810)] 16:57:01.120720 run osmo-stp_10.42.42.5(pid=30810): stdout: | (launched: 2022-12-12_16:56:59.639159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:01.261029 run osmo-stp_10.42.42.5(pid=30810): stderr: | 20221212165659830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165659830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165659830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165659830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165659831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165659831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165659831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:01.401322 run osmo-stp_10.42.42.5(pid=30810): stdout: | (launched: 2022-12-12_16:56:59.639159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:01.535760 run osmo-stp_10.42.42.5(pid=30810): stderr: | 20221212165659830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165659830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165659830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165659830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165659831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165659831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165659831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:01.695197 run patchelf(pid=30813): Terminating (SIGINT) 16:57:01.878838 run patchelf(pid=30813): Terminated: ok {rc=0} 16:57:02.010626 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30810): Process ended prematurely: osmo-stp_10.42.42.5(pid=30810) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30810)] [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 16:57:02.021073 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:57:02.050331 run osmo-hlr_10.42.42.2(pid=30807): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30807)] 16:57:02.101624 run osmo-hlr_10.42.42.2(pid=30807): stdout: | (launched: 2022-12-12_16:56:58.640867) 16:57:02.154018 run osmo-hlr_10.42.42.2(pid=30807): stderr: | 20221212165658838 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165658838 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165658838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165658838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165658838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165658839 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165658851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165658859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165658860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165658860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:02.206156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30806): Terminating (SIGTERM) 16:57:02.248078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30809): Terminating (SIGTERM) 16:57:02.290168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30812): Terminating (SIGTERM) 16:57:02.332333 --- ParallelTerminationStrategy: PID 30806 died... 16:57:02.352565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30806): Terminated: ok {rc=0} 16:57:02.398903 --- ParallelTerminationStrategy: PID 30809 died... 16:57:02.418850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30809): Terminated: ok {rc=0} 16:57:02.465243 --- ParallelTerminationStrategy: PID 30812 died... 16:57:02.484738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30812): Terminated: ok {rc=0} 16:57:02.574105 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 16:57:03.879650 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:57:03.886663 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 16:57:03.920736 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 16:57:03.960057 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 16:57:04.053785 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 16:57:04.088418 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 16:57:04.127483 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 16:57:04.716169 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 16:57:04.769878 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:04.781371 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:57:04.851422 tst cs_paging_gprs_active.py: using LAC 30232 16:57:04.978658 tst cs_paging_gprs_active.py: using RAC 142 16:57:05.105488 tst cs_paging_gprs_active.py: using CellId 30232 16:57:05.232558 tst cs_paging_gprs_active.py: using BVCI 30233 16:57:05.351659 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:05.363135 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:05.374310 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:05.385552 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:05.396577 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:05.407888 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:05.419208 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:05.430361 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:05.441759 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:57:05.558088 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:57:05.678279 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:57:05.884676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:57:06.194107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30818): Launched 16:57:06.464352 run iperf3-srv_10.42.42.10(pid=30819): Launched 16:57:06.580822 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:57:06.786135 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:57:07.094954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30820): Launched 16:57:07.365516 run iperf3-srv_10.42.42.10(pid=30821): Launched 16:57:07.481416 tst cs_paging_gprs_active.py:38: start network... 16:57:07.687146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:08.162856 run create_hlr_db(pid=30822): Launched 16:57:08.283885 bus /gobi_6: Setting Powered False 16:57:09.345879 run create_hlr_db(pid=30822): Terminated: ok {rc=0} 16:57:09.793734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30824): Launched 16:57:10.121111 run osmo-hlr_10.42.42.2(pid=30825): Launched 16:57:10.246843 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:10.812568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30827): Launched 16:57:11.141557 run osmo-stp_10.42.42.5(pid=30828): Launched 16:57:11.268866 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:57:11.835967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30830): Launched 16:57:11.963191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:57:12.247935 run patchelf(pid=30831): Launched 16:57:12.431003 run osmo-stp_10.42.42.5(pid=30828): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30828)] 16:57:12.569843 run osmo-stp_10.42.42.5(pid=30828): stdout: | (launched: 2022-12-12_16:57:11.081168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:12.710041 run osmo-stp_10.42.42.5(pid=30828): stderr: | 20221212165711274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165711274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165711274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165711275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165711275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165711275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165711275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:12.849898 run osmo-stp_10.42.42.5(pid=30828): stdout: | (launched: 2022-12-12_16:57:11.081168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:12.984133 run osmo-stp_10.42.42.5(pid=30828): stderr: | 20221212165711274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165711274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165711274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165711275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165711275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165711275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165711275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:13.143382 run patchelf(pid=30831): Terminating (SIGINT) 16:57:13.326997 run patchelf(pid=30831): Terminated: ok {rc=0} 16:57:13.459368 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30828): Process ended prematurely: osmo-stp_10.42.42.5(pid=30828) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30828)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 16:57:13.469729 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:57:13.498480 run osmo-hlr_10.42.42.2(pid=30825): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30825)] 16:57:13.548408 run osmo-hlr_10.42.42.2(pid=30825): stdout: | (launched: 2022-12-12_16:57:10.060666) 16:57:13.600098 run osmo-hlr_10.42.42.2(pid=30825): stderr: | 20221212165710260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165710260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165710260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165710260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165710260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165710260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165710273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165710282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165710282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165710282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:13.652098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30818): Terminating (SIGTERM) 16:57:13.693716 run iperf3-srv_10.42.42.10(pid=30819): Terminating (SIGTERM) 16:57:13.735370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30820): Terminating (SIGTERM) 16:57:13.777076 run iperf3-srv_10.42.42.10(pid=30821): Terminating (SIGTERM) 16:57:13.818586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30824): Terminating (SIGTERM) 16:57:13.860283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30827): Terminating (SIGTERM) 16:57:13.901930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30830): Terminating (SIGTERM) 16:57:13.943814 --- ParallelTerminationStrategy: PID 30818 died... 16:57:13.963952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30818): Terminated: ok {rc=0} 16:57:14.010132 --- ParallelTerminationStrategy: PID 30819 died... 16:57:14.029715 run iperf3-srv_10.42.42.10(pid=30819): Terminated {rc=256} 16:57:14.076122 --- ParallelTerminationStrategy: PID 30820 died... 16:57:14.095940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30820): Terminated: ok {rc=0} 16:57:14.142557 --- ParallelTerminationStrategy: PID 30821 died... 16:57:14.162305 run iperf3-srv_10.42.42.10(pid=30821): Terminated {rc=256} 16:57:14.208150 --- ParallelTerminationStrategy: PID 30824 died... 16:57:14.227857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30824): Terminated: ok {rc=0} 16:57:14.274180 --- ParallelTerminationStrategy: PID 30827 died... 16:57:14.293948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30827): Terminated: ok {rc=0} 16:57:14.340346 --- ParallelTerminationStrategy: PID 30830 died... 16:57:14.360140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30830): Terminated: ok {rc=0} 16:57:14.447643 bus /gobi_0: Setting Powered False 16:57:15.545377 bus /gobi_0: Setting Powered False 16:57:16.658052 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 16:57:17.807906 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:17.819875 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:57:17.892105 tst iperf3.py: using LAC 30233 16:57:18.021324 tst iperf3.py: using RAC 143 16:57:18.149699 tst iperf3.py: using CellId 30233 16:57:18.276872 tst iperf3.py: using BVCI 30234 16:57:18.396615 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:18.408019 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:18.419175 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:18.430396 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:18.441575 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:18.452653 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:18.463977 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:18.475104 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:18.486451 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:57:18.606909 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:57:18.827001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:57:19.155631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30832): Launched 16:57:19.440834 run iperf3-srv_10.42.42.10(pid=30833): Launched 16:57:19.565191 tst iperf3.py:8: start network... 16:57:19.784857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:20.293331 run create_hlr_db(pid=30834): Launched 16:57:20.413249 bus /gobi_6: Setting Powered False 16:57:21.473705 run create_hlr_db(pid=30834): Terminated: ok {rc=0} 16:57:21.898550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30836): Launched 16:57:22.207208 run osmo-hlr_10.42.42.2(pid=30837): Launched 16:57:22.324296 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:22.852469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30839): Launched 16:57:23.158770 run osmo-stp_10.42.42.5(pid=30840): Launched 16:57:23.276372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:57:23.819635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30842): Launched 16:57:23.938735 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:57:24.197705 run patchelf(pid=30843): Launched 16:57:24.368073 run osmo-stp_10.42.42.5(pid=30840): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30840)] 16:57:24.497094 run osmo-stp_10.42.42.5(pid=30840): stdout: | (launched: 2022-12-12_16:57:23.102283) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:24.627840 run osmo-stp_10.42.42.5(pid=30840): stderr: | 20221212165723273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165723273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165723273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165723274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165723274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165723274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165723274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:24.759165 run osmo-stp_10.42.42.5(pid=30840): stdout: | (launched: 2022-12-12_16:57:23.102283) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:24.884035 run osmo-stp_10.42.42.5(pid=30840): stderr: | 20221212165723273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165723273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165723273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165723274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165723274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165723274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165723274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:25.032411 run patchelf(pid=30843): Terminating (SIGINT) 16:57:25.203305 run patchelf(pid=30843): Terminated: ok {rc=0} 16:57:25.325954 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30840): Process ended prematurely: osmo-stp_10.42.42.5(pid=30840) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30840)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 16:57:25.335537 tst iperf3.py:8: Test FAILED (7.6 sec) 16:57:25.363227 run osmo-hlr_10.42.42.2(pid=30837): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30837)] 16:57:25.411335 run osmo-hlr_10.42.42.2(pid=30837): stdout: | (launched: 2022-12-12_16:57:22.150491) 16:57:25.461305 run osmo-hlr_10.42.42.2(pid=30837): stderr: | 20221212165722329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165722329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165722329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165722329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165722329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165722329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165722342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165722351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165722351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165722351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:25.511214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30832): Terminating (SIGTERM) 16:57:25.550675 run iperf3-srv_10.42.42.10(pid=30833): Terminating (SIGTERM) 16:57:25.590735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30836): Terminating (SIGTERM) 16:57:25.630599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30839): Terminating (SIGTERM) 16:57:25.670233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30842): Terminating (SIGTERM) 16:57:25.710310 --- ParallelTerminationStrategy: PID 30832 died... 16:57:25.729421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30832): Terminated: ok {rc=0} 16:57:25.773780 --- ParallelTerminationStrategy: PID 30833 died... 16:57:25.792348 run iperf3-srv_10.42.42.10(pid=30833): Terminated {rc=256} 16:57:25.836203 --- ParallelTerminationStrategy: PID 30836 died... 16:57:25.854858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30836): Terminated: ok {rc=0} 16:57:25.898847 --- ParallelTerminationStrategy: PID 30839 died... 16:57:25.917527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30839): Terminated: ok {rc=0} 16:57:25.962159 --- ParallelTerminationStrategy: PID 30842 died... 16:57:25.980864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30842): Terminated: ok {rc=0} 16:57:26.067695 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 16:57:27.216411 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:27.228083 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:57:27.299013 tst iperf3m4.py: using LAC 30234 16:57:27.420248 tst iperf3m4.py: using RAC 144 16:57:27.542207 tst iperf3m4.py: using CellId 30234 16:57:27.665110 tst iperf3m4.py: using BVCI 30235 16:57:27.778036 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:27.788853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:27.799620 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:27.810717 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:27.821783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:27.832655 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:27.843787 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:27.854742 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:27.865886 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:57:27.981994 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:57:28.101912 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:57:28.220169 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:57:28.340293 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:57:28.562141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:57:28.891964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30844): Launched 16:57:29.180228 run iperf3-srv_10.42.42.10(pid=30845): Launched 16:57:29.305793 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:57:29.526622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:57:29.855337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30846): Launched 16:57:30.142393 run iperf3-srv_10.42.42.10(pid=30847): Launched 16:57:30.265837 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:57:30.485647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:57:30.823053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30848): Launched 16:57:31.139718 run iperf3-srv_10.42.42.10(pid=30849): Launched 16:57:31.309805 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:57:31.535627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:57:31.855998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30850): Launched 16:57:32.202343 run iperf3-srv_10.42.42.10(pid=30851): Launched 16:57:32.335545 tst iperf3m4.py:8: start network... 16:57:32.542178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:33.019226 run create_hlr_db(pid=30852): Launched 16:57:33.137121 bus /gobi_6: Setting Powered False 16:57:34.198233 run create_hlr_db(pid=30852): Terminated: ok {rc=0} 16:57:34.624192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30854): Launched 16:57:34.930505 run osmo-hlr_10.42.42.2(pid=30855): Launched 16:57:35.049288 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:35.579175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30857): Launched 16:57:35.886378 run osmo-stp_10.42.42.5(pid=30858): Launched 16:57:36.005259 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:57:36.532601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30860): Launched 16:57:36.650954 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:57:36.910010 run patchelf(pid=30861): Launched 16:57:37.081802 run osmo-stp_10.42.42.5(pid=30858): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30858)] 16:57:37.210810 run osmo-stp_10.42.42.5(pid=30858): stdout: | (launched: 2022-12-12_16:57:35.829496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:37.341600 run osmo-stp_10.42.42.5(pid=30858): stderr: | 20221212165736000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165736000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165736000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165736001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165736001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165736001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165736002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:37.472338 run osmo-stp_10.42.42.5(pid=30858): stdout: | (launched: 2022-12-12_16:57:35.829496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:37.597346 run osmo-stp_10.42.42.5(pid=30858): stderr: | 20221212165736000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165736000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165736000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165736001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165736001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165736001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165736002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:37.745398 run patchelf(pid=30861): Terminating (SIGINT) 16:57:37.915723 run patchelf(pid=30861): Terminated: ok {rc=0} 16:57:38.038615 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30858): Process ended prematurely: osmo-stp_10.42.42.5(pid=30858) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30858)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 16:57:38.048215 tst iperf3m4.py:8: Test FAILED (10.9 sec) 16:57:38.076487 run osmo-hlr_10.42.42.2(pid=30855): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30855)] 16:57:38.124240 run osmo-hlr_10.42.42.2(pid=30855): stdout: | (launched: 2022-12-12_16:57:34.873726) 16:57:38.173690 run osmo-hlr_10.42.42.2(pid=30855): stderr: | 20221212165735049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165735049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165735049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165735049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165735049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165735050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165735061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165735071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165735071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165735071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:38.223445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30844): Terminating (SIGTERM) 16:57:38.263494 run iperf3-srv_10.42.42.10(pid=30845): Terminating (SIGTERM) 16:57:38.303404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30846): Terminating (SIGTERM) 16:57:38.343985 run iperf3-srv_10.42.42.10(pid=30847): Terminating (SIGTERM) 16:57:38.384178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30848): Terminating (SIGTERM) 16:57:38.423961 run iperf3-srv_10.42.42.10(pid=30849): Terminating (SIGTERM) 16:57:38.463614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30850): Terminating (SIGTERM) 16:57:38.503386 run iperf3-srv_10.42.42.10(pid=30851): Terminating (SIGTERM) 16:57:38.543052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30854): Terminating (SIGTERM) 16:57:38.583450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30857): Terminating (SIGTERM) 16:57:38.623272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30860): Terminating (SIGTERM) 16:57:38.663611 --- ParallelTerminationStrategy: PID 30844 died... 16:57:38.682738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30844): Terminated: ok {rc=0} 16:57:38.727040 --- ParallelTerminationStrategy: PID 30845 died... 16:57:38.745770 run iperf3-srv_10.42.42.10(pid=30845): Terminated {rc=256} 16:57:38.790029 --- ParallelTerminationStrategy: PID 30846 died... 16:57:38.808747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30846): Terminated: ok {rc=0} 16:57:38.853577 --- ParallelTerminationStrategy: PID 30847 died... 16:57:38.872295 run iperf3-srv_10.42.42.10(pid=30847): Terminated {rc=256} 16:57:38.917350 --- ParallelTerminationStrategy: PID 30848 died... 16:57:38.936110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30848): Terminated: ok {rc=0} 16:57:38.980758 --- ParallelTerminationStrategy: PID 30849 died... 16:57:38.999576 run iperf3-srv_10.42.42.10(pid=30849): Terminated {rc=256} 16:57:39.044080 --- ParallelTerminationStrategy: PID 30850 died... 16:57:39.062834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30850): Terminated: ok {rc=0} 16:57:39.107562 --- ParallelTerminationStrategy: PID 30851 died... 16:57:39.126419 run iperf3-srv_10.42.42.10(pid=30851): Terminated {rc=256} 16:57:39.171004 --- ParallelTerminationStrategy: PID 30854 died... 16:57:39.189761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30854): Terminated: ok {rc=0} 16:57:39.234194 --- ParallelTerminationStrategy: PID 30857 died... 16:57:39.253127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30857): Terminated: ok {rc=0} 16:57:39.297864 --- ParallelTerminationStrategy: PID 30860 died... 16:57:39.316795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30860): Terminated: ok {rc=0} 16:57:39.404143 bus /gobi_4: Setting Powered False 16:57:40.504920 bus /gobi_4: Setting Powered False 16:57:41.620681 bus /gobi_1: Setting Powered False 16:57:42.719094 bus /gobi_1: Setting Powered False 16:57:43.835711 bus /gobi_0: Setting Powered False 16:57:44.934592 bus /gobi_0: Setting Powered False 16:57:46.068695 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 16:57:47.186955 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:47.199663 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:57:47.272543 tst ping.py: using LAC 30235 16:57:47.399783 tst ping.py: using RAC 145 16:57:47.525293 tst ping.py: using CellId 30235 16:57:47.652936 tst ping.py: using BVCI 30236 16:57:47.769184 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:47.780526 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:47.791761 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:47.802965 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:47.814038 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:47.825243 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:47.836535 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:47.847784 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:57:47.964734 tst ping.py:19: start network... 16:57:48.179647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:48.678680 run create_hlr_db(pid=30862): Launched 16:57:48.798079 bus /gobi_6: Setting Powered False 16:57:49.857891 run create_hlr_db(pid=30862): Terminated: ok {rc=0} 16:57:50.296837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30864): Launched 16:57:50.619919 run osmo-hlr_10.42.42.2(pid=30865): Launched 16:57:50.742417 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:51.297704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30867): Launched 16:57:51.619662 run osmo-stp_10.42.42.5(pid=30868): Launched 16:57:51.743292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:57:52.305796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30870): Launched 16:57:52.428922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:57:52.700774 run patchelf(pid=30871): Launched 16:57:52.880685 run osmo-stp_10.42.42.5(pid=30868): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30868)] 16:57:53.016613 run osmo-stp_10.42.42.5(pid=30868): stdout: | (launched: 2022-12-12_16:57:51.560372) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:53.153775 run osmo-stp_10.42.42.5(pid=30868): stderr: | 20221212165751751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165751751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165751751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165751751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165751752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165751752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165751752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:53.291860 run osmo-stp_10.42.42.5(pid=30868): stdout: | (launched: 2022-12-12_16:57:51.560372) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:57:53.423385 run osmo-stp_10.42.42.5(pid=30868): stderr: | 20221212165751751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165751751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165751751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165751751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165751752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165751752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165751752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:57:53.579436 run patchelf(pid=30871): Terminating (SIGINT) 16:57:53.758041 run patchelf(pid=30871): Terminated: ok {rc=0} 16:57:53.887102 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30868): Process ended prematurely: osmo-stp_10.42.42.5(pid=30868) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30868)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 16:57:53.896786 tst ping.py:22: Test FAILED (6.7 sec) 16:57:53.925528 run osmo-hlr_10.42.42.2(pid=30865): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30865)] 16:57:53.975809 run osmo-hlr_10.42.42.2(pid=30865): stdout: | (launched: 2022-12-12_16:57:50.560545) 16:57:54.027990 run osmo-hlr_10.42.42.2(pid=30865): stderr: | 20221212165750759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165750759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165750759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165750759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165750759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165750759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165750771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165750779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165750779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165750779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:57:54.080359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30864): Terminating (SIGTERM) 16:57:54.122551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30867): Terminating (SIGTERM) 16:57:54.164673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30870): Terminating (SIGTERM) 16:57:54.207546 --- ParallelTerminationStrategy: PID 30864 died... 16:57:54.227879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30864): Terminated: ok {rc=0} 16:57:54.274784 --- ParallelTerminationStrategy: PID 30867 died... 16:57:54.294513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30867): Terminated: ok {rc=0} 16:57:54.341535 --- ParallelTerminationStrategy: PID 30870 died... 16:57:54.361201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30870): Terminated: ok {rc=0} 16:57:54.449497 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 16:57:55.537888 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:55.550102 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 16:57:55.622670 tst ping_idle_ping.py: using LAC 30236 16:57:55.742948 tst ping_idle_ping.py: using RAC 146 16:57:55.863235 tst ping_idle_ping.py: using CellId 30236 16:57:55.982748 tst ping_idle_ping.py: using BVCI 30237 16:57:56.094087 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:56.104911 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:56.116289 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:56.127456 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:56.138654 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:56.149833 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:56.161140 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 16:57:56.172259 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 16:57:56.292699 tst ping_idle_ping.py:24: start network... 16:57:56.493761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:57:56.964292 run create_hlr_db(pid=30872): Launched 16:57:57.079110 bus /gobi_6: Setting Powered False 16:57:58.143602 run create_hlr_db(pid=30872): Terminated: ok {rc=0} 16:57:58.575222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30874): Launched 16:57:58.876348 run osmo-hlr_10.42.42.2(pid=30875): Launched 16:57:58.992600 run osmo-stp_10.42.42.5: Starting osmo-stp 16:57:59.516427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30877): Launched 16:57:59.840336 run osmo-stp_10.42.42.5(pid=30878): Launched 16:57:59.963434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:58:00.519947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30880): Launched 16:58:00.645149 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:58:00.940393 run patchelf(pid=30881): Launched 16:58:01.128018 run osmo-stp_10.42.42.5(pid=30878): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30878)] 16:58:01.267862 run osmo-stp_10.42.42.5(pid=30878): stdout: | (launched: 2022-12-12_16:57:59.780906) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:01.408574 run osmo-stp_10.42.42.5(pid=30878): stderr: | 20221212165759972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165759972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165759972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165759973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165759973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165759973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165759973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:01.562446 run osmo-stp_10.42.42.5(pid=30878): stdout: | (launched: 2022-12-12_16:57:59.780906) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:01.698634 run osmo-stp_10.42.42.5(pid=30878): stderr: | 20221212165759972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165759972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165759972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165759973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165759973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165759973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165759973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:01.859989 run patchelf(pid=30881): Terminating (SIGINT) 16:58:02.069930 run patchelf(pid=30881): Terminated: ok {rc=0} 16:58:02.197976 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30878): Process ended prematurely: osmo-stp_10.42.42.5(pid=30878) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30878)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 16:58:02.207310 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 16:58:02.235748 run osmo-hlr_10.42.42.2(pid=30875): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30875)] 16:58:02.286071 run osmo-hlr_10.42.42.2(pid=30875): stdout: | (launched: 2022-12-12_16:57:58.820276) 16:58:02.340326 run osmo-hlr_10.42.42.2(pid=30875): stderr: | 20221212165758997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165758997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165758997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165758997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165758997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165758997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165759009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165759018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165759018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165759018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:02.392808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30874): Terminating (SIGTERM) 16:58:02.434902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30877): Terminating (SIGTERM) 16:58:02.477215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30880): Terminating (SIGTERM) 16:58:02.519758 --- ParallelTerminationStrategy: PID 30874 died... 16:58:02.540198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30874): Terminated: ok {rc=0} 16:58:02.586939 --- ParallelTerminationStrategy: PID 30877 died... 16:58:02.606930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30877): Terminated: ok {rc=0} 16:58:02.653680 --- ParallelTerminationStrategy: PID 30880 died... 16:58:02.673634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30880): Terminated: ok {rc=0} 16:58:02.762291 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 16:58:04.066527 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:58:04.074821 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 16:58:04.108991 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 16:58:04.148499 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 16:58:04.239144 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 16:58:04.273606 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 16:58:04.312919 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 16:58:04.905239 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 16:58:04.958124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:04.969473 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:58:05.041374 tst cs_paging_gprs_active.py: using LAC 30237 16:58:05.170335 tst cs_paging_gprs_active.py: using RAC 147 16:58:05.299864 tst cs_paging_gprs_active.py: using CellId 30237 16:58:05.428778 tst cs_paging_gprs_active.py: using BVCI 30238 16:58:05.549227 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:05.560528 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:05.571651 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:05.582867 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:05.594199 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:05.605395 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:05.616566 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:05.627689 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:05.639022 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:58:05.757499 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:58:05.878998 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 16:58:06.085153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:58:06.394001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30887): Launched 16:58:06.663905 run iperf3-srv_10.42.42.10(pid=30888): Launched 16:58:06.781577 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 16:58:06.986031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:58:07.294821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30889): Launched 16:58:07.563559 run iperf3-srv_10.42.42.10(pid=30890): Launched 16:58:07.679759 tst cs_paging_gprs_active.py:38: start network... 16:58:07.885946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:08.363089 run create_hlr_db(pid=30891): Launched 16:58:08.481924 bus /gobi_6: Setting Powered False 16:58:09.543627 run create_hlr_db(pid=30891): Terminated: ok {rc=0} 16:58:09.991449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30893): Launched 16:58:10.319127 run osmo-hlr_10.42.42.2(pid=30894): Launched 16:58:10.445029 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:11.011059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30896): Launched 16:58:11.342499 run osmo-stp_10.42.42.5(pid=30897): Launched 16:58:11.467540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:58:12.036045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30899): Launched 16:58:12.163734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:58:12.442956 run patchelf(pid=30900): Launched 16:58:12.628793 run osmo-stp_10.42.42.5(pid=30897): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30897)] 16:58:12.767623 run osmo-stp_10.42.42.5(pid=30897): stdout: | (launched: 2022-12-12_16:58:11.281711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:12.907557 run osmo-stp_10.42.42.5(pid=30897): stderr: | 20221212165811475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165811475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165811475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165811476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165811476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165811476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165811476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:13.047638 run osmo-stp_10.42.42.5(pid=30897): stdout: | (launched: 2022-12-12_16:58:11.281711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:13.183054 run osmo-stp_10.42.42.5(pid=30897): stderr: | 20221212165811475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165811475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165811475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165811476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165811476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165811476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165811476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:13.342672 run patchelf(pid=30900): Terminating (SIGINT) 16:58:13.525023 run patchelf(pid=30900): Terminated: ok {rc=0} 16:58:13.656922 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30897): Process ended prematurely: osmo-stp_10.42.42.5(pid=30897) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30897)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 16:58:13.667284 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 16:58:13.695906 run osmo-hlr_10.42.42.2(pid=30894): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30894)] 16:58:13.745831 run osmo-hlr_10.42.42.2(pid=30894): stdout: | (launched: 2022-12-12_16:58:10.258490) 16:58:13.797348 run osmo-hlr_10.42.42.2(pid=30894): stderr: | 20221212165810455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165810455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165810455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165810455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165810455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165810455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165810467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165810477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165810478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165810478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:13.849453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30887): Terminating (SIGTERM) 16:58:13.891112 run iperf3-srv_10.42.42.10(pid=30888): Terminating (SIGTERM) 16:58:13.932523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30889): Terminating (SIGTERM) 16:58:13.974172 run iperf3-srv_10.42.42.10(pid=30890): Terminating (SIGTERM) 16:58:14.015592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30893): Terminating (SIGTERM) 16:58:14.057220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30896): Terminating (SIGTERM) 16:58:14.098700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30899): Terminating (SIGTERM) 16:58:14.140495 --- ParallelTerminationStrategy: PID 30887 died... 16:58:14.160595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30887): Terminated: ok {rc=0} 16:58:14.206510 --- ParallelTerminationStrategy: PID 30888 died... 16:58:14.225921 run iperf3-srv_10.42.42.10(pid=30888): Terminated {rc=256} 16:58:14.271978 --- ParallelTerminationStrategy: PID 30889 died... 16:58:14.291593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30889): Terminated: ok {rc=0} 16:58:14.337363 --- ParallelTerminationStrategy: PID 30890 died... 16:58:14.356595 run iperf3-srv_10.42.42.10(pid=30890): Terminated {rc=256} 16:58:14.402518 --- ParallelTerminationStrategy: PID 30893 died... 16:58:14.421976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30893): Terminated: ok {rc=0} 16:58:14.467646 --- ParallelTerminationStrategy: PID 30896 died... 16:58:14.487123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30896): Terminated: ok {rc=0} 16:58:14.533073 --- ParallelTerminationStrategy: PID 30899 died... 16:58:14.552454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30899): Terminated: ok {rc=0} 16:58:14.638945 bus /gobi_0: Setting Powered False 16:58:15.737117 bus /gobi_0: Setting Powered False 16:58:16.852732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 16:58:18.005836 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:18.017804 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:58:18.090423 tst iperf3.py: using LAC 30238 16:58:18.219750 tst iperf3.py: using RAC 148 16:58:18.348419 tst iperf3.py: using CellId 30238 16:58:18.476488 tst iperf3.py: using BVCI 30239 16:58:18.597458 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:18.608721 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:18.620018 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:18.631205 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:18.642317 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:18.653519 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:18.664809 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:18.675948 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:18.687265 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:58:18.803381 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 16:58:19.010443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:58:19.319618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30901): Launched 16:58:19.589091 run iperf3-srv_10.42.42.10(pid=30902): Launched 16:58:19.704491 tst iperf3.py:8: start network... 16:58:19.909681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:20.387220 run create_hlr_db(pid=30903): Launched 16:58:20.505933 bus /gobi_6: Setting Powered False 16:58:21.567726 run create_hlr_db(pid=30903): Terminated: ok {rc=0} 16:58:22.015428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30905): Launched 16:58:22.347497 run osmo-hlr_10.42.42.2(pid=30906): Launched 16:58:22.475543 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:23.042671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30908): Launched 16:58:23.372227 run osmo-stp_10.42.42.5(pid=30909): Launched 16:58:23.498835 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:58:24.065507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30911): Launched 16:58:24.191147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:58:24.469865 run patchelf(pid=30912): Launched 16:58:24.653610 run osmo-stp_10.42.42.5(pid=30909): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30909)] 16:58:24.791696 run osmo-stp_10.42.42.5(pid=30909): stdout: | (launched: 2022-12-12_16:58:23.311670) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:24.931630 run osmo-stp_10.42.42.5(pid=30909): stderr: | 20221212165823504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165823505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165823505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165823505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165823506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165823506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165823506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:25.071713 run osmo-stp_10.42.42.5(pid=30909): stdout: | (launched: 2022-12-12_16:58:23.311670) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:25.206146 run osmo-stp_10.42.42.5(pid=30909): stderr: | 20221212165823504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165823505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165823505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165823505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165823506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165823506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165823506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:25.365277 run patchelf(pid=30912): Terminating (SIGINT) 16:58:25.547361 run patchelf(pid=30912): Terminated: ok {rc=0} 16:58:25.678701 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30909): Process ended prematurely: osmo-stp_10.42.42.5(pid=30909) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30909)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 16:58:25.688791 tst iperf3.py:8: Test FAILED (7.7 sec) 16:58:25.717836 run osmo-hlr_10.42.42.2(pid=30906): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30906)] 16:58:25.768092 run osmo-hlr_10.42.42.2(pid=30906): stdout: | (launched: 2022-12-12_16:58:22.286581) 16:58:25.820148 run osmo-hlr_10.42.42.2(pid=30906): stderr: | 20221212165822485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165822485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165822485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165822485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165822485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165822486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165822497 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165822506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165822507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165822507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:25.872595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30901): Terminating (SIGTERM) 16:58:25.914551 run iperf3-srv_10.42.42.10(pid=30902): Terminating (SIGTERM) 16:58:25.956594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30905): Terminating (SIGTERM) 16:58:25.998797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30908): Terminating (SIGTERM) 16:58:26.040682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30911): Terminating (SIGTERM) 16:58:26.083075 --- ParallelTerminationStrategy: PID 30901 died... 16:58:26.103311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30901): Terminated: ok {rc=0} 16:58:26.149464 --- ParallelTerminationStrategy: PID 30902 died... 16:58:26.168812 run iperf3-srv_10.42.42.10(pid=30902): Terminated {rc=256} 16:58:26.214970 --- ParallelTerminationStrategy: PID 30905 died... 16:58:26.234758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30905): Terminated: ok {rc=0} 16:58:26.281179 --- ParallelTerminationStrategy: PID 30908 died... 16:58:26.300825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30908): Terminated: ok {rc=0} 16:58:26.347220 --- ParallelTerminationStrategy: PID 30911 died... 16:58:26.366959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30911): Terminated: ok {rc=0} 16:58:26.454535 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 16:58:27.603498 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:27.615413 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:58:27.686951 tst iperf3m4.py: using LAC 30239 16:58:27.809381 tst iperf3m4.py: using RAC 149 16:58:27.932062 tst iperf3m4.py: using CellId 30239 16:58:28.054355 tst iperf3m4.py: using BVCI 30240 16:58:28.168066 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:28.179085 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:28.190050 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:28.201689 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:28.213282 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:28.224854 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:28.236648 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:28.248144 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:28.259788 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:58:28.383957 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:58:28.502497 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:58:28.623369 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:58:28.741360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 16:58:28.948082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:58:29.257803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30913): Launched 16:58:29.527137 run iperf3-srv_10.42.42.10(pid=30914): Launched 16:58:29.643113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 16:58:29.848905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:58:30.158775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30915): Launched 16:58:30.429523 run iperf3-srv_10.42.42.10(pid=30916): Launched 16:58:30.545559 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 16:58:30.751191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:58:31.106030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30917): Launched 16:58:31.385041 run iperf3-srv_10.42.42.10(pid=30918): Launched 16:58:31.517993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 16:58:31.729255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 16:58:32.053868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30919): Launched 16:58:32.346997 run iperf3-srv_10.42.42.10(pid=30920): Launched 16:58:32.471787 tst iperf3m4.py:8: start network... 16:58:32.693185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:33.204133 run create_hlr_db(pid=30921): Launched 16:58:33.338137 bus /gobi_6: Setting Powered False 16:58:34.403010 run create_hlr_db(pid=30921): Terminated: ok {rc=0} 16:58:34.841292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30923): Launched 16:58:35.148407 run osmo-hlr_10.42.42.2(pid=30924): Launched 16:58:35.266114 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:35.812312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30926): Launched 16:58:36.120644 run osmo-stp_10.42.42.5(pid=30927): Launched 16:58:36.240099 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:58:36.771208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30929): Launched 16:58:36.890464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:58:37.150327 run patchelf(pid=30930): Launched 16:58:37.323403 run osmo-stp_10.42.42.5(pid=30927): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30927)] 16:58:37.453293 run osmo-stp_10.42.42.5(pid=30927): stdout: | (launched: 2022-12-12_16:58:36.063212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:37.584866 run osmo-stp_10.42.42.5(pid=30927): stderr: | 20221212165836234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165836234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165836235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165836235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165836236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165836236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165836236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:37.717149 run osmo-stp_10.42.42.5(pid=30927): stdout: | (launched: 2022-12-12_16:58:36.063212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:37.842841 run osmo-stp_10.42.42.5(pid=30927): stderr: | 20221212165836234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165836234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165836235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165836235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165836236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165836236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165836236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:37.991955 run patchelf(pid=30930): Terminating (SIGINT) 16:58:38.163675 run patchelf(pid=30930): Terminated: ok {rc=0} 16:58:38.287585 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30927): Process ended prematurely: osmo-stp_10.42.42.5(pid=30927) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30927)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 16:58:38.297438 tst iperf3m4.py:8: Test FAILED (10.7 sec) 16:58:38.326150 run osmo-hlr_10.42.42.2(pid=30924): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30924)] 16:58:38.374522 run osmo-hlr_10.42.42.2(pid=30924): stdout: | (launched: 2022-12-12_16:58:35.091265) 16:58:38.424602 run osmo-hlr_10.42.42.2(pid=30924): stderr: | 20221212165835266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165835266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165835266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165835266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165835266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165835266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165835279 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165835288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165835288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165835288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:38.474989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30913): Terminating (SIGTERM) 16:58:38.515381 run iperf3-srv_10.42.42.10(pid=30914): Terminating (SIGTERM) 16:58:38.555657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30915): Terminating (SIGTERM) 16:58:38.595972 run iperf3-srv_10.42.42.10(pid=30916): Terminating (SIGTERM) 16:58:38.636031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30917): Terminating (SIGTERM) 16:58:38.676214 run iperf3-srv_10.42.42.10(pid=30918): Terminating (SIGTERM) 16:58:38.716205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30919): Terminating (SIGTERM) 16:58:38.756334 run iperf3-srv_10.42.42.10(pid=30920): Terminating (SIGTERM) 16:58:38.796457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30923): Terminating (SIGTERM) 16:58:38.836768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30926): Terminating (SIGTERM) 16:58:38.876908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30929): Terminating (SIGTERM) 16:58:38.917419 --- ParallelTerminationStrategy: PID 30913 died... 16:58:38.936547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30913): Terminated: ok {rc=0} 16:58:38.981411 --- ParallelTerminationStrategy: PID 30914 died... 16:58:39.000168 run iperf3-srv_10.42.42.10(pid=30914): Terminated {rc=256} 16:58:39.044632 --- ParallelTerminationStrategy: PID 30915 died... 16:58:39.063557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30915): Terminated: ok {rc=0} 16:58:39.108176 --- ParallelTerminationStrategy: PID 30916 died... 16:58:39.126891 run iperf3-srv_10.42.42.10(pid=30916): Terminated {rc=256} 16:58:39.171319 --- ParallelTerminationStrategy: PID 30917 died... 16:58:39.189935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30917): Terminated: ok {rc=0} 16:58:39.234235 --- ParallelTerminationStrategy: PID 30918 died... 16:58:39.252824 run iperf3-srv_10.42.42.10(pid=30918): Terminated {rc=256} 16:58:39.297851 --- ParallelTerminationStrategy: PID 30919 died... 16:58:39.316593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30919): Terminated: ok {rc=0} 16:58:39.361785 --- ParallelTerminationStrategy: PID 30920 died... 16:58:39.380250 run iperf3-srv_10.42.42.10(pid=30920): Terminated {rc=256} 16:58:39.424707 --- ParallelTerminationStrategy: PID 30923 died... 16:58:39.443528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30923): Terminated: ok {rc=0} 16:58:39.488259 --- ParallelTerminationStrategy: PID 30926 died... 16:58:39.507012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30926): Terminated: ok {rc=0} 16:58:39.552016 --- ParallelTerminationStrategy: PID 30929 died... 16:58:39.570746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30929): Terminated: ok {rc=0} 16:58:39.658455 bus /gobi_4: Setting Powered False 16:58:40.758974 bus /gobi_4: Setting Powered False 16:58:41.875375 bus /gobi_1: Setting Powered False 16:58:42.975783 bus /gobi_1: Setting Powered False 16:58:44.091590 bus /gobi_0: Setting Powered False 16:58:45.189329 bus /gobi_0: Setting Powered False 16:58:46.307682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 16:58:47.414384 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:47.426436 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:58:47.498754 tst ping.py: using LAC 30240 16:58:47.627014 tst ping.py: using RAC 150 16:58:47.752670 tst ping.py: using CellId 30240 16:58:47.878269 tst ping.py: using BVCI 30241 16:58:47.996344 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:48.007835 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:48.019347 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:48.030583 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:48.041757 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:48.052883 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:48.064216 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:48.075490 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:58:48.191700 tst ping.py:19: start network... 16:58:48.393802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:48.861761 run create_hlr_db(pid=30931): Launched 16:58:48.977466 bus /gobi_6: Setting Powered False 16:58:50.041875 run create_hlr_db(pid=30931): Terminated: ok {rc=0} 16:58:50.491929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30933): Launched 16:58:50.817667 run osmo-hlr_10.42.42.2(pid=30934): Launched 16:58:50.942485 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:51.503749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30936): Launched 16:58:51.827209 run osmo-stp_10.42.42.5(pid=30937): Launched 16:58:51.950870 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:58:52.507633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30939): Launched 16:58:52.631826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:58:52.904730 run patchelf(pid=30940): Launched 16:58:53.086333 run osmo-stp_10.42.42.5(pid=30937): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30937)] 16:58:53.222516 run osmo-stp_10.42.42.5(pid=30937): stdout: | (launched: 2022-12-12_16:58:51.767621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:53.361022 run osmo-stp_10.42.42.5(pid=30937): stderr: | 20221212165851959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165851960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165851960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165851960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165851961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165851961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165851961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:53.499480 run osmo-stp_10.42.42.5(pid=30937): stdout: | (launched: 2022-12-12_16:58:51.767621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:58:53.631408 run osmo-stp_10.42.42.5(pid=30937): stderr: | 20221212165851959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165851960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165851960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165851960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165851961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165851961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165851961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:58:53.787928 run patchelf(pid=30940): Terminating (SIGINT) 16:58:53.967709 run patchelf(pid=30940): Terminated: ok {rc=0} 16:58:54.097308 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30937): Process ended prematurely: osmo-stp_10.42.42.5(pid=30937) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30937)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 16:58:54.107029 tst ping.py:22: Test FAILED (6.7 sec) 16:58:54.135980 run osmo-hlr_10.42.42.2(pid=30934): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30934)] 16:58:54.185784 run osmo-hlr_10.42.42.2(pid=30934): stdout: | (launched: 2022-12-12_16:58:50.757896) 16:58:54.237298 run osmo-hlr_10.42.42.2(pid=30934): stderr: | 20221212165850957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165850957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165850957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165850957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165850957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165850957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165850970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165850978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165850978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165850978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:58:54.289798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30933): Terminating (SIGTERM) 16:58:54.331544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30936): Terminating (SIGTERM) 16:58:54.373625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30939): Terminating (SIGTERM) 16:58:54.415790 --- ParallelTerminationStrategy: PID 30933 died... 16:58:54.435824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30933): Terminated: ok {rc=0} 16:58:54.482072 --- ParallelTerminationStrategy: PID 30936 died... 16:58:54.501488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30936): Terminated: ok {rc=0} 16:58:54.547475 --- ParallelTerminationStrategy: PID 30939 died... 16:58:54.566946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30939): Terminated: ok {rc=0} 16:58:54.655051 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 16:58:55.742642 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:55.754851 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 16:58:55.828614 tst ping_idle_ping.py: using LAC 30241 16:58:55.956279 tst ping_idle_ping.py: using RAC 151 16:58:56.085364 tst ping_idle_ping.py: using CellId 30241 16:58:56.211262 tst ping_idle_ping.py: using BVCI 30242 16:58:56.328473 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:56.340181 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:56.351907 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:56.363215 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:56.374408 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:56.386129 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:56.397601 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 16:58:56.408760 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 16:58:56.526268 tst ping_idle_ping.py:24: start network... 16:58:56.742846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:58:57.247123 run create_hlr_db(pid=30941): Launched 16:58:57.378866 bus /gobi_6: Setting Powered False 16:58:58.443506 run create_hlr_db(pid=30941): Terminated: ok {rc=0} 16:58:58.877386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30943): Launched 16:58:59.185566 run osmo-hlr_10.42.42.2(pid=30944): Launched 16:58:59.303801 run osmo-stp_10.42.42.5: Starting osmo-stp 16:58:59.826581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30946): Launched 16:59:00.131932 run osmo-stp_10.42.42.5(pid=30947): Launched 16:59:00.247679 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:59:00.770421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30949): Launched 16:59:00.906451 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:59:01.205793 run patchelf(pid=30950): Launched 16:59:01.385584 run osmo-stp_10.42.42.5(pid=30947): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30947)] 16:59:01.516139 run osmo-stp_10.42.42.5(pid=30947): stdout: | (launched: 2022-12-12_16:59:00.075351) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:01.649114 run osmo-stp_10.42.42.5(pid=30947): stderr: | 20221212165900244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165900244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165900244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165900245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165900245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165900245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165900245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:01.781858 run osmo-stp_10.42.42.5(pid=30947): stdout: | (launched: 2022-12-12_16:59:00.075351) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:01.910348 run osmo-stp_10.42.42.5(pid=30947): stderr: | 20221212165900244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165900244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165900244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165900245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165900245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165900245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165900245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:02.061218 run patchelf(pid=30950): Terminating (SIGINT) 16:59:02.233853 run patchelf(pid=30950): Terminated: ok {rc=0} 16:59:02.356492 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30947): Process ended prematurely: osmo-stp_10.42.42.5(pid=30947) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30947)] [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 16:59:02.365808 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 16:59:02.393327 run osmo-hlr_10.42.42.2(pid=30944): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30944)] 16:59:02.442174 run osmo-hlr_10.42.42.2(pid=30944): stdout: | (launched: 2022-12-12_16:58:59.128811) 16:59:02.492533 run osmo-hlr_10.42.42.2(pid=30944): stderr: | 20221212165859304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165859304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165859304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165859304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165859304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165859304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165859317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165859325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165859325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165859325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:02.543149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30943): Terminating (SIGTERM) 16:59:02.583886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30946): Terminating (SIGTERM) 16:59:02.624410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30949): Terminating (SIGTERM) 16:59:02.665399 --- ParallelTerminationStrategy: PID 30943 died... 16:59:02.684546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30943): Terminated: ok {rc=0} 16:59:02.730022 --- ParallelTerminationStrategy: PID 30946 died... 16:59:02.748831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30946): Terminated: ok {rc=0} 16:59:02.793977 --- ParallelTerminationStrategy: PID 30949 died... 16:59:02.813143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30949): Terminated: ok {rc=0} 16:59:02.899721 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 16:59:04.201688 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:04.208570 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 16:59:04.242556 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 16:59:04.276712 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 16:59:04.330569 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 16:59:04.364844 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 16:59:04.398946 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 16:59:04.953885 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 16:59:04.958978 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:59:04.970261 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 16:59:05.044374 tst switch_tch_pdch.py: using LAC 30242 16:59:05.162626 tst switch_tch_pdch.py: using RAC 152 16:59:05.281798 tst switch_tch_pdch.py: using CellId 30242 16:59:05.409348 tst switch_tch_pdch.py: using BVCI 30243 16:59:05.527633 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:59:05.539375 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:59:05.550953 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:59:05.563206 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:59:05.575327 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:59:05.587342 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:59:05.599587 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 16:59:05.611914 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:59:05.728152 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 16:59:05.850920 tst switch_tch_pdch.py:51: start network... 16:59:06.053504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:06.523118 run create_hlr_db(pid=30955): Launched 16:59:06.639272 bus /gobi_6: Setting Powered False 16:59:07.702782 run create_hlr_db(pid=30955): Terminated: ok {rc=0} 16:59:08.152246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30957): Launched 16:59:08.478865 run osmo-hlr_10.42.42.2(pid=30958): Launched 16:59:08.604564 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:09.161681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30960): Launched 16:59:09.487709 run osmo-stp_10.42.42.5(pid=30961): Launched 16:59:09.613500 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:59:10.169659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30963): Launched 16:59:10.293849 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:59:10.566518 run patchelf(pid=30964): Launched 16:59:10.747142 run osmo-stp_10.42.42.5(pid=30961): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30961)] 16:59:10.883002 run osmo-stp_10.42.42.5(pid=30961): stdout: | (launched: 2022-12-12_16:59:09.426127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:11.020487 run osmo-stp_10.42.42.5(pid=30961): stderr: | 20221212165909618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165909619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165909619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165909619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165909620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165909620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165909620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:11.157962 run osmo-stp_10.42.42.5(pid=30961): stdout: | (launched: 2022-12-12_16:59:09.426127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:11.289723 run osmo-stp_10.42.42.5(pid=30961): stderr: | 20221212165909618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165909619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165909619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165909619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165909620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165909620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165909620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:11.446092 run patchelf(pid=30964): Terminating (SIGINT) 16:59:11.626351 run patchelf(pid=30964): Terminated: ok {rc=0} 16:59:11.755818 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30961): Process ended prematurely: osmo-stp_10.42.42.5(pid=30961) [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30961)] [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 16:59:11.765517 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 16:59:11.793764 run osmo-hlr_10.42.42.2(pid=30958): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30958)] 16:59:11.843426 run osmo-hlr_10.42.42.2(pid=30958): stdout: | (launched: 2022-12-12_16:59:08.418664) 16:59:11.894877 run osmo-hlr_10.42.42.2(pid=30958): stderr: | 20221212165908615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165908615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165908615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165908615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165908615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165908616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165908628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165908636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165908637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165908637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:11.946542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30957): Terminating (SIGTERM) 16:59:11.988142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30960): Terminating (SIGTERM) 16:59:12.030038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30963): Terminating (SIGTERM) 16:59:12.071874 --- ParallelTerminationStrategy: PID 30957 died... 16:59:12.091595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30957): Terminated: ok {rc=0} 16:59:12.137489 --- ParallelTerminationStrategy: PID 30960 died... 16:59:12.157098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30960): Terminated: ok {rc=0} 16:59:12.202892 --- ParallelTerminationStrategy: PID 30963 died... 16:59:12.222397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30963): Terminated: ok {rc=0} 16:59:12.309562 bus /gobi_0: Setting Powered False 16:59:13.407575 bus /gobi_0: Setting Powered False 16:59:14.521749 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 16:59:15.769990 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:15.776730 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 16:59:15.819735 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 16:59:15.869021 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 16:59:15.937497 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 16:59:15.973571 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 16:59:16.011951 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 16:59:16.556486 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 16:59:16.564203 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:59:16.577417 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 16:59:16.663986 tst switch_tch_pdch.py: using LAC 30243 16:59:16.794417 tst switch_tch_pdch.py: using RAC 153 16:59:16.926098 tst switch_tch_pdch.py: using CellId 30243 16:59:17.053312 tst switch_tch_pdch.py: using BVCI 30244 16:59:17.202214 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:59:17.215556 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:59:17.226834 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:59:17.239244 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:59:17.253223 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:59:17.265992 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:59:17.277712 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 16:59:17.289565 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:59:17.413323 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 16:59:17.529179 tst switch_tch_pdch.py:51: start network... 16:59:17.731668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:18.172199 run create_hlr_db(pid=30968): Launched 16:59:18.287720 bus /gobi_6: Setting Powered False 16:59:19.347789 run create_hlr_db(pid=30968): Terminated: ok {rc=0} 16:59:19.762756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30970): Launched 16:59:20.087053 run osmo-hlr_10.42.42.2(pid=30971): Launched 16:59:20.210836 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:20.741626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30973): Launched 16:59:21.065672 run osmo-stp_10.42.42.5(pid=30974): Launched 16:59:21.190077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 16:59:21.718462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30976): Launched 16:59:21.843206 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 16:59:22.115366 run patchelf(pid=30977): Launched 16:59:22.296363 run osmo-stp_10.42.42.5(pid=30974): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30974)] 16:59:22.433126 run osmo-stp_10.42.42.5(pid=30974): stdout: | (launched: 2022-12-12_16:59:21.006202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:22.570637 run osmo-stp_10.42.42.5(pid=30974): stderr: | 20221212165921198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165921198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165921198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165921199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165921199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165921199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165921199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:22.708329 run osmo-stp_10.42.42.5(pid=30974): stdout: | (launched: 2022-12-12_16:59:21.006202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:22.840113 run osmo-stp_10.42.42.5(pid=30974): stderr: | 20221212165921198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165921198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165921198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165921199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165921199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165921199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165921199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:22.996459 run patchelf(pid=30977): Terminating (SIGINT) 16:59:23.176350 run patchelf(pid=30977): Terminated: ok {rc=0} 16:59:23.306418 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30974): Process ended prematurely: osmo-stp_10.42.42.5(pid=30974) [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30974)] [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 16:59:23.316169 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 16:59:23.344472 run osmo-hlr_10.42.42.2(pid=30971): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30971)] 16:59:23.394493 run osmo-hlr_10.42.42.2(pid=30971): stdout: | (launched: 2022-12-12_16:59:20.027704) 16:59:23.446294 run osmo-hlr_10.42.42.2(pid=30971): stderr: | 20221212165920225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165920225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165920225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165920225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165920225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165920225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165920238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165920246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165920246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165920246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:23.498756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30970): Terminating (SIGTERM) 16:59:23.540465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30973): Terminating (SIGTERM) 16:59:23.582261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30976): Terminating (SIGTERM) 16:59:23.624272 --- ParallelTerminationStrategy: PID 30970 died... 16:59:23.644650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30970): Terminated: ok {rc=0} 16:59:23.690980 --- ParallelTerminationStrategy: PID 30973 died... 16:59:23.710596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30973): Terminated: ok {rc=0} 16:59:23.756637 --- ParallelTerminationStrategy: PID 30976 died... 16:59:23.776306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30976): Terminated: ok {rc=0} 16:59:23.864097 bus /gobi_0: Setting Powered False 16:59:24.964201 bus /gobi_0: Setting Powered False 16:59:26.080358 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 16:59:27.333117 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:27.337015 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:59:27.366622 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 16:59:27.373476 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:59:27.423562 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:59:27.452674 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 16:59:27.459382 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:59:27.998347 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 16:59:28.003297 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 16:59:28.014222 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:59:28.061254 tst mo_mt_sms.py: using LAC 30244 16:59:28.179617 tst mo_mt_sms.py: using RAC 154 16:59:28.296076 tst mo_mt_sms.py: using CellId 30244 16:59:28.412074 tst mo_mt_sms.py: using BVCI 30245 16:59:28.520856 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:59:28.641145 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:59:28.760886 tst mo_mt_sms.py:9: start nitb and bts... 16:59:28.978868 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:59:29.635809 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30981): Launched 16:59:29.958891 run osmo-nitb_10.42.42.2(pid=30982): Launched 16:59:30.139199 run osmo-nitb_10.42.42.2(pid=30982): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30982)] 16:59:30.282870 run osmo-nitb_10.42.42.2(pid=30982): stdout: | (launched: 2022-12-12_16:59:29.899727) 16:59:30.428658 run osmo-nitb_10.42.42.2(pid=30982): stderr: | (launched: 2022-12-12_16:59:29.947388) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:59:30.574244 run osmo-nitb_10.42.42.2(pid=30982): stdout: | (launched: 2022-12-12_16:59:29.899727) 16:59:30.713679 run osmo-nitb_10.42.42.2(pid=30982): stderr: | (launched: 2022-12-12_16:59:29.947388) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30982): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30982) [trial-2379↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30982)] 16:59:31.082161 tst osmo-nitb_10.42.42.2(pid=30982): stdout: | (launched: 2022-12-12_16:59:29.899727) 16:59:31.206699 tst osmo-nitb_10.42.42.2(pid=30982): stderr: | (launched: 2022-12-12_16:59:29.947388) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:59:31.355036 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30982): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30982) [trial-2379↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30982)] [trial-2379↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 16:59:31.364562 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 16:59:31.373830 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30981): Terminating (SIGTERM) 16:59:31.586895 --- ParallelTerminationStrategy: PID 30981 died... 16:59:31.606785 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30981): Terminated: ok {rc=0} 16:59:31.695365 bus /sierra_3: Setting Powered False 16:59:32.794898 bus /sierra_3: Setting Powered False 16:59:33.910873 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 16:59:35.107196 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:35.111615 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:59:35.141660 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:59:35.168757 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 16:59:35.224357 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:59:35.254050 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:59:35.280537 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 16:59:35.825027 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 16:59:35.830228 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:35.840934 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:59:35.884873 tst mo_mt_sms.py: using LAC 30245 16:59:36.002578 tst mo_mt_sms.py: using RAC 155 16:59:36.122384 tst mo_mt_sms.py: using CellId 30245 16:59:36.244510 tst mo_mt_sms.py: using BVCI 30246 16:59:36.355265 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:36.366097 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:36.376776 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:36.387617 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:36.398489 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:36.409370 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:59:36.528536 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 16:59:36.642450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:37.109640 run create_hlr_db(pid=30986): Launched 16:59:37.224903 bus /sierra_2: Setting Powered False 16:59:38.284418 run create_hlr_db(pid=30986): Terminated: ok {rc=0} 16:59:38.704509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30988): Launched 16:59:39.005100 run osmo-hlr_10.42.42.2(pid=30989): Launched 16:59:39.120660 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:39.642799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30991): Launched 16:59:39.945369 run osmo-stp_10.42.42.5(pid=30992): Launched 16:59:40.063563 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:40.614212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30994): Launched 16:59:40.918348 run osmo-msc_10.42.42.6(pid=30995): Launched 16:59:41.087376 run osmo-stp_10.42.42.5(pid=30992): ERR: Terminated: ERROR {rc=1} [trial-2379↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30992)] 16:59:41.215112 run osmo-stp_10.42.42.5(pid=30992): stdout: | (launched: 2022-12-12_16:59:39.889126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:41.343331 run osmo-stp_10.42.42.5(pid=30992): stderr: | 20221212165940059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165940059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165940059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165940060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165940060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165940060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165940060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:41.469412 run osmo-stp_10.42.42.5(pid=30992): stdout: | (launched: 2022-12-12_16:59:39.889126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:41.589235 run osmo-stp_10.42.42.5(pid=30992): stderr: | 20221212165940059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165940059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165940059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165940060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165940060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165940060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165940060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:41.732822 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30992): Process ended prematurely: osmo-stp_10.42.42.5(pid=30992) [trial-2379↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30992)] [trial-2379↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 16:59:41.741394 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 16:59:41.768033 run osmo-hlr_10.42.42.2(pid=30989): ERR: Terminated: ERROR {rc=237} [trial-2379↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30989)] 16:59:41.816627 run osmo-hlr_10.42.42.2(pid=30989): stdout: | (launched: 2022-12-12_16:59:38.948923) 16:59:41.866210 run osmo-hlr_10.42.42.2(pid=30989): stderr: | 20221212165939121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165939122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165939122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165939122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165939122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165939122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165939134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165939143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165939143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165939143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:41.935557 run osmo-msc_10.42.42.6(pid=30995): ERR: Terminated: ERROR {rc=2} [trial-2379↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30995)] 16:59:41.983951 run osmo-msc_10.42.42.6(pid=30995): stdout: | (launched: 2022-12-12_16:59:40.862020) 16:59:42.033802 run osmo-msc_10.42.42.6(pid=30995): stderr: | 20221212165941133 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165941133 DLGLOBAL DEBUG validating counter group 0x7feebb554c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165941133 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165941133 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165941134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165941134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165941135 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165941136 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165941136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165941136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:42.084288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30988): Terminating (SIGTERM) 16:59:42.124605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30991): Terminating (SIGTERM) 16:59:42.164843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30994): Terminating (SIGTERM) 16:59:42.205834 --- ParallelTerminationStrategy: PID 30988 died... 16:59:42.225599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30988): Terminated: ok {rc=0} 16:59:42.270367 --- ParallelTerminationStrategy: PID 30991 died... 16:59:42.289264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30991): Terminated: ok {rc=0} 16:59:42.334228 --- ParallelTerminationStrategy: PID 30994 died... 16:59:42.352865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30994): Terminated: ok {rc=0} 16:59:42.440287 bus /sierra_3: Setting Powered False 16:59:43.542528 bus /sierra_3: Setting Powered False 16:59:44.660445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 16:59:45.914336 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:45.918956 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:59:45.957163 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 16:59:45.964926 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 16:59:46.005037 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:59:46.036626 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 16:59:46.044577 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 16:59:46.557926 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 16:59:46.564000 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 16:59:46.576312 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:59:46.622466 tst assert_extension.py: using LAC 30246 16:59:46.749456 tst assert_extension.py: using RAC 156 16:59:46.906819 tst assert_extension.py: using CellId 30246 16:59:47.027436 tst assert_extension.py: using BVCI 30247 16:59:47.143265 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 16:59:47.254862 tst assert_extension.py:10: start nitb and bts... 16:59:47.466672 run osmo-nitb_10.42.42.2: Starting osmo-nitb 16:59:48.086514 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31000): Launched 16:59:48.390570 run osmo-nitb_10.42.42.2(pid=31001): Launched 16:59:48.560392 run osmo-nitb_10.42.42.2(pid=31001): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31001)] 16:59:48.695692 run osmo-nitb_10.42.42.2(pid=31001): stdout: | (launched: 2022-12-12_16:59:48.334521) 16:59:48.832189 run osmo-nitb_10.42.42.2(pid=31001): stderr: | (launched: 2022-12-12_16:59:48.379191) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:59:48.968787 run osmo-nitb_10.42.42.2(pid=31001): stdout: | (launched: 2022-12-12_16:59:48.334521) 16:59:49.099817 run osmo-nitb_10.42.42.2(pid=31001): stderr: | (launched: 2022-12-12_16:59:48.379191) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31001): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31001) [trial-2379↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31001)] 16:59:49.506951 tst osmo-nitb_10.42.42.2(pid=31001): stdout: | (launched: 2022-12-12_16:59:48.334521) 16:59:49.629161 tst osmo-nitb_10.42.42.2(pid=31001): stderr: | (launched: 2022-12-12_16:59:48.379191) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 16:59:49.772105 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31001): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31001) [trial-2379↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31001)] [trial-2379↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 16:59:49.780840 tst assert_extension.py:12: Test FAILED (3.2 sec) 16:59:49.787877 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31000): Terminating (SIGTERM) 16:59:49.997716 --- ParallelTerminationStrategy: PID 31000 died... 16:59:50.019000 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31000): Terminated: ok {rc=0} 16:59:50.105962 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 16:59:51.278755 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:51.283153 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 16:59:51.313901 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 16:59:51.340244 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 16:59:51.376860 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 16:59:51.407496 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 16:59:51.435306 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 16:59:51.960410 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 16:59:51.965472 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:51.976197 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 16:59:52.019897 tst assert_extension.py: using LAC 30247 16:59:52.137257 tst assert_extension.py: using RAC 157 16:59:52.256169 tst assert_extension.py: using CellId 30247 16:59:52.374873 tst assert_extension.py: using BVCI 30248 16:59:52.485202 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:52.496012 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:52.506673 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:52.517543 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:52.528371 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 16:59:52.539188 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 16:59:52.657935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 16:59:53.156440 run create_hlr_db(pid=31006): Launched 16:59:53.288587 bus /sierra_2: Setting Powered False 16:59:54.352578 run create_hlr_db(pid=31006): Terminated: ok {rc=0} 16:59:54.799928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31008): Launched 16:59:55.125151 run osmo-hlr_10.42.42.2(pid=31009): Launched 16:59:55.248190 run osmo-stp_10.42.42.5: Starting osmo-stp 16:59:55.810721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31011): Launched 16:59:56.137050 run osmo-stp_10.42.42.5(pid=31012): Launched 16:59:56.259773 run osmo-msc_10.42.42.6: Starting osmo-msc 16:59:56.843240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31014): Launched 16:59:57.167120 run osmo-msc_10.42.42.6(pid=31015): Launched 16:59:57.348521 run osmo-stp_10.42.42.5(pid=31012): ERR: Terminated: ERROR {rc=1} [trial-2379↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31012)] 16:59:57.484786 run osmo-stp_10.42.42.5(pid=31012): stdout: | (launched: 2022-12-12_16:59:56.077444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:57.620393 run osmo-stp_10.42.42.5(pid=31012): stderr: | 20221212165956267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165956267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165956267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165956268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165956268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165956268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165956268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:57.755340 run osmo-stp_10.42.42.5(pid=31012): stdout: | (launched: 2022-12-12_16:59:56.077444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 16:59:57.883713 run osmo-stp_10.42.42.5(pid=31012): stderr: | 20221212165956267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212165956267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212165956267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212165956268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212165956268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212165956268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212165956268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 16:59:58.038180 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31012): Process ended prematurely: osmo-stp_10.42.42.5(pid=31012) [trial-2379↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31012)] [trial-2379↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 16:59:58.047325 tst assert_extension.py:17: Test FAILED (6.1 sec) 16:59:58.075394 run osmo-hlr_10.42.42.2(pid=31009): ERR: Terminated: ERROR {rc=237} [trial-2379↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31009)] 16:59:58.125654 run osmo-hlr_10.42.42.2(pid=31009): stdout: | (launched: 2022-12-12_16:59:55.065410) 16:59:58.177240 run osmo-hlr_10.42.42.2(pid=31009): stderr: | 20221212165955263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212165955263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212165955263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212165955264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212165955264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212165955264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212165955277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212165955285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212165955285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212165955285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 16:59:58.249446 run osmo-msc_10.42.42.6(pid=31015): ERR: Terminated: ERROR {rc=2} [trial-2379↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31015)] 16:59:58.299136 run osmo-msc_10.42.42.6(pid=31015): stdout: | (launched: 2022-12-12_16:59:57.107477) 16:59:58.350666 run osmo-msc_10.42.42.6(pid=31015): stderr: | 20221212165957430 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212165957430 DLGLOBAL DEBUG validating counter group 0x7fdd8e565c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212165957430 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212165957430 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212165957430 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212165957431 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212165957432 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212165957433 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212165957433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212165957433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 16:59:58.402424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31008): Terminating (SIGTERM) 16:59:58.443800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31011): Terminating (SIGTERM) 16:59:58.485596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31014): Terminating (SIGTERM) 16:59:58.527711 --- ParallelTerminationStrategy: PID 31008 died... 16:59:58.547630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31008): Terminated: ok {rc=0} 16:59:58.594387 --- ParallelTerminationStrategy: PID 31011 died... 16:59:58.614076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31011): Terminated: ok {rc=0} 16:59:58.659928 --- ParallelTerminationStrategy: PID 31014 died... 16:59:58.679446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31014): Terminated: ok {rc=0} 16:59:58.766413 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 16:59:59.979433 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 16:59:59.987309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:00:00.018277 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:00:00.045503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:00:00.099778 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:00:00.131233 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:00:00.158769 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:00:00.710757 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:00:00.764764 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:00.776747 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:00:00.865569 tst mo_mt_call.py: using LAC 30248 17:00:00.994508 tst mo_mt_call.py: using RAC 158 17:00:01.128381 tst mo_mt_call.py: using CellId 30248 17:00:01.261669 tst mo_mt_call.py: using BVCI 30249 17:00:01.385537 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:01.397959 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:01.410412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:01.422893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:01.435327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:01.447912 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:00:01.568085 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:00:01.686626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:02.179543 run create_hlr_db(pid=31023): Launched 17:00:02.335362 bus /sierra_2: Setting Powered False 17:00:03.396602 run create_hlr_db(pid=31023): Terminated: ok {rc=0} 17:00:03.825361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31025): Launched 17:00:04.133925 run osmo-hlr_10.42.42.2(pid=31026): Launched 17:00:04.251943 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:04.785780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31028): Launched 17:00:05.094455 run osmo-stp_10.42.42.5(pid=31029): Launched 17:00:05.213756 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:05.768839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31031): Launched 17:00:06.078190 run osmo-msc_10.42.42.6(pid=31032): Launched 17:00:06.248853 run osmo-stp_10.42.42.5(pid=31029): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31029)] 17:00:06.379861 run osmo-stp_10.42.42.5(pid=31029): stdout: | (launched: 2022-12-12_17:00:05.037311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:06.509369 run osmo-stp_10.42.42.5(pid=31029): stderr: | 20221212170005208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170005208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170005209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170005209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170005209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170005210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170005210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:06.636707 run osmo-stp_10.42.42.5(pid=31029): stdout: | (launched: 2022-12-12_17:00:05.037311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:06.758680 run osmo-stp_10.42.42.5(pid=31029): stderr: | 20221212170005208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170005208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170005209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170005209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170005209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170005210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170005210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:06.904777 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31029): Process ended prematurely: osmo-stp_10.42.42.5(pid=31029) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31029)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:00:06.913918 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:00:06.941099 run osmo-hlr_10.42.42.2(pid=31026): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31026)] 17:00:06.988645 run osmo-hlr_10.42.42.2(pid=31026): stdout: | (launched: 2022-12-12_17:00:04.076555) 17:00:07.038010 run osmo-hlr_10.42.42.2(pid=31026): stderr: | 20221212170004253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170004253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170004253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170004253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170004253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170004253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170004266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170004275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170004275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170004275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:07.106984 run osmo-msc_10.42.42.6(pid=31032): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31032)] 17:00:07.154459 run osmo-msc_10.42.42.6(pid=31032): stdout: | (launched: 2022-12-12_17:00:06.021316) 17:00:07.203649 run osmo-msc_10.42.42.6(pid=31032): stderr: | 20221212170006291 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170006291 DLGLOBAL DEBUG validating counter group 0x7efd19ad9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170006291 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170006291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170006291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170006291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170006293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170006293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170006294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170006294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:07.252906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31025): Terminating (SIGTERM) 17:00:07.292439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31028): Terminating (SIGTERM) 17:00:07.331894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31031): Terminating (SIGTERM) 17:00:07.371717 --- ParallelTerminationStrategy: PID 31025 died... 17:00:07.390700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31025): Terminated: ok {rc=0} 17:00:07.434556 --- ParallelTerminationStrategy: PID 31028 died... 17:00:07.453300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31028): Terminated: ok {rc=0} 17:00:07.497294 --- ParallelTerminationStrategy: PID 31031 died... 17:00:07.515693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31031): Terminated: ok {rc=0} 17:00:07.599539 bus /sierra_3: Setting Powered False 17:00:08.695548 bus /sierra_3: Setting Powered False 17:00:09.811382 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:00:10.963700 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:10.976203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:00:11.042665 tst mo_mt_call_osmux.py: using LAC 30249 17:00:11.169383 tst mo_mt_call_osmux.py: using RAC 159 17:00:11.298347 tst mo_mt_call_osmux.py: using CellId 30249 17:00:11.425680 tst mo_mt_call_osmux.py: using BVCI 30250 17:00:11.544907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:11.557307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:11.569152 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:11.580729 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:11.592405 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:00:11.603997 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:00:11.720208 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:00:11.839823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:12.350908 run create_hlr_db(pid=31034): Launched 17:00:12.484329 bus /sierra_2: Setting Powered False 17:00:13.549554 run create_hlr_db(pid=31034): Terminated: ok {rc=0} 17:00:13.988240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31036): Launched 17:00:14.297672 run osmo-hlr_10.42.42.2(pid=31037): Launched 17:00:14.417167 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:14.961176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31039): Launched 17:00:15.269380 run osmo-stp_10.42.42.5(pid=31040): Launched 17:00:15.387653 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:15.958775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31042): Launched 17:00:16.295455 run osmo-msc_10.42.42.6(pid=31043): Launched 17:00:16.766194 run osmo-stp_10.42.42.5(pid=31040): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31040)] 17:00:16.919454 run osmo-stp_10.42.42.5(pid=31040): stdout: | (launched: 2022-12-12_17:00:15.212169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:17.059655 run osmo-stp_10.42.42.5(pid=31040): stderr: | 20221212170015383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170015383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170015384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170015384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170015384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170015385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170015385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:17.199917 run osmo-stp_10.42.42.5(pid=31040): stdout: | (launched: 2022-12-12_17:00:15.212169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:17.335087 run osmo-stp_10.42.42.5(pid=31040): stderr: | 20221212170015383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170015383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170015384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170015384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170015384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170015385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170015385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:17.491411 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31040): Process ended prematurely: osmo-stp_10.42.42.5(pid=31040) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31040)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:00:17.501138 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:00:17.529421 run osmo-hlr_10.42.42.2(pid=31037): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31037)] 17:00:17.579513 run osmo-hlr_10.42.42.2(pid=31037): stdout: | (launched: 2022-12-12_17:00:14.240505) 17:00:17.631076 run osmo-hlr_10.42.42.2(pid=31037): stderr: | 20221212170014417 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170014417 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170014417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170014417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170014417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170014417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170014428 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170014437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170014437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170014437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:17.703252 run osmo-msc_10.42.42.6(pid=31043): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31043)] 17:00:17.753234 run osmo-msc_10.42.42.6(pid=31043): stdout: | (launched: 2022-12-12_17:00:16.238324) 17:00:17.804597 run osmo-msc_10.42.42.6(pid=31043): stderr: | 20221212170016626 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170016627 DLGLOBAL DEBUG validating counter group 0x7f80b6980c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170016627 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170016627 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170016627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170016627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170016629 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170016629 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170016630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170016630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:17.856454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31036): Terminating (SIGTERM) 17:00:17.898106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31039): Terminating (SIGTERM) 17:00:17.939804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31042): Terminating (SIGTERM) 17:00:17.981831 --- ParallelTerminationStrategy: PID 31036 died... 17:00:18.001874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31036): Terminated: ok {rc=0} 17:00:18.047871 --- ParallelTerminationStrategy: PID 31039 died... 17:00:18.067687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31039): Terminated: ok {rc=0} 17:00:18.114391 --- ParallelTerminationStrategy: PID 31042 died... 17:00:18.134086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31042): Terminated: ok {rc=0} 17:00:18.223403 bus /sierra_3: Setting Powered False 17:00:19.322767 bus /sierra_3: Setting Powered False 17:00:20.440680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:00:21.684664 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:21.692331 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:00:21.722476 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:00:21.748745 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:00:21.801372 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:00:21.830911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:00:21.857380 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:00:22.408064 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:00:22.463238 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:22.474913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:00:22.542375 tst mo_mt_call.py: using LAC 30250 17:00:22.672541 tst mo_mt_call.py: using RAC 160 17:00:22.802350 tst mo_mt_call.py: using CellId 30250 17:00:22.931791 tst mo_mt_call.py: using BVCI 30251 17:00:23.050652 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:23.062417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:23.073987 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:23.085638 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:23.097880 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:23.109448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:00:23.226497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:00:23.342873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:23.820016 run create_hlr_db(pid=31048): Launched 17:00:23.938500 bus /sierra_2: Setting Powered False 17:00:24.999576 run create_hlr_db(pid=31048): Terminated: ok {rc=0} 17:00:25.449387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31050): Launched 17:00:25.778965 run osmo-hlr_10.42.42.2(pid=31051): Launched 17:00:25.906072 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:26.478061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31053): Launched 17:00:26.807365 run osmo-stp_10.42.42.5(pid=31054): Launched 17:00:26.934855 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:27.530059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31056): Launched 17:00:27.859041 run osmo-msc_10.42.42.6(pid=31057): Launched 17:00:28.044264 run osmo-stp_10.42.42.5(pid=31054): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31054)] 17:00:28.183064 run osmo-stp_10.42.42.5(pid=31054): stdout: | (launched: 2022-12-12_17:00:26.746952) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:28.321903 run osmo-stp_10.42.42.5(pid=31054): stderr: | 20221212170026938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170026938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170026938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170026939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170026939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170026939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170026939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:28.459130 run osmo-stp_10.42.42.5(pid=31054): stdout: | (launched: 2022-12-12_17:00:26.746952) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:28.589258 run osmo-stp_10.42.42.5(pid=31054): stderr: | 20221212170026938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170026938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170026938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170026939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170026939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170026939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170026939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:28.745373 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31054): Process ended prematurely: osmo-stp_10.42.42.5(pid=31054) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31054)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:00:28.755016 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:00:28.783069 run osmo-hlr_10.42.42.2(pid=31051): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31051)] 17:00:28.833291 run osmo-hlr_10.42.42.2(pid=31051): stdout: | (launched: 2022-12-12_17:00:25.718439) 17:00:28.885105 run osmo-hlr_10.42.42.2(pid=31051): stderr: | 20221212170025917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170025917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170025917 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170025917 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170025917 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170025917 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170025929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170025938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170025938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170025938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:28.957210 run osmo-msc_10.42.42.6(pid=31057): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31057)] 17:00:29.007074 run osmo-msc_10.42.42.6(pid=31057): stdout: | (launched: 2022-12-12_17:00:27.798501) 17:00:29.058536 run osmo-msc_10.42.42.6(pid=31057): stderr: | 20221212170028119 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170028119 DLGLOBAL DEBUG validating counter group 0x7fe6f54e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170028119 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170028119 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170028120 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170028120 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170028122 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170028122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170028122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170028122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:29.110274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31050): Terminating (SIGTERM) 17:00:29.151770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31053): Terminating (SIGTERM) 17:00:29.193423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31056): Terminating (SIGTERM) 17:00:29.235166 --- ParallelTerminationStrategy: PID 31050 died... 17:00:29.255162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31050): Terminated: ok {rc=0} 17:00:29.301231 --- ParallelTerminationStrategy: PID 31053 died... 17:00:29.320640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31053): Terminated: ok {rc=0} 17:00:29.366738 --- ParallelTerminationStrategy: PID 31056 died... 17:00:29.386493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31056): Terminated: ok {rc=0} 17:00:29.473165 bus /sierra_3: Setting Powered False 17:00:30.571795 bus /sierra_3: Setting Powered False 17:00:31.688550 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:00:32.839702 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:32.852263 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:00:32.925820 tst mo_mt_call_osmux.py: using LAC 30251 17:00:33.054392 tst mo_mt_call_osmux.py: using RAC 161 17:00:33.181170 tst mo_mt_call_osmux.py: using CellId 30251 17:00:33.312625 tst mo_mt_call_osmux.py: using BVCI 30252 17:00:33.433679 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:33.445553 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:33.457061 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:33.468523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:33.480181 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:00:33.491804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:00:33.609415 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:00:33.730518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:34.242565 run create_hlr_db(pid=31059): Launched 17:00:34.377209 bus /sierra_2: Setting Powered False 17:00:35.442817 run create_hlr_db(pid=31059): Terminated: ok {rc=0} 17:00:35.881924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31061): Launched 17:00:36.190491 run osmo-hlr_10.42.42.2(pid=31062): Launched 17:00:36.308423 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:36.843104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31064): Launched 17:00:37.153028 run osmo-stp_10.42.42.5(pid=31065): Launched 17:00:37.271380 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:37.830747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31067): Launched 17:00:38.140879 run osmo-msc_10.42.42.6(pid=31068): Launched 17:00:38.315546 run osmo-stp_10.42.42.5(pid=31065): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31065)] 17:00:38.446079 run osmo-stp_10.42.42.5(pid=31065): stdout: | (launched: 2022-12-12_17:00:37.095815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:38.576565 run osmo-stp_10.42.42.5(pid=31065): stderr: | 20221212170037265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170037265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170037265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170037266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170037266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170037266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170037266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:38.705278 run osmo-stp_10.42.42.5(pid=31065): stdout: | (launched: 2022-12-12_17:00:37.095815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:38.827954 run osmo-stp_10.42.42.5(pid=31065): stderr: | 20221212170037265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170037265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170037265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170037266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170037266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170037266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170037266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:38.975007 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31065): Process ended prematurely: osmo-stp_10.42.42.5(pid=31065) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31065)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:00:38.984305 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:00:39.012306 run osmo-hlr_10.42.42.2(pid=31062): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31062)] 17:00:39.061130 run osmo-hlr_10.42.42.2(pid=31062): stdout: | (launched: 2022-12-12_17:00:36.133489) 17:00:39.111318 run osmo-hlr_10.42.42.2(pid=31062): stderr: | 20221212170036310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170036310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170036310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170036311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170036311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170036311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170036326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170036336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170036336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170036336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:39.181741 run osmo-msc_10.42.42.6(pid=31068): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31068)] 17:00:39.230082 run osmo-msc_10.42.42.6(pid=31068): stdout: | (launched: 2022-12-12_17:00:38.083724) 17:00:39.280297 run osmo-msc_10.42.42.6(pid=31068): stderr: | 20221212170038356 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170038357 DLGLOBAL DEBUG validating counter group 0x7f65cb961c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170038357 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170038357 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170038357 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170038357 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170038359 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170038359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170038359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170038360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:39.331020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31061): Terminating (SIGTERM) 17:00:39.371658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31064): Terminating (SIGTERM) 17:00:39.412332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31067): Terminating (SIGTERM) 17:00:39.453415 --- ParallelTerminationStrategy: PID 31061 died... 17:00:39.472901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31061): Terminated: ok {rc=0} 17:00:39.518137 --- ParallelTerminationStrategy: PID 31064 died... 17:00:39.537183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31064): Terminated: ok {rc=0} 17:00:39.582390 --- ParallelTerminationStrategy: PID 31067 died... 17:00:39.601493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31067): Terminated: ok {rc=0} 17:00:39.688678 bus /sierra_3: Setting Powered False 17:00:40.790599 bus /sierra_3: Setting Powered False 17:00:41.907243 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:00:43.153984 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:00:43.162014 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:00:43.191722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:00:43.219066 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:00:43.274008 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:00:43.304572 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:00:43.332117 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:00:43.882320 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:00:43.934821 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:43.946715 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:00:44.014308 tst mo_mt_call.py: using LAC 30252 17:00:44.144386 tst mo_mt_call.py: using RAC 162 17:00:44.266783 tst mo_mt_call.py: using CellId 30252 17:00:44.387859 tst mo_mt_call.py: using BVCI 30253 17:00:44.501434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:44.512877 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:44.524124 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:44.535899 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:44.547759 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:44.559517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:00:44.678021 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:00:44.797519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:45.311274 run create_hlr_db(pid=31073): Launched 17:00:45.448502 bus /sierra_2: Setting Powered False 17:00:46.531819 run create_hlr_db(pid=31073): Terminated: ok {rc=0} 17:00:47.072777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31075): Launched 17:00:47.402534 run osmo-hlr_10.42.42.2(pid=31076): Launched 17:00:47.525261 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:48.069625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31078): Launched 17:00:48.380481 run osmo-stp_10.42.42.5(pid=31079): Launched 17:00:48.499221 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:49.062121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31081): Launched 17:00:49.375094 run osmo-msc_10.42.42.6(pid=31082): Launched 17:00:49.550518 run osmo-stp_10.42.42.5(pid=31079): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31079)] 17:00:49.680540 run osmo-stp_10.42.42.5(pid=31079): stdout: | (launched: 2022-12-12_17:00:48.322869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:49.811193 run osmo-stp_10.42.42.5(pid=31079): stderr: | 20221212170048493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170048494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170048494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170048494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170048495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170048495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170048495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:49.939549 run osmo-stp_10.42.42.5(pid=31079): stdout: | (launched: 2022-12-12_17:00:48.322869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:50.062720 run osmo-stp_10.42.42.5(pid=31079): stderr: | 20221212170048493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170048494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170048494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170048494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170048495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170048495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170048495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:00:50.210584 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31079): Process ended prematurely: osmo-stp_10.42.42.5(pid=31079) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31079)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:00:50.219972 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:00:50.247354 run osmo-hlr_10.42.42.2(pid=31076): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31076)] 17:00:50.295778 run osmo-hlr_10.42.42.2(pid=31076): stdout: | (launched: 2022-12-12_17:00:47.344872) 17:00:50.345449 run osmo-hlr_10.42.42.2(pid=31076): stderr: | 20221212170047521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170047521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170047521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170047522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170047522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170047522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170047535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170047543 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170047543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170047543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:00:50.414863 run osmo-msc_10.42.42.6(pid=31082): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31082)] 17:00:50.462715 run osmo-msc_10.42.42.6(pid=31082): stdout: | (launched: 2022-12-12_17:00:49.317501) 17:00:50.512037 run osmo-msc_10.42.42.6(pid=31082): stderr: | 20221212170049590 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170049590 DLGLOBAL DEBUG validating counter group 0x7f53b19a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170049590 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170049590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170049590 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170049591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170049592 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170049593 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170049593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170049593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:00:50.562516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31075): Terminating (SIGTERM) 17:00:50.602601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31078): Terminating (SIGTERM) 17:00:50.642612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31081): Terminating (SIGTERM) 17:00:50.683105 --- ParallelTerminationStrategy: PID 31075 died... 17:00:50.702169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31075): Terminated: ok {rc=0} 17:00:50.746843 --- ParallelTerminationStrategy: PID 31078 died... 17:00:50.765540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31078): Terminated: ok {rc=0} 17:00:50.809998 --- ParallelTerminationStrategy: PID 31081 died... 17:00:50.828734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31081): Terminated: ok {rc=0} 17:00:50.914930 bus /sierra_3: Setting Powered False 17:00:52.014440 bus /sierra_3: Setting Powered False 17:00:53.128273 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:00:54.273268 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:54.285509 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:00:54.351076 tst mo_mt_call_osmux.py: using LAC 30253 17:00:54.473347 tst mo_mt_call_osmux.py: using RAC 163 17:00:54.597074 tst mo_mt_call_osmux.py: using CellId 30253 17:00:54.722789 tst mo_mt_call_osmux.py: using BVCI 30254 17:00:54.835460 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:54.846984 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:54.858356 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:54.869974 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:54.881552 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:00:54.893057 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:00:55.014007 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:00:55.137724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:00:55.652392 run create_hlr_db(pid=31084): Launched 17:00:55.787935 bus /sierra_2: Setting Powered False 17:00:56.852510 run create_hlr_db(pid=31084): Terminated: ok {rc=0} 17:00:57.292779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31086): Launched 17:00:57.603271 run osmo-hlr_10.42.42.2(pid=31087): Launched 17:00:57.721453 run osmo-stp_10.42.42.5: Starting osmo-stp 17:00:58.256886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31089): Launched 17:00:58.566392 run osmo-stp_10.42.42.5(pid=31090): Launched 17:00:58.687038 run osmo-msc_10.42.42.6: Starting osmo-msc 17:00:59.245923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31092): Launched 17:00:59.555306 run osmo-msc_10.42.42.6(pid=31093): Launched 17:00:59.728485 run osmo-stp_10.42.42.5(pid=31090): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31090)] 17:00:59.858752 run osmo-stp_10.42.42.5(pid=31090): stdout: | (launched: 2022-12-12_17:00:58.508769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:00:59.988636 run osmo-stp_10.42.42.5(pid=31090): stderr: | 20221212170058678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170058678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170058678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170058679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170058679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170058679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170058679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:00.116807 run osmo-stp_10.42.42.5(pid=31090): stdout: | (launched: 2022-12-12_17:00:58.508769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:00.239303 run osmo-stp_10.42.42.5(pid=31090): stderr: | 20221212170058678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170058678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170058678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170058679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170058679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170058679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170058679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:00.386258 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31090): Process ended prematurely: osmo-stp_10.42.42.5(pid=31090) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31090)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:01:00.395742 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:01:00.423304 run osmo-hlr_10.42.42.2(pid=31087): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31087)] 17:01:00.472033 run osmo-hlr_10.42.42.2(pid=31087): stdout: | (launched: 2022-12-12_17:00:57.545425) 17:01:00.521951 run osmo-hlr_10.42.42.2(pid=31087): stderr: | 20221212170057722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170057722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170057722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170057722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170057722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170057722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170057735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170057746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170057746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170057746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:00.591729 run osmo-msc_10.42.42.6(pid=31093): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31093)] 17:01:00.639690 run osmo-msc_10.42.42.6(pid=31093): stdout: | (launched: 2022-12-12_17:00:59.498049) 17:01:00.689751 run osmo-msc_10.42.42.6(pid=31093): stderr: | 20221212170059768 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170059768 DLGLOBAL DEBUG validating counter group 0x7f8fd89bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170059768 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170059769 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170059769 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170059769 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170059771 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170059771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170059771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170059771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:00.739967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31086): Terminating (SIGTERM) 17:01:00.780014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31089): Terminating (SIGTERM) 17:01:00.820522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31092): Terminating (SIGTERM) 17:01:00.863215 --- ParallelTerminationStrategy: PID 31086 died... 17:01:00.883169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31086): Terminated: ok {rc=0} 17:01:00.929954 --- ParallelTerminationStrategy: PID 31089 died... 17:01:00.949861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31089): Terminated: ok {rc=0} 17:01:00.996514 --- ParallelTerminationStrategy: PID 31092 died... 17:01:01.016105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31092): Terminated: ok {rc=0} 17:01:01.104883 bus /sierra_3: Setting Powered False 17:01:02.203434 bus /sierra_3: Setting Powered False 17:01:03.323702 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:01:04.568901 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:01:04.575421 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:01:04.605199 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:01:04.631579 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:01:04.685473 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:01:04.715440 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:01:04.741830 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:01:05.291308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:01:05.341350 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:05.352692 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:01:05.422191 tst mo_mt_call.py: using LAC 30254 17:01:05.542768 tst mo_mt_call.py: using RAC 164 17:01:05.661633 tst mo_mt_call.py: using CellId 30254 17:01:05.781582 tst mo_mt_call.py: using BVCI 30255 17:01:05.894896 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:05.906159 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:05.917279 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:05.928570 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:05.939987 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:05.951304 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:01:06.071580 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:01:06.188394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:06.670308 run create_hlr_db(pid=31098): Launched 17:01:06.789554 bus /sierra_2: Setting Powered False 17:01:07.851014 run create_hlr_db(pid=31098): Terminated: ok {rc=0} 17:01:08.302898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31100): Launched 17:01:08.636581 run osmo-hlr_10.42.42.2(pid=31101): Launched 17:01:08.764649 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:09.334291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31103): Launched 17:01:09.666409 run osmo-stp_10.42.42.5(pid=31104): Launched 17:01:09.794335 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:10.390822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31106): Launched 17:01:10.723346 run osmo-msc_10.42.42.6(pid=31107): Launched 17:01:10.908473 run osmo-stp_10.42.42.5(pid=31104): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31104)] 17:01:11.047249 run osmo-stp_10.42.42.5(pid=31104): stdout: | (launched: 2022-12-12_17:01:09.605615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:11.186112 run osmo-stp_10.42.42.5(pid=31104): stderr: | 20221212170109799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170109799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170109799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170109800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170109800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170109800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170109800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:11.323683 run osmo-stp_10.42.42.5(pid=31104): stdout: | (launched: 2022-12-12_17:01:09.605615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:11.455360 run osmo-stp_10.42.42.5(pid=31104): stderr: | 20221212170109799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170109799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170109799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170109800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170109800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170109800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170109800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:11.612237 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31104): Process ended prematurely: osmo-stp_10.42.42.5(pid=31104) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31104)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:01:11.622235 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:01:11.650786 run osmo-hlr_10.42.42.2(pid=31101): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31101)] 17:01:11.701525 run osmo-hlr_10.42.42.2(pid=31101): stdout: | (launched: 2022-12-12_17:01:08.575704) 17:01:11.753596 run osmo-hlr_10.42.42.2(pid=31101): stderr: | 20221212170108774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170108774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170108774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170108774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170108774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170108774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170108787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170108796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170108796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170108796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:11.826608 run osmo-msc_10.42.42.6(pid=31107): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31107)] 17:01:11.876629 run osmo-msc_10.42.42.6(pid=31107): stdout: | (launched: 2022-12-12_17:01:10.662123) 17:01:11.929168 run osmo-msc_10.42.42.6(pid=31107): stderr: | 20221212170110984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170110985 DLGLOBAL DEBUG validating counter group 0x7f3e5f389c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170110985 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170110985 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170110985 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170110985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170110987 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170110987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170110987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170110987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:11.981567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31100): Terminating (SIGTERM) 17:01:12.023664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31103): Terminating (SIGTERM) 17:01:12.066050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31106): Terminating (SIGTERM) 17:01:12.108647 --- ParallelTerminationStrategy: PID 31100 died... 17:01:12.128909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31100): Terminated: ok {rc=0} 17:01:12.175724 --- ParallelTerminationStrategy: PID 31103 died... 17:01:12.195424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31103): Terminated: ok {rc=0} 17:01:12.241598 --- ParallelTerminationStrategy: PID 31106 died... 17:01:12.261230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31106): Terminated: ok {rc=0} 17:01:12.349742 bus /sierra_3: Setting Powered False 17:01:13.451177 bus /sierra_3: Setting Powered False 17:01:14.569737 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:01:15.716807 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:15.729173 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:01:15.796340 tst mo_mt_call_osmux.py: using LAC 30255 17:01:15.920642 tst mo_mt_call_osmux.py: using RAC 165 17:01:16.090570 tst mo_mt_call_osmux.py: using CellId 30255 17:01:16.217646 tst mo_mt_call_osmux.py: using BVCI 30256 17:01:16.342663 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:16.355675 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:16.367942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:16.380289 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:16.393054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:01:16.405777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:01:16.534497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:01:16.688446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:17.192697 run create_hlr_db(pid=31109): Launched 17:01:17.333266 bus /sierra_2: Setting Powered False 17:01:18.398823 run create_hlr_db(pid=31109): Terminated: ok {rc=0} 17:01:18.838730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31111): Launched 17:01:19.147986 run osmo-hlr_10.42.42.2(pid=31112): Launched 17:01:19.265666 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:19.799883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31114): Launched 17:01:20.110936 run osmo-stp_10.42.42.5(pid=31115): Launched 17:01:20.230738 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:20.786979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31117): Launched 17:01:21.096308 run osmo-msc_10.42.42.6(pid=31118): Launched 17:01:21.270431 run osmo-stp_10.42.42.5(pid=31115): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31115)] 17:01:21.401206 run osmo-stp_10.42.42.5(pid=31115): stdout: | (launched: 2022-12-12_17:01:20.053492) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:21.531170 run osmo-stp_10.42.42.5(pid=31115): stderr: | 20221212170120224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170120224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170120225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170120225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170120225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170120226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170120226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:21.659373 run osmo-stp_10.42.42.5(pid=31115): stdout: | (launched: 2022-12-12_17:01:20.053492) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:21.781976 run osmo-stp_10.42.42.5(pid=31115): stderr: | 20221212170120224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170120224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170120225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170120225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170120225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170120226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170120226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:21.928693 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31115): Process ended prematurely: osmo-stp_10.42.42.5(pid=31115) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31115)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:01:21.937919 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:01:21.965315 run osmo-hlr_10.42.42.2(pid=31112): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31112)] 17:01:22.013908 run osmo-hlr_10.42.42.2(pid=31112): stdout: | (launched: 2022-12-12_17:01:19.090586) 17:01:22.063796 run osmo-hlr_10.42.42.2(pid=31112): stderr: | 20221212170119264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170119264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170119264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170119264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170119264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170119264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170119276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170119285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170119285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170119285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:22.133078 run osmo-msc_10.42.42.6(pid=31118): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31118)] 17:01:22.181063 run osmo-msc_10.42.42.6(pid=31118): stdout: | (launched: 2022-12-12_17:01:21.039113) 17:01:22.230615 run osmo-msc_10.42.42.6(pid=31118): stderr: | 20221212170121310 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170121310 DLGLOBAL DEBUG validating counter group 0x7fcb6622ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170121310 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170121310 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170121311 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170121311 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170121313 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170121313 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170121313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170121313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:22.281046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31111): Terminating (SIGTERM) 17:01:22.321018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31114): Terminating (SIGTERM) 17:01:22.361119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31117): Terminating (SIGTERM) 17:01:22.401625 --- ParallelTerminationStrategy: PID 31111 died... 17:01:22.420236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31111): Terminated: ok {rc=0} 17:01:22.465084 --- ParallelTerminationStrategy: PID 31114 died... 17:01:22.483876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31114): Terminated: ok {rc=0} 17:01:22.528447 --- ParallelTerminationStrategy: PID 31117 died... 17:01:22.547211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31117): Terminated: ok {rc=0} 17:01:22.634626 bus /sierra_3: Setting Powered False 17:01:23.734069 bus /sierra_3: Setting Powered False 17:01:24.850481 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:01:26.100649 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:01:26.107737 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:01:26.138006 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:01:26.166537 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:01:26.220220 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:01:26.250661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:01:26.278431 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:01:26.835024 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:01:26.888203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:26.899886 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:01:26.967948 tst mo_mt_call.py: using LAC 30256 17:01:27.090691 tst mo_mt_call.py: using RAC 166 17:01:27.213194 tst mo_mt_call.py: using CellId 30256 17:01:27.334559 tst mo_mt_call.py: using BVCI 30257 17:01:27.446392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:27.457863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:27.469067 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:27.480454 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:27.496212 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:27.507804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:01:27.626720 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:01:27.747438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:28.258957 run create_hlr_db(pid=31124): Launched 17:01:28.393711 bus /sierra_2: Setting Powered False 17:01:29.459018 run create_hlr_db(pid=31124): Terminated: ok {rc=0} 17:01:29.916382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31126): Launched 17:01:30.247651 run osmo-hlr_10.42.42.2(pid=31127): Launched 17:01:30.375489 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:30.969941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31129): Launched 17:01:31.311250 run osmo-stp_10.42.42.5(pid=31130): Launched 17:01:31.566090 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:32.235312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31132): Launched 17:01:32.566028 run osmo-msc_10.42.42.6(pid=31133): Launched 17:01:32.751612 run osmo-stp_10.42.42.5(pid=31130): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31130)] 17:01:32.890157 run osmo-stp_10.42.42.5(pid=31130): stdout: | (launched: 2022-12-12_17:01:31.250795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:33.028496 run osmo-stp_10.42.42.5(pid=31130): stderr: | 20221212170131535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170131535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170131536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170131536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170131536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170131549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170131549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:33.165681 run osmo-stp_10.42.42.5(pid=31130): stdout: | (launched: 2022-12-12_17:01:31.250795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:33.296678 run osmo-stp_10.42.42.5(pid=31130): stderr: | 20221212170131535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170131535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170131536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170131536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170131536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170131549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170131549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:33.454064 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31130): Process ended prematurely: osmo-stp_10.42.42.5(pid=31130) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31130)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:01:33.463879 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 17:01:33.492365 run osmo-hlr_10.42.42.2(pid=31127): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31127)] 17:01:33.543310 run osmo-hlr_10.42.42.2(pid=31127): stdout: | (launched: 2022-12-12_17:01:30.187215) 17:01:33.595323 run osmo-hlr_10.42.42.2(pid=31127): stderr: | 20221212170130386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170130386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170130386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170130386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170130386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170130386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170130398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170130407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170130408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170130408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:33.667775 run osmo-msc_10.42.42.6(pid=31133): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31133)] 17:01:33.718101 run osmo-msc_10.42.42.6(pid=31133): stdout: | (launched: 2022-12-12_17:01:32.505106) 17:01:33.769935 run osmo-msc_10.42.42.6(pid=31133): stderr: | 20221212170132829 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170132829 DLGLOBAL DEBUG validating counter group 0x7f5eae40ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170132829 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170132829 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170132829 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170132829 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170132831 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170132831 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170132832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170132832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:33.822111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31126): Terminating (SIGTERM) 17:01:33.864223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31129): Terminating (SIGTERM) 17:01:33.906431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31132): Terminating (SIGTERM) 17:01:33.948872 --- ParallelTerminationStrategy: PID 31126 died... 17:01:33.968866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31126): Terminated: ok {rc=0} 17:01:34.015784 --- ParallelTerminationStrategy: PID 31129 died... 17:01:34.035226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31129): Terminated: ok {rc=0} 17:01:34.082040 --- ParallelTerminationStrategy: PID 31132 died... 17:01:34.101575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31132): Terminated: ok {rc=0} 17:01:34.190253 bus /sierra_3: Setting Powered False 17:01:35.289736 bus /sierra_3: Setting Powered False 17:01:36.406056 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:01:37.554150 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:37.566407 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:01:37.633413 tst mo_mt_call_osmux.py: using LAC 30257 17:01:37.757367 tst mo_mt_call_osmux.py: using RAC 167 17:01:37.878452 tst mo_mt_call_osmux.py: using CellId 30257 17:01:38.002074 tst mo_mt_call_osmux.py: using BVCI 30258 17:01:38.113887 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:38.125221 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:38.136335 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:38.147889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:38.159525 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:01:38.171046 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:01:38.292912 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:01:38.410422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:38.891983 run create_hlr_db(pid=31135): Launched 17:01:39.010225 bus /sierra_2: Setting Powered False 17:01:40.071089 run create_hlr_db(pid=31135): Terminated: ok {rc=0} 17:01:40.520564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31137): Launched 17:01:40.852610 run osmo-hlr_10.42.42.2(pid=31138): Launched 17:01:40.979351 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:41.545987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31140): Launched 17:01:41.875819 run osmo-stp_10.42.42.5(pid=31141): Launched 17:01:42.001728 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:42.596448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31143): Launched 17:01:42.927654 run osmo-msc_10.42.42.6(pid=31144): Launched 17:01:43.113902 run osmo-stp_10.42.42.5(pid=31141): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31141)] 17:01:43.254673 run osmo-stp_10.42.42.5(pid=31141): stdout: | (launched: 2022-12-12_17:01:41.815135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:43.394472 run osmo-stp_10.42.42.5(pid=31141): stderr: | 20221212170142008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170142008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170142008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170142009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170142009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170142009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170142009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:43.531153 run osmo-stp_10.42.42.5(pid=31141): stdout: | (launched: 2022-12-12_17:01:41.815135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:43.661328 run osmo-stp_10.42.42.5(pid=31141): stderr: | 20221212170142008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170142008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170142008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170142009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170142009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170142009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170142009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:43.817285 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31141): Process ended prematurely: osmo-stp_10.42.42.5(pid=31141) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31141)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:01:43.826982 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:01:43.855202 run osmo-hlr_10.42.42.2(pid=31138): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31138)] 17:01:43.905218 run osmo-hlr_10.42.42.2(pid=31138): stdout: | (launched: 2022-12-12_17:01:40.791814) 17:01:43.956850 run osmo-hlr_10.42.42.2(pid=31138): stderr: | 20221212170140991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170140991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170140991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170140991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170140991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170140991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170141003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170141012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170141012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170141012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:44.029233 run osmo-msc_10.42.42.6(pid=31144): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31144)] 17:01:44.079260 run osmo-msc_10.42.42.6(pid=31144): stdout: | (launched: 2022-12-12_17:01:42.866699) 17:01:44.130885 run osmo-msc_10.42.42.6(pid=31144): stderr: | 20221212170143190 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170143191 DLGLOBAL DEBUG validating counter group 0x7f605a191c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170143191 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170143191 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170143191 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170143191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170143193 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170143193 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170143193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170143193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:44.182723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31137): Terminating (SIGTERM) 17:01:44.224046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31140): Terminating (SIGTERM) 17:01:44.266152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31143): Terminating (SIGTERM) 17:01:44.308107 --- ParallelTerminationStrategy: PID 31137 died... 17:01:44.328246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31137): Terminated: ok {rc=0} 17:01:44.374572 --- ParallelTerminationStrategy: PID 31140 died... 17:01:44.394197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31140): Terminated: ok {rc=0} 17:01:44.440151 --- ParallelTerminationStrategy: PID 31143 died... 17:01:44.459845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31143): Terminated: ok {rc=0} 17:01:44.547437 bus /sierra_3: Setting Powered False 17:01:45.645162 bus /sierra_3: Setting Powered False 17:01:46.768112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:01:48.020387 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:01:48.027583 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:01:48.057530 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:01:48.085217 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:01:48.137522 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:01:48.167082 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:01:48.193489 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:01:48.749906 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:01:48.803219 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:48.815306 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:01:48.881616 tst mo_mt_call.py: using LAC 30258 17:01:49.008895 tst mo_mt_call.py: using RAC 168 17:01:49.135786 tst mo_mt_call.py: using CellId 30258 17:01:49.264528 tst mo_mt_call.py: using BVCI 30259 17:01:49.384359 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:49.396289 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:49.407843 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:49.419589 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:49.431384 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:49.443113 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:01:49.559612 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:01:49.681484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:01:50.194172 run create_hlr_db(pid=31149): Launched 17:01:50.328025 bus /sierra_2: Setting Powered False 17:01:51.393087 run create_hlr_db(pid=31149): Terminated: ok {rc=0} 17:01:51.834618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31151): Launched 17:01:52.144457 run osmo-hlr_10.42.42.2(pid=31152): Launched 17:01:52.263441 run osmo-stp_10.42.42.5: Starting osmo-stp 17:01:52.807943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31154): Launched 17:01:53.119380 run osmo-stp_10.42.42.5(pid=31155): Launched 17:01:53.237498 run osmo-msc_10.42.42.6: Starting osmo-msc 17:01:53.796528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31157): Launched 17:01:54.107240 run osmo-msc_10.42.42.6(pid=31158): Launched 17:01:54.282233 run osmo-stp_10.42.42.5(pid=31155): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31155)] 17:01:54.413979 run osmo-stp_10.42.42.5(pid=31155): stdout: | (launched: 2022-12-12_17:01:53.062065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:54.545330 run osmo-stp_10.42.42.5(pid=31155): stderr: | 20221212170153231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170153231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170153231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170153232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170153232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170153232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170153232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:54.674486 run osmo-stp_10.42.42.5(pid=31155): stdout: | (launched: 2022-12-12_17:01:53.062065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:01:54.797223 run osmo-stp_10.42.42.5(pid=31155): stderr: | 20221212170153231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170153231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170153231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170153232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170153232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170153232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170153232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:01:54.944659 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31155): Process ended prematurely: osmo-stp_10.42.42.5(pid=31155) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31155)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:01:54.953965 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:01:54.981352 run osmo-hlr_10.42.42.2(pid=31152): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31152)] 17:01:55.030063 run osmo-hlr_10.42.42.2(pid=31152): stdout: | (launched: 2022-12-12_17:01:52.087075) 17:01:55.080161 run osmo-hlr_10.42.42.2(pid=31152): stderr: | 20221212170152263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170152263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170152263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170152263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170152263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170152263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170152275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170152283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170152283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170152283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:01:55.150428 run osmo-msc_10.42.42.6(pid=31158): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31158)] 17:01:55.198718 run osmo-msc_10.42.42.6(pid=31158): stdout: | (launched: 2022-12-12_17:01:54.049650) 17:01:55.249021 run osmo-msc_10.42.42.6(pid=31158): stderr: | 20221212170154321 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170154321 DLGLOBAL DEBUG validating counter group 0x7f352ad40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170154321 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170154321 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170154322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170154322 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170154323 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170154324 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170154324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170154324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:01:55.299571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31151): Terminating (SIGTERM) 17:01:55.339882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31154): Terminating (SIGTERM) 17:01:55.380214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31157): Terminating (SIGTERM) 17:01:55.421154 --- ParallelTerminationStrategy: PID 31151 died... 17:01:55.440459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31151): Terminated: ok {rc=0} 17:01:55.485283 --- ParallelTerminationStrategy: PID 31154 died... 17:01:55.504246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31154): Terminated: ok {rc=0} 17:01:55.549807 --- ParallelTerminationStrategy: PID 31157 died... 17:01:55.568783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31157): Terminated: ok {rc=0} 17:01:55.656520 bus /sierra_3: Setting Powered False 17:01:56.756941 bus /sierra_3: Setting Powered False 17:01:57.875091 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:01:59.021777 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:59.034034 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:01:59.100912 tst mo_mt_call_osmux.py: using LAC 30259 17:01:59.221969 tst mo_mt_call_osmux.py: using RAC 169 17:01:59.345266 tst mo_mt_call_osmux.py: using CellId 30259 17:01:59.466493 tst mo_mt_call_osmux.py: using BVCI 30260 17:01:59.580074 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:59.591559 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:59.602918 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:59.614531 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:59.626156 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:01:59.637698 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:01:59.753811 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:01:59.869173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:00.350141 run create_hlr_db(pid=31160): Launched 17:02:00.470551 bus /sierra_2: Setting Powered False 17:02:01.531439 run create_hlr_db(pid=31160): Terminated: ok {rc=0} 17:02:01.970547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31162): Launched 17:02:02.296554 run osmo-hlr_10.42.42.2(pid=31163): Launched 17:02:02.418404 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:02.963000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31165): Launched 17:02:03.275412 run osmo-stp_10.42.42.5(pid=31166): Launched 17:02:03.395079 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:03.953121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31168): Launched 17:02:04.262736 run osmo-msc_10.42.42.6(pid=31169): Launched 17:02:04.435511 run osmo-stp_10.42.42.5(pid=31166): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31166)] 17:02:04.565634 run osmo-stp_10.42.42.5(pid=31166): stdout: | (launched: 2022-12-12_17:02:03.217750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:04.695893 run osmo-stp_10.42.42.5(pid=31166): stderr: | 20221212170203389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170203389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170203390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170203390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170203391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170203391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170203391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:04.824300 run osmo-stp_10.42.42.5(pid=31166): stdout: | (launched: 2022-12-12_17:02:03.217750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:04.947048 run osmo-stp_10.42.42.5(pid=31166): stderr: | 20221212170203389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170203389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170203390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170203390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170203391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170203391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170203391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:05.094341 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31166): Process ended prematurely: osmo-stp_10.42.42.5(pid=31166) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31166)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:02:05.103593 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:02:05.130982 run osmo-hlr_10.42.42.2(pid=31163): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31163)] 17:02:05.179375 run osmo-hlr_10.42.42.2(pid=31163): stdout: | (launched: 2022-12-12_17:02:02.238823) 17:02:05.229224 run osmo-hlr_10.42.42.2(pid=31163): stderr: | 20221212170202411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170202411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170202412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170202412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170202412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170202412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170202426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170202435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170202436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170202436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:05.299148 run osmo-msc_10.42.42.6(pid=31169): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31169)] 17:02:05.347294 run osmo-msc_10.42.42.6(pid=31169): stdout: | (launched: 2022-12-12_17:02:04.204783) 17:02:05.397727 run osmo-msc_10.42.42.6(pid=31169): stderr: | 20221212170204477 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170204478 DLGLOBAL DEBUG validating counter group 0x7f44bd9d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170204478 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170204478 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170204478 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170204478 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170204480 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170204480 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170204480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170204481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:05.447962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31162): Terminating (SIGTERM) 17:02:05.488778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31165): Terminating (SIGTERM) 17:02:05.529265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31168): Terminating (SIGTERM) 17:02:05.570605 --- ParallelTerminationStrategy: PID 31162 died... 17:02:05.590013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31162): Terminated: ok {rc=0} 17:02:05.634884 --- ParallelTerminationStrategy: PID 31165 died... 17:02:05.653887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31165): Terminated: ok {rc=0} 17:02:05.698668 --- ParallelTerminationStrategy: PID 31168 died... 17:02:05.717536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31168): Terminated: ok {rc=0} 17:02:05.805305 bus /sierra_3: Setting Powered False 17:02:06.905635 bus /sierra_3: Setting Powered False 17:02:08.022844 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:02:09.272632 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:02:09.278388 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:02:09.307692 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:02:09.333770 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:02:09.384682 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:02:09.413687 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:02:09.439629 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:02:09.989430 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:02:10.037969 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:10.049104 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:02:10.114884 tst mo_mt_call.py: using LAC 30260 17:02:10.231393 tst mo_mt_call.py: using RAC 170 17:02:10.350016 tst mo_mt_call.py: using CellId 30260 17:02:10.481596 tst mo_mt_call.py: using BVCI 30261 17:02:10.599413 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:10.611205 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:10.622519 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:10.634356 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:10.646280 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:10.658199 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:02:10.773959 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:02:10.890067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:11.389285 run create_hlr_db(pid=31174): Launched 17:02:11.518971 bus /sierra_2: Setting Powered False 17:02:12.582112 run create_hlr_db(pid=31174): Terminated: ok {rc=0} 17:02:13.009172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31176): Launched 17:02:13.308117 run osmo-hlr_10.42.42.2(pid=31177): Launched 17:02:13.423037 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:13.936075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31179): Launched 17:02:14.234221 run osmo-stp_10.42.42.5(pid=31180): Launched 17:02:14.348158 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:14.887675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31182): Launched 17:02:15.188209 run osmo-msc_10.42.42.6(pid=31183): Launched 17:02:15.356062 run osmo-stp_10.42.42.5(pid=31180): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31180)] 17:02:15.483435 run osmo-stp_10.42.42.5(pid=31180): stdout: | (launched: 2022-12-12_17:02:14.179152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:15.610100 run osmo-stp_10.42.42.5(pid=31180): stderr: | 20221212170214345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170214345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170214345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170214346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170214346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170214346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170214346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:15.734779 run osmo-stp_10.42.42.5(pid=31180): stdout: | (launched: 2022-12-12_17:02:14.179152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:15.859634 run osmo-stp_10.42.42.5(pid=31180): stderr: | 20221212170214345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170214345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170214345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170214346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170214346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170214346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170214346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:16.038546 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31180): Process ended prematurely: osmo-stp_10.42.42.5(pid=31180) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31180)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:02:16.048503 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:02:16.077972 run osmo-hlr_10.42.42.2(pid=31177): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31177)] 17:02:16.129421 run osmo-hlr_10.42.42.2(pid=31177): stdout: | (launched: 2022-12-12_17:02:13.253061) 17:02:16.181704 run osmo-hlr_10.42.42.2(pid=31177): stderr: | 20221212170213426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170213426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170213427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170213427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170213427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170213427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170213441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170213451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170213451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170213451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:16.255569 run osmo-msc_10.42.42.6(pid=31183): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31183)] 17:02:16.316808 run osmo-msc_10.42.42.6(pid=31183): stdout: | (launched: 2022-12-12_17:02:15.132723) 17:02:16.380003 run osmo-msc_10.42.42.6(pid=31183): stderr: | 20221212170215402 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170215402 DLGLOBAL DEBUG validating counter group 0x7f042d504c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170215402 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170215402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170215402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170215402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170215404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170215404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170215405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170215405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:16.436871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31176): Terminating (SIGTERM) 17:02:16.481577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31179): Terminating (SIGTERM) 17:02:16.527629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31182): Terminating (SIGTERM) 17:02:16.572722 --- ParallelTerminationStrategy: PID 31176 died... 17:02:16.593603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31176): Terminated: ok {rc=0} 17:02:16.642436 --- ParallelTerminationStrategy: PID 31179 died... 17:02:16.663308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31179): Terminated: ok {rc=0} 17:02:16.719870 --- ParallelTerminationStrategy: PID 31182 died... 17:02:16.744795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31182): Terminated: ok {rc=0} 17:02:16.850031 bus /sierra_3: Setting Powered False 17:02:17.954425 bus /sierra_3: Setting Powered False 17:02:19.068893 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:02:20.212533 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:20.224262 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:02:20.290258 tst mo_mt_call_osmux.py: using LAC 30261 17:02:20.418828 tst mo_mt_call_osmux.py: using RAC 171 17:02:20.542016 tst mo_mt_call_osmux.py: using CellId 30261 17:02:20.663280 tst mo_mt_call_osmux.py: using BVCI 30262 17:02:20.777193 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:20.788678 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:20.799913 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:20.811138 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:20.822514 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:02:20.833753 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:02:20.946852 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:02:21.060534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:21.516102 run create_hlr_db(pid=31185): Launched 17:02:21.631957 bus /sierra_2: Setting Powered False 17:02:22.691875 run create_hlr_db(pid=31185): Terminated: ok {rc=0} 17:02:23.129741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31187): Launched 17:02:23.449881 run osmo-hlr_10.42.42.2(pid=31188): Launched 17:02:23.570465 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:24.119537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31190): Launched 17:02:24.439561 run osmo-stp_10.42.42.5(pid=31191): Launched 17:02:24.561414 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:25.138779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31193): Launched 17:02:25.458790 run osmo-msc_10.42.42.6(pid=31194): Launched 17:02:25.637772 run osmo-stp_10.42.42.5(pid=31191): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31191)] 17:02:25.772269 run osmo-stp_10.42.42.5(pid=31191): stdout: | (launched: 2022-12-12_17:02:24.380169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:25.907071 run osmo-stp_10.42.42.5(pid=31191): stderr: | 20221212170224569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170224569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170224569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170224570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170224570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170224570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170224570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:26.040749 run osmo-stp_10.42.42.5(pid=31191): stdout: | (launched: 2022-12-12_17:02:24.380169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:26.167929 run osmo-stp_10.42.42.5(pid=31191): stderr: | 20221212170224569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170224569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170224569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170224570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170224570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170224570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170224570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:26.319995 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31191): Process ended prematurely: osmo-stp_10.42.42.5(pid=31191) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31191)] [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:02:26.329509 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:02:26.357313 run osmo-hlr_10.42.42.2(pid=31188): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31188)] 17:02:26.406751 run osmo-hlr_10.42.42.2(pid=31188): stdout: | (launched: 2022-12-12_17:02:23.391058) 17:02:26.457798 run osmo-hlr_10.42.42.2(pid=31188): stderr: | 20221212170223586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170223586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170223586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170223586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170223586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170223586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170223599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170223607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170223607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170223607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:26.529349 run osmo-msc_10.42.42.6(pid=31194): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31194)] 17:02:26.578506 run osmo-msc_10.42.42.6(pid=31194): stdout: | (launched: 2022-12-12_17:02:25.399706) 17:02:26.629455 run osmo-msc_10.42.42.6(pid=31194): stderr: | 20221212170225720 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170225720 DLGLOBAL DEBUG validating counter group 0x7f558ca03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170225720 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170225720 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170225721 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170225721 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170225722 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170225723 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170225723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170225723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:26.680605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31187): Terminating (SIGTERM) 17:02:26.721769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31190): Terminating (SIGTERM) 17:02:26.763008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31193): Terminating (SIGTERM) 17:02:26.804563 --- ParallelTerminationStrategy: PID 31187 died... 17:02:26.824405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31187): Terminated: ok {rc=0} 17:02:26.869990 --- ParallelTerminationStrategy: PID 31190 died... 17:02:26.889393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31190): Terminated: ok {rc=0} 17:02:26.934717 --- ParallelTerminationStrategy: PID 31193 died... 17:02:26.954152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31193): Terminated: ok {rc=0} 17:02:27.039801 bus /sierra_3: Setting Powered False 17:02:28.136383 bus /sierra_3: Setting Powered False 17:02:29.249900 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 17:02:30.490094 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:02:30.494758 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 17:02:30.525495 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 17:02:30.552531 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 17:02:30.637769 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 17:02:30.667344 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 17:02:30.693363 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 17:02:31.318125 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2379 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 17:02:31.323414 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:31.334492 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 17:02:31.382247 tst emergency_mo_mt_call.py: using LAC 30262 17:02:31.501982 tst emergency_mo_mt_call.py: using RAC 172 17:02:31.654741 tst emergency_mo_mt_call.py: using CellId 30262 17:02:31.772770 tst emergency_mo_mt_call.py: using BVCI 30263 17:02:31.884439 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:31.897502 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:31.909049 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:31.921426 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:31.933685 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:31.946028 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:02:32.064244 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:02:32.201709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:32.690005 run create_hlr_db(pid=31199): Launched 17:02:32.819252 bus /sierra_2: Setting Powered False 17:02:33.881254 run create_hlr_db(pid=31199): Terminated: ok {rc=0} 17:02:34.302007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31201): Launched 17:02:34.595872 run osmo-hlr_10.42.42.2(pid=31202): Launched 17:02:34.707058 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:35.221745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31204): Launched 17:02:35.514023 run osmo-stp_10.42.42.5(pid=31205): Launched 17:02:35.633508 tst emergency_mo_mt_call.py: using MSISDN 7872 17:02:35.781663 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:36.311830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31207): Launched 17:02:36.605199 run osmo-msc_10.42.42.6(pid=31208): Launched 17:02:36.769315 run osmo-stp_10.42.42.5(pid=31205): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31205)] 17:02:36.893475 run osmo-stp_10.42.42.5(pid=31205): stdout: | (launched: 2022-12-12_17:02:35.459302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:37.017950 run osmo-stp_10.42.42.5(pid=31205): stderr: | 20221212170235624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170235625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170235625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170235625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170235626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170235627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170235627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:37.139836 run osmo-stp_10.42.42.5(pid=31205): stdout: | (launched: 2022-12-12_17:02:35.459302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:37.256400 run osmo-stp_10.42.42.5(pid=31205): stderr: | 20221212170235624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170235625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170235625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170235625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170235626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170235627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170235627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:37.395575 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31205): Process ended prematurely: osmo-stp_10.42.42.5(pid=31205) [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31205)] [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 17:02:37.403874 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 17:02:37.430361 run osmo-hlr_10.42.42.2(pid=31202): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31202)] 17:02:37.477642 run osmo-hlr_10.42.42.2(pid=31202): stdout: | (launched: 2022-12-12_17:02:34.540886) 17:02:37.526527 run osmo-hlr_10.42.42.2(pid=31202): stderr: | 20221212170234713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170234713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170234713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170234713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170234713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170234713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170234724 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170234733 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170234733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170234733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:37.594199 run osmo-msc_10.42.42.6(pid=31208): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31208)] 17:02:37.641201 run osmo-msc_10.42.42.6(pid=31208): stdout: | (launched: 2022-12-12_17:02:36.550522) 17:02:37.689615 run osmo-msc_10.42.42.6(pid=31208): stderr: | 20221212170236819 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170236819 DLGLOBAL DEBUG validating counter group 0x7f402c2aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170236819 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170236819 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170236819 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170236819 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170236822 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170236822 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170236822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170236822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:37.738580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31201): Terminating (SIGTERM) 17:02:37.777721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31204): Terminating (SIGTERM) 17:02:37.817129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31207): Terminating (SIGTERM) 17:02:37.856504 --- ParallelTerminationStrategy: PID 31201 died... 17:02:37.875190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31201): Terminated: ok {rc=0} 17:02:37.919221 --- ParallelTerminationStrategy: PID 31204 died... 17:02:37.937577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31204): Terminated: ok {rc=0} 17:02:37.981716 --- ParallelTerminationStrategy: PID 31207 died... 17:02:37.999977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31207): Terminated: ok {rc=0} 17:02:38.085664 bus /sierra_3: Setting Powered False 17:02:39.183696 bus /sierra_3: Setting Powered False 17:02:40.298040 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 17:02:41.385519 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:41.397351 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 17:02:41.449437 tst emergency_preemptive_call.py: using LAC 30263 17:02:41.572590 tst emergency_preemptive_call.py: using RAC 173 17:02:41.693472 tst emergency_preemptive_call.py: using CellId 30263 17:02:41.808059 tst emergency_preemptive_call.py: using BVCI 30264 17:02:41.914164 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:41.925138 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:41.935789 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:41.947411 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:41.959046 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:02:41.970550 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:02:42.089442 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:02:42.206819 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:02:42.323019 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:02:42.440570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:02:42.927740 run create_hlr_db(pid=31210): Launched 17:02:43.058353 bus /sierra_2: Setting Powered False 17:02:44.121906 run create_hlr_db(pid=31210): Terminated: ok {rc=0} 17:02:44.549229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31212): Launched 17:02:44.848351 run osmo-hlr_10.42.42.2(pid=31213): Launched 17:02:44.961438 run osmo-stp_10.42.42.5: Starting osmo-stp 17:02:45.484612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31215): Launched 17:02:45.784042 run osmo-stp_10.42.42.5(pid=31216): Launched 17:02:46.043671 tst emergency_preemptive_call.py: using MSISDN 7873 17:02:46.208901 run osmo-msc_10.42.42.6: Starting osmo-msc 17:02:46.809136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31218): Launched 17:02:47.143886 run osmo-msc_10.42.42.6(pid=31219): Launched 17:02:47.318624 run osmo-stp_10.42.42.5(pid=31216): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31216)] 17:02:47.446217 run osmo-stp_10.42.42.5(pid=31216): stdout: | (launched: 2022-12-12_17:02:45.728856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:47.572846 run osmo-stp_10.42.42.5(pid=31216): stderr: | 20221212170245898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170245898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170245898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170245898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170245899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170245899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170245899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:47.698262 run osmo-stp_10.42.42.5(pid=31216): stdout: | (launched: 2022-12-12_17:02:45.728856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:02:47.817386 run osmo-stp_10.42.42.5(pid=31216): stderr: | 20221212170245898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170245898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170245898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170245898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170245899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170245899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170245899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:02:47.959645 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31216): Process ended prematurely: osmo-stp_10.42.42.5(pid=31216) [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31216)] [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 17:02:47.967978 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 17:02:47.994645 run osmo-hlr_10.42.42.2(pid=31213): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31213)] 17:02:48.042552 run osmo-hlr_10.42.42.2(pid=31213): stdout: | (launched: 2022-12-12_17:02:44.793343) 17:02:48.091822 run osmo-hlr_10.42.42.2(pid=31213): stderr: | 20221212170244967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170244967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170244967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170244967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170244967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170244967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170244980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170244991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170244991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170244991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:02:48.160726 run osmo-msc_10.42.42.6(pid=31219): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31219)] 17:02:48.208513 run osmo-msc_10.42.42.6(pid=31219): stdout: | (launched: 2022-12-12_17:02:47.082661) 17:02:48.257771 run osmo-msc_10.42.42.6(pid=31219): stderr: | 20221212170247360 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170247360 DLGLOBAL DEBUG validating counter group 0x7f28a3361c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170247361 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170247361 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170247361 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170247361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170247363 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170247363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170247363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170247364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:02:48.307424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31212): Terminating (SIGTERM) 17:02:48.346856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31215): Terminating (SIGTERM) 17:02:48.386325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31218): Terminating (SIGTERM) 17:02:48.426105 --- ParallelTerminationStrategy: PID 31212 died... 17:02:48.445220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31212): Terminated: ok {rc=0} 17:02:48.489135 --- ParallelTerminationStrategy: PID 31215 died... 17:02:48.507987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31215): Terminated: ok {rc=0} 17:02:48.551865 --- ParallelTerminationStrategy: PID 31218 died... 17:02:48.570423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31218): Terminated: ok {rc=0} 17:02:48.655730 bus /sierra_9: Setting Powered False 17:02:49.755843 bus /sierra_9: Setting Powered False 17:02:50.871303 bus /sierra_8: Setting Powered False 17:02:51.968847 bus /sierra_8: Setting Powered False 17:02:53.083307 bus /sierra_3: Setting Powered False 17:02:54.180172 bus /sierra_3: Setting Powered False 17:02:55.294712 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 17:02:56.564068 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:02:56.568421 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 17:02:56.597434 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 17:02:56.636203 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 17:02:56.722149 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 17:02:56.751076 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 17:02:56.789049 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 17:02:57.378882 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 17:02:57.429222 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:02:57.439793 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 17:02:57.492013 tst cs_paging_gprs_active.py: using LAC 30264 17:02:57.610457 tst cs_paging_gprs_active.py: using RAC 174 17:02:57.732517 tst cs_paging_gprs_active.py: using CellId 30264 17:02:57.851338 tst cs_paging_gprs_active.py: using BVCI 30265 17:02:57.961160 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:02:57.971822 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:02:57.982482 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:02:57.993332 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:02:58.003968 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:02:58.014616 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:02:58.025652 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:02:58.036762 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:02:58.047673 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:02:58.168238 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:02:58.287099 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:02:58.507423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:02:58.834662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31224): Launched 17:02:59.118804 run iperf3-srv_10.42.42.10(pid=31225): Launched 17:02:59.241327 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:02:59.461565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:02:59.788053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31226): Launched 17:03:00.071584 run iperf3-srv_10.42.42.10(pid=31227): Launched 17:03:00.194050 tst cs_paging_gprs_active.py:38: start network... 17:03:00.414059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:03:00.937686 run create_hlr_db(pid=31228): Launched 17:03:01.099972 bus /sierra_2: Setting Powered False 17:03:02.176829 run create_hlr_db(pid=31228): Terminated: ok {rc=0} 17:03:02.613090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31231): Launched 17:03:02.919284 run osmo-hlr_10.42.42.2(pid=31232): Launched 17:03:03.035688 run osmo-stp_10.42.42.5: Starting osmo-stp 17:03:03.567889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31234): Launched 17:03:03.873352 run osmo-stp_10.42.42.5(pid=31235): Launched 17:03:03.990638 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:03:04.514438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31237): Launched 17:03:04.633199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:03:04.890210 run patchelf(pid=31238): Launched 17:03:05.059535 run osmo-stp_10.42.42.5(pid=31235): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31235)] 17:03:05.188008 run osmo-stp_10.42.42.5(pid=31235): stdout: | (launched: 2022-12-12_17:03:03.816783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:05.317887 run osmo-stp_10.42.42.5(pid=31235): stderr: | 20221212170303983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170303984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170303984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170303984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170303985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170303985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170303985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:05.448661 run osmo-stp_10.42.42.5(pid=31235): stdout: | (launched: 2022-12-12_17:03:03.816783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:05.573525 run osmo-stp_10.42.42.5(pid=31235): stderr: | 20221212170303983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170303984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170303984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170303984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170303985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170303985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170303985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:05.721327 run patchelf(pid=31238): Terminating (SIGINT) 17:03:05.890756 run patchelf(pid=31238): Terminated: ok {rc=0} 17:03:06.013467 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31235): Process ended prematurely: osmo-stp_10.42.42.5(pid=31235) [trial-2379↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31235)] [trial-2379↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 17:03:06.023028 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:03:06.050826 run osmo-hlr_10.42.42.2(pid=31232): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31232)] 17:03:06.098297 run osmo-hlr_10.42.42.2(pid=31232): stdout: | (launched: 2022-12-12_17:03:02.862434) 17:03:06.147238 run osmo-hlr_10.42.42.2(pid=31232): stderr: | 20221212170303035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170303035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170303035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170303035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170303035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170303035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170303047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170303056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170303056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170303056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:03:06.196605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31224): Terminating (SIGTERM) 17:03:06.235925 run iperf3-srv_10.42.42.10(pid=31225): Terminating (SIGTERM) 17:03:06.275193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31226): Terminating (SIGTERM) 17:03:06.314601 run iperf3-srv_10.42.42.10(pid=31227): Terminating (SIGTERM) 17:03:06.354434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31231): Terminating (SIGTERM) 17:03:06.394098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31234): Terminating (SIGTERM) 17:03:06.433527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31237): Terminating (SIGTERM) 17:03:06.473150 --- ParallelTerminationStrategy: PID 31224 died... 17:03:06.491958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31224): Terminated: ok {rc=0} 17:03:06.535885 --- ParallelTerminationStrategy: PID 31225 died... 17:03:06.554240 run iperf3-srv_10.42.42.10(pid=31225): Terminated {rc=256} 17:03:06.597769 --- ParallelTerminationStrategy: PID 31226 died... 17:03:06.616158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31226): Terminated: ok {rc=0} 17:03:06.659628 --- ParallelTerminationStrategy: PID 31227 died... 17:03:06.677892 run iperf3-srv_10.42.42.10(pid=31227): Terminated {rc=256} 17:03:06.721554 --- ParallelTerminationStrategy: PID 31231 died... 17:03:06.739906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31231): Terminated: ok {rc=0} 17:03:06.783461 --- ParallelTerminationStrategy: PID 31234 died... 17:03:06.801901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31234): Terminated: ok {rc=0} 17:03:06.846456 --- ParallelTerminationStrategy: PID 31237 died... 17:03:06.864778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31237): Terminated: ok {rc=0} 17:03:06.949267 bus /gobi_0: Setting Powered False 17:03:08.048072 bus /gobi_0: Setting Powered False 17:03:09.162455 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 17:03:10.308569 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:10.320227 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 17:03:10.368760 tst iperf3.py: using LAC 30265 17:03:10.490192 tst iperf3.py: using RAC 175 17:03:10.611232 tst iperf3.py: using CellId 30265 17:03:10.732156 tst iperf3.py: using BVCI 30266 17:03:10.843735 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:10.854594 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:10.865188 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:10.875981 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:10.886688 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:10.897417 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:10.908271 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:10.919051 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:10.930000 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:03:11.047658 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:03:11.266734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:03:11.594431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31239): Launched 17:03:11.878262 run iperf3-srv_10.42.42.10(pid=31240): Launched 17:03:12.002397 tst iperf3.py:8: start network... 17:03:12.220549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:03:12.723562 run create_hlr_db(pid=31241): Launched 17:03:12.855503 bus /gobi_6: Setting Powered False 17:03:13.919365 run create_hlr_db(pid=31241): Terminated: ok {rc=0} 17:03:14.351996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31243): Launched 17:03:14.678171 run osmo-hlr_10.42.42.2(pid=31244): Launched 17:03:14.801436 run osmo-stp_10.42.42.5: Starting osmo-stp 17:03:15.359895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31246): Launched 17:03:15.684354 run osmo-stp_10.42.42.5(pid=31247): Launched 17:03:15.807239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:03:16.446754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31249): Launched 17:03:16.582289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:03:16.847385 run patchelf(pid=31250): Launched 17:03:17.037866 run osmo-stp_10.42.42.5(pid=31247): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31247)] 17:03:17.171081 run osmo-stp_10.42.42.5(pid=31247): stdout: | (launched: 2022-12-12_17:03:15.625400) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:17.304026 run osmo-stp_10.42.42.5(pid=31247): stderr: | 20221212170315838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170315838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170315839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170315839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170315839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170315839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170315840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:17.435093 run osmo-stp_10.42.42.5(pid=31247): stdout: | (launched: 2022-12-12_17:03:15.625400) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:17.560869 run osmo-stp_10.42.42.5(pid=31247): stderr: | 20221212170315838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170315838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170315839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170315839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170315839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170315839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170315840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:17.708712 run patchelf(pid=31250): Terminating (SIGINT) 17:03:17.879309 run patchelf(pid=31250): Terminated: ok {rc=0} 17:03:18.002661 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31247): Process ended prematurely: osmo-stp_10.42.42.5(pid=31247) [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31247)] [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 17:03:18.012360 tst iperf3.py:8: Test FAILED (7.7 sec) 17:03:18.040381 run osmo-hlr_10.42.42.2(pid=31244): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31244)] 17:03:18.088534 run osmo-hlr_10.42.42.2(pid=31244): stdout: | (launched: 2022-12-12_17:03:14.618944) 17:03:18.138316 run osmo-hlr_10.42.42.2(pid=31244): stderr: | 20221212170314814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170314814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170314814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170314815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170314815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170314815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170314828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170314836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170314836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170314837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:03:18.188748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31239): Terminating (SIGTERM) 17:03:18.229160 run iperf3-srv_10.42.42.10(pid=31240): Terminating (SIGTERM) 17:03:18.269326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31243): Terminating (SIGTERM) 17:03:18.309588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31246): Terminating (SIGTERM) 17:03:18.349759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31249): Terminating (SIGTERM) 17:03:18.390266 --- ParallelTerminationStrategy: PID 31239 died... 17:03:18.409447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31239): Terminated: ok {rc=0} 17:03:18.454181 --- ParallelTerminationStrategy: PID 31240 died... 17:03:18.473138 run iperf3-srv_10.42.42.10(pid=31240): Terminated {rc=256} 17:03:18.517616 --- ParallelTerminationStrategy: PID 31243 died... 17:03:18.536706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31243): Terminated: ok {rc=0} 17:03:18.581468 --- ParallelTerminationStrategy: PID 31246 died... 17:03:18.600333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31246): Terminated: ok {rc=0} 17:03:18.644789 --- ParallelTerminationStrategy: PID 31249 died... 17:03:18.663600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31249): Terminated: ok {rc=0} 17:03:18.749263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 17:03:19.897552 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:19.908934 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 17:03:19.954801 tst iperf3m4.py: using LAC 30266 17:03:20.076163 tst iperf3m4.py: using RAC 176 17:03:20.197253 tst iperf3m4.py: using CellId 30266 17:03:20.317613 tst iperf3m4.py: using BVCI 30267 17:03:20.429765 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:20.440609 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:20.451287 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:20.462252 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:20.473106 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:20.483761 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:20.494738 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:20.505503 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:20.517069 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:03:20.636392 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:03:20.758352 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:03:20.873374 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:03:20.996510 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:03:21.215592 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:03:21.542931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31251): Launched 17:03:21.827730 run iperf3-srv_10.42.42.10(pid=31252): Launched 17:03:21.950436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:03:22.170105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:03:22.497499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31253): Launched 17:03:22.779486 run iperf3-srv_10.42.42.10(pid=31254): Launched 17:03:22.901514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:03:23.119551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:03:23.445153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31255): Launched 17:03:23.728129 run iperf3-srv_10.42.42.10(pid=31256): Launched 17:03:23.850453 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:03:24.068672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:03:24.394584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31257): Launched 17:03:24.678907 run iperf3-srv_10.42.42.10(pid=31258): Launched 17:03:24.802775 tst iperf3m4.py:8: start network... 17:03:25.022072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:03:25.529205 run create_hlr_db(pid=31259): Launched 17:03:25.660489 bus /gobi_6: Setting Powered False 17:03:26.724636 run create_hlr_db(pid=31259): Terminated: ok {rc=0} 17:03:27.157422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31261): Launched 17:03:27.461809 run osmo-hlr_10.42.42.2(pid=31262): Launched 17:03:27.579759 run osmo-stp_10.42.42.5: Starting osmo-stp 17:03:28.229372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31264): Launched 17:03:28.527113 run osmo-stp_10.42.42.5(pid=31265): Launched 17:03:28.641470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:03:29.156847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31267): Launched 17:03:29.271416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:03:29.524005 run patchelf(pid=31268): Launched 17:03:29.690871 run osmo-stp_10.42.42.5(pid=31265): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31265)] 17:03:29.817639 run osmo-stp_10.42.42.5(pid=31265): stdout: | (launched: 2022-12-12_17:03:28.472242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:29.945731 run osmo-stp_10.42.42.5(pid=31265): stderr: | 20221212170328638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170328638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170328638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170328638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170328639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170328639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170328639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:30.074133 run osmo-stp_10.42.42.5(pid=31265): stdout: | (launched: 2022-12-12_17:03:28.472242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:30.196730 run osmo-stp_10.42.42.5(pid=31265): stderr: | 20221212170328638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170328638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170328638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170328638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170328639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170328639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170328639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:30.342159 run patchelf(pid=31268): Terminating (SIGINT) 17:03:30.509411 run patchelf(pid=31268): Terminated: ok {rc=0} 17:03:30.630858 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31265): Process ended prematurely: osmo-stp_10.42.42.5(pid=31265) [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31265)] [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 17:03:30.640469 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:03:30.668742 run osmo-hlr_10.42.42.2(pid=31262): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31262)] 17:03:30.716285 run osmo-hlr_10.42.42.2(pid=31262): stdout: | (launched: 2022-12-12_17:03:27.405190) 17:03:30.765857 run osmo-hlr_10.42.42.2(pid=31262): stderr: | 20221212170327581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170327581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170327581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170327582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170327582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170327582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170327595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170327606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170327606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170327606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:03:30.815658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31251): Terminating (SIGTERM) 17:03:30.858162 run iperf3-srv_10.42.42.10(pid=31252): Terminating (SIGTERM) 17:03:30.902290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31253): Terminating (SIGTERM) 17:03:30.943754 run iperf3-srv_10.42.42.10(pid=31254): Terminating (SIGTERM) 17:03:30.987357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31255): Terminating (SIGTERM) 17:03:31.028862 run iperf3-srv_10.42.42.10(pid=31256): Terminating (SIGTERM) 17:03:31.072732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31257): Terminating (SIGTERM) 17:03:31.114475 run iperf3-srv_10.42.42.10(pid=31258): Terminating (SIGTERM) 17:03:31.158470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31261): Terminating (SIGTERM) 17:03:31.200037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31264): Terminating (SIGTERM) 17:03:31.242546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31267): Terminating (SIGTERM) 17:03:31.283768 --- ParallelTerminationStrategy: PID 31251 died... 17:03:31.303075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31251): Terminated: ok {rc=0} 17:03:31.348164 --- ParallelTerminationStrategy: PID 31252 died... 17:03:31.367328 run iperf3-srv_10.42.42.10(pid=31252): Terminated {rc=256} 17:03:31.412365 --- ParallelTerminationStrategy: PID 31253 died... 17:03:31.431533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31253): Terminated: ok {rc=0} 17:03:31.476696 --- ParallelTerminationStrategy: PID 31254 died... 17:03:31.495785 run iperf3-srv_10.42.42.10(pid=31254): Terminated {rc=256} 17:03:31.541100 --- ParallelTerminationStrategy: PID 31255 died... 17:03:31.560267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31255): Terminated: ok {rc=0} 17:03:31.605541 --- ParallelTerminationStrategy: PID 31256 died... 17:03:31.624716 run iperf3-srv_10.42.42.10(pid=31256): Terminated {rc=256} 17:03:31.669860 --- ParallelTerminationStrategy: PID 31257 died... 17:03:31.689043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31257): Terminated: ok {rc=0} 17:03:31.734019 --- ParallelTerminationStrategy: PID 31258 died... 17:03:31.753375 run iperf3-srv_10.42.42.10(pid=31258): Terminated {rc=256} 17:03:31.798677 --- ParallelTerminationStrategy: PID 31261 died... 17:03:31.817926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31261): Terminated: ok {rc=0} 17:03:31.863120 --- ParallelTerminationStrategy: PID 31264 died... 17:03:31.882179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31264): Terminated: ok {rc=0} 17:03:31.926815 --- ParallelTerminationStrategy: PID 31267 died... 17:03:31.945900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31267): Terminated: ok {rc=0} 17:03:32.030659 bus /gobi_4: Setting Powered False 17:03:33.128376 bus /gobi_4: Setting Powered False 17:03:34.243357 bus /gobi_1: Setting Powered False 17:03:35.339294 bus /gobi_1: Setting Powered False 17:03:36.454757 bus /gobi_0: Setting Powered False 17:03:37.552694 bus /gobi_0: Setting Powered False 17:03:38.668497 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 17:03:39.770450 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:39.781971 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 17:03:39.972508 tst ping.py: using LAC 30267 17:03:40.089472 tst ping.py: using RAC 177 17:03:40.215675 tst ping.py: using CellId 30267 17:03:40.339408 tst ping.py: using BVCI 30268 17:03:40.455807 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:40.467064 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:40.478240 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:40.489415 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:40.500142 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:40.511024 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:40.522162 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:40.533081 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:03:40.645351 tst ping.py:19: start network... 17:03:40.841657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:03:41.294541 run create_hlr_db(pid=31269): Launched 17:03:41.423660 bus /gobi_6: Setting Powered False 17:03:42.486672 run create_hlr_db(pid=31269): Terminated: ok {rc=0} 17:03:42.923468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31271): Launched 17:03:43.236468 run osmo-hlr_10.42.42.2(pid=31272): Launched 17:03:43.355891 run osmo-stp_10.42.42.5: Starting osmo-stp 17:03:43.898554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31274): Launched 17:03:44.212393 run osmo-stp_10.42.42.5(pid=31275): Launched 17:03:44.332261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:03:44.874905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31277): Launched 17:03:44.995417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:03:45.261289 run patchelf(pid=31278): Launched 17:03:45.436388 run osmo-stp_10.42.42.5(pid=31275): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31275)] 17:03:45.569871 run osmo-stp_10.42.42.5(pid=31275): stdout: | (launched: 2022-12-12_17:03:44.155161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:45.704722 run osmo-stp_10.42.42.5(pid=31275): stderr: | 20221212170344342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170344342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170344343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170344343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170344344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170344344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170344344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:45.845336 run osmo-stp_10.42.42.5(pid=31275): stdout: | (launched: 2022-12-12_17:03:44.155161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:45.988742 run osmo-stp_10.42.42.5(pid=31275): stderr: | 20221212170344342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170344342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170344343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170344343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170344344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170344344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170344344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:46.137542 run patchelf(pid=31278): Terminating (SIGINT) 17:03:46.307620 run patchelf(pid=31278): Terminated: ok {rc=0} 17:03:46.430234 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31275): Process ended prematurely: osmo-stp_10.42.42.5(pid=31275) [trial-2379↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31275)] [trial-2379↪gprs:trx-lms-limenet-micro↪ping.py:22] 17:03:46.440183 tst ping.py:22: Test FAILED (6.7 sec) 17:03:46.469699 run osmo-hlr_10.42.42.2(pid=31272): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31272)] 17:03:46.523012 run osmo-hlr_10.42.42.2(pid=31272): stdout: | (launched: 2022-12-12_17:03:43.179607) 17:03:46.576317 run osmo-hlr_10.42.42.2(pid=31272): stderr: | 20221212170343373 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170343373 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170343373 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170343373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170343373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170343373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170343433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170343442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170343442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170343443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:03:46.629299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31271): Terminating (SIGTERM) 17:03:46.672297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31274): Terminating (SIGTERM) 17:03:46.718107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31277): Terminating (SIGTERM) 17:03:46.763029 --- ParallelTerminationStrategy: PID 31271 died... 17:03:46.783132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31271): Terminated: ok {rc=0} 17:03:46.832116 --- ParallelTerminationStrategy: PID 31274 died... 17:03:46.851745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31274): Terminated: ok {rc=0} 17:03:46.900159 --- ParallelTerminationStrategy: PID 31277 died... 17:03:46.919858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31277): Terminated: ok {rc=0} 17:03:47.008188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 17:03:48.094679 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:48.106586 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 17:03:48.154251 tst ping_idle_ping.py: using LAC 30268 17:03:48.272790 tst ping_idle_ping.py: using RAC 178 17:03:48.389122 tst ping_idle_ping.py: using CellId 30268 17:03:48.504799 tst ping_idle_ping.py: using BVCI 30269 17:03:48.612335 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:48.623006 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:48.633642 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:48.644893 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:48.656175 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:48.667641 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:48.679153 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 17:03:48.690588 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 17:03:48.809866 tst ping_idle_ping.py:24: start network... 17:03:49.007667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:03:49.465488 run create_hlr_db(pid=31279): Launched 17:03:49.578030 bus /gobi_6: Setting Powered False 17:03:50.636784 run create_hlr_db(pid=31279): Terminated: ok {rc=0} 17:03:51.066850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31281): Launched 17:03:51.382230 run osmo-hlr_10.42.42.2(pid=31282): Launched 17:03:51.502043 run osmo-stp_10.42.42.5: Starting osmo-stp 17:03:52.049557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31284): Launched 17:03:52.364288 run osmo-stp_10.42.42.5(pid=31285): Launched 17:03:52.484865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:03:53.029429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31287): Launched 17:03:53.150148 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:03:53.416560 run patchelf(pid=31288): Launched 17:03:53.593183 run osmo-stp_10.42.42.5(pid=31285): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31285)] 17:03:53.726618 run osmo-stp_10.42.42.5(pid=31285): stdout: | (launched: 2022-12-12_17:03:52.306399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:53.862646 run osmo-stp_10.42.42.5(pid=31285): stderr: | 20221212170352495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170352495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170352495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170352496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170352496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170352496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170352496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:53.998022 run osmo-stp_10.42.42.5(pid=31285): stdout: | (launched: 2022-12-12_17:03:52.306399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:03:54.127974 run osmo-stp_10.42.42.5(pid=31285): stderr: | 20221212170352495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170352495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170352495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170352496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170352496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170352496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170352496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:03:54.281725 run patchelf(pid=31288): Terminating (SIGINT) 17:03:54.457799 run patchelf(pid=31288): Terminated: ok {rc=0} 17:03:54.584566 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31285): Process ended prematurely: osmo-stp_10.42.42.5(pid=31285) [trial-2379↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31285)] [trial-2379↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 17:03:54.594093 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:03:54.622030 run osmo-hlr_10.42.42.2(pid=31282): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31282)] 17:03:54.671636 run osmo-hlr_10.42.42.2(pid=31282): stdout: | (launched: 2022-12-12_17:03:51.324580) 17:03:54.722966 run osmo-hlr_10.42.42.2(pid=31282): stderr: | 20221212170351518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170351518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170351518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170351518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170351518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170351518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170351530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170351539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170351539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170351539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:03:54.774825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31281): Terminating (SIGTERM) 17:03:54.816303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31284): Terminating (SIGTERM) 17:03:54.857880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31287): Terminating (SIGTERM) 17:03:54.899512 --- ParallelTerminationStrategy: PID 31281 died... 17:03:54.919235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31281): Terminated: ok {rc=0} 17:03:54.964617 --- ParallelTerminationStrategy: PID 31284 died... 17:03:54.983955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31284): Terminated: ok {rc=0} 17:03:55.029346 --- ParallelTerminationStrategy: PID 31287 died... 17:03:55.048529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31287): Terminated: ok {rc=0} 17:03:55.135386 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 17:03:56.434205 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:03:56.440218 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:03:56.469823 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:03:56.508713 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:03:56.599234 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:03:56.629054 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:03:56.667859 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:03:57.261904 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:03:57.313427 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:03:57.324711 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:03:57.372331 tst cs_paging_gprs_active.py: using LAC 30269 17:03:57.500047 tst cs_paging_gprs_active.py: using RAC 179 17:03:57.624880 tst cs_paging_gprs_active.py: using CellId 30269 17:03:57.750385 tst cs_paging_gprs_active.py: using BVCI 30270 17:03:57.869225 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:03:57.880604 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:03:57.891752 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:03:57.902960 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:03:57.914108 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:03:57.925311 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:03:57.936567 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:03:57.947704 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:03:57.959063 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:03:58.072108 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:03:58.186087 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:03:58.389292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:03:58.692568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31293): Launched 17:03:58.955598 run iperf3-srv_10.42.42.10(pid=31294): Launched 17:03:59.068774 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:03:59.270398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:03:59.573057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31295): Launched 17:03:59.835925 run iperf3-srv_10.42.42.10(pid=31296): Launched 17:03:59.950018 tst cs_paging_gprs_active.py:38: start network... 17:04:00.151680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:04:00.619746 run create_hlr_db(pid=31297): Launched 17:04:00.736035 bus /gobi_6: Setting Powered False 17:04:01.795988 run create_hlr_db(pid=31297): Terminated: ok {rc=0} 17:04:02.281097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Launched 17:04:02.584183 run osmo-hlr_10.42.42.2(pid=31300): Launched 17:04:02.698996 run osmo-stp_10.42.42.5: Starting osmo-stp 17:04:03.228154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Launched 17:04:03.530528 run osmo-stp_10.42.42.5(pid=31303): Launched 17:04:03.645786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:04:04.166374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Launched 17:04:04.281605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:04:04.536426 run patchelf(pid=31306): Launched 17:04:04.703689 run osmo-stp_10.42.42.5(pid=31303): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] 17:04:04.831103 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-12_17:04:03.474896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:04.959980 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221212170403641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170403641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170403641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170403642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170403642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170403642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170403642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:05.088504 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-12_17:04:03.474896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:05.211969 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221212170403641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170403641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170403641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170403642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170403642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170403642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170403642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:05.357991 run patchelf(pid=31306): Terminating (SIGINT) 17:04:05.526241 run patchelf(pid=31306): Terminated: ok {rc=0} 17:04:05.648446 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:04:05.657941 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 17:04:05.685272 run osmo-hlr_10.42.42.2(pid=31300): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31300)] 17:04:05.732490 run osmo-hlr_10.42.42.2(pid=31300): stdout: | (launched: 2022-12-12_17:04:02.528070) 17:04:05.781570 run osmo-hlr_10.42.42.2(pid=31300): stderr: | 20221212170402701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170402701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170402702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170402702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170402702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170402702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170402717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170402725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170402726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170402726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:04:05.831307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31293): Terminating (SIGTERM) 17:04:05.870879 run iperf3-srv_10.42.42.10(pid=31294): Terminating (SIGTERM) 17:04:05.910086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31295): Terminating (SIGTERM) 17:04:05.949400 run iperf3-srv_10.42.42.10(pid=31296): Terminating (SIGTERM) 17:04:05.989234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminating (SIGTERM) 17:04:06.028710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminating (SIGTERM) 17:04:06.067921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Terminating (SIGTERM) 17:04:06.107501 --- ParallelTerminationStrategy: PID 31293 died... 17:04:06.126425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31293): Terminated: ok {rc=0} 17:04:06.170346 --- ParallelTerminationStrategy: PID 31294 died... 17:04:06.188435 run iperf3-srv_10.42.42.10(pid=31294): Terminated {rc=256} 17:04:06.231969 --- ParallelTerminationStrategy: PID 31295 died... 17:04:06.250285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31295): Terminated: ok {rc=0} 17:04:06.293930 --- ParallelTerminationStrategy: PID 31296 died... 17:04:06.312060 run iperf3-srv_10.42.42.10(pid=31296): Terminated {rc=256} 17:04:06.355612 --- ParallelTerminationStrategy: PID 31299 died... 17:04:06.373921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminated: ok {rc=0} 17:04:06.417723 --- ParallelTerminationStrategy: PID 31302 died... 17:04:06.435940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminated: ok {rc=0} 17:04:06.479529 --- ParallelTerminationStrategy: PID 31305 died... 17:04:06.497982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Terminated: ok {rc=0} 17:04:06.582415 bus /gobi_0: Setting Powered False 17:04:07.681184 bus /gobi_0: Setting Powered False 17:04:08.795953 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:04:09.940027 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:09.951882 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:04:09.998389 tst iperf3.py: using LAC 30270 17:04:10.117785 tst iperf3.py: using RAC 180 17:04:10.234943 tst iperf3.py: using CellId 30270 17:04:10.354526 tst iperf3.py: using BVCI 30271 17:04:10.463272 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:10.474262 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:10.485053 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:10.496129 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:10.507065 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:10.518187 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:10.529357 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:10.540294 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:10.551782 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:04:10.669570 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:04:10.885700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:04:11.205684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31307): Launched 17:04:11.484574 run iperf3-srv_10.42.42.10(pid=31308): Launched 17:04:11.606125 tst iperf3.py:8: start network... 17:04:11.821073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:04:12.318204 run create_hlr_db(pid=31309): Launched 17:04:12.451075 bus /gobi_6: Setting Powered False 17:04:13.515413 run create_hlr_db(pid=31309): Terminated: ok {rc=0} 17:04:13.942732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31311): Launched 17:04:14.243766 run osmo-hlr_10.42.42.2(pid=31312): Launched 17:04:14.358724 run osmo-stp_10.42.42.5: Starting osmo-stp 17:04:14.890246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31314): Launched 17:04:15.188652 run osmo-stp_10.42.42.5(pid=31315): Launched 17:04:15.303439 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:04:15.826882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31317): Launched 17:04:15.967168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:04:16.240448 run patchelf(pid=31318): Launched 17:04:16.440898 run osmo-stp_10.42.42.5(pid=31315): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31315)] 17:04:16.587407 run osmo-stp_10.42.42.5(pid=31315): stdout: | (launched: 2022-12-12_17:04:15.134071) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:16.743269 run osmo-stp_10.42.42.5(pid=31315): stderr: | 20221212170415300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170415300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170415300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170415300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170415301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170415301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170415301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:16.884282 run osmo-stp_10.42.42.5(pid=31315): stdout: | (launched: 2022-12-12_17:04:15.134071) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:17.019556 run osmo-stp_10.42.42.5(pid=31315): stderr: | 20221212170415300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170415300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170415300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170415300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170415301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170415301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170415301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:17.180378 run patchelf(pid=31318): Terminating (SIGINT) 17:04:17.359014 run patchelf(pid=31318): Terminated: ok {rc=0} 17:04:17.488182 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31315): Process ended prematurely: osmo-stp_10.42.42.5(pid=31315) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31315)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 17:04:17.498642 tst iperf3.py:8: Test FAILED (7.6 sec) 17:04:17.527247 run osmo-hlr_10.42.42.2(pid=31312): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31312)] 17:04:17.577252 run osmo-hlr_10.42.42.2(pid=31312): stdout: | (launched: 2022-12-12_17:04:14.188185) 17:04:17.629274 run osmo-hlr_10.42.42.2(pid=31312): stderr: | 20221212170414361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170414362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170414362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170414362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170414362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170414362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170414374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170414385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170414385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170414385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:04:17.681188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31307): Terminating (SIGTERM) 17:04:17.722812 run iperf3-srv_10.42.42.10(pid=31308): Terminating (SIGTERM) 17:04:17.764395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31311): Terminating (SIGTERM) 17:04:17.806121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31314): Terminating (SIGTERM) 17:04:17.847878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31317): Terminating (SIGTERM) 17:04:17.889752 --- ParallelTerminationStrategy: PID 31307 died... 17:04:17.909966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31307): Terminated: ok {rc=0} 17:04:17.956282 --- ParallelTerminationStrategy: PID 31308 died... 17:04:17.975780 run iperf3-srv_10.42.42.10(pid=31308): Terminated {rc=256} 17:04:18.022217 --- ParallelTerminationStrategy: PID 31311 died... 17:04:18.041665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31311): Terminated: ok {rc=0} 17:04:18.087121 --- ParallelTerminationStrategy: PID 31314 died... 17:04:18.106486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31314): Terminated: ok {rc=0} 17:04:18.152431 --- ParallelTerminationStrategy: PID 31317 died... 17:04:18.171846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31317): Terminated: ok {rc=0} 17:04:18.258850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:04:19.408157 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:19.421073 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:04:19.468239 tst iperf3m4.py: using LAC 30271 17:04:19.593799 tst iperf3m4.py: using RAC 181 17:04:19.719843 tst iperf3m4.py: using CellId 30271 17:04:19.843465 tst iperf3m4.py: using BVCI 30272 17:04:19.959712 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:19.971214 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:19.982741 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:19.994332 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:20.005798 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:20.017138 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:20.028443 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:20.039662 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:20.051079 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:04:20.174128 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:04:20.288565 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:04:20.406016 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:04:20.521775 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:04:20.722822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:04:21.023521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31319): Launched 17:04:21.284429 run iperf3-srv_10.42.42.10(pid=31320): Launched 17:04:21.397333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:04:21.597542 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:04:21.898186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31321): Launched 17:04:22.162407 run iperf3-srv_10.42.42.10(pid=31322): Launched 17:04:22.275443 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:04:22.475409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:04:22.776164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31323): Launched 17:04:23.037748 run iperf3-srv_10.42.42.10(pid=31324): Launched 17:04:23.150593 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:04:23.351222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:04:23.652263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31325): Launched 17:04:23.914092 run iperf3-srv_10.42.42.10(pid=31326): Launched 17:04:24.026880 tst iperf3m4.py:8: start network... 17:04:24.226939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:04:24.692848 run create_hlr_db(pid=31327): Launched 17:04:24.808423 bus /gobi_6: Setting Powered False 17:04:25.868524 run create_hlr_db(pid=31327): Terminated: ok {rc=0} 17:04:26.287037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31329): Launched 17:04:26.586937 run osmo-hlr_10.42.42.2(pid=31330): Launched 17:04:26.701952 run osmo-stp_10.42.42.5: Starting osmo-stp 17:04:27.232527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31332): Launched 17:04:27.532580 run osmo-stp_10.42.42.5(pid=31333): Launched 17:04:27.648146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:04:28.167303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31335): Launched 17:04:28.282150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:04:28.535837 run patchelf(pid=31336): Launched 17:04:28.702685 run osmo-stp_10.42.42.5(pid=31333): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31333)] 17:04:28.829569 run osmo-stp_10.42.42.5(pid=31333): stdout: | (launched: 2022-12-12_17:04:27.477317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:28.958273 run osmo-stp_10.42.42.5(pid=31333): stderr: | 20221212170427644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170427644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170427644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170427645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170427645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170427645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170427645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:29.087250 run osmo-stp_10.42.42.5(pid=31333): stdout: | (launched: 2022-12-12_17:04:27.477317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:29.210272 run osmo-stp_10.42.42.5(pid=31333): stderr: | 20221212170427644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170427644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170427644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170427645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170427645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170427645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170427645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:29.356038 run patchelf(pid=31336): Terminating (SIGINT) 17:04:29.523587 run patchelf(pid=31336): Terminated: ok {rc=0} 17:04:29.644358 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31333): Process ended prematurely: osmo-stp_10.42.42.5(pid=31333) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31333)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 17:04:29.653991 tst iperf3m4.py:8: Test FAILED (10.3 sec) 17:04:29.681979 run osmo-hlr_10.42.42.2(pid=31330): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31330)] 17:04:29.730013 run osmo-hlr_10.42.42.2(pid=31330): stdout: | (launched: 2022-12-12_17:04:26.531515) 17:04:29.779117 run osmo-hlr_10.42.42.2(pid=31330): stderr: | 20221212170426703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170426703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170426703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170426703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170426703 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170426703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170426718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170426728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170426728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170426728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:04:29.828440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31319): Terminating (SIGTERM) 17:04:29.867906 run iperf3-srv_10.42.42.10(pid=31320): Terminating (SIGTERM) 17:04:29.907473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31321): Terminating (SIGTERM) 17:04:29.947149 run iperf3-srv_10.42.42.10(pid=31322): Terminating (SIGTERM) 17:04:29.986687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31323): Terminating (SIGTERM) 17:04:30.026174 run iperf3-srv_10.42.42.10(pid=31324): Terminating (SIGTERM) 17:04:30.065629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31325): Terminating (SIGTERM) 17:04:30.105360 run iperf3-srv_10.42.42.10(pid=31326): Terminating (SIGTERM) 17:04:30.145144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31329): Terminating (SIGTERM) 17:04:30.184549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31332): Terminating (SIGTERM) 17:04:30.223750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31335): Terminating (SIGTERM) 17:04:30.263380 --- ParallelTerminationStrategy: PID 31319 died... 17:04:30.282206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31319): Terminated: ok {rc=0} 17:04:30.326752 --- ParallelTerminationStrategy: PID 31320 died... 17:04:30.344937 run iperf3-srv_10.42.42.10(pid=31320): Terminated {rc=256} 17:04:30.388343 --- ParallelTerminationStrategy: PID 31321 died... 17:04:30.406666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31321): Terminated: ok {rc=0} 17:04:30.450306 --- ParallelTerminationStrategy: PID 31322 died... 17:04:30.468355 run iperf3-srv_10.42.42.10(pid=31322): Terminated {rc=256} 17:04:30.511852 --- ParallelTerminationStrategy: PID 31323 died... 17:04:30.530078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31323): Terminated: ok {rc=0} 17:04:30.573845 --- ParallelTerminationStrategy: PID 31324 died... 17:04:30.591988 run iperf3-srv_10.42.42.10(pid=31324): Terminated {rc=256} 17:04:30.635298 --- ParallelTerminationStrategy: PID 31325 died... 17:04:30.653668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31325): Terminated: ok {rc=0} 17:04:30.697384 --- ParallelTerminationStrategy: PID 31326 died... 17:04:30.715674 run iperf3-srv_10.42.42.10(pid=31326): Terminated {rc=256} 17:04:30.759085 --- ParallelTerminationStrategy: PID 31329 died... 17:04:30.777405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31329): Terminated: ok {rc=0} 17:04:30.842266 --- ParallelTerminationStrategy: PID 31332 died... 17:04:30.861902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31332): Terminated: ok {rc=0} 17:04:30.908417 --- ParallelTerminationStrategy: PID 31335 died... 17:04:30.928010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31335): Terminated: ok {rc=0} 17:04:31.016687 bus /gobi_4: Setting Powered False 17:04:32.124331 bus /gobi_4: Setting Powered False 17:04:33.240607 bus /gobi_1: Setting Powered False 17:04:34.340332 bus /gobi_1: Setting Powered False 17:04:35.454391 bus /gobi_0: Setting Powered False 17:04:36.550502 bus /gobi_0: Setting Powered False 17:04:37.667358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 17:04:38.770453 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:38.782543 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:04:38.830790 tst ping.py: using LAC 30272 17:04:38.955868 tst ping.py: using RAC 182 17:04:39.073341 tst ping.py: using CellId 30272 17:04:39.190388 tst ping.py: using BVCI 30273 17:04:39.299609 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:39.310660 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:39.321520 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:39.332535 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:39.343510 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:39.354907 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:39.366208 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:39.377205 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:04:39.493937 tst ping.py:19: start network... 17:04:39.690678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:04:40.145786 run create_hlr_db(pid=31340): Launched 17:04:40.257475 bus /gobi_6: Setting Powered False 17:04:41.316203 run create_hlr_db(pid=31340): Terminated: ok {rc=0} 17:04:41.725641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31342): Launched 17:04:42.019114 run osmo-hlr_10.42.42.2(pid=31343): Launched 17:04:42.130899 run osmo-stp_10.42.42.5: Starting osmo-stp 17:04:42.655839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31345): Launched 17:04:42.949270 run osmo-stp_10.42.42.5(pid=31346): Launched 17:04:43.061210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:04:43.569027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31348): Launched 17:04:43.682402 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:04:43.930873 run patchelf(pid=31349): Launched 17:04:44.094650 run osmo-stp_10.42.42.5(pid=31346): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31346)] 17:04:44.219395 run osmo-stp_10.42.42.5(pid=31346): stdout: | (launched: 2022-12-12_17:04:42.894902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:44.345825 run osmo-stp_10.42.42.5(pid=31346): stderr: | 20221212170443059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170443059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170443059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170443059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170443060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170443060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170443060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:44.472443 run osmo-stp_10.42.42.5(pid=31346): stdout: | (launched: 2022-12-12_17:04:42.894902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:44.593597 run osmo-stp_10.42.42.5(pid=31346): stderr: | 20221212170443059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170443059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170443059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170443059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170443060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170443060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170443060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:44.736698 run patchelf(pid=31349): Terminating (SIGINT) 17:04:44.901475 run patchelf(pid=31349): Terminated: ok {rc=0} 17:04:45.020132 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31346): Process ended prematurely: osmo-stp_10.42.42.5(pid=31346) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31346)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 17:04:45.029137 tst ping.py:22: Test FAILED (6.3 sec) 17:04:45.056186 run osmo-hlr_10.42.42.2(pid=31343): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31343)] 17:04:45.103846 run osmo-hlr_10.42.42.2(pid=31343): stdout: | (launched: 2022-12-12_17:04:41.965491) 17:04:45.153262 run osmo-hlr_10.42.42.2(pid=31343): stderr: | 20221212170442137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170442137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170442137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170442137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170442137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170442137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170442149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170442158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170442159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170442159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:04:45.203115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31342): Terminating (SIGTERM) 17:04:45.242709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31345): Terminating (SIGTERM) 17:04:45.282163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31348): Terminating (SIGTERM) 17:04:45.321922 --- ParallelTerminationStrategy: PID 31342 died... 17:04:45.340615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31342): Terminated: ok {rc=0} 17:04:45.384844 --- ParallelTerminationStrategy: PID 31345 died... 17:04:45.403321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31345): Terminated: ok {rc=0} 17:04:45.447163 --- ParallelTerminationStrategy: PID 31348 died... 17:04:45.465597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31348): Terminated: ok {rc=0} 17:04:45.551652 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:04:46.646561 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:46.659838 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:04:46.710738 tst ping_idle_ping.py: using LAC 30273 17:04:46.862182 tst ping_idle_ping.py: using RAC 183 17:04:47.017119 tst ping_idle_ping.py: using CellId 30273 17:04:47.159464 tst ping_idle_ping.py: using BVCI 30274 17:04:47.275746 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:47.287769 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:47.298802 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:47.310232 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:47.321226 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:47.332224 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:47.343341 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:04:47.354959 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:04:47.471829 tst ping_idle_ping.py:24: start network... 17:04:47.684904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:04:48.176250 run create_hlr_db(pid=31350): Launched 17:04:48.305579 bus /gobi_6: Setting Powered False 17:04:49.368654 run create_hlr_db(pid=31350): Terminated: ok {rc=0} 17:04:49.791630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31352): Launched 17:04:50.086024 run osmo-hlr_10.42.42.2(pid=31353): Launched 17:04:50.198149 run osmo-stp_10.42.42.5: Starting osmo-stp 17:04:50.705443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31355): Launched 17:04:51.001550 run osmo-stp_10.42.42.5(pid=31356): Launched 17:04:51.114509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:04:51.623060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31358): Launched 17:04:51.736601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:04:51.985225 run patchelf(pid=31359): Launched 17:04:52.150363 run osmo-stp_10.42.42.5(pid=31356): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31356)] 17:04:52.275929 run osmo-stp_10.42.42.5(pid=31356): stdout: | (launched: 2022-12-12_17:04:50.946843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:52.402763 run osmo-stp_10.42.42.5(pid=31356): stderr: | 20221212170451113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170451113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170451113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170451113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170451114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170451114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170451114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:52.533668 run osmo-stp_10.42.42.5(pid=31356): stdout: | (launched: 2022-12-12_17:04:50.946843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:04:52.663712 run osmo-stp_10.42.42.5(pid=31356): stderr: | 20221212170451113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170451113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170451113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170451113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170451114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170451114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170451114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:04:52.817784 run patchelf(pid=31359): Terminating (SIGINT) 17:04:52.993600 run patchelf(pid=31359): Terminated: ok {rc=0} 17:04:53.121036 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31356): Process ended prematurely: osmo-stp_10.42.42.5(pid=31356) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31356)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 17:04:53.130777 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:04:53.158871 run osmo-hlr_10.42.42.2(pid=31353): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31353)] 17:04:53.208454 run osmo-hlr_10.42.42.2(pid=31353): stdout: | (launched: 2022-12-12_17:04:50.032044) 17:04:53.259612 run osmo-hlr_10.42.42.2(pid=31353): stderr: | 20221212170450204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170450204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170450204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170450204 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170450204 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170450204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170450236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170450246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170450246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170450246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:04:53.311315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31352): Terminating (SIGTERM) 17:04:53.352777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31355): Terminating (SIGTERM) 17:04:53.394352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31358): Terminating (SIGTERM) 17:04:53.436168 --- ParallelTerminationStrategy: PID 31352 died... 17:04:53.455947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31352): Terminated: ok {rc=0} 17:04:53.501754 --- ParallelTerminationStrategy: PID 31355 died... 17:04:53.521297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31355): Terminated: ok {rc=0} 17:04:53.566778 --- ParallelTerminationStrategy: PID 31358 died... 17:04:53.586180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31358): Terminated: ok {rc=0} 17:04:53.672843 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:04:54.978893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:04:54.985825 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:04:55.015539 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:04:55.054326 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:04:55.140400 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:04:55.170015 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:04:55.208904 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:04:55.808482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:04:55.860010 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:04:55.871424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:04:55.937323 tst cs_paging_gprs_active.py: using LAC 30274 17:04:56.062328 tst cs_paging_gprs_active.py: using RAC 184 17:04:56.186623 tst cs_paging_gprs_active.py: using CellId 30274 17:04:56.311029 tst cs_paging_gprs_active.py: using BVCI 30275 17:04:56.427461 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:04:56.438943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:04:56.450283 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:04:56.461662 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:04:56.473325 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:04:56.484535 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:04:56.495919 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:04:56.507190 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:04:56.518771 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:04:56.633669 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:04:56.748853 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:04:56.952184 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:04:57.256102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31363): Launched 17:04:57.520382 run iperf3-srv_10.42.42.10(pid=31364): Launched 17:04:57.636238 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:04:57.838853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:04:58.142511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31365): Launched 17:04:58.406244 run iperf3-srv_10.42.42.10(pid=31366): Launched 17:04:58.520104 tst cs_paging_gprs_active.py:38: start network... 17:04:58.722518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:04:59.189290 run create_hlr_db(pid=31367): Launched 17:04:59.306080 bus /gobi_6: Setting Powered False 17:05:00.366045 run create_hlr_db(pid=31367): Terminated: ok {rc=0} 17:05:00.805804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31370): Launched 17:05:01.186522 run osmo-hlr_10.42.42.2(pid=31371): Launched 17:05:01.441650 run osmo-stp_10.42.42.5: Starting osmo-stp 17:05:02.153842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31377): Launched 17:05:02.475505 run osmo-stp_10.42.42.5(pid=31382): Launched 17:05:02.596046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:05:03.192419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31386): Launched 17:05:03.308145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:05:03.562502 run patchelf(pid=31387): Launched 17:05:03.729983 run osmo-stp_10.42.42.5(pid=31382): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31382)] 17:05:03.857518 run osmo-stp_10.42.42.5(pid=31382): stdout: | (launched: 2022-12-12_17:05:02.412543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:03.986650 run osmo-stp_10.42.42.5(pid=31382): stderr: | 20221212170502677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170502677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170502677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170502678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170502678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170502678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170502678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:04.115501 run osmo-stp_10.42.42.5(pid=31382): stdout: | (launched: 2022-12-12_17:05:02.412543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:04.239675 run osmo-stp_10.42.42.5(pid=31382): stderr: | 20221212170502677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170502677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170502677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170502678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170502678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170502678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170502678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:04.386662 run patchelf(pid=31387): Terminating (SIGINT) 17:05:04.555648 run patchelf(pid=31387): Terminated: ok {rc=0} 17:05:04.677422 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31382): Process ended prematurely: osmo-stp_10.42.42.5(pid=31382) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31382)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:05:04.686916 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:05:04.714334 run osmo-hlr_10.42.42.2(pid=31371): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31371)] 17:05:04.762017 run osmo-hlr_10.42.42.2(pid=31371): stdout: | (launched: 2022-12-12_17:05:01.126226) 17:05:04.811524 run osmo-hlr_10.42.42.2(pid=31371): stderr: | 20221212170501476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170501476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170501476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170501476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170501476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170501476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170501498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170501515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170501515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170501515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:05:04.861243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31363): Terminating (SIGTERM) 17:05:04.900556 run iperf3-srv_10.42.42.10(pid=31364): Terminating (SIGTERM) 17:05:04.939873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31365): Terminating (SIGTERM) 17:05:04.979144 run iperf3-srv_10.42.42.10(pid=31366): Terminating (SIGTERM) 17:05:05.018491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31370): Terminating (SIGTERM) 17:05:05.057929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31377): Terminating (SIGTERM) 17:05:05.097335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31386): Terminating (SIGTERM) 17:05:05.137070 --- ParallelTerminationStrategy: PID 31363 died... 17:05:05.155837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31363): Terminated: ok {rc=0} 17:05:05.199516 --- ParallelTerminationStrategy: PID 31364 died... 17:05:05.217737 run iperf3-srv_10.42.42.10(pid=31364): Terminated {rc=256} 17:05:05.261369 --- ParallelTerminationStrategy: PID 31365 died... 17:05:05.279652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31365): Terminated: ok {rc=0} 17:05:05.323907 --- ParallelTerminationStrategy: PID 31366 died... 17:05:05.342091 run iperf3-srv_10.42.42.10(pid=31366): Terminated {rc=256} 17:05:05.386166 --- ParallelTerminationStrategy: PID 31370 died... 17:05:05.404445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31370): Terminated: ok {rc=0} 17:05:05.448512 --- ParallelTerminationStrategy: PID 31377 died... 17:05:05.466827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31377): Terminated: ok {rc=0} 17:05:05.511023 --- ParallelTerminationStrategy: PID 31386 died... 17:05:05.529314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31386): Terminated: ok {rc=0} 17:05:05.612560 bus /gobi_0: Setting Powered False 17:05:06.711407 bus /gobi_0: Setting Powered False 17:05:07.825473 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:05:08.973902 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:08.986357 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:05:09.056835 tst iperf3.py: using LAC 30275 17:05:09.183135 tst iperf3.py: using RAC 185 17:05:09.310500 tst iperf3.py: using CellId 30275 17:05:09.438365 tst iperf3.py: using BVCI 30276 17:05:09.557406 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:09.569234 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:09.580478 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:09.591800 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:09.603081 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:09.614347 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:09.625851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:09.637080 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:09.648517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:05:09.763997 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:05:09.965829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:05:10.268304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31388): Launched 17:05:10.531674 run iperf3-srv_10.42.42.10(pid=31389): Launched 17:05:10.645362 tst iperf3.py:8: start network... 17:05:10.846789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:05:11.313546 run create_hlr_db(pid=31390): Launched 17:05:11.429407 bus /gobi_6: Setting Powered False 17:05:12.489731 run create_hlr_db(pid=31390): Terminated: ok {rc=0} 17:05:12.935820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31395): Launched 17:05:13.281727 run osmo-hlr_10.42.42.2(pid=31424): Launched 17:05:13.479276 run osmo-stp_10.42.42.5: Starting osmo-stp 17:05:14.107020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31567): Launched 17:05:14.429297 run osmo-stp_10.42.42.5(pid=31601): Launched 17:05:14.627731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:05:15.270951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31683): Launched 17:05:15.458567 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:05:15.733720 run patchelf(pid=31752): Launched 17:05:15.955540 run osmo-stp_10.42.42.5(pid=31601): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31601)] 17:05:16.087877 run osmo-stp_10.42.42.5(pid=31601): stdout: | (launched: 2022-12-12_17:05:14.372872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:16.222509 run osmo-stp_10.42.42.5(pid=31601): stderr: | 20221212170514660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170514660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170514660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170514661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170514661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170514662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170514662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:16.357640 run osmo-stp_10.42.42.5(pid=31601): stdout: | (launched: 2022-12-12_17:05:14.372872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:16.485759 run osmo-stp_10.42.42.5(pid=31601): stderr: | 20221212170514660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170514660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170514660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170514661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170514661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170514662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170514662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:16.639413 run patchelf(pid=31752): Terminating (SIGINT) 17:05:16.815877 run patchelf(pid=31752): Terminated: ok {rc=0} 17:05:16.944259 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31601): Process ended prematurely: osmo-stp_10.42.42.5(pid=31601) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31601)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 17:05:16.954471 tst iperf3.py:8: Test FAILED (8.0 sec) 17:05:16.984763 run osmo-hlr_10.42.42.2(pid=31424): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31424)] 17:05:17.035620 run osmo-hlr_10.42.42.2(pid=31424): stdout: | (launched: 2022-12-12_17:05:13.214992) 17:05:17.087997 run osmo-hlr_10.42.42.2(pid=31424): stderr: | 20221212170513470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170513470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170513470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170513470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170513470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170513470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170513486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170513502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170513502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170513502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:05:17.141720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31388): Terminating (SIGTERM) 17:05:17.184245 run iperf3-srv_10.42.42.10(pid=31389): Terminating (SIGTERM) 17:05:17.226249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31395): Terminating (SIGTERM) 17:05:17.269173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31567): Terminating (SIGTERM) 17:05:17.313214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31683): Terminating (SIGTERM) 17:05:17.357263 --- ParallelTerminationStrategy: PID 31388 died... 17:05:17.377248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31388): Terminated: ok {rc=0} 17:05:17.425358 --- ParallelTerminationStrategy: PID 31389 died... 17:05:17.445154 run iperf3-srv_10.42.42.10(pid=31389): Terminated {rc=256} 17:05:17.493099 --- ParallelTerminationStrategy: PID 31395 died... 17:05:17.512670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31395): Terminated: ok {rc=0} 17:05:17.560297 --- ParallelTerminationStrategy: PID 31567 died... 17:05:17.579925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31567): Terminated: ok {rc=0} 17:05:17.627430 --- ParallelTerminationStrategy: PID 31683 died... 17:05:17.647019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31683): Terminated: ok {rc=0} 17:05:17.737120 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:05:18.888246 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:18.900941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:05:18.970804 tst iperf3m4.py: using LAC 30276 17:05:19.100136 tst iperf3m4.py: using RAC 186 17:05:19.226848 tst iperf3m4.py: using CellId 30276 17:05:19.355851 tst iperf3m4.py: using BVCI 30277 17:05:19.473795 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:19.485872 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:19.497401 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:19.509514 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:19.521424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:19.533460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:19.545544 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:19.557418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:19.569479 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:05:19.687008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:05:19.808942 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:05:19.929819 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:05:20.047136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:05:20.250071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:05:20.554979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31753): Launched 17:05:20.819379 run iperf3-srv_10.42.42.10(pid=31754): Launched 17:05:20.933659 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:05:21.136939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:05:21.441223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31755): Launched 17:05:21.706097 run iperf3-srv_10.42.42.10(pid=31756): Launched 17:05:21.820847 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:05:22.024120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:05:22.329519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31757): Launched 17:05:22.595926 run iperf3-srv_10.42.42.10(pid=31758): Launched 17:05:22.710680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:05:22.913153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:05:23.221862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31759): Launched 17:05:23.525682 run iperf3-srv_10.42.42.10(pid=31777): Launched 17:05:23.654794 tst iperf3m4.py:8: start network... 17:05:23.862788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:05:24.356476 run create_hlr_db(pid=31935): Launched 17:05:24.506243 bus /gobi_6: Setting Powered False 17:05:25.570381 run create_hlr_db(pid=31935): Terminated: ok {rc=0} 17:05:26.032797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31938): Launched 17:05:26.377851 run osmo-hlr_10.42.42.2(pid=31939): Launched 17:05:26.631230 run osmo-stp_10.42.42.5: Starting osmo-stp 17:05:27.298384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31941): Launched 17:05:27.644764 run osmo-stp_10.42.42.5(pid=31942): Launched 17:05:27.901165 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:05:28.547733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31944): Launched 17:05:28.688338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:05:28.975830 run patchelf(pid=31945): Launched 17:05:29.172312 run osmo-stp_10.42.42.5(pid=31942): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31942)] 17:05:29.316656 run osmo-stp_10.42.42.5(pid=31942): stdout: | (launched: 2022-12-12_17:05:27.582640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:29.460139 run osmo-stp_10.42.42.5(pid=31942): stderr: | 20221212170527875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170527876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170527876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170527876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170527877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170527877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170527877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:29.604690 run osmo-stp_10.42.42.5(pid=31942): stdout: | (launched: 2022-12-12_17:05:27.582640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:29.739193 run osmo-stp_10.42.42.5(pid=31942): stderr: | 20221212170527875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170527876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170527876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170527876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170527877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170527877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170527877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:29.898279 run patchelf(pid=31945): Terminating (SIGINT) 17:05:30.080723 run patchelf(pid=31945): Terminated: ok {rc=0} 17:05:30.212281 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31942): Process ended prematurely: osmo-stp_10.42.42.5(pid=31942) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31942)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:05:30.222792 tst iperf3m4.py:8: Test FAILED (11.4 sec) 17:05:30.251847 run osmo-hlr_10.42.42.2(pid=31939): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31939)] 17:05:30.301963 run osmo-hlr_10.42.42.2(pid=31939): stdout: | (launched: 2022-12-12_17:05:26.314889) 17:05:30.354101 run osmo-hlr_10.42.42.2(pid=31939): stderr: | 20221212170526623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170526623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170526623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170526623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170526623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170526623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170526645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170526654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170526654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170526654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:05:30.406528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31753): Terminating (SIGTERM) 17:05:30.448391 run iperf3-srv_10.42.42.10(pid=31754): Terminating (SIGTERM) 17:05:30.490699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31755): Terminating (SIGTERM) 17:05:30.532636 run iperf3-srv_10.42.42.10(pid=31756): Terminating (SIGTERM) 17:05:30.574987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31757): Terminating (SIGTERM) 17:05:30.616938 run iperf3-srv_10.42.42.10(pid=31758): Terminating (SIGTERM) 17:05:30.658786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31759): Terminating (SIGTERM) 17:05:30.700698 run iperf3-srv_10.42.42.10(pid=31777): Terminating (SIGTERM) 17:05:30.742572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31938): Terminating (SIGTERM) 17:05:30.784491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31941): Terminating (SIGTERM) 17:05:30.830866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31944): Terminating (SIGTERM) 17:05:30.882700 --- ParallelTerminationStrategy: PID 31753 died... 17:05:30.903160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31753): Terminated: ok {rc=0} 17:05:30.951241 --- ParallelTerminationStrategy: PID 31754 died... 17:05:30.971426 run iperf3-srv_10.42.42.10(pid=31754): Terminated {rc=256} 17:05:31.018101 --- ParallelTerminationStrategy: PID 31755 died... 17:05:31.038244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31755): Terminated: ok {rc=0} 17:05:31.085312 --- ParallelTerminationStrategy: PID 31756 died... 17:05:31.105267 run iperf3-srv_10.42.42.10(pid=31756): Terminated {rc=256} 17:05:31.152193 --- ParallelTerminationStrategy: PID 31757 died... 17:05:31.172474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31757): Terminated: ok {rc=0} 17:05:31.219580 --- ParallelTerminationStrategy: PID 31758 died... 17:05:31.239699 run iperf3-srv_10.42.42.10(pid=31758): Terminated {rc=256} 17:05:31.286890 --- ParallelTerminationStrategy: PID 31759 died... 17:05:31.307141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31759): Terminated: ok {rc=0} 17:05:31.354364 --- ParallelTerminationStrategy: PID 31777 died... 17:05:31.374497 run iperf3-srv_10.42.42.10(pid=31777): Terminated {rc=256} 17:05:31.421609 --- ParallelTerminationStrategy: PID 31938 died... 17:05:31.442011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31938): Terminated: ok {rc=0} 17:05:31.489596 --- ParallelTerminationStrategy: PID 31941 died... 17:05:31.509805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31941): Terminated: ok {rc=0} 17:05:31.557226 --- ParallelTerminationStrategy: PID 31944 died... 17:05:31.577375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31944): Terminated: ok {rc=0} 17:05:31.671502 bus /gobi_4: Setting Powered False 17:05:32.771082 bus /gobi_4: Setting Powered False 17:05:33.888440 bus /gobi_1: Setting Powered False 17:05:34.988925 bus /gobi_1: Setting Powered False 17:05:36.105410 bus /gobi_0: Setting Powered False 17:05:37.205141 bus /gobi_0: Setting Powered False 17:05:38.322156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:05:39.425922 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:39.438492 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:05:39.508402 tst ping.py: using LAC 30277 17:05:39.636588 tst ping.py: using RAC 187 17:05:39.762003 tst ping.py: using CellId 30277 17:05:39.889203 tst ping.py: using BVCI 30278 17:05:40.006592 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:40.018358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:40.029889 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:40.041519 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:40.052881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:40.064418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:40.076109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:40.087653 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:05:40.203129 tst ping.py:19: start network... 17:05:40.406316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:05:40.874920 run create_hlr_db(pid=31947): Launched 17:05:40.992465 bus /gobi_6: Setting Powered False 17:05:42.052560 run create_hlr_db(pid=31947): Terminated: ok {rc=0} 17:05:42.494152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31949): Launched 17:05:42.818676 run osmo-hlr_10.42.42.2(pid=31950): Launched 17:05:42.943496 run osmo-stp_10.42.42.5: Starting osmo-stp 17:05:43.502295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31952): Launched 17:05:43.817679 run osmo-stp_10.42.42.5(pid=31954): Launched 17:05:43.935466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:05:44.457997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31956): Launched 17:05:44.575400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:05:44.831239 run patchelf(pid=31957): Launched 17:05:45.000846 run osmo-stp_10.42.42.5(pid=31954): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31954)] 17:05:45.128265 run osmo-stp_10.42.42.5(pid=31954): stdout: | (launched: 2022-12-12_17:05:43.761428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:45.257343 run osmo-stp_10.42.42.5(pid=31954): stderr: | 20221212170543933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170543933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170543933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170543933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170543934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170543934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170543934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:45.386459 run osmo-stp_10.42.42.5(pid=31954): stdout: | (launched: 2022-12-12_17:05:43.761428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:45.510845 run osmo-stp_10.42.42.5(pid=31954): stderr: | 20221212170543933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170543933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170543933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170543933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170543934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170543934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170543934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:45.657114 run patchelf(pid=31957): Terminating (SIGINT) 17:05:45.840017 run patchelf(pid=31957): Terminated: ok {rc=0} 17:05:45.965590 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31954): Process ended prematurely: osmo-stp_10.42.42.5(pid=31954) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31954)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 17:05:45.975821 tst ping.py:22: Test FAILED (6.5 sec) 17:05:46.006246 run osmo-hlr_10.42.42.2(pid=31950): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31950)] 17:05:46.057184 run osmo-hlr_10.42.42.2(pid=31950): stdout: | (launched: 2022-12-12_17:05:42.759128) 17:05:46.109366 run osmo-hlr_10.42.42.2(pid=31950): stderr: | 20221212170542958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170542958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170542958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170542958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170542958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170542958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170542970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170542979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170542979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170542979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:05:46.162415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31949): Terminating (SIGTERM) 17:05:46.205478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31952): Terminating (SIGTERM) 17:05:46.250060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31956): Terminating (SIGTERM) 17:05:46.295223 --- ParallelTerminationStrategy: PID 31949 died... 17:05:46.315451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31949): Terminated: ok {rc=0} 17:05:46.364858 --- ParallelTerminationStrategy: PID 31952 died... 17:05:46.384736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31952): Terminated: ok {rc=0} 17:05:46.432811 --- ParallelTerminationStrategy: PID 31956 died... 17:05:46.452701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31956): Terminated: ok {rc=0} 17:05:46.545911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:05:47.642668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:47.655110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:05:47.722732 tst ping_idle_ping.py: using LAC 30278 17:05:47.842883 tst ping_idle_ping.py: using RAC 188 17:05:47.962857 tst ping_idle_ping.py: using CellId 30278 17:05:48.082730 tst ping_idle_ping.py: using BVCI 30279 17:05:48.194284 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:48.205501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:48.216414 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:48.227702 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:48.238991 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:48.250404 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:48.261818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:05:48.272915 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:05:48.392048 tst ping_idle_ping.py:24: start network... 17:05:48.611485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:05:49.121644 run create_hlr_db(pid=31958): Launched 17:05:49.253887 bus /gobi_6: Setting Powered False 17:05:50.318009 run create_hlr_db(pid=31958): Terminated: ok {rc=0} 17:05:50.769744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31960): Launched 17:05:51.094943 run osmo-hlr_10.42.42.2(pid=31961): Launched 17:05:51.219694 run osmo-stp_10.42.42.5: Starting osmo-stp 17:05:51.781348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31963): Launched 17:05:52.104489 run osmo-stp_10.42.42.5(pid=31964): Launched 17:05:52.229359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:05:52.788804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31966): Launched 17:05:52.913431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:05:53.186354 run patchelf(pid=31967): Launched 17:05:53.366445 run osmo-stp_10.42.42.5(pid=31964): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31964)] 17:05:53.502695 run osmo-stp_10.42.42.5(pid=31964): stdout: | (launched: 2022-12-12_17:05:52.044497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:53.640722 run osmo-stp_10.42.42.5(pid=31964): stderr: | 20221212170552237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170552238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170552238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170552238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170552239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170552239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170552239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:53.778743 run osmo-stp_10.42.42.5(pid=31964): stdout: | (launched: 2022-12-12_17:05:52.044497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:05:53.910993 run osmo-stp_10.42.42.5(pid=31964): stderr: | 20221212170552237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170552238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170552238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170552238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170552239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170552239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170552239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:05:54.067588 run patchelf(pid=31967): Terminating (SIGINT) 17:05:54.247548 run patchelf(pid=31967): Terminated: ok {rc=0} 17:05:54.377439 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31964): Process ended prematurely: osmo-stp_10.42.42.5(pid=31964) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31964)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:05:54.387169 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:05:54.415397 run osmo-hlr_10.42.42.2(pid=31961): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31961)] 17:05:54.465179 run osmo-hlr_10.42.42.2(pid=31961): stdout: | (launched: 2022-12-12_17:05:51.035140) 17:05:54.517283 run osmo-hlr_10.42.42.2(pid=31961): stderr: | 20221212170551236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170551236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170551236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170551236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170551236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170551236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170551249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170551257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170551257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170551257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:05:54.569443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31960): Terminating (SIGTERM) 17:05:54.610983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31963): Terminating (SIGTERM) 17:05:54.652795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31966): Terminating (SIGTERM) 17:05:54.695011 --- ParallelTerminationStrategy: PID 31960 died... 17:05:54.715182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31960): Terminated: ok {rc=0} 17:05:54.762454 --- ParallelTerminationStrategy: PID 31963 died... 17:05:54.782040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31963): Terminated: ok {rc=0} 17:05:54.827773 --- ParallelTerminationStrategy: PID 31966 died... 17:05:54.847213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31966): Terminated: ok {rc=0} 17:05:54.935101 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:05:56.238763 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:05:56.244889 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:05:56.274701 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:05:56.313119 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:05:56.398902 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:05:56.428923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:05:56.468778 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:05:57.063838 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:05:57.114349 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:05:57.125804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:05:57.190247 tst cs_paging_gprs_active.py: using LAC 30279 17:05:57.308443 tst cs_paging_gprs_active.py: using RAC 189 17:05:57.426556 tst cs_paging_gprs_active.py: using CellId 30279 17:05:57.546357 tst cs_paging_gprs_active.py: using BVCI 30280 17:05:57.659128 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:05:57.670351 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:05:57.681336 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:05:57.692464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:05:57.703723 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:05:57.714938 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:05:57.726315 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:05:57.737666 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:05:57.749197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:05:57.869831 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:05:57.986302 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:05:58.193726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:05:58.503936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31971): Launched 17:05:58.774101 run iperf3-srv_10.42.42.10(pid=31972): Launched 17:05:58.890386 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:05:59.097060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:05:59.409616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31973): Launched 17:05:59.679763 run iperf3-srv_10.42.42.10(pid=31974): Launched 17:05:59.796187 tst cs_paging_gprs_active.py:38: start network... 17:06:00.002388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:06:00.480591 run create_hlr_db(pid=31975): Launched 17:06:00.599554 bus /gobi_6: Setting Powered False 17:06:01.660104 run create_hlr_db(pid=31975): Terminated: ok {rc=0} 17:06:02.099189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31977): Launched 17:06:02.423321 run osmo-hlr_10.42.42.2(pid=31978): Launched 17:06:02.544922 run osmo-stp_10.42.42.5: Starting osmo-stp 17:06:03.079658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31980): Launched 17:06:03.391479 run osmo-stp_10.42.42.5(pid=31981): Launched 17:06:03.511449 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:06:04.042844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31983): Launched 17:06:04.162753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:06:04.432092 run patchelf(pid=31984): Launched 17:06:04.604152 run osmo-stp_10.42.42.5(pid=31981): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31981)] 17:06:04.734531 run osmo-stp_10.42.42.5(pid=31981): stdout: | (launched: 2022-12-12_17:06:03.333660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:04.866850 run osmo-stp_10.42.42.5(pid=31981): stderr: | 20221212170603504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170603504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170603505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170603505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170603508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170603508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170603509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:04.998852 run osmo-stp_10.42.42.5(pid=31981): stdout: | (launched: 2022-12-12_17:06:03.333660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:05.124724 run osmo-stp_10.42.42.5(pid=31981): stderr: | 20221212170603504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170603504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170603505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170603505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170603508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170603508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170603509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:05.274868 run patchelf(pid=31984): Terminating (SIGINT) 17:06:05.447197 run patchelf(pid=31984): Terminated: ok {rc=0} 17:06:05.571795 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31981): Process ended prematurely: osmo-stp_10.42.42.5(pid=31981) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31981)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:06:05.581634 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 17:06:05.609506 run osmo-hlr_10.42.42.2(pid=31978): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31978)] 17:06:05.657682 run osmo-hlr_10.42.42.2(pid=31978): stdout: | (launched: 2022-12-12_17:06:02.365514) 17:06:05.707105 run osmo-hlr_10.42.42.2(pid=31978): stderr: | 20221212170602542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170602542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170602543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170602543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170602543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170602543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170602557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170602567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170602567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170602567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:06:05.757027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31971): Terminating (SIGTERM) 17:06:05.797032 run iperf3-srv_10.42.42.10(pid=31972): Terminating (SIGTERM) 17:06:05.837064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31973): Terminating (SIGTERM) 17:06:05.876982 run iperf3-srv_10.42.42.10(pid=31974): Terminating (SIGTERM) 17:06:05.916678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31977): Terminating (SIGTERM) 17:06:05.956482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31980): Terminating (SIGTERM) 17:06:05.996339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31983): Terminating (SIGTERM) 17:06:06.036479 --- ParallelTerminationStrategy: PID 31971 died... 17:06:06.055687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31971): Terminated: ok {rc=0} 17:06:06.100177 --- ParallelTerminationStrategy: PID 31972 died... 17:06:06.118559 run iperf3-srv_10.42.42.10(pid=31972): Terminated {rc=256} 17:06:06.162555 --- ParallelTerminationStrategy: PID 31973 died... 17:06:06.181275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31973): Terminated: ok {rc=0} 17:06:06.225460 --- ParallelTerminationStrategy: PID 31974 died... 17:06:06.244015 run iperf3-srv_10.42.42.10(pid=31974): Terminated {rc=256} 17:06:06.288557 --- ParallelTerminationStrategy: PID 31977 died... 17:06:06.307306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31977): Terminated: ok {rc=0} 17:06:06.351414 --- ParallelTerminationStrategy: PID 31980 died... 17:06:06.370074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31980): Terminated: ok {rc=0} 17:06:06.414307 --- ParallelTerminationStrategy: PID 31983 died... 17:06:06.433029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31983): Terminated: ok {rc=0} 17:06:06.517755 bus /gobi_0: Setting Powered False 17:06:07.618530 bus /gobi_0: Setting Powered False 17:06:08.735240 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:06:09.885800 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:09.898316 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:06:09.968015 tst iperf3.py: using LAC 30280 17:06:10.099334 tst iperf3.py: using RAC 190 17:06:10.229401 tst iperf3.py: using CellId 30280 17:06:10.358745 tst iperf3.py: using BVCI 30281 17:06:10.479829 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:10.491685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:10.503124 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:10.515095 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:10.526721 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:10.538134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:10.549717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:10.561211 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:10.572818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:06:10.694342 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:06:10.916052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:06:11.246344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31985): Launched 17:06:11.533727 run iperf3-srv_10.42.42.10(pid=31986): Launched 17:06:11.656893 tst iperf3.py:8: start network... 17:06:11.877168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:06:12.387452 run create_hlr_db(pid=31987): Launched 17:06:12.521399 bus /gobi_6: Setting Powered False 17:06:13.585745 run create_hlr_db(pid=31987): Terminated: ok {rc=0} 17:06:14.024918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31989): Launched 17:06:14.332931 run osmo-hlr_10.42.42.2(pid=31990): Launched 17:06:14.451305 run osmo-stp_10.42.42.5: Starting osmo-stp 17:06:14.984472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31992): Launched 17:06:15.293954 run osmo-stp_10.42.42.5(pid=31993): Launched 17:06:15.413092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:06:15.955220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31995): Launched 17:06:16.090707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:06:16.357813 run patchelf(pid=31996): Launched 17:06:16.588868 run osmo-stp_10.42.42.5(pid=31993): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31993)] 17:06:16.724122 run osmo-stp_10.42.42.5(pid=31993): stdout: | (launched: 2022-12-12_17:06:15.236340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:16.860187 run osmo-stp_10.42.42.5(pid=31993): stderr: | 20221212170615410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170615410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170615410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170615411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170615411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170615411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170615411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:16.996705 run osmo-stp_10.42.42.5(pid=31993): stdout: | (launched: 2022-12-12_17:06:15.236340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:17.126462 run osmo-stp_10.42.42.5(pid=31993): stderr: | 20221212170615410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170615410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170615410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170615411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170615411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170615411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170615411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:17.279945 run patchelf(pid=31996): Terminating (SIGINT) 17:06:17.456335 run patchelf(pid=31996): Terminated: ok {rc=0} 17:06:17.583170 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31993): Process ended prematurely: osmo-stp_10.42.42.5(pid=31993) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31993)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 17:06:17.593068 tst iperf3.py:8: Test FAILED (7.7 sec) 17:06:17.621318 run osmo-hlr_10.42.42.2(pid=31990): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31990)] 17:06:17.669939 run osmo-hlr_10.42.42.2(pid=31990): stdout: | (launched: 2022-12-12_17:06:14.275880) 17:06:17.720077 run osmo-hlr_10.42.42.2(pid=31990): stderr: | 20221212170614455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170614455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170614455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170614455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170614455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170614455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170614467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170614477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170614477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170614477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:06:17.770485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31985): Terminating (SIGTERM) 17:06:17.810899 run iperf3-srv_10.42.42.10(pid=31986): Terminating (SIGTERM) 17:06:17.851366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31989): Terminating (SIGTERM) 17:06:17.891806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31992): Terminating (SIGTERM) 17:06:17.932204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31995): Terminating (SIGTERM) 17:06:17.972775 --- ParallelTerminationStrategy: PID 31985 died... 17:06:17.992165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31985): Terminated: ok {rc=0} 17:06:18.037454 --- ParallelTerminationStrategy: PID 31986 died... 17:06:18.056202 run iperf3-srv_10.42.42.10(pid=31986): Terminated {rc=256} 17:06:18.101214 --- ParallelTerminationStrategy: PID 31989 died... 17:06:18.119997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31989): Terminated: ok {rc=0} 17:06:18.164821 --- ParallelTerminationStrategy: PID 31992 died... 17:06:18.184073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31992): Terminated: ok {rc=0} 17:06:18.229319 --- ParallelTerminationStrategy: PID 31995 died... 17:06:18.248239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31995): Terminated: ok {rc=0} 17:06:18.335395 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:06:19.484893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:19.496891 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:06:19.563870 tst iperf3m4.py: using LAC 30281 17:06:19.685466 tst iperf3m4.py: using RAC 191 17:06:19.820561 tst iperf3m4.py: using CellId 30281 17:06:19.951962 tst iperf3m4.py: using BVCI 30282 17:06:20.071420 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:20.083342 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:20.095109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:20.106950 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:20.119176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:20.131324 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:20.143350 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:20.155132 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:20.167049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:06:20.286073 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:06:20.409580 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:06:20.530456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:06:20.647367 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:06:20.853705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:06:21.163542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31997): Launched 17:06:21.433306 run iperf3-srv_10.42.42.10(pid=31998): Launched 17:06:21.549303 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:06:21.754815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:06:22.065346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31999): Launched 17:06:22.334633 run iperf3-srv_10.42.42.10(pid=32000): Launched 17:06:22.450418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:06:22.656434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:06:22.967240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32001): Launched 17:06:23.238971 run iperf3-srv_10.42.42.10(pid=32002): Launched 17:06:23.356645 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:06:23.562581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:06:23.872737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32003): Launched 17:06:24.143476 run iperf3-srv_10.42.42.10(pid=32004): Launched 17:06:24.261132 tst iperf3m4.py:8: start network... 17:06:24.466789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:06:24.946531 run create_hlr_db(pid=32005): Launched 17:06:25.067266 bus /gobi_6: Setting Powered False 17:06:26.128516 run create_hlr_db(pid=32005): Terminated: ok {rc=0} 17:06:26.558917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32007): Launched 17:06:26.870436 run osmo-hlr_10.42.42.2(pid=32008): Launched 17:06:26.990899 run osmo-stp_10.42.42.5: Starting osmo-stp 17:06:27.538164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32010): Launched 17:06:27.848456 run osmo-stp_10.42.42.5(pid=32011): Launched 17:06:27.969434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:06:28.499794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32013): Launched 17:06:28.618959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:06:28.879420 run patchelf(pid=32014): Launched 17:06:29.052717 run osmo-stp_10.42.42.5(pid=32011): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32011)] 17:06:29.182592 run osmo-stp_10.42.42.5(pid=32011): stdout: | (launched: 2022-12-12_17:06:27.790726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:29.314088 run osmo-stp_10.42.42.5(pid=32011): stderr: | 20221212170627964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170627965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170627965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170627965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170627966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170627966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170627966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:29.445845 run osmo-stp_10.42.42.5(pid=32011): stdout: | (launched: 2022-12-12_17:06:27.790726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:29.571711 run osmo-stp_10.42.42.5(pid=32011): stderr: | 20221212170627964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170627965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170627965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170627965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170627966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170627966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170627966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:29.720685 run patchelf(pid=32014): Terminating (SIGINT) 17:06:29.891966 run patchelf(pid=32014): Terminated: ok {rc=0} 17:06:30.015494 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32011): Process ended prematurely: osmo-stp_10.42.42.5(pid=32011) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32011)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:06:30.025336 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:06:30.053541 run osmo-hlr_10.42.42.2(pid=32008): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32008)] 17:06:30.101502 run osmo-hlr_10.42.42.2(pid=32008): stdout: | (launched: 2022-12-12_17:06:26.812507) 17:06:30.150913 run osmo-hlr_10.42.42.2(pid=32008): stderr: | 20221212170626992 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170626992 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170626992 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170626992 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170626992 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170626992 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170627004 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170627014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170627015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170627015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:06:30.200722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31997): Terminating (SIGTERM) 17:06:30.240505 run iperf3-srv_10.42.42.10(pid=31998): Terminating (SIGTERM) 17:06:30.279960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31999): Terminating (SIGTERM) 17:06:30.319641 run iperf3-srv_10.42.42.10(pid=32000): Terminating (SIGTERM) 17:06:30.359021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32001): Terminating (SIGTERM) 17:06:30.398598 run iperf3-srv_10.42.42.10(pid=32002): Terminating (SIGTERM) 17:06:30.438189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32003): Terminating (SIGTERM) 17:06:30.477833 run iperf3-srv_10.42.42.10(pid=32004): Terminating (SIGTERM) 17:06:30.517212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32007): Terminating (SIGTERM) 17:06:30.556867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32010): Terminating (SIGTERM) 17:06:30.596522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32013): Terminating (SIGTERM) 17:06:30.636213 --- ParallelTerminationStrategy: PID 31997 died... 17:06:30.655348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31997): Terminated: ok {rc=0} 17:06:30.699675 --- ParallelTerminationStrategy: PID 31998 died... 17:06:30.718146 run iperf3-srv_10.42.42.10(pid=31998): Terminated {rc=256} 17:06:30.762228 --- ParallelTerminationStrategy: PID 31999 died... 17:06:30.780760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31999): Terminated: ok {rc=0} 17:06:30.826242 --- ParallelTerminationStrategy: PID 32000 died... 17:06:30.845661 run iperf3-srv_10.42.42.10(pid=32000): Terminated {rc=256} 17:06:30.892054 --- ParallelTerminationStrategy: PID 32001 died... 17:06:30.911541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32001): Terminated: ok {rc=0} 17:06:30.957495 --- ParallelTerminationStrategy: PID 32002 died... 17:06:30.976841 run iperf3-srv_10.42.42.10(pid=32002): Terminated {rc=256} 17:06:31.023085 --- ParallelTerminationStrategy: PID 32003 died... 17:06:31.042933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32003): Terminated: ok {rc=0} 17:06:31.089296 --- ParallelTerminationStrategy: PID 32004 died... 17:06:31.108577 run iperf3-srv_10.42.42.10(pid=32004): Terminated {rc=256} 17:06:31.154699 --- ParallelTerminationStrategy: PID 32007 died... 17:06:31.174134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32007): Terminated: ok {rc=0} 17:06:31.220153 --- ParallelTerminationStrategy: PID 32010 died... 17:06:31.239749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32010): Terminated: ok {rc=0} 17:06:31.285875 --- ParallelTerminationStrategy: PID 32013 died... 17:06:31.305208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32013): Terminated: ok {rc=0} 17:06:31.392316 bus /gobi_4: Setting Powered False 17:06:32.490820 bus /gobi_4: Setting Powered False 17:06:33.608744 bus /gobi_1: Setting Powered False 17:06:34.703701 bus /gobi_1: Setting Powered False 17:06:35.818795 bus /gobi_0: Setting Powered False 17:06:36.916906 bus /gobi_0: Setting Powered False 17:06:38.033416 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:06:39.136111 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:39.148154 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:06:39.221387 tst ping.py: using LAC 30282 17:06:39.343338 tst ping.py: using RAC 192 17:06:39.461089 tst ping.py: using CellId 30282 17:06:39.578152 tst ping.py: using BVCI 30283 17:06:39.689178 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:39.700253 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:39.711419 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:39.722877 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:39.734282 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:39.745558 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:39.756870 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:39.768343 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:06:39.884465 tst ping.py:19: start network... 17:06:40.085617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:06:40.552907 run create_hlr_db(pid=32015): Launched 17:06:40.668856 bus /gobi_6: Setting Powered False 17:06:41.729486 run create_hlr_db(pid=32015): Terminated: ok {rc=0} 17:06:42.150849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32017): Launched 17:06:42.454926 run osmo-hlr_10.42.42.2(pid=32018): Launched 17:06:42.571344 run osmo-stp_10.42.42.5: Starting osmo-stp 17:06:43.108532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32020): Launched 17:06:43.411230 run osmo-stp_10.42.42.5(pid=32021): Launched 17:06:43.528601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:06:44.050978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32023): Launched 17:06:44.168657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:06:44.423922 run patchelf(pid=32024): Launched 17:06:44.593953 run osmo-stp_10.42.42.5(pid=32021): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32021)] 17:06:44.721590 run osmo-stp_10.42.42.5(pid=32021): stdout: | (launched: 2022-12-12_17:06:43.354824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:44.850922 run osmo-stp_10.42.42.5(pid=32021): stderr: | 20221212170643528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170643529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170643529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170643529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170643530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170643530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170643530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:44.980409 run osmo-stp_10.42.42.5(pid=32021): stdout: | (launched: 2022-12-12_17:06:43.354824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:45.104112 run osmo-stp_10.42.42.5(pid=32021): stderr: | 20221212170643528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170643529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170643529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170643529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170643530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170643530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170643530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:45.251000 run patchelf(pid=32024): Terminating (SIGINT) 17:06:45.419394 run patchelf(pid=32024): Terminated: ok {rc=0} 17:06:45.540548 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32021): Process ended prematurely: osmo-stp_10.42.42.5(pid=32021) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32021)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 17:06:45.549743 tst ping.py:22: Test FAILED (6.4 sec) 17:06:45.577103 run osmo-hlr_10.42.42.2(pid=32018): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32018)] 17:06:45.624933 run osmo-hlr_10.42.42.2(pid=32018): stdout: | (launched: 2022-12-12_17:06:42.398563) 17:06:45.674602 run osmo-hlr_10.42.42.2(pid=32018): stderr: | 20221212170642578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170642578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170642578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170642578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170642578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170642578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170642590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170642599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170642599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170642599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:06:45.724468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32017): Terminating (SIGTERM) 17:06:45.764259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32020): Terminating (SIGTERM) 17:06:45.804203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32023): Terminating (SIGTERM) 17:06:45.854690 --- ParallelTerminationStrategy: PID 32017 died... 17:06:45.882464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32017): Terminated: ok {rc=0} 17:06:45.939039 --- ParallelTerminationStrategy: PID 32020 died... 17:06:45.958809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32020): Terminated: ok {rc=0} 17:06:46.006426 --- ParallelTerminationStrategy: PID 32023 died... 17:06:46.026188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32023): Terminated: ok {rc=0} 17:06:46.114157 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:06:47.202495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:47.223265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:06:47.295729 tst ping_idle_ping.py: using LAC 30283 17:06:47.415627 tst ping_idle_ping.py: using RAC 193 17:06:47.534758 tst ping_idle_ping.py: using CellId 30283 17:06:47.653643 tst ping_idle_ping.py: using BVCI 30284 17:06:47.766338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:47.777672 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:47.788781 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:47.800866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:47.812636 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:47.824694 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:47.836791 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:06:47.848661 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:06:47.966120 tst ping_idle_ping.py:24: start network... 17:06:48.169820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:06:48.642954 run create_hlr_db(pid=32025): Launched 17:06:48.758006 bus /gobi_6: Setting Powered False 17:06:49.818573 run create_hlr_db(pid=32025): Terminated: ok {rc=0} 17:06:50.261727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32027): Launched 17:06:50.588662 run osmo-hlr_10.42.42.2(pid=32028): Launched 17:06:50.714074 run osmo-stp_10.42.42.5: Starting osmo-stp 17:06:51.276430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32030): Launched 17:06:51.602153 run osmo-stp_10.42.42.5(pid=32031): Launched 17:06:51.727490 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:06:52.288140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32033): Launched 17:06:52.414522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:06:52.690370 run patchelf(pid=32034): Launched 17:06:52.871550 run osmo-stp_10.42.42.5(pid=32031): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32031)] 17:06:53.008494 run osmo-stp_10.42.42.5(pid=32031): stdout: | (launched: 2022-12-12_17:06:51.541559) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:53.147353 run osmo-stp_10.42.42.5(pid=32031): stderr: | 20221212170651735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170651736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170651736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170651736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170651737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170651737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170651737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:53.287404 run osmo-stp_10.42.42.5(pid=32031): stdout: | (launched: 2022-12-12_17:06:51.541559) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:06:53.420712 run osmo-stp_10.42.42.5(pid=32031): stderr: | 20221212170651735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170651736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170651736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170651736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170651737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170651737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170651737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:06:53.578605 run patchelf(pid=32034): Terminating (SIGINT) 17:06:53.759047 run patchelf(pid=32034): Terminated: ok {rc=0} 17:06:53.888865 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32031): Process ended prematurely: osmo-stp_10.42.42.5(pid=32031) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32031)] [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:06:53.898690 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:06:53.927153 run osmo-hlr_10.42.42.2(pid=32028): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32028)] 17:06:53.977187 run osmo-hlr_10.42.42.2(pid=32028): stdout: | (launched: 2022-12-12_17:06:50.526734) 17:06:54.029098 run osmo-hlr_10.42.42.2(pid=32028): stderr: | 20221212170650728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170650728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170650728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170650728 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170650728 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170650728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170650743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170650752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170650753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170650753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:06:54.081545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32027): Terminating (SIGTERM) 17:06:54.123622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32030): Terminating (SIGTERM) 17:06:54.165731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32033): Terminating (SIGTERM) 17:06:54.208090 --- ParallelTerminationStrategy: PID 32027 died... 17:06:54.228322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32027): Terminated: ok {rc=0} 17:06:54.274852 --- ParallelTerminationStrategy: PID 32030 died... 17:06:54.294723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32030): Terminated: ok {rc=0} 17:06:54.341548 --- ParallelTerminationStrategy: PID 32033 died... 17:06:54.361303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32033): Terminated: ok {rc=0} 17:06:54.450005 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:06:55.750489 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:06:55.757192 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:06:55.787099 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:06:55.821816 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:06:55.875463 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:06:55.906114 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:06:55.943030 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:06:56.497136 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:06:56.502199 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:06:56.513697 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:06:56.578268 tst switch_tch_pdch.py: using LAC 30284 17:06:56.694567 tst switch_tch_pdch.py: using RAC 194 17:06:56.810534 tst switch_tch_pdch.py: using CellId 30284 17:06:56.927533 tst switch_tch_pdch.py: using BVCI 30285 17:06:57.047963 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:06:57.060125 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:06:57.072189 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:06:57.084710 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:06:57.097450 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:06:57.110084 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:06:57.122810 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:06:57.135326 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:06:57.254920 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:06:57.372345 tst switch_tch_pdch.py:51: start network... 17:06:57.573447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:06:58.042002 run create_hlr_db(pid=32038): Launched 17:06:58.158973 bus /gobi_6: Setting Powered False 17:06:59.219425 run create_hlr_db(pid=32038): Terminated: ok {rc=0} 17:06:59.663592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32040): Launched 17:06:59.990837 run osmo-hlr_10.42.42.2(pid=32041): Launched 17:07:00.116027 run osmo-stp_10.42.42.5: Starting osmo-stp 17:07:00.677067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32043): Launched 17:07:01.025691 run osmo-stp_10.42.42.5(pid=32044): Launched 17:07:01.262830 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:07:01.917384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32046): Launched 17:07:02.078341 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:07:02.360489 run patchelf(pid=32047): Launched 17:07:02.531704 run osmo-stp_10.42.42.5(pid=32044): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32044)] 17:07:02.660143 run osmo-stp_10.42.42.5(pid=32044): stdout: | (launched: 2022-12-12_17:07:00.959719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:02.790130 run osmo-stp_10.42.42.5(pid=32044): stderr: | 20221212170701218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170701218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170701219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170701219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170701219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170701220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170701220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:02.920119 run osmo-stp_10.42.42.5(pid=32044): stdout: | (launched: 2022-12-12_17:07:00.959719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:03.043765 run osmo-stp_10.42.42.5(pid=32044): stderr: | 20221212170701218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170701218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170701219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170701219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170701219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170701220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170701220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:03.190307 run patchelf(pid=32047): Terminating (SIGINT) 17:07:03.359425 run patchelf(pid=32047): Terminated: ok {rc=0} 17:07:03.480693 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32044): Process ended prematurely: osmo-stp_10.42.42.5(pid=32044) [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32044)] [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:07:03.489914 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 17:07:03.517252 run osmo-hlr_10.42.42.2(pid=32041): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32041)] 17:07:03.565389 run osmo-hlr_10.42.42.2(pid=32041): stdout: | (launched: 2022-12-12_17:06:59.931008) 17:07:03.615577 run osmo-hlr_10.42.42.2(pid=32041): stderr: | 20221212170700129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170700129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170700129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170700129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170700129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170700130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170700142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170700150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170700151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170700151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:07:03.665999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32040): Terminating (SIGTERM) 17:07:03.705835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32043): Terminating (SIGTERM) 17:07:03.745827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32046): Terminating (SIGTERM) 17:07:03.786064 --- ParallelTerminationStrategy: PID 32040 died... 17:07:03.805254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32040): Terminated: ok {rc=0} 17:07:03.849915 --- ParallelTerminationStrategy: PID 32043 died... 17:07:03.868766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32043): Terminated: ok {rc=0} 17:07:03.912550 --- ParallelTerminationStrategy: PID 32046 died... 17:07:03.931581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32046): Terminated: ok {rc=0} 17:07:04.018263 bus /gobi_0: Setting Powered False 17:07:05.116254 bus /gobi_0: Setting Powered False 17:07:06.231839 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:07:07.487165 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:07:07.493239 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:07:07.524351 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:07:07.560378 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:07:07.614907 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:07:07.644500 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:07:07.679763 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:07:08.238546 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:07:08.244449 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:07:08.256318 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:07:08.326840 tst switch_tch_pdch.py: using LAC 30285 17:07:08.453532 tst switch_tch_pdch.py: using RAC 195 17:07:08.581191 tst switch_tch_pdch.py: using CellId 30285 17:07:08.707627 tst switch_tch_pdch.py: using BVCI 30286 17:07:08.824490 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:07:08.836247 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:07:08.847750 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:07:08.859242 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:07:08.870666 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:07:08.882222 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:07:08.893793 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:07:08.905256 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:07:09.022378 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:07:09.142916 tst switch_tch_pdch.py:51: start network... 17:07:09.360733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:07:09.832091 run create_hlr_db(pid=32051): Launched 17:07:09.964188 bus /gobi_6: Setting Powered False 17:07:11.028622 run create_hlr_db(pid=32051): Terminated: ok {rc=0} 17:07:11.436291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32053): Launched 17:07:11.740761 run osmo-hlr_10.42.42.2(pid=32054): Launched 17:07:11.857167 run osmo-stp_10.42.42.5: Starting osmo-stp 17:07:12.355733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32056): Launched 17:07:12.660574 run osmo-stp_10.42.42.5(pid=32057): Launched 17:07:12.777441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:07:13.273713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32059): Launched 17:07:13.390225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:07:13.645636 run patchelf(pid=32060): Launched 17:07:13.815333 run osmo-stp_10.42.42.5(pid=32057): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32057)] 17:07:13.943016 run osmo-stp_10.42.42.5(pid=32057): stdout: | (launched: 2022-12-12_17:07:12.604271) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:14.072236 run osmo-stp_10.42.42.5(pid=32057): stderr: | 20221212170712775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170712775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170712776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170712776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170712776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170712776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170712777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:14.201571 run osmo-stp_10.42.42.5(pid=32057): stdout: | (launched: 2022-12-12_17:07:12.604271) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:14.325217 run osmo-stp_10.42.42.5(pid=32057): stderr: | 20221212170712775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170712775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170712776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170712776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170712776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170712776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170712777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:14.471457 run patchelf(pid=32060): Terminating (SIGINT) 17:07:14.639849 run patchelf(pid=32060): Terminated: ok {rc=0} 17:07:14.761383 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32057): Process ended prematurely: osmo-stp_10.42.42.5(pid=32057) [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32057)] [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:07:14.770329 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:07:14.797706 run osmo-hlr_10.42.42.2(pid=32054): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32054)] 17:07:14.845645 run osmo-hlr_10.42.42.2(pid=32054): stdout: | (launched: 2022-12-12_17:07:11.684172) 17:07:14.895202 run osmo-hlr_10.42.42.2(pid=32054): stderr: | 20221212170711864 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170711864 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170711864 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170711864 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170711864 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170711864 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170711874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170711883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170711883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170711883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:07:14.945310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32053): Terminating (SIGTERM) 17:07:14.985365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32056): Terminating (SIGTERM) 17:07:15.025302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32059): Terminating (SIGTERM) 17:07:15.066039 --- ParallelTerminationStrategy: PID 32053 died... 17:07:15.085220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32053): Terminated: ok {rc=0} 17:07:15.129856 --- ParallelTerminationStrategy: PID 32056 died... 17:07:15.148331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32056): Terminated: ok {rc=0} 17:07:15.193054 --- ParallelTerminationStrategy: PID 32059 died... 17:07:15.211597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32059): Terminated: ok {rc=0} 17:07:15.297811 bus /gobi_0: Setting Powered False 17:07:16.397715 bus /gobi_0: Setting Powered False 17:07:17.512617 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_sms:nanobts --------------------------------------------------------------------- 17:07:18.763748 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:07:18.768823 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 17:07:18.793782 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 17:07:18.801066 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 17:07:18.853920 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 17:07:18.878288 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 17:07:18.885275 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 17:07:19.423803 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 17:07:19.429514 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 17:07:19.440653 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 17:07:19.479740 tst mo_mt_sms.py: using LAC 30286 17:07:19.607678 tst mo_mt_sms.py: using RAC 196 17:07:19.727213 tst mo_mt_sms.py: using CellId 30286 17:07:19.846878 tst mo_mt_sms.py: using BVCI 30287 17:07:19.957912 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 17:07:20.076202 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 17:07:20.197175 tst mo_mt_sms.py:9: start nitb and bts... 17:07:20.413662 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:07:21.072893 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32065): Launched 17:07:21.398703 run osmo-nitb_10.42.42.2(pid=32066): Launched 17:07:21.579768 run osmo-nitb_10.42.42.2(pid=32066): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32066)] 17:07:21.724764 run osmo-nitb_10.42.42.2(pid=32066): stdout: | (launched: 2022-12-12_17:07:21.339044) 17:07:21.870983 run osmo-nitb_10.42.42.2(pid=32066): stderr: | (launched: 2022-12-12_17:07:21.386885) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:07:22.016856 run osmo-nitb_10.42.42.2(pid=32066): stdout: | (launched: 2022-12-12_17:07:21.339044) 17:07:22.157390 run osmo-nitb_10.42.42.2(pid=32066): stderr: | (launched: 2022-12-12_17:07:21.386885) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32066): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32066) [trial-2379↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32066)] 17:07:22.522839 tst osmo-nitb_10.42.42.2(pid=32066): stdout: | (launched: 2022-12-12_17:07:21.339044) 17:07:22.653737 tst osmo-nitb_10.42.42.2(pid=32066): stderr: | (launched: 2022-12-12_17:07:21.386885) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:07:22.806936 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32066): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32066) [trial-2379↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32066)] [trial-2379↪nitb_sms:nanobts↪mo_mt_sms.py:11] 17:07:22.816201 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 17:07:22.823609 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32065): Terminating (SIGTERM) 17:07:23.033987 --- ParallelTerminationStrategy: PID 32065 died... 17:07:23.056073 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32065): Terminated: ok {rc=0} 17:07:23.144712 bus /sierra_3: Setting Powered False 17:07:24.246177 bus /sierra_3: Setting Powered False 17:07:25.365759 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 sms:nanobts+band-1900 --------------------------------------------------------------------- 17:07:26.553710 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:07:26.559248 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 17:07:26.583964 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 17:07:26.611342 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 17:07:26.666987 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 17:07:26.691807 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 17:07:26.718619 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 17:07:27.265635 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 17:07:27.270931 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:27.282310 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:07:27.321987 tst mo_mt_sms.py: using LAC 30287 17:07:27.442160 tst mo_mt_sms.py: using RAC 197 17:07:27.562856 tst mo_mt_sms.py: using CellId 30287 17:07:27.682661 tst mo_mt_sms.py: using BVCI 30288 17:07:27.791261 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:27.802034 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:27.812593 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:27.823535 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:27.834456 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:27.845202 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 17:07:27.964064 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 17:07:28.080196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:07:28.551535 run create_hlr_db(pid=32070): Launched 17:07:28.684671 bus /sierra_2: Setting Powered False 17:07:29.748820 run create_hlr_db(pid=32070): Terminated: ok {rc=0} 17:07:30.181685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32072): Launched 17:07:30.485254 run osmo-hlr_10.42.42.2(pid=32073): Launched 17:07:30.600763 run osmo-stp_10.42.42.5: Starting osmo-stp 17:07:31.169683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32075): Launched 17:07:31.484932 run osmo-stp_10.42.42.5(pid=32076): Launched 17:07:31.728418 run osmo-msc_10.42.42.6: Starting osmo-msc 17:07:32.383430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32078): Launched 17:07:32.688375 run osmo-msc_10.42.42.6(pid=32079): Launched 17:07:32.858707 run osmo-stp_10.42.42.5(pid=32076): ERR: Terminated: ERROR {rc=1} [trial-2379↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32076)] 17:07:32.986869 run osmo-stp_10.42.42.5(pid=32076): stdout: | (launched: 2022-12-12_17:07:31.427106) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:33.115064 run osmo-stp_10.42.42.5(pid=32076): stderr: | 20221212170731759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170731760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170731760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170731760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170731768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170731768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170731768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:33.240638 run osmo-stp_10.42.42.5(pid=32076): stdout: | (launched: 2022-12-12_17:07:31.427106) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:33.360386 run osmo-stp_10.42.42.5(pid=32076): stderr: | 20221212170731759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170731760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170731760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170731760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170731768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170731768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170731768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:33.504093 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32076): Process ended prematurely: osmo-stp_10.42.42.5(pid=32076) [trial-2379↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32076)] [trial-2379↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 17:07:33.512521 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 17:07:33.539697 run osmo-hlr_10.42.42.2(pid=32073): ERR: Terminated: ERROR {rc=237} [trial-2379↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32073)] 17:07:33.587917 run osmo-hlr_10.42.42.2(pid=32073): stdout: | (launched: 2022-12-12_17:07:30.428673) 17:07:33.637652 run osmo-hlr_10.42.42.2(pid=32073): stderr: | 20221212170730608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170730608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170730608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170730608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170730608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170730608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170730620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170730629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170730629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170730629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:07:33.706622 run osmo-msc_10.42.42.6(pid=32079): ERR: Terminated: ERROR {rc=2} [trial-2379↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32079)] 17:07:33.754432 run osmo-msc_10.42.42.6(pid=32079): stdout: | (launched: 2022-12-12_17:07:32.631648) 17:07:33.803617 run osmo-msc_10.42.42.6(pid=32079): stderr: | 20221212170732906 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170732906 DLGLOBAL DEBUG validating counter group 0x7f2a81e1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170732907 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170732907 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170732907 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170732907 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170732910 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170732910 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170732910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170732910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:07:33.853295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32072): Terminating (SIGTERM) 17:07:33.893120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32075): Terminating (SIGTERM) 17:07:33.932606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32078): Terminating (SIGTERM) 17:07:33.972515 --- ParallelTerminationStrategy: PID 32072 died... 17:07:33.991452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32072): Terminated: ok {rc=0} 17:07:34.035457 --- ParallelTerminationStrategy: PID 32075 died... 17:07:34.053849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32075): Terminated: ok {rc=0} 17:07:34.097604 --- ParallelTerminationStrategy: PID 32078 died... 17:07:34.116023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32078): Terminated: ok {rc=0} 17:07:34.199859 bus /sierra_3: Setting Powered False 17:07:35.298410 bus /sierra_3: Setting Powered False 17:07:36.416524 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 17:07:37.640086 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:07:37.644848 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 17:07:37.668788 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 17:07:37.675769 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 17:07:37.711504 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 17:07:37.735101 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 17:07:37.742264 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 17:07:38.263040 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 17:07:38.268481 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 17:07:38.279800 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:07:38.319275 tst assert_extension.py: using LAC 30288 17:07:38.438168 tst assert_extension.py: using RAC 198 17:07:38.558647 tst assert_extension.py: using CellId 30288 17:07:38.678186 tst assert_extension.py: using BVCI 30289 17:07:38.789537 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 17:07:38.905156 tst assert_extension.py:10: start nitb and bts... 17:07:39.122146 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:07:39.782201 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32085): Launched 17:07:40.107580 run osmo-nitb_10.42.42.2(pid=32086): Launched 17:07:40.287938 run osmo-nitb_10.42.42.2(pid=32086): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32086)] 17:07:40.432071 run osmo-nitb_10.42.42.2(pid=32086): stdout: | (launched: 2022-12-12_17:07:40.047706) 17:07:40.578061 run osmo-nitb_10.42.42.2(pid=32086): stderr: | (launched: 2022-12-12_17:07:40.095633) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:07:40.723469 run osmo-nitb_10.42.42.2(pid=32086): stdout: | (launched: 2022-12-12_17:07:40.047706) 17:07:40.863508 run osmo-nitb_10.42.42.2(pid=32086): stderr: | (launched: 2022-12-12_17:07:40.095633) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32086): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32086) [trial-2379↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32086)] 17:07:41.230835 tst osmo-nitb_10.42.42.2(pid=32086): stdout: | (launched: 2022-12-12_17:07:40.047706) 17:07:41.360930 tst osmo-nitb_10.42.42.2(pid=32086): stderr: | (launched: 2022-12-12_17:07:40.095633) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:07:41.513853 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32086): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32086) [trial-2379↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32086)] [trial-2379↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 17:07:41.523261 tst assert_extension.py:12: Test FAILED (3.2 sec) 17:07:41.530593 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32085): Terminating (SIGTERM) 17:07:41.742092 --- ParallelTerminationStrategy: PID 32085 died... 17:07:41.764303 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32085): Terminated: ok {rc=0} 17:07:41.853298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 ussd:nanobts+band-1900 --------------------------------------------------------------------- 17:07:43.020422 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:07:43.026084 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 17:07:43.050591 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 17:07:43.077760 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 17:07:43.113347 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 17:07:43.138173 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 17:07:43.165512 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 17:07:43.692779 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 17:07:43.699735 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:43.712114 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:07:43.751234 tst assert_extension.py: using LAC 30289 17:07:43.879329 tst assert_extension.py: using RAC 199 17:07:44.005373 tst assert_extension.py: using CellId 30289 17:07:44.131228 tst assert_extension.py: using BVCI 30290 17:07:44.247999 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:44.259234 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:44.270362 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:44.281479 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:44.292523 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:07:44.303647 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 17:07:44.422556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:07:44.923242 run create_hlr_db(pid=32091): Launched 17:07:45.053806 bus /sierra_2: Setting Powered False 17:07:46.123203 run create_hlr_db(pid=32091): Terminated: ok {rc=0} 17:07:46.580734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32093): Launched 17:07:46.929734 run osmo-hlr_10.42.42.2(pid=32094): Launched 17:07:47.179420 run osmo-stp_10.42.42.5: Starting osmo-stp 17:07:47.733668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32096): Launched 17:07:48.038627 run osmo-stp_10.42.42.5(pid=32097): Launched 17:07:48.154353 run osmo-msc_10.42.42.6: Starting osmo-msc 17:07:48.702786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32099): Launched 17:07:49.007637 run osmo-msc_10.42.42.6(pid=32100): Launched 17:07:49.178704 run osmo-stp_10.42.42.5(pid=32097): ERR: Terminated: ERROR {rc=1} [trial-2379↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32097)] 17:07:49.306983 run osmo-stp_10.42.42.5(pid=32097): stdout: | (launched: 2022-12-12_17:07:47.982065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:49.435951 run osmo-stp_10.42.42.5(pid=32097): stderr: | 20221212170748153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170748153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170748153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170748154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170748154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170748154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170748154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:49.562170 run osmo-stp_10.42.42.5(pid=32097): stdout: | (launched: 2022-12-12_17:07:47.982065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:49.683344 run osmo-stp_10.42.42.5(pid=32097): stderr: | 20221212170748153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170748153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170748153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170748154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170748154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170748154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170748154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:49.827336 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32097): Process ended prematurely: osmo-stp_10.42.42.5(pid=32097) [trial-2379↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32097)] [trial-2379↪ussd:nanobts+band-1900↪assert_extension.py:17] 17:07:49.835861 tst assert_extension.py:17: Test FAILED (6.1 sec) 17:07:49.862520 run osmo-hlr_10.42.42.2(pid=32094): ERR: Terminated: ERROR {rc=237} [trial-2379↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32094)] 17:07:49.910786 run osmo-hlr_10.42.42.2(pid=32094): stdout: | (launched: 2022-12-12_17:07:46.865510) 17:07:49.960586 run osmo-hlr_10.42.42.2(pid=32094): stderr: | 20221212170747203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170747203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170747203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170747203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170747203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170747203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170747222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170747232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170747232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170747232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:07:50.029823 run osmo-msc_10.42.42.6(pid=32100): ERR: Terminated: ERROR {rc=2} [trial-2379↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32100)] 17:07:50.077919 run osmo-msc_10.42.42.6(pid=32100): stdout: | (launched: 2022-12-12_17:07:48.951323) 17:07:50.127463 run osmo-msc_10.42.42.6(pid=32100): stderr: | 20221212170749224 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170749224 DLGLOBAL DEBUG validating counter group 0x7f1b1c542c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170749224 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170749224 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170749224 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170749224 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170749226 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170749227 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170749227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170749227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:07:50.177578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32093): Terminating (SIGTERM) 17:07:50.217730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32096): Terminating (SIGTERM) 17:07:50.257828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32099): Terminating (SIGTERM) 17:07:50.298177 --- ParallelTerminationStrategy: PID 32093 died... 17:07:50.317318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32093): Terminated: ok {rc=0} 17:07:50.361832 --- ParallelTerminationStrategy: PID 32096 died... 17:07:50.380267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32096): Terminated: ok {rc=0} 17:07:50.425155 --- ParallelTerminationStrategy: PID 32099 died... 17:07:50.443795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32099): Terminated: ok {rc=0} 17:07:50.530828 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:07:51.735456 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:07:51.744794 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:07:51.770467 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:07:51.797914 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:07:51.851267 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:07:51.875926 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:07:51.903400 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:07:52.457604 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:07:52.510852 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:07:52.522820 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:07:52.584133 tst mo_mt_call.py: using LAC 30290 17:07:52.714440 tst mo_mt_call.py: using RAC 200 17:07:52.844688 tst mo_mt_call.py: using CellId 30290 17:07:52.972569 tst mo_mt_call.py: using BVCI 30291 17:07:53.091802 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:07:53.103589 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:07:53.115162 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:07:53.126715 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:07:53.138339 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:07:53.149997 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:07:53.265952 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:07:53.383024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:07:53.863525 run create_hlr_db(pid=32105): Launched 17:07:53.982047 bus /sierra_2: Setting Powered False 17:07:55.042540 run create_hlr_db(pid=32105): Terminated: ok {rc=0} 17:07:55.493646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32107): Launched 17:07:55.824833 run osmo-hlr_10.42.42.2(pid=32108): Launched 17:07:55.950900 run osmo-stp_10.42.42.5: Starting osmo-stp 17:07:56.519778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32110): Launched 17:07:56.849580 run osmo-stp_10.42.42.5(pid=32111): Launched 17:07:56.975036 run osmo-msc_10.42.42.6: Starting osmo-msc 17:07:57.573018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32113): Launched 17:07:57.904507 run osmo-msc_10.42.42.6(pid=32114): Launched 17:07:58.089537 run osmo-stp_10.42.42.5(pid=32111): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32111)] 17:07:58.226978 run osmo-stp_10.42.42.5(pid=32111): stdout: | (launched: 2022-12-12_17:07:56.789155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:58.364832 run osmo-stp_10.42.42.5(pid=32111): stderr: | 20221212170756983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170756983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170756984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170756984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170756985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170756985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170756985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:58.501955 run osmo-stp_10.42.42.5(pid=32111): stdout: | (launched: 2022-12-12_17:07:56.789155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:07:58.633096 run osmo-stp_10.42.42.5(pid=32111): stderr: | 20221212170756983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170756983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170756984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170756984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170756985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170756985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170756985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:07:58.789096 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32111): Process ended prematurely: osmo-stp_10.42.42.5(pid=32111) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32111)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:07:58.798766 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:07:58.826760 run osmo-hlr_10.42.42.2(pid=32108): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32108)] 17:07:58.876702 run osmo-hlr_10.42.42.2(pid=32108): stdout: | (launched: 2022-12-12_17:07:55.763945) 17:07:58.928592 run osmo-hlr_10.42.42.2(pid=32108): stderr: | 20221212170755966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170755966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170755966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170755966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170755966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170755966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170755979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170755987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170755987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170755987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:07:59.001095 run osmo-msc_10.42.42.6(pid=32114): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32114)] 17:07:59.051379 run osmo-msc_10.42.42.6(pid=32114): stdout: | (launched: 2022-12-12_17:07:57.843675) 17:07:59.103075 run osmo-msc_10.42.42.6(pid=32114): stderr: | 20221212170758170 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170758170 DLGLOBAL DEBUG validating counter group 0x7ff0a2e94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170758170 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170758170 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170758170 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170758170 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170758172 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170758172 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170758172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170758173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:07:59.155068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32107): Terminating (SIGTERM) 17:07:59.196667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32110): Terminating (SIGTERM) 17:07:59.238459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32113): Terminating (SIGTERM) 17:07:59.280432 --- ParallelTerminationStrategy: PID 32107 died... 17:07:59.300658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32107): Terminated: ok {rc=0} 17:07:59.347171 --- ParallelTerminationStrategy: PID 32110 died... 17:07:59.366859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32110): Terminated: ok {rc=0} 17:07:59.413093 --- ParallelTerminationStrategy: PID 32113 died... 17:07:59.432605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32113): Terminated: ok {rc=0} 17:07:59.520147 bus /sierra_3: Setting Powered False 17:08:00.619808 bus /sierra_3: Setting Powered False 17:08:01.745354 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:08:02.902191 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:08:02.914317 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:08:02.975659 tst mo_mt_call_osmux.py: using LAC 30291 17:08:03.098224 tst mo_mt_call_osmux.py: using RAC 201 17:08:03.218213 tst mo_mt_call_osmux.py: using CellId 30291 17:08:03.340646 tst mo_mt_call_osmux.py: using BVCI 30292 17:08:03.454050 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:08:03.465381 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:08:03.476374 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:08:03.488409 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:08:03.500540 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:08:03.512474 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:08:03.636220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:08:03.756480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:08:04.268652 run create_hlr_db(pid=32116): Launched 17:08:04.404139 bus /sierra_2: Setting Powered False 17:08:05.469553 run create_hlr_db(pid=32116): Terminated: ok {rc=0} 17:08:05.910247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32118): Launched 17:08:06.218750 run osmo-hlr_10.42.42.2(pid=32119): Launched 17:08:06.336583 run osmo-stp_10.42.42.5: Starting osmo-stp 17:08:06.883040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32121): Launched 17:08:07.193578 run osmo-stp_10.42.42.5(pid=32122): Launched 17:08:07.311393 run osmo-msc_10.42.42.6: Starting osmo-msc 17:08:07.869971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32124): Launched 17:08:08.181548 run osmo-msc_10.42.42.6(pid=32125): Launched 17:08:08.355559 run osmo-stp_10.42.42.5(pid=32122): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32122)] 17:08:08.485984 run osmo-stp_10.42.42.5(pid=32122): stdout: | (launched: 2022-12-12_17:08:07.136149) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:08.616133 run osmo-stp_10.42.42.5(pid=32122): stderr: | 20221212170807307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170807307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170807307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170807307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170807308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170807308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170807308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:08.744248 run osmo-stp_10.42.42.5(pid=32122): stdout: | (launched: 2022-12-12_17:08:07.136149) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:08.866539 run osmo-stp_10.42.42.5(pid=32122): stderr: | 20221212170807307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170807307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170807307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170807307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170807308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170807308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170807308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:09.013228 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32122): Process ended prematurely: osmo-stp_10.42.42.5(pid=32122) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32122)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:08:09.022377 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:08:09.049365 run osmo-hlr_10.42.42.2(pid=32119): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32119)] 17:08:09.096849 run osmo-hlr_10.42.42.2(pid=32119): stdout: | (launched: 2022-12-12_17:08:06.161520) 17:08:09.146316 run osmo-hlr_10.42.42.2(pid=32119): stderr: | 20221212170806342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170806342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170806342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170806342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170806342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170806342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170806354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170806364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170806364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170806364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:08:09.215607 run osmo-msc_10.42.42.6(pid=32125): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32125)] 17:08:09.263903 run osmo-msc_10.42.42.6(pid=32125): stdout: | (launched: 2022-12-12_17:08:08.123815) 17:08:09.313220 run osmo-msc_10.42.42.6(pid=32125): stderr: | 20221212170808399 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170808400 DLGLOBAL DEBUG validating counter group 0x7fdfbe586c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170808400 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170808400 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170808400 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170808400 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170808402 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170808402 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170808403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170808403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:08:09.363035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32118): Terminating (SIGTERM) 17:08:09.402771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32121): Terminating (SIGTERM) 17:08:09.442664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32124): Terminating (SIGTERM) 17:08:09.482641 --- ParallelTerminationStrategy: PID 32118 died... 17:08:09.501591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32118): Terminated: ok {rc=0} 17:08:09.546169 --- ParallelTerminationStrategy: PID 32121 died... 17:08:09.564675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32121): Terminated: ok {rc=0} 17:08:09.608533 --- ParallelTerminationStrategy: PID 32124 died... 17:08:09.627124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32124): Terminated: ok {rc=0} 17:08:09.711137 bus /sierra_3: Setting Powered False 17:08:10.809916 bus /sierra_3: Setting Powered False 17:08:11.928230 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:08:13.178665 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:08:13.186986 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:08:13.211780 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:08:13.239420 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:08:13.293493 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:08:13.318537 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:08:13.345972 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:08:13.897837 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:08:13.950050 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:13.961780 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:08:14.022597 tst mo_mt_call.py: using LAC 30292 17:08:14.151284 tst mo_mt_call.py: using RAC 202 17:08:14.281504 tst mo_mt_call.py: using CellId 30292 17:08:14.410354 tst mo_mt_call.py: using BVCI 30293 17:08:14.529799 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:14.541556 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:14.553071 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:14.564615 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:14.576684 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:14.588410 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:08:14.705552 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:08:14.822407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:08:15.332520 run create_hlr_db(pid=32130): Launched 17:08:15.467660 bus /sierra_2: Setting Powered False 17:08:16.532543 run create_hlr_db(pid=32130): Terminated: ok {rc=0} 17:08:16.977668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32132): Launched 17:08:17.305784 run osmo-hlr_10.42.42.2(pid=32133): Launched 17:08:17.426955 run osmo-stp_10.42.42.5: Starting osmo-stp 17:08:17.972572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32135): Launched 17:08:18.282679 run osmo-stp_10.42.42.5(pid=32136): Launched 17:08:18.402904 run osmo-msc_10.42.42.6: Starting osmo-msc 17:08:18.961397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32138): Launched 17:08:19.271576 run osmo-msc_10.42.42.6(pid=32139): Launched 17:08:19.446204 run osmo-stp_10.42.42.5(pid=32136): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32136)] 17:08:19.577444 run osmo-stp_10.42.42.5(pid=32136): stdout: | (launched: 2022-12-12_17:08:18.225132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:19.708300 run osmo-stp_10.42.42.5(pid=32136): stderr: | 20221212170818399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170818399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170818399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170818400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170818400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170818400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170818400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:19.837434 run osmo-stp_10.42.42.5(pid=32136): stdout: | (launched: 2022-12-12_17:08:18.225132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:19.960815 run osmo-stp_10.42.42.5(pid=32136): stderr: | 20221212170818399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170818399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170818399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170818400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170818400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170818400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170818400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:20.108311 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32136): Process ended prematurely: osmo-stp_10.42.42.5(pid=32136) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32136)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:08:20.117465 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:08:20.144737 run osmo-hlr_10.42.42.2(pid=32133): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32133)] 17:08:20.194145 run osmo-hlr_10.42.42.2(pid=32133): stdout: | (launched: 2022-12-12_17:08:17.248323) 17:08:20.244092 run osmo-hlr_10.42.42.2(pid=32133): stderr: | 20221212170817426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170817426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170817426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170817426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170817426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170817426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170817438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170817446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170817446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170817446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:08:20.313777 run osmo-msc_10.42.42.6(pid=32139): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32139)] 17:08:20.361693 run osmo-msc_10.42.42.6(pid=32139): stdout: | (launched: 2022-12-12_17:08:19.213967) 17:08:20.410995 run osmo-msc_10.42.42.6(pid=32139): stderr: | 20221212170819487 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170819487 DLGLOBAL DEBUG validating counter group 0x7f9bd4d50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170819487 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170819488 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170819488 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170819488 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170819490 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170819490 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170819490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170819490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:08:20.460596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32132): Terminating (SIGTERM) 17:08:20.500176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32135): Terminating (SIGTERM) 17:08:20.540034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32138): Terminating (SIGTERM) 17:08:20.580139 --- ParallelTerminationStrategy: PID 32132 died... 17:08:20.599345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32132): Terminated: ok {rc=0} 17:08:20.643559 --- ParallelTerminationStrategy: PID 32135 died... 17:08:20.662103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32135): Terminated: ok {rc=0} 17:08:20.706216 --- ParallelTerminationStrategy: PID 32138 died... 17:08:20.724805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32138): Terminated: ok {rc=0} 17:08:20.809338 bus /sierra_3: Setting Powered False 17:08:21.908230 bus /sierra_3: Setting Powered False 17:08:23.025224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:08:24.176418 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:24.189128 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:08:24.256782 tst mo_mt_call_osmux.py: using LAC 30293 17:08:24.386422 tst mo_mt_call_osmux.py: using RAC 203 17:08:24.514175 tst mo_mt_call_osmux.py: using CellId 30293 17:08:24.641773 tst mo_mt_call_osmux.py: using BVCI 30294 17:08:24.754503 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:24.766077 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:24.777366 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:24.788995 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:24.800584 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:08:24.812129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:08:24.933412 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:08:25.055438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:08:25.567000 run create_hlr_db(pid=32141): Launched 17:08:25.701821 bus /sierra_2: Setting Powered False 17:08:26.762840 run create_hlr_db(pid=32141): Terminated: ok {rc=0} 17:08:27.221851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32143): Launched 17:08:27.553274 run osmo-hlr_10.42.42.2(pid=32144): Launched 17:08:27.680051 run osmo-stp_10.42.42.5: Starting osmo-stp 17:08:28.251030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32146): Launched 17:08:28.579697 run osmo-stp_10.42.42.5(pid=32147): Launched 17:08:28.706167 run osmo-msc_10.42.42.6: Starting osmo-msc 17:08:29.304143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32149): Launched 17:08:29.636409 run osmo-msc_10.42.42.6(pid=32150): Launched 17:08:29.820639 run osmo-stp_10.42.42.5(pid=32147): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32147)] 17:08:29.958912 run osmo-stp_10.42.42.5(pid=32147): stdout: | (launched: 2022-12-12_17:08:28.519107) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:30.098351 run osmo-stp_10.42.42.5(pid=32147): stderr: | 20221212170828714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170828714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170828714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170828715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170828715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170828715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170828715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:30.236283 run osmo-stp_10.42.42.5(pid=32147): stdout: | (launched: 2022-12-12_17:08:28.519107) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:30.367152 run osmo-stp_10.42.42.5(pid=32147): stderr: | 20221212170828714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170828714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170828714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170828715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170828715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170828715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170828715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:30.523649 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32147): Process ended prematurely: osmo-stp_10.42.42.5(pid=32147) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32147)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:08:30.533314 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:08:30.561301 run osmo-hlr_10.42.42.2(pid=32144): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32144)] 17:08:30.611824 run osmo-hlr_10.42.42.2(pid=32144): stdout: | (launched: 2022-12-12_17:08:27.491925) 17:08:30.663725 run osmo-hlr_10.42.42.2(pid=32144): stderr: | 20221212170827693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170827693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170827693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170827693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170827693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170827693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170827706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170827715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170827715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170827715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:08:30.736019 run osmo-msc_10.42.42.6(pid=32150): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32150)] 17:08:30.786076 run osmo-msc_10.42.42.6(pid=32150): stdout: | (launched: 2022-12-12_17:08:29.574850) 17:08:30.856479 run osmo-msc_10.42.42.6(pid=32150): stderr: | 20221212170829902 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170829902 DLGLOBAL DEBUG validating counter group 0x7f6a5b94bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170829902 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170829902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170829903 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170829903 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170829905 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170829905 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170829905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170829905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:08:30.922714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32143): Terminating (SIGTERM) 17:08:30.965924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32146): Terminating (SIGTERM) 17:08:31.010496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32149): Terminating (SIGTERM) 17:08:31.055298 --- ParallelTerminationStrategy: PID 32143 died... 17:08:31.075790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32143): Terminated: ok {rc=0} 17:08:31.124275 --- ParallelTerminationStrategy: PID 32146 died... 17:08:31.144468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32146): Terminated: ok {rc=0} 17:08:31.191110 --- ParallelTerminationStrategy: PID 32149 died... 17:08:31.211290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32149): Terminated: ok {rc=0} 17:08:31.301065 bus /sierra_3: Setting Powered False 17:08:32.400465 bus /sierra_3: Setting Powered False 17:08:33.515355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:08:34.760354 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:08:34.767923 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:08:34.792270 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:08:34.819163 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:08:34.868764 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:08:34.892531 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:08:34.919061 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:08:35.476210 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:08:35.526865 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:35.538200 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:08:35.596494 tst mo_mt_call.py: using LAC 30294 17:08:35.715036 tst mo_mt_call.py: using RAC 204 17:08:35.834315 tst mo_mt_call.py: using CellId 30294 17:08:35.955519 tst mo_mt_call.py: using BVCI 30295 17:08:36.069638 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:36.080768 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:36.091898 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:36.103278 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:36.114875 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:36.126254 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:08:36.242534 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:08:36.359343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:08:36.837108 run create_hlr_db(pid=32155): Launched 17:08:36.954644 bus /sierra_2: Setting Powered False 17:08:38.015830 run create_hlr_db(pid=32155): Terminated: ok {rc=0} 17:08:38.444940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32157): Launched 17:08:38.754361 run osmo-hlr_10.42.42.2(pid=32158): Launched 17:08:38.872888 run osmo-stp_10.42.42.5: Starting osmo-stp 17:08:39.416159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32160): Launched 17:08:39.748155 run osmo-stp_10.42.42.5(pid=32161): Launched 17:08:39.874555 run osmo-msc_10.42.42.6: Starting osmo-msc 17:08:40.470409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32163): Launched 17:08:40.800142 run osmo-msc_10.42.42.6(pid=32164): Launched 17:08:40.984230 run osmo-stp_10.42.42.5(pid=32161): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32161)] 17:08:41.122163 run osmo-stp_10.42.42.5(pid=32161): stdout: | (launched: 2022-12-12_17:08:39.687459) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:41.260114 run osmo-stp_10.42.42.5(pid=32161): stderr: | 20221212170839882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170839882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170839882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170839883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170839883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170839883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170839883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:41.397830 run osmo-stp_10.42.42.5(pid=32161): stdout: | (launched: 2022-12-12_17:08:39.687459) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:41.528444 run osmo-stp_10.42.42.5(pid=32161): stderr: | 20221212170839882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170839882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170839882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170839883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170839883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170839883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170839883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:41.685346 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32161): Process ended prematurely: osmo-stp_10.42.42.5(pid=32161) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32161)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:08:41.695251 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:08:41.723802 run osmo-hlr_10.42.42.2(pid=32158): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32158)] 17:08:41.774300 run osmo-hlr_10.42.42.2(pid=32158): stdout: | (launched: 2022-12-12_17:08:38.696835) 17:08:41.826468 run osmo-hlr_10.42.42.2(pid=32158): stderr: | 20221212170838874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170838874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170838874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170838874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170838874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170838874 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170838886 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170838896 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170838897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170838897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:08:41.899401 run osmo-msc_10.42.42.6(pid=32164): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32164)] 17:08:41.949722 run osmo-msc_10.42.42.6(pid=32164): stdout: | (launched: 2022-12-12_17:08:40.739471) 17:08:42.001451 run osmo-msc_10.42.42.6(pid=32164): stderr: | 20221212170841063 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170841063 DLGLOBAL DEBUG validating counter group 0x7f992a202c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170841063 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170841063 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170841064 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170841064 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170841065 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170841066 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170841066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170841066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:08:42.053624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32157): Terminating (SIGTERM) 17:08:42.095564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32160): Terminating (SIGTERM) 17:08:42.137575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32163): Terminating (SIGTERM) 17:08:42.179637 --- ParallelTerminationStrategy: PID 32157 died... 17:08:42.199664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32157): Terminated: ok {rc=0} 17:08:42.246196 --- ParallelTerminationStrategy: PID 32160 died... 17:08:42.265928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32160): Terminated: ok {rc=0} 17:08:42.312006 --- ParallelTerminationStrategy: PID 32163 died... 17:08:42.331673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32163): Terminated: ok {rc=0} 17:08:42.420410 bus /sierra_3: Setting Powered False 17:08:43.519787 bus /sierra_3: Setting Powered False 17:08:44.635841 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:08:45.786652 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:45.799348 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:08:45.887782 tst mo_mt_call_osmux.py: using LAC 30295 17:08:46.043791 tst mo_mt_call_osmux.py: using RAC 205 17:08:46.219617 tst mo_mt_call_osmux.py: using CellId 30295 17:08:46.365082 tst mo_mt_call_osmux.py: using BVCI 30296 17:08:46.496083 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:46.513939 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:46.529290 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:46.543817 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:46.556857 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:08:46.571689 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:08:46.714817 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:08:46.852939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:08:47.468013 run create_hlr_db(pid=32226): Launched 17:08:47.695704 bus /sierra_2: Setting Powered False 17:08:48.783336 run create_hlr_db(pid=32226): Terminated: ok {rc=0} 17:08:49.289883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32437): Launched 17:08:49.636807 run osmo-hlr_10.42.42.2(pid=32438): Launched 17:08:49.892107 run osmo-stp_10.42.42.5: Starting osmo-stp 17:08:50.550309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32440): Launched 17:08:50.898104 run osmo-stp_10.42.42.5(pid=32441): Launched 17:08:51.148179 run osmo-msc_10.42.42.6: Starting osmo-msc 17:08:51.823516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32445): Launched 17:08:52.155711 run osmo-msc_10.42.42.6(pid=32446): Launched 17:08:52.509644 run osmo-stp_10.42.42.5(pid=32441): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32441)] 17:08:52.785428 run osmo-stp_10.42.42.5(pid=32441): stdout: | (launched: 2022-12-12_17:08:50.836204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:53.059605 run osmo-stp_10.42.42.5(pid=32441): stderr: | 20221212170851133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170851133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170851133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170851134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170851134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170851134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170851134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:53.216695 run osmo-stp_10.42.42.5(pid=32441): stdout: | (launched: 2022-12-12_17:08:50.836204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:08:53.343314 run osmo-stp_10.42.42.5(pid=32441): stderr: | 20221212170851133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170851133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170851133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170851134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170851134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170851134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170851134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:08:53.493974 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32441): Process ended prematurely: osmo-stp_10.42.42.5(pid=32441) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32441)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:08:53.504182 tst mo_mt_call_osmux.py:8: Test FAILED (7.8 sec) 17:08:53.535805 run osmo-hlr_10.42.42.2(pid=32438): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32438)] 17:08:53.586768 run osmo-hlr_10.42.42.2(pid=32438): stdout: | (launched: 2022-12-12_17:08:49.575443) 17:08:53.638604 run osmo-hlr_10.42.42.2(pid=32438): stderr: | 20221212170849886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170849886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170849886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170849886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170849886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170849886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170849903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170849916 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170849916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170849916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:08:53.711048 run osmo-msc_10.42.42.6(pid=32446): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32446)] 17:08:53.763753 run osmo-msc_10.42.42.6(pid=32446): stdout: | (launched: 2022-12-12_17:08:52.095903) 17:08:53.816048 run osmo-msc_10.42.42.6(pid=32446): stderr: | 20221212170852683 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170852684 DLGLOBAL DEBUG validating counter group 0x7fc6393a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170852684 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170852684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170852684 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170852684 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170852686 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170852686 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170852686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170852687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:08:53.868713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32437): Terminating (SIGTERM) 17:08:53.911686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32440): Terminating (SIGTERM) 17:08:53.957329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32445): Terminating (SIGTERM) 17:08:54.002556 --- ParallelTerminationStrategy: PID 32437 died... 17:08:54.023227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32437): Terminated: ok {rc=0} 17:08:54.073294 --- ParallelTerminationStrategy: PID 32440 died... 17:08:54.093270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32440): Terminated: ok {rc=0} 17:08:54.141973 --- ParallelTerminationStrategy: PID 32445 died... 17:08:54.161999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32445): Terminated: ok {rc=0} 17:08:54.250831 bus /sierra_3: Setting Powered False 17:08:55.352350 bus /sierra_3: Setting Powered False 17:08:56.468565 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:08:57.721478 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:08:57.730156 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:08:57.760013 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:08:57.789465 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:08:57.840901 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:08:57.866077 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:08:57.895709 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:08:58.448335 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:08:58.504730 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:08:58.518389 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:08:58.581923 tst mo_mt_call.py: using LAC 30296 17:08:58.705688 tst mo_mt_call.py: using RAC 206 17:08:58.830708 tst mo_mt_call.py: using CellId 30296 17:08:58.958502 tst mo_mt_call.py: using BVCI 30297 17:08:59.073833 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:08:59.086181 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:08:59.098776 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:08:59.114328 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:08:59.128139 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:08:59.140311 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:08:59.262823 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:08:59.385240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:08:59.882188 run create_hlr_db(pid=32451): Launched 17:09:00.043984 bus /sierra_2: Setting Powered False 17:09:01.135563 run create_hlr_db(pid=32451): Terminated: ok {rc=0} 17:09:01.646288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32453): Launched 17:09:02.022417 run osmo-hlr_10.42.42.2(pid=32454): Launched 17:09:02.278886 run osmo-stp_10.42.42.5: Starting osmo-stp 17:09:03.077673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32456): Launched 17:09:03.420595 run osmo-stp_10.42.42.5(pid=32457): Launched 17:09:03.673454 run osmo-msc_10.42.42.6: Starting osmo-msc 17:09:04.348308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32459): Launched 17:09:04.695157 run osmo-msc_10.42.42.6(pid=32460): Launched 17:09:05.059921 run osmo-stp_10.42.42.5(pid=32457): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32457)] 17:09:05.356458 run osmo-stp_10.42.42.5(pid=32457): stdout: | (launched: 2022-12-12_17:09:03.359204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:05.520030 run osmo-stp_10.42.42.5(pid=32457): stderr: | 20221212170903655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170903655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170903656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170903656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170903657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170903657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170903657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:05.660402 run osmo-stp_10.42.42.5(pid=32457): stdout: | (launched: 2022-12-12_17:09:03.359204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:05.794818 run osmo-stp_10.42.42.5(pid=32457): stderr: | 20221212170903655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170903655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170903656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170903656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170903657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170903657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170903657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:05.955568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32457): Process ended prematurely: osmo-stp_10.42.42.5(pid=32457) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32457)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:09:05.966864 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 17:09:05.996253 run osmo-hlr_10.42.42.2(pid=32454): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32454)] 17:09:06.048941 run osmo-hlr_10.42.42.2(pid=32454): stdout: | (launched: 2022-12-12_17:09:01.959006) 17:09:06.103192 run osmo-hlr_10.42.42.2(pid=32454): stderr: | 20221212170902288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170902288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170902288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170902288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170902288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170902288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170902310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170902330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170902330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170902331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:09:06.178492 run osmo-msc_10.42.42.6(pid=32460): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32460)] 17:09:06.230529 run osmo-msc_10.42.42.6(pid=32460): stdout: | (launched: 2022-12-12_17:09:04.634002) 17:09:06.285274 run osmo-msc_10.42.42.6(pid=32460): stderr: | 20221212170905134 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170905134 DLGLOBAL DEBUG validating counter group 0x7fb3f05b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170905134 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170905134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170905135 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170905135 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170905136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170905137 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170905137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170905137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:09:06.339500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32453): Terminating (SIGTERM) 17:09:06.383797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32456): Terminating (SIGTERM) 17:09:06.430164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32459): Terminating (SIGTERM) 17:09:06.476301 --- ParallelTerminationStrategy: PID 32453 died... 17:09:06.497308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32453): Terminated: ok {rc=0} 17:09:06.546376 --- ParallelTerminationStrategy: PID 32456 died... 17:09:06.567358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32456): Terminated: ok {rc=0} 17:09:06.615213 --- ParallelTerminationStrategy: PID 32459 died... 17:09:06.635760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32459): Terminated: ok {rc=0} 17:09:06.726009 bus /sierra_3: Setting Powered False 17:09:07.829148 bus /sierra_3: Setting Powered False 17:09:08.946216 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:09:10.098239 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:09:10.111600 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:09:10.175819 tst mo_mt_call_osmux.py: using LAC 30297 17:09:10.302175 tst mo_mt_call_osmux.py: using RAC 207 17:09:10.430371 tst mo_mt_call_osmux.py: using CellId 30297 17:09:10.559589 tst mo_mt_call_osmux.py: using BVCI 30298 17:09:10.679675 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:09:10.691961 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:09:10.704207 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:09:10.717707 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:09:10.732183 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:09:10.745517 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:09:10.879736 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:09:11.001360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:09:11.511123 run create_hlr_db(pid=32463): Launched 17:09:11.646461 bus /sierra_2: Setting Powered False 17:09:12.710677 run create_hlr_db(pid=32463): Terminated: ok {rc=0} 17:09:13.149471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32465): Launched 17:09:13.458238 run osmo-hlr_10.42.42.2(pid=32466): Launched 17:09:13.576905 run osmo-stp_10.42.42.5: Starting osmo-stp 17:09:14.121428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32468): Launched 17:09:14.432745 run osmo-stp_10.42.42.5(pid=32469): Launched 17:09:14.551310 run osmo-msc_10.42.42.6: Starting osmo-msc 17:09:15.109594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32471): Launched 17:09:15.419964 run osmo-msc_10.42.42.6(pid=32472): Launched 17:09:15.596334 run osmo-stp_10.42.42.5(pid=32469): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32469)] 17:09:15.726849 run osmo-stp_10.42.42.5(pid=32469): stdout: | (launched: 2022-12-12_17:09:14.375353) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:15.858602 run osmo-stp_10.42.42.5(pid=32469): stderr: | 20221212170914549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170914549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170914550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170914550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170914550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170914551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170914551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:16.003272 run osmo-stp_10.42.42.5(pid=32469): stdout: | (launched: 2022-12-12_17:09:14.375353) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:16.128279 run osmo-stp_10.42.42.5(pid=32469): stderr: | 20221212170914549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170914549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170914550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170914550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170914550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170914551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170914551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:16.278309 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32469): Process ended prematurely: osmo-stp_10.42.42.5(pid=32469) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32469)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:09:16.288398 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:09:16.318929 run osmo-hlr_10.42.42.2(pid=32466): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32466)] 17:09:16.369697 run osmo-hlr_10.42.42.2(pid=32466): stdout: | (launched: 2022-12-12_17:09:13.401128) 17:09:16.421832 run osmo-hlr_10.42.42.2(pid=32466): stderr: | 20221212170913581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170913581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170913581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170913581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170913581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170913581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170913594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170913603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170913603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170913603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:09:16.493927 run osmo-msc_10.42.42.6(pid=32472): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32472)] 17:09:16.543617 run osmo-msc_10.42.42.6(pid=32472): stdout: | (launched: 2022-12-12_17:09:15.362558) 17:09:16.596935 run osmo-msc_10.42.42.6(pid=32472): stderr: | 20221212170915634 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170915635 DLGLOBAL DEBUG validating counter group 0x7f50235b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170915635 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170915635 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170915635 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170915635 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170915637 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170915637 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170915637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170915638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:09:16.649254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32465): Terminating (SIGTERM) 17:09:16.691359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32468): Terminating (SIGTERM) 17:09:16.734013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32471): Terminating (SIGTERM) 17:09:16.777973 --- ParallelTerminationStrategy: PID 32465 died... 17:09:16.797840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32465): Terminated: ok {rc=0} 17:09:16.845742 --- ParallelTerminationStrategy: PID 32468 died... 17:09:16.865429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32468): Terminated: ok {rc=0} 17:09:16.913159 --- ParallelTerminationStrategy: PID 32471 died... 17:09:16.932779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32471): Terminated: ok {rc=0} 17:09:17.021700 bus /sierra_3: Setting Powered False 17:09:18.118790 bus /sierra_3: Setting Powered False 17:09:19.233392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:09:20.472060 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:09:20.479656 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:09:20.503250 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:09:20.531069 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:09:20.583734 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:09:20.607707 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:09:20.634442 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:09:21.187035 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:09:21.235729 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:21.247256 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:09:21.307244 tst mo_mt_call.py: using LAC 30298 17:09:21.426591 tst mo_mt_call.py: using RAC 208 17:09:21.546643 tst mo_mt_call.py: using CellId 30298 17:09:21.666410 tst mo_mt_call.py: using BVCI 30299 17:09:21.779837 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:21.791143 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:21.802543 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:21.814210 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:21.825442 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:21.836474 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:09:21.960664 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:09:22.079898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:09:22.558532 run create_hlr_db(pid=32479): Launched 17:09:22.677597 bus /sierra_2: Setting Powered False 17:09:23.738996 run create_hlr_db(pid=32479): Terminated: ok {rc=0} 17:09:24.188805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32481): Launched 17:09:24.520031 run osmo-hlr_10.42.42.2(pid=32482): Launched 17:09:24.648570 run osmo-stp_10.42.42.5: Starting osmo-stp 17:09:25.186688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32484): Launched 17:09:25.497005 run osmo-stp_10.42.42.5(pid=32485): Launched 17:09:25.614940 run osmo-msc_10.42.42.6: Starting osmo-msc 17:09:26.177475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32487): Launched 17:09:26.488827 run osmo-msc_10.42.42.6(pid=32488): Launched 17:09:26.663049 run osmo-stp_10.42.42.5(pid=32485): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32485)] 17:09:26.794325 run osmo-stp_10.42.42.5(pid=32485): stdout: | (launched: 2022-12-12_17:09:25.439508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:26.925828 run osmo-stp_10.42.42.5(pid=32485): stderr: | 20221212170925613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170925613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170925614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170925614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170925614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170925614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170925615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:27.054656 run osmo-stp_10.42.42.5(pid=32485): stdout: | (launched: 2022-12-12_17:09:25.439508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:27.177726 run osmo-stp_10.42.42.5(pid=32485): stderr: | 20221212170925613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170925613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170925614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170925614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170925614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170925614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170925615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:27.325214 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32485): Process ended prematurely: osmo-stp_10.42.42.5(pid=32485) [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32485)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:09:27.334500 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:09:27.361357 run osmo-hlr_10.42.42.2(pid=32482): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32482)] 17:09:27.410161 run osmo-hlr_10.42.42.2(pid=32482): stdout: | (launched: 2022-12-12_17:09:24.459404) 17:09:27.459927 run osmo-hlr_10.42.42.2(pid=32482): stderr: | 20221212170924660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170924660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170924660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170924660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170924660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170924660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170924672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170924680 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170924681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170924681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:09:27.529467 run osmo-msc_10.42.42.6(pid=32488): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32488)] 17:09:27.577266 run osmo-msc_10.42.42.6(pid=32488): stdout: | (launched: 2022-12-12_17:09:26.430402) 17:09:27.627466 run osmo-msc_10.42.42.6(pid=32488): stderr: | 20221212170926706 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170926706 DLGLOBAL DEBUG validating counter group 0x7f68c4c6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170926706 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170926706 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170926706 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170926707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170926710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170926710 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170926711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170926711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:09:27.677403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32481): Terminating (SIGTERM) 17:09:27.717585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32484): Terminating (SIGTERM) 17:09:27.757946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32487): Terminating (SIGTERM) 17:09:27.797796 --- ParallelTerminationStrategy: PID 32481 died... 17:09:27.817385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32481): Terminated: ok {rc=0} 17:09:27.861961 --- ParallelTerminationStrategy: PID 32484 died... 17:09:27.880381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32484): Terminated: ok {rc=0} 17:09:27.924491 --- ParallelTerminationStrategy: PID 32487 died... 17:09:27.943467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32487): Terminated: ok {rc=0} 17:09:28.029651 bus /sierra_3: Setting Powered False 17:09:29.128784 bus /sierra_3: Setting Powered False 17:09:30.243774 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:09:31.423029 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:31.436306 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:09:31.530621 tst mo_mt_call_osmux.py: using LAC 30299 17:09:31.653771 tst mo_mt_call_osmux.py: using RAC 209 17:09:31.777780 tst mo_mt_call_osmux.py: using CellId 30299 17:09:31.901411 tst mo_mt_call_osmux.py: using BVCI 30300 17:09:32.040158 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:32.053233 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:32.065658 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:32.079052 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:32.091524 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:09:32.105441 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:09:32.226185 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:09:32.350875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:09:32.830519 run create_hlr_db(pid=32490): Launched 17:09:32.951426 bus /sierra_2: Setting Powered False 17:09:34.012445 run create_hlr_db(pid=32490): Terminated: ok {rc=0} 17:09:34.450913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32492): Launched 17:09:34.784104 run osmo-hlr_10.42.42.2(pid=32493): Launched 17:09:34.911650 run osmo-stp_10.42.42.5: Starting osmo-stp 17:09:35.484188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32495): Launched 17:09:35.816642 run osmo-stp_10.42.42.5(pid=32496): Launched 17:09:35.944674 run osmo-msc_10.42.42.6: Starting osmo-msc 17:09:36.546504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32498): Launched 17:09:36.879407 run osmo-msc_10.42.42.6(pid=32499): Launched 17:09:37.065275 run osmo-stp_10.42.42.5(pid=32496): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32496)] 17:09:37.204128 run osmo-stp_10.42.42.5(pid=32496): stdout: | (launched: 2022-12-12_17:09:35.755658) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:37.343699 run osmo-stp_10.42.42.5(pid=32496): stderr: | 20221212170935949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170935949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170935950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170935950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170935952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170935952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170935952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:37.481876 run osmo-stp_10.42.42.5(pid=32496): stdout: | (launched: 2022-12-12_17:09:35.755658) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:37.614037 run osmo-stp_10.42.42.5(pid=32496): stderr: | 20221212170935949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170935949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170935950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170935950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170935952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170935952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170935952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:37.771550 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32496): Process ended prematurely: osmo-stp_10.42.42.5(pid=32496) [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32496)] [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:09:37.781259 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:09:37.809768 run osmo-hlr_10.42.42.2(pid=32493): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32493)] 17:09:37.860351 run osmo-hlr_10.42.42.2(pid=32493): stdout: | (launched: 2022-12-12_17:09:34.723345) 17:09:37.912485 run osmo-hlr_10.42.42.2(pid=32493): stderr: | 20221212170934923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170934924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170934924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170934924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170934924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170934924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170934936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170934945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170934945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170934945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:09:37.985373 run osmo-msc_10.42.42.6(pid=32499): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32499)] 17:09:38.035906 run osmo-msc_10.42.42.6(pid=32499): stdout: | (launched: 2022-12-12_17:09:36.818325) 17:09:38.087973 run osmo-msc_10.42.42.6(pid=32499): stderr: | 20221212170937144 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170937144 DLGLOBAL DEBUG validating counter group 0x7f5ae0567c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170937144 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170937144 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170937145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170937145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170937146 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170937147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170937147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170937147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:09:38.140617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32492): Terminating (SIGTERM) 17:09:38.182656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32495): Terminating (SIGTERM) 17:09:38.224806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32498): Terminating (SIGTERM) 17:09:38.267192 --- ParallelTerminationStrategy: PID 32492 died... 17:09:38.287526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32492): Terminated: ok {rc=0} 17:09:38.334223 --- ParallelTerminationStrategy: PID 32495 died... 17:09:38.354106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32495): Terminated: ok {rc=0} 17:09:38.400310 --- ParallelTerminationStrategy: PID 32498 died... 17:09:38.420226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32498): Terminated: ok {rc=0} 17:09:38.509967 bus /sierra_3: Setting Powered False 17:09:39.609562 bus /sierra_3: Setting Powered False 17:09:40.726629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 emergency:nanobts+band-1900 --------------------------------------------------------------------- 17:09:41.965065 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:09:41.970533 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 17:09:41.994532 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 17:09:42.021622 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 17:09:42.106464 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 17:09:42.130134 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 17:09:42.156609 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 17:09:42.741837 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2379 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 17:09:42.748200 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:42.760039 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:09:42.798930 tst emergency_mo_mt_call.py: using LAC 30300 17:09:42.918879 tst emergency_mo_mt_call.py: using RAC 210 17:09:43.038011 tst emergency_mo_mt_call.py: using CellId 30300 17:09:43.158037 tst emergency_mo_mt_call.py: using BVCI 30301 17:09:43.270210 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:43.281041 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:43.291763 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:43.302389 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:43.312998 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:43.323539 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:09:43.441918 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:09:43.563066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:09:44.067839 run create_hlr_db(pid=32504): Launched 17:09:44.202053 bus /sierra_2: Setting Powered False 17:09:45.266733 run create_hlr_db(pid=32504): Terminated: ok {rc=0} 17:09:45.718835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32506): Launched 17:09:46.074275 run osmo-hlr_10.42.42.2(pid=32507): Launched 17:09:46.294279 run osmo-stp_10.42.42.5: Starting osmo-stp 17:09:46.967885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32509): Launched 17:09:47.280785 run osmo-stp_10.42.42.5(pid=32510): Launched 17:09:47.407896 tst emergency_mo_mt_call.py: using MSISDN 7874 17:09:47.563215 run osmo-msc_10.42.42.6: Starting osmo-msc 17:09:48.109970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32512): Launched 17:09:48.414818 run osmo-msc_10.42.42.6(pid=32513): Launched 17:09:48.587043 run osmo-stp_10.42.42.5(pid=32510): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32510)] 17:09:48.715751 run osmo-stp_10.42.42.5(pid=32510): stdout: | (launched: 2022-12-12_17:09:47.223805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:48.843870 run osmo-stp_10.42.42.5(pid=32510): stderr: | 20221212170947392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170947392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170947393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170947393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170947395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170947395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170947396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:48.969916 run osmo-stp_10.42.42.5(pid=32510): stdout: | (launched: 2022-12-12_17:09:47.223805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:49.090067 run osmo-stp_10.42.42.5(pid=32510): stderr: | 20221212170947392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170947392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170947393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170947393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170947395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170947395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170947396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:49.234051 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32510): Process ended prematurely: osmo-stp_10.42.42.5(pid=32510) [trial-2379↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32510)] [trial-2379↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 17:09:49.242591 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 17:09:49.269142 run osmo-hlr_10.42.42.2(pid=32507): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32507)] 17:09:49.317659 run osmo-hlr_10.42.42.2(pid=32507): stdout: | (launched: 2022-12-12_17:09:46.014172) 17:09:49.367385 run osmo-hlr_10.42.42.2(pid=32507): stderr: | 20221212170946224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170946224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170946224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170946233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170946233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170946233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170946272 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170946298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170946298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170946298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:09:49.437116 run osmo-msc_10.42.42.6(pid=32513): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32513)] 17:09:49.484785 run osmo-msc_10.42.42.6(pid=32513): stdout: | (launched: 2022-12-12_17:09:48.358178) 17:09:49.534679 run osmo-msc_10.42.42.6(pid=32513): stderr: | 20221212170948633 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170948633 DLGLOBAL DEBUG validating counter group 0x7f4ea4e78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170948633 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170948634 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170948634 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170948634 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170948636 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170948636 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170948636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170948636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:09:49.584604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32506): Terminating (SIGTERM) 17:09:49.624873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32509): Terminating (SIGTERM) 17:09:49.664537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32512): Terminating (SIGTERM) 17:09:49.704830 --- ParallelTerminationStrategy: PID 32506 died... 17:09:49.724379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32506): Terminated: ok {rc=0} 17:09:49.768777 --- ParallelTerminationStrategy: PID 32509 died... 17:09:49.787517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32509): Terminated: ok {rc=0} 17:09:49.831718 --- ParallelTerminationStrategy: PID 32512 died... 17:09:49.850616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32512): Terminated: ok {rc=0} 17:09:49.936755 bus /sierra_3: Setting Powered False 17:09:51.036221 bus /sierra_3: Setting Powered False 17:09:52.152526 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 17:09:53.240558 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:53.252231 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:09:53.295101 tst emergency_preemptive_call.py: using LAC 30301 17:09:53.415899 tst emergency_preemptive_call.py: using RAC 211 17:09:53.535987 tst emergency_preemptive_call.py: using CellId 30301 17:09:53.657391 tst emergency_preemptive_call.py: using BVCI 30302 17:09:53.769290 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:53.780236 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:53.791063 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:53.801830 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:53.812802 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 17:09:53.824434 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:09:53.939856 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:09:54.059440 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:09:54.175373 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:09:54.294287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:09:54.800212 run create_hlr_db(pid=32515): Launched 17:09:54.933242 bus /sierra_2: Setting Powered False 17:09:55.993950 run create_hlr_db(pid=32515): Terminated: ok {rc=0} 17:09:56.443949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32517): Launched 17:09:56.772921 run osmo-hlr_10.42.42.2(pid=32518): Launched 17:09:56.897702 run osmo-stp_10.42.42.5: Starting osmo-stp 17:09:57.458353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32520): Launched 17:09:57.784612 run osmo-stp_10.42.42.5(pid=32521): Launched 17:09:57.919490 tst emergency_preemptive_call.py: using MSISDN 7875 17:09:58.083475 run osmo-msc_10.42.42.6: Starting osmo-msc 17:09:58.667743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32523): Launched 17:09:58.995600 run osmo-msc_10.42.42.6(pid=32524): Launched 17:09:59.177207 run osmo-stp_10.42.42.5(pid=32521): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32521)] 17:09:59.314149 run osmo-stp_10.42.42.5(pid=32521): stdout: | (launched: 2022-12-12_17:09:57.724331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:59.451360 run osmo-stp_10.42.42.5(pid=32521): stderr: | 20221212170957919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170957919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170957920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170957920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170957921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170957921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170957921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:59.587644 run osmo-stp_10.42.42.5(pid=32521): stdout: | (launched: 2022-12-12_17:09:57.724331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:09:59.717121 run osmo-stp_10.42.42.5(pid=32521): stderr: | 20221212170957919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212170957919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212170957920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212170957920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212170957921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212170957921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212170957921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:09:59.871503 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32521): Process ended prematurely: osmo-stp_10.42.42.5(pid=32521) [trial-2379↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32521)] [trial-2379↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 17:09:59.880718 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 17:09:59.908727 run osmo-hlr_10.42.42.2(pid=32518): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32518)] 17:09:59.959621 run osmo-hlr_10.42.42.2(pid=32518): stdout: | (launched: 2022-12-12_17:09:56.712446) 17:10:00.011473 run osmo-hlr_10.42.42.2(pid=32518): stderr: | 20221212170956915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212170956915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212170956915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212170956916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212170956916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212170956916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212170956929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212170956937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212170956937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212170956937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:10:00.083488 run osmo-msc_10.42.42.6(pid=32524): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32524)] 17:10:00.133258 run osmo-msc_10.42.42.6(pid=32524): stdout: | (launched: 2022-12-12_17:09:58.934820) 17:10:00.184678 run osmo-msc_10.42.42.6(pid=32524): stderr: | 20221212170959257 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212170959257 DLGLOBAL DEBUG validating counter group 0x7fb72bff3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212170959257 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212170959257 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212170959258 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212170959258 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212170959260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212170959260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212170959260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212170959260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:10:00.236430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32517): Terminating (SIGTERM) 17:10:00.277896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32520): Terminating (SIGTERM) 17:10:00.319561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32523): Terminating (SIGTERM) 17:10:00.361615 --- ParallelTerminationStrategy: PID 32517 died... 17:10:00.381821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32517): Terminated: ok {rc=0} 17:10:00.427793 --- ParallelTerminationStrategy: PID 32520 died... 17:10:00.447590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32520): Terminated: ok {rc=0} 17:10:00.493436 --- ParallelTerminationStrategy: PID 32523 died... 17:10:00.513071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32523): Terminated: ok {rc=0} 17:10:00.601195 bus /sierra_9: Setting Powered False 17:10:01.700851 bus /sierra_9: Setting Powered False 17:10:02.820669 bus /sierra_8: Setting Powered False 17:10:03.920575 bus /sierra_8: Setting Powered False 17:10:05.035704 bus /sierra_3: Setting Powered False 17:10:06.135982 bus /sierra_3: Setting Powered False 17:10:07.255075 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-1900 --------------------------------------------------------------------- 17:10:08.526075 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:10:08.531411 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 17:10:08.555633 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 17:10:08.594481 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 17:10:08.681842 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 17:10:08.706356 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 17:10:08.745842 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 17:10:09.333235 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 17:10:09.384258 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:09.395056 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:10:09.434462 tst cs_paging_gprs_active.py: using LAC 30302 17:10:09.554944 tst cs_paging_gprs_active.py: using RAC 212 17:10:09.676509 tst cs_paging_gprs_active.py: using CellId 30302 17:10:09.798221 tst cs_paging_gprs_active.py: using BVCI 30303 17:10:09.911922 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:09.922787 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:09.933403 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:09.944502 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:09.955425 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:09.966224 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:09.977172 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:09.987852 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:09.998795 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:10:10.118311 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:10:10.236917 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:10:10.444232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:10:10.754522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32532): Launched 17:10:11.026806 run iperf3-srv_10.42.42.10(pid=32533): Launched 17:10:11.143573 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:10:11.350814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:10:11.662911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32534): Launched 17:10:11.935508 run iperf3-srv_10.42.42.10(pid=32535): Launched 17:10:12.052337 tst cs_paging_gprs_active.py:38: start network... 17:10:12.259575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:10:12.739904 run create_hlr_db(pid=32536): Launched 17:10:12.860152 bus /sierra_2: Setting Powered False 17:10:13.922091 run create_hlr_db(pid=32536): Terminated: ok {rc=0} 17:10:14.374223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32538): Launched 17:10:14.706938 run osmo-hlr_10.42.42.2(pid=32539): Launched 17:10:14.835057 run osmo-stp_10.42.42.5: Starting osmo-stp 17:10:15.408349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32541): Launched 17:10:15.741688 run osmo-stp_10.42.42.5(pid=32542): Launched 17:10:15.974070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:10:16.581754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32544): Launched 17:10:16.717915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:10:17.001792 run patchelf(pid=32545): Launched 17:10:17.204053 run osmo-stp_10.42.42.5(pid=32542): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32542)] 17:10:17.335599 run osmo-stp_10.42.42.5(pid=32542): stdout: | (launched: 2022-12-12_17:10:15.679954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:10:17.468585 run osmo-stp_10.42.42.5(pid=32542): stderr: | 20221212171015904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171015904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171015904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171015908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171015909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171015909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171015909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:10:17.601757 run osmo-stp_10.42.42.5(pid=32542): stdout: | (launched: 2022-12-12_17:10:15.679954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:10:17.729183 run osmo-stp_10.42.42.5(pid=32542): stderr: | 20221212171015904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171015904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171015904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171015908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171015909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171015909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171015909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:10:17.879502 run patchelf(pid=32545): Terminating (SIGINT) 17:10:18.053164 run patchelf(pid=32545): Terminated: ok {rc=0} 17:10:18.178953 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32542): Process ended prematurely: osmo-stp_10.42.42.5(pid=32542) [trial-2379↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32542)] [trial-2379↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 17:10:18.188611 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:10:18.216516 run osmo-hlr_10.42.42.2(pid=32539): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32539)] 17:10:18.265250 run osmo-hlr_10.42.42.2(pid=32539): stdout: | (launched: 2022-12-12_17:10:14.645343) 17:10:18.315119 run osmo-hlr_10.42.42.2(pid=32539): stderr: | 20221212171014847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171014847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171014847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171014847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171014847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171014847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171014859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171014868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171014869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171014869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:10:18.365763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32532): Terminating (SIGTERM) 17:10:18.406085 run iperf3-srv_10.42.42.10(pid=32533): Terminating (SIGTERM) 17:10:18.446232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32534): Terminating (SIGTERM) 17:10:18.486428 run iperf3-srv_10.42.42.10(pid=32535): Terminating (SIGTERM) 17:10:18.526705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32538): Terminating (SIGTERM) 17:10:18.566985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32541): Terminating (SIGTERM) 17:10:18.607027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32544): Terminating (SIGTERM) 17:10:18.647479 --- ParallelTerminationStrategy: PID 32532 died... 17:10:18.666812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32532): Terminated: ok {rc=0} 17:10:18.711632 --- ParallelTerminationStrategy: PID 32533 died... 17:10:18.730146 run iperf3-srv_10.42.42.10(pid=32533): Terminated {rc=256} 17:10:18.774695 --- ParallelTerminationStrategy: PID 32534 died... 17:10:18.793233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32534): Terminated: ok {rc=0} 17:10:18.837703 --- ParallelTerminationStrategy: PID 32535 died... 17:10:18.856424 run iperf3-srv_10.42.42.10(pid=32535): Terminated {rc=256} 17:10:18.900622 --- ParallelTerminationStrategy: PID 32538 died... 17:10:18.919475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32538): Terminated: ok {rc=0} 17:10:18.963606 --- ParallelTerminationStrategy: PID 32541 died... 17:10:18.982300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32541): Terminated: ok {rc=0} 17:10:19.027168 --- ParallelTerminationStrategy: PID 32544 died... 17:10:19.046191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32544): Terminated: ok {rc=0} 17:10:19.133725 bus /gobi_0: Setting Powered False 17:10:20.233858 bus /gobi_0: Setting Powered False 17:10:21.350183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 17:10:22.498742 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:22.510388 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:10:22.551296 tst iperf3.py: using LAC 30303 17:10:22.689490 tst iperf3.py: using RAC 213 17:10:22.819682 tst iperf3.py: using CellId 30303 17:10:22.947866 tst iperf3.py: using BVCI 30304 17:10:23.067915 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:23.079287 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:23.090532 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:23.101757 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:23.112715 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:23.123835 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:23.135204 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:23.146454 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:23.157819 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:10:23.278631 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:10:23.486449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:10:23.798944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32546): Launched 17:10:24.071525 run iperf3-srv_10.42.42.10(pid=32547): Launched 17:10:24.188189 tst iperf3.py:8: start network... 17:10:24.396328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:10:24.878645 run create_hlr_db(pid=32548): Launched 17:10:24.999992 bus /gobi_6: Setting Powered False 17:10:26.061704 run create_hlr_db(pid=32548): Terminated: ok {rc=0} 17:10:26.494603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32550): Launched 17:10:26.805522 run osmo-hlr_10.42.42.2(pid=32551): Launched 17:10:26.924213 run osmo-stp_10.42.42.5: Starting osmo-stp 17:10:27.466202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32553): Launched 17:10:27.776514 run osmo-stp_10.42.42.5(pid=32554): Launched 17:10:27.896910 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:10:28.431242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32556): Launched 17:10:28.551005 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:10:28.814008 run patchelf(pid=32557): Launched 17:10:28.998850 run osmo-stp_10.42.42.5(pid=32554): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32554)] 17:10:29.138215 run osmo-stp_10.42.42.5(pid=32554): stdout: | (launched: 2022-12-12_17:10:27.719100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:10:29.279244 run osmo-stp_10.42.42.5(pid=32554): stderr: | 20221212171027892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171027892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171027893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171027893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171027893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171027893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171027894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:10:29.420449 run osmo-stp_10.42.42.5(pid=32554): stdout: | (launched: 2022-12-12_17:10:27.719100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:10:29.555616 run osmo-stp_10.42.42.5(pid=32554): stderr: | 20221212171027892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171027892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171027893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171027893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171027893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171027893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171027894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:10:29.716391 run patchelf(pid=32557): Terminating (SIGINT) 17:10:29.900052 run patchelf(pid=32557): Terminated: ok {rc=0} 17:10:30.032599 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32554): Process ended prematurely: osmo-stp_10.42.42.5(pid=32554) [trial-2379↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32554)] [trial-2379↪gprs:nanobts+band-1900↪iperf3.py:8] 17:10:30.043136 tst iperf3.py:8: Test FAILED (7.6 sec) 17:10:30.072106 run osmo-hlr_10.42.42.2(pid=32551): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32551)] 17:10:30.122579 run osmo-hlr_10.42.42.2(pid=32551): stdout: | (launched: 2022-12-12_17:10:26.747316) 17:10:30.174818 run osmo-hlr_10.42.42.2(pid=32551): stderr: | 20221212171026927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171026927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171026927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171026927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171026927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171026927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171026940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171026950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171026950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171026950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:10:30.227410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32546): Terminating (SIGTERM) 17:10:30.269745 run iperf3-srv_10.42.42.10(pid=32547): Terminating (SIGTERM) 17:10:30.311761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32550): Terminating (SIGTERM) 17:10:30.354440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32553): Terminating (SIGTERM) 17:10:30.396527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32556): Terminating (SIGTERM) 17:10:30.439214 --- ParallelTerminationStrategy: PID 32546 died... 17:10:30.459548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32546): Terminated: ok {rc=0} 17:10:30.506639 --- ParallelTerminationStrategy: PID 32547 died... 17:10:30.526517 run iperf3-srv_10.42.42.10(pid=32547): Terminated {rc=256} 17:10:30.573491 --- ParallelTerminationStrategy: PID 32550 died... 17:10:30.593161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32550): Terminated: ok {rc=0} 17:10:30.640281 --- ParallelTerminationStrategy: PID 32553 died... 17:10:30.660063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32553): Terminated: ok {rc=0} 17:10:30.706790 --- ParallelTerminationStrategy: PID 32556 died... 17:10:30.726557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32556): Terminated: ok {rc=0} 17:10:30.815458 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 17:10:31.999922 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:32.012705 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:10:32.055762 tst iperf3m4.py: using LAC 30304 17:10:32.188688 tst iperf3m4.py: using RAC 214 17:10:32.316167 tst iperf3m4.py: using CellId 30304 17:10:32.440135 tst iperf3m4.py: using BVCI 30305 17:10:32.553253 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:32.564262 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:32.575333 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:32.587125 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:32.598840 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:32.610518 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:32.622285 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:32.633704 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:32.645478 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:10:32.763991 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:10:32.888913 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:10:33.012756 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:10:33.132763 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:10:33.356090 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:10:33.691338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32558): Launched 17:10:33.985764 run iperf3-srv_10.42.42.10(pid=32559): Launched 17:10:34.103425 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:10:34.309908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:10:34.622469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32560): Launched 17:10:34.894306 run iperf3-srv_10.42.42.10(pid=32561): Launched 17:10:35.011257 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:10:35.217372 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:10:35.528699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32562): Launched 17:10:35.798934 run iperf3-srv_10.42.42.10(pid=32563): Launched 17:10:35.916849 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:10:36.123585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:10:36.435684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32564): Launched 17:10:36.709218 run iperf3-srv_10.42.42.10(pid=32565): Launched 17:10:36.826947 tst iperf3m4.py:8: start network... 17:10:37.034173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:10:37.514267 run create_hlr_db(pid=32566): Launched 17:10:37.634498 bus /gobi_6: Setting Powered False 17:10:38.696250 run create_hlr_db(pid=32566): Terminated: ok {rc=0} 17:10:39.128902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32568): Launched 17:10:39.440657 run osmo-hlr_10.42.42.2(pid=32569): Launched 17:10:39.561613 run osmo-stp_10.42.42.5: Starting osmo-stp 17:10:40.113298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32571): Launched 17:10:40.426526 run osmo-stp_10.42.42.5(pid=32572): Launched 17:10:40.547368 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:10:41.082816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32574): Launched 17:10:41.203099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:10:41.465962 run patchelf(pid=32575): Launched 17:10:41.642188 run osmo-stp_10.42.42.5(pid=32572): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32572)] 17:10:41.773273 run osmo-stp_10.42.42.5(pid=32572): stdout: | (launched: 2022-12-12_17:10:40.368512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:10:41.906580 run osmo-stp_10.42.42.5(pid=32572): stderr: | 20221212171040543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171040543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171040543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171040544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171040544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171040544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171040544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:10:42.040296 run osmo-stp_10.42.42.5(pid=32572): stdout: | (launched: 2022-12-12_17:10:40.368512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:10:42.167674 run osmo-stp_10.42.42.5(pid=32572): stderr: | 20221212171040543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171040543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171040543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171040544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171040544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171040544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171040544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:10:42.318501 run patchelf(pid=32575): Terminating (SIGINT) 17:10:42.491979 run patchelf(pid=32575): Terminated: ok {rc=0} 17:10:42.617619 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32572): Process ended prematurely: osmo-stp_10.42.42.5(pid=32572) [trial-2379↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32572)] [trial-2379↪gprs:nanobts+band-1900↪iperf3m4.py:8] 17:10:42.627186 tst iperf3m4.py:8: Test FAILED (10.7 sec) 17:10:42.655640 run osmo-hlr_10.42.42.2(pid=32569): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32569)] 17:10:42.703897 run osmo-hlr_10.42.42.2(pid=32569): stdout: | (launched: 2022-12-12_17:10:39.382424) 17:10:42.753544 run osmo-hlr_10.42.42.2(pid=32569): stderr: | 20221212171039565 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171039565 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171039565 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171039565 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171039565 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171039565 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171039577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171039585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171039586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171039586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:10:42.803449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32558): Terminating (SIGTERM) 17:10:42.843447 run iperf3-srv_10.42.42.10(pid=32559): Terminating (SIGTERM) 17:10:42.883305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32560): Terminating (SIGTERM) 17:10:42.923273 run iperf3-srv_10.42.42.10(pid=32561): Terminating (SIGTERM) 17:10:42.963098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32562): Terminating (SIGTERM) 17:10:43.002985 run iperf3-srv_10.42.42.10(pid=32563): Terminating (SIGTERM) 17:10:43.043086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32564): Terminating (SIGTERM) 17:10:43.082898 run iperf3-srv_10.42.42.10(pid=32565): Terminating (SIGTERM) 17:10:43.122577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32568): Terminating (SIGTERM) 17:10:43.162600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32571): Terminating (SIGTERM) 17:10:43.202321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32574): Terminating (SIGTERM) 17:10:43.242368 --- ParallelTerminationStrategy: PID 32558 died... 17:10:43.261633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32558): Terminated: ok {rc=0} 17:10:43.306003 --- ParallelTerminationStrategy: PID 32559 died... 17:10:43.324521 run iperf3-srv_10.42.42.10(pid=32559): Terminated {rc=256} 17:10:43.368640 --- ParallelTerminationStrategy: PID 32560 died... 17:10:43.387296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32560): Terminated: ok {rc=0} 17:10:43.431599 --- ParallelTerminationStrategy: PID 32561 died... 17:10:43.450174 run iperf3-srv_10.42.42.10(pid=32561): Terminated {rc=256} 17:10:43.494621 --- ParallelTerminationStrategy: PID 32562 died... 17:10:43.513181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32562): Terminated: ok {rc=0} 17:10:43.557337 --- ParallelTerminationStrategy: PID 32563 died... 17:10:43.575911 run iperf3-srv_10.42.42.10(pid=32563): Terminated {rc=256} 17:10:43.619853 --- ParallelTerminationStrategy: PID 32564 died... 17:10:43.638534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32564): Terminated: ok {rc=0} 17:10:43.682805 --- ParallelTerminationStrategy: PID 32565 died... 17:10:43.701576 run iperf3-srv_10.42.42.10(pid=32565): Terminated {rc=256} 17:10:43.745572 --- ParallelTerminationStrategy: PID 32568 died... 17:10:43.764190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32568): Terminated: ok {rc=0} 17:10:43.808468 --- ParallelTerminationStrategy: PID 32571 died... 17:10:43.827187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32571): Terminated: ok {rc=0} 17:10:43.871379 --- ParallelTerminationStrategy: PID 32574 died... 17:10:43.889981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32574): Terminated: ok {rc=0} 17:10:43.976247 bus /gobi_4: Setting Powered False 17:10:45.076841 bus /gobi_4: Setting Powered False 17:10:46.190656 bus /gobi_1: Setting Powered False 17:10:47.289855 bus /gobi_1: Setting Powered False 17:10:48.401710 bus /gobi_0: Setting Powered False 17:10:49.496839 bus /gobi_0: Setting Powered False 17:10:50.612132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 17:10:51.717534 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:51.729502 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:10:51.769982 tst ping.py: using LAC 30305 17:10:51.896820 tst ping.py: using RAC 215 17:10:52.026983 tst ping.py: using CellId 30305 17:10:52.157757 tst ping.py: using BVCI 30306 17:10:52.276781 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:52.288095 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:52.299304 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:52.310493 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:52.321563 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:52.332652 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:52.343910 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:10:52.355085 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:10:52.472779 tst ping.py:19: start network... 17:10:52.675330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:10:53.145982 run create_hlr_db(pid=32576): Launched 17:10:53.263970 bus /gobi_6: Setting Powered False 17:10:54.324762 run create_hlr_db(pid=32576): Terminated: ok {rc=0} 17:10:54.768720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32578): Launched 17:10:55.095628 run osmo-hlr_10.42.42.2(pid=32579): Launched 17:10:55.219922 run osmo-stp_10.42.42.5: Starting osmo-stp 17:10:55.780112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32581): Launched 17:10:56.107068 run osmo-stp_10.42.42.5(pid=32582): Launched 17:10:56.231104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:10:56.794725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32584): Launched 17:10:56.918659 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:10:57.195170 run patchelf(pid=32585): Launched 17:10:57.375685 run osmo-stp_10.42.42.5(pid=32582): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32582)] 17:10:57.512919 run osmo-stp_10.42.42.5(pid=32582): stdout: | (launched: 2022-12-12_17:10:56.046221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:10:57.651670 run osmo-stp_10.42.42.5(pid=32582): stderr: | 20221212171056241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171056241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171056242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171056242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171056242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171056242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171056243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:10:57.790088 run osmo-stp_10.42.42.5(pid=32582): stdout: | (launched: 2022-12-12_17:10:56.046221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:10:57.922833 run osmo-stp_10.42.42.5(pid=32582): stderr: | 20221212171056241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171056241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171056242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171056242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171056242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171056242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171056243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:10:58.079672 run patchelf(pid=32585): Terminating (SIGINT) 17:10:58.260228 run patchelf(pid=32585): Terminated: ok {rc=0} 17:10:58.390444 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32582): Process ended prematurely: osmo-stp_10.42.42.5(pid=32582) [trial-2379↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32582)] [trial-2379↪gprs:nanobts+band-1900↪ping.py:22] 17:10:58.400086 tst ping.py:22: Test FAILED (6.7 sec) 17:10:58.428456 run osmo-hlr_10.42.42.2(pid=32579): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32579)] 17:10:58.478631 run osmo-hlr_10.42.42.2(pid=32579): stdout: | (launched: 2022-12-12_17:10:55.035316) 17:10:58.530533 run osmo-hlr_10.42.42.2(pid=32579): stderr: | 20221212171055235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171055235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171055235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171055235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171055235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171055235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171055247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171055256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171055256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171055256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:10:58.582561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32578): Terminating (SIGTERM) 17:10:58.624379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32581): Terminating (SIGTERM) 17:10:58.666703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32584): Terminating (SIGTERM) 17:10:58.708844 --- ParallelTerminationStrategy: PID 32578 died... 17:10:58.729044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32578): Terminated: ok {rc=0} 17:10:58.774980 --- ParallelTerminationStrategy: PID 32581 died... 17:10:58.794677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32581): Terminated: ok {rc=0} 17:10:58.840468 --- ParallelTerminationStrategy: PID 32584 died... 17:10:58.860085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32584): Terminated: ok {rc=0} 17:10:58.948054 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 17:11:00.035896 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:11:00.048620 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 17:11:00.091539 tst ping_idle_ping.py: using LAC 30306 17:11:00.221541 tst ping_idle_ping.py: using RAC 216 17:11:00.349429 tst ping_idle_ping.py: using CellId 30306 17:11:00.470443 tst ping_idle_ping.py: using BVCI 30307 17:11:00.584511 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:11:00.595523 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:11:00.606464 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:11:00.618221 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:11:00.629816 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:11:00.641240 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:11:00.654606 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 17:11:00.666603 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 17:11:00.782065 tst ping_idle_ping.py:24: start network... 17:11:01.021886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:11:01.516640 run create_hlr_db(pid=32586): Launched 17:11:01.671857 bus /gobi_6: Setting Powered False 17:11:02.732070 run create_hlr_db(pid=32586): Terminated: ok {rc=0} 17:11:03.183856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32588): Launched 17:11:03.511458 run osmo-hlr_10.42.42.2(pid=32589): Launched 17:11:03.638548 run osmo-stp_10.42.42.5: Starting osmo-stp 17:11:04.204590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32591): Launched 17:11:04.531852 run osmo-stp_10.42.42.5(pid=32592): Launched 17:11:04.656834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:11:05.220835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32594): Launched 17:11:05.346884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:11:05.622816 run patchelf(pid=32595): Launched 17:11:05.804116 run osmo-stp_10.42.42.5(pid=32592): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32592)] 17:11:05.941462 run osmo-stp_10.42.42.5(pid=32592): stdout: | (launched: 2022-12-12_17:11:04.470672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:06.080832 run osmo-stp_10.42.42.5(pid=32592): stderr: | 20221212171104666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171104666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171104666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171104666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171104667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171104667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171104667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:06.220018 run osmo-stp_10.42.42.5(pid=32592): stdout: | (launched: 2022-12-12_17:11:04.470672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:06.353644 run osmo-stp_10.42.42.5(pid=32592): stderr: | 20221212171104666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171104666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171104666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171104666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171104667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171104667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171104667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:06.511657 run patchelf(pid=32595): Terminating (SIGINT) 17:11:06.694292 run patchelf(pid=32595): Terminated: ok {rc=0} 17:11:06.825079 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32592): Process ended prematurely: osmo-stp_10.42.42.5(pid=32592) [trial-2379↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32592)] [trial-2379↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 17:11:06.834842 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 17:11:06.863342 run osmo-hlr_10.42.42.2(pid=32589): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32589)] 17:11:06.913418 run osmo-hlr_10.42.42.2(pid=32589): stdout: | (launched: 2022-12-12_17:11:03.450862) 17:11:06.965139 run osmo-hlr_10.42.42.2(pid=32589): stderr: | 20221212171103652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171103653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171103653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171103653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171103653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171103653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171103665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171103673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171103674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171103674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:11:07.017173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32588): Terminating (SIGTERM) 17:11:07.059029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32591): Terminating (SIGTERM) 17:11:07.100874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32594): Terminating (SIGTERM) 17:11:07.143321 --- ParallelTerminationStrategy: PID 32588 died... 17:11:07.163429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32588): Terminated: ok {rc=0} 17:11:07.209611 --- ParallelTerminationStrategy: PID 32591 died... 17:11:07.229412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32591): Terminated: ok {rc=0} 17:11:07.275424 --- ParallelTerminationStrategy: PID 32594 died... 17:11:07.295056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32594): Terminated: ok {rc=0} 17:11:07.383182 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 17:11:08.689629 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:11:08.696850 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:11:08.722240 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:11:08.761582 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:11:08.850075 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:11:08.874469 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:11:08.913902 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:11:09.512166 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:11:09.565059 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:09.576459 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:11:09.620330 tst cs_paging_gprs_active.py: using LAC 30307 17:11:09.750459 tst cs_paging_gprs_active.py: using RAC 217 17:11:09.880484 tst cs_paging_gprs_active.py: using CellId 30307 17:11:10.009427 tst cs_paging_gprs_active.py: using BVCI 30308 17:11:10.123474 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:10.134752 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:10.145813 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:10.157716 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:10.169393 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:10.180924 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:10.192817 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:10.204613 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:10.216514 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:11:10.337899 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:11:10.455434 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:11:10.664193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:11:10.975993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32600): Launched 17:11:11.247087 run iperf3-srv_10.42.42.10(pid=32601): Launched 17:11:11.364388 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:11:11.571981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:11:11.883740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32602): Launched 17:11:12.154561 run iperf3-srv_10.42.42.10(pid=32603): Launched 17:11:12.272659 tst cs_paging_gprs_active.py:38: start network... 17:11:12.479293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:11:12.957674 run create_hlr_db(pid=32604): Launched 17:11:13.077358 bus /gobi_6: Setting Powered False 17:11:14.143492 run create_hlr_db(pid=32604): Terminated: ok {rc=0} 17:11:14.601606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32606): Launched 17:11:14.933623 run osmo-hlr_10.42.42.2(pid=32607): Launched 17:11:15.059675 run osmo-stp_10.42.42.5: Starting osmo-stp 17:11:15.627192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32609): Launched 17:11:15.987900 run osmo-stp_10.42.42.5(pid=32610): Launched 17:11:16.282251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:11:16.945606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32612): Launched 17:11:17.101366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:11:17.400725 run patchelf(pid=32613): Launched 17:11:17.575451 run osmo-stp_10.42.42.5(pid=32610): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32610)] 17:11:17.707435 run osmo-stp_10.42.42.5(pid=32610): stdout: | (launched: 2022-12-12_17:11:15.927346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:17.839663 run osmo-stp_10.42.42.5(pid=32610): stderr: | 20221212171116176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171116176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171116177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171116177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171116180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171116181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171116181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:17.971794 run osmo-stp_10.42.42.5(pid=32610): stdout: | (launched: 2022-12-12_17:11:15.927346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:18.098794 run osmo-stp_10.42.42.5(pid=32610): stderr: | 20221212171116176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171116176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171116177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171116177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171116180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171116181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171116181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:18.249067 run patchelf(pid=32613): Terminating (SIGINT) 17:11:18.421767 run patchelf(pid=32613): Terminated: ok {rc=0} 17:11:18.546726 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32610): Process ended prematurely: osmo-stp_10.42.42.5(pid=32610) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32610)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:11:18.556299 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 17:11:18.583987 run osmo-hlr_10.42.42.2(pid=32607): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32607)] 17:11:18.632140 run osmo-hlr_10.42.42.2(pid=32607): stdout: | (launched: 2022-12-12_17:11:14.872346) 17:11:18.681671 run osmo-hlr_10.42.42.2(pid=32607): stderr: | 20221212171115075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171115075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171115075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171115075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171115075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171115075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171115087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171115095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171115096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171115096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:11:18.731618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32600): Terminating (SIGTERM) 17:11:18.771438 run iperf3-srv_10.42.42.10(pid=32601): Terminating (SIGTERM) 17:11:18.811138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32602): Terminating (SIGTERM) 17:11:18.850899 run iperf3-srv_10.42.42.10(pid=32603): Terminating (SIGTERM) 17:11:18.890465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32606): Terminating (SIGTERM) 17:11:18.930221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32609): Terminating (SIGTERM) 17:11:18.970081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32612): Terminating (SIGTERM) 17:11:19.010085 --- ParallelTerminationStrategy: PID 32600 died... 17:11:19.028925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32600): Terminated: ok {rc=0} 17:11:19.073946 --- ParallelTerminationStrategy: PID 32601 died... 17:11:19.092202 run iperf3-srv_10.42.42.10(pid=32601): Terminated {rc=256} 17:11:19.136371 --- ParallelTerminationStrategy: PID 32602 died... 17:11:19.154976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32602): Terminated: ok {rc=0} 17:11:19.199457 --- ParallelTerminationStrategy: PID 32603 died... 17:11:19.217900 run iperf3-srv_10.42.42.10(pid=32603): Terminated {rc=256} 17:11:19.261943 --- ParallelTerminationStrategy: PID 32606 died... 17:11:19.280392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32606): Terminated: ok {rc=0} 17:11:19.325145 --- ParallelTerminationStrategy: PID 32609 died... 17:11:19.343745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32609): Terminated: ok {rc=0} 17:11:19.390181 --- ParallelTerminationStrategy: PID 32612 died... 17:11:19.408751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32612): Terminated: ok {rc=0} 17:11:19.494019 bus /gobi_0: Setting Powered False 17:11:20.593370 bus /gobi_0: Setting Powered False 17:11:21.706731 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:11:22.856139 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:22.868391 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:11:22.913206 tst iperf3.py: using LAC 30308 17:11:23.043482 tst iperf3.py: using RAC 218 17:11:23.172465 tst iperf3.py: using CellId 30308 17:11:23.300597 tst iperf3.py: using BVCI 30309 17:11:23.414368 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:23.425544 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:23.436392 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:23.447557 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:23.458565 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:23.469542 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:23.480699 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:23.491812 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:23.503039 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:11:23.620794 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:11:23.828750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:11:24.140296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32618): Launched 17:11:24.411372 run iperf3-srv_10.42.42.10(pid=32619): Launched 17:11:24.529445 tst iperf3.py:8: start network... 17:11:24.736615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:11:25.218703 run create_hlr_db(pid=32620): Launched 17:11:25.338738 bus /gobi_6: Setting Powered False 17:11:26.400069 run create_hlr_db(pid=32620): Terminated: ok {rc=0} 17:11:26.854253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32622): Launched 17:11:27.187686 run osmo-hlr_10.42.42.2(pid=32623): Launched 17:11:27.315822 run osmo-stp_10.42.42.5: Starting osmo-stp 17:11:27.892803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32625): Launched 17:11:28.223614 run osmo-stp_10.42.42.5(pid=32626): Launched 17:11:28.352496 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:11:28.924143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32628): Launched 17:11:29.051314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:11:29.331742 run patchelf(pid=32629): Launched 17:11:29.518333 run osmo-stp_10.42.42.5(pid=32626): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32626)] 17:11:29.658012 run osmo-stp_10.42.42.5(pid=32626): stdout: | (launched: 2022-12-12_17:11:28.162501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:29.800274 run osmo-stp_10.42.42.5(pid=32626): stderr: | 20221212171128356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171128356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171128356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171128356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171128357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171128357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171128357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:29.941613 run osmo-stp_10.42.42.5(pid=32626): stdout: | (launched: 2022-12-12_17:11:28.162501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:30.076781 run osmo-stp_10.42.42.5(pid=32626): stderr: | 20221212171128356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171128356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171128356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171128356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171128357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171128357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171128357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:30.236908 run patchelf(pid=32629): Terminating (SIGINT) 17:11:30.421299 run patchelf(pid=32629): Terminated: ok {rc=0} 17:11:30.554187 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32626): Process ended prematurely: osmo-stp_10.42.42.5(pid=32626) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32626)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 17:11:30.564510 tst iperf3.py:8: Test FAILED (7.7 sec) 17:11:30.593363 run osmo-hlr_10.42.42.2(pid=32623): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32623)] 17:11:30.643332 run osmo-hlr_10.42.42.2(pid=32623): stdout: | (launched: 2022-12-12_17:11:27.126293) 17:11:30.695028 run osmo-hlr_10.42.42.2(pid=32623): stderr: | 20221212171127326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171127326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171127326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171127326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171127326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171127326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171127338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171127349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171127349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171127349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:11:30.747311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32618): Terminating (SIGTERM) 17:11:30.789128 run iperf3-srv_10.42.42.10(pid=32619): Terminating (SIGTERM) 17:11:30.836419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32622): Terminating (SIGTERM) 17:11:30.889474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32625): Terminating (SIGTERM) 17:11:30.932000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32628): Terminating (SIGTERM) 17:11:30.975096 --- ParallelTerminationStrategy: PID 32618 died... 17:11:30.995496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32618): Terminated: ok {rc=0} 17:11:31.042812 --- ParallelTerminationStrategy: PID 32619 died... 17:11:31.063563 run iperf3-srv_10.42.42.10(pid=32619): Terminated {rc=256} 17:11:31.111884 --- ParallelTerminationStrategy: PID 32622 died... 17:11:31.133767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32622): Terminated: ok {rc=0} 17:11:31.193191 --- ParallelTerminationStrategy: PID 32625 died... 17:11:31.217293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32625): Terminated: ok {rc=0} 17:11:31.275270 --- ParallelTerminationStrategy: PID 32628 died... 17:11:31.296377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32628): Terminated: ok {rc=0} 17:11:31.388334 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:11:32.544115 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:32.556254 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:11:32.598353 tst iperf3m4.py: using LAC 30309 17:11:32.729872 tst iperf3m4.py: using RAC 219 17:11:32.858681 tst iperf3m4.py: using CellId 30309 17:11:32.989732 tst iperf3m4.py: using BVCI 30310 17:11:33.111919 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:33.123575 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:33.134891 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:33.146242 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:33.157535 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:33.168748 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:33.180380 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:33.191696 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:33.203214 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:11:33.322433 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:11:33.442383 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:11:33.560863 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:11:33.679345 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:11:33.888720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:11:34.202312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32630): Launched 17:11:34.477286 run iperf3-srv_10.42.42.10(pid=32631): Launched 17:11:34.594895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:11:34.803269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:11:35.117151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32632): Launched 17:11:35.391497 run iperf3-srv_10.42.42.10(pid=32633): Launched 17:11:35.510545 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:11:35.718172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:11:36.030722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32634): Launched 17:11:36.302814 run iperf3-srv_10.42.42.10(pid=32635): Launched 17:11:36.420006 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:11:36.627566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:11:36.939732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32636): Launched 17:11:37.213490 run iperf3-srv_10.42.42.10(pid=32637): Launched 17:11:37.330257 tst iperf3m4.py:8: start network... 17:11:37.537785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:11:38.020165 run create_hlr_db(pid=32638): Launched 17:11:38.139863 bus /gobi_6: Setting Powered False 17:11:39.201370 run create_hlr_db(pid=32638): Terminated: ok {rc=0} 17:11:39.634965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32640): Launched 17:11:39.948800 run osmo-hlr_10.42.42.2(pid=32641): Launched 17:11:40.070702 run osmo-stp_10.42.42.5: Starting osmo-stp 17:11:40.609849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32643): Launched 17:11:40.921131 run osmo-stp_10.42.42.5(pid=32644): Launched 17:11:41.041577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:11:41.576365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32646): Launched 17:11:41.695797 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:11:41.959426 run patchelf(pid=32647): Launched 17:11:42.133766 run osmo-stp_10.42.42.5(pid=32644): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32644)] 17:11:42.264809 run osmo-stp_10.42.42.5(pid=32644): stdout: | (launched: 2022-12-12_17:11:40.862968) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:42.397692 run osmo-stp_10.42.42.5(pid=32644): stderr: | 20221212171141035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171141035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171141035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171141036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171141036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171141036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171141036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:42.530632 run osmo-stp_10.42.42.5(pid=32644): stdout: | (launched: 2022-12-12_17:11:40.862968) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:42.657828 run osmo-stp_10.42.42.5(pid=32644): stderr: | 20221212171141035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171141035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171141035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171141036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171141036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171141036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171141036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:42.808057 run patchelf(pid=32647): Terminating (SIGINT) 17:11:42.981240 run patchelf(pid=32647): Terminated: ok {rc=0} 17:11:43.105783 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32644): Process ended prematurely: osmo-stp_10.42.42.5(pid=32644) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32644)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 17:11:43.115491 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:11:43.143501 run osmo-hlr_10.42.42.2(pid=32641): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32641)] 17:11:43.191561 run osmo-hlr_10.42.42.2(pid=32641): stdout: | (launched: 2022-12-12_17:11:39.890187) 17:11:43.241051 run osmo-hlr_10.42.42.2(pid=32641): stderr: | 20221212171140068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171140068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171140069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171140069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171140069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171140069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171140081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171140089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171140089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171140089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:11:43.291060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32630): Terminating (SIGTERM) 17:11:43.331198 run iperf3-srv_10.42.42.10(pid=32631): Terminating (SIGTERM) 17:11:43.371325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32632): Terminating (SIGTERM) 17:11:43.411541 run iperf3-srv_10.42.42.10(pid=32633): Terminating (SIGTERM) 17:11:43.451742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32634): Terminating (SIGTERM) 17:11:43.491863 run iperf3-srv_10.42.42.10(pid=32635): Terminating (SIGTERM) 17:11:43.532125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32636): Terminating (SIGTERM) 17:11:43.572239 run iperf3-srv_10.42.42.10(pid=32637): Terminating (SIGTERM) 17:11:43.612184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32640): Terminating (SIGTERM) 17:11:43.652276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32643): Terminating (SIGTERM) 17:11:43.692217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32646): Terminating (SIGTERM) 17:11:43.732898 --- ParallelTerminationStrategy: PID 32630 died... 17:11:43.752362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32630): Terminated: ok {rc=0} 17:11:43.797311 --- ParallelTerminationStrategy: PID 32631 died... 17:11:43.815941 run iperf3-srv_10.42.42.10(pid=32631): Terminated {rc=256} 17:11:43.861073 --- ParallelTerminationStrategy: PID 32632 died... 17:11:43.879760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32632): Terminated: ok {rc=0} 17:11:43.924404 --- ParallelTerminationStrategy: PID 32633 died... 17:11:43.943261 run iperf3-srv_10.42.42.10(pid=32633): Terminated {rc=256} 17:11:43.987325 --- ParallelTerminationStrategy: PID 32634 died... 17:11:44.005803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32634): Terminated: ok {rc=0} 17:11:44.049821 --- ParallelTerminationStrategy: PID 32635 died... 17:11:44.068328 run iperf3-srv_10.42.42.10(pid=32635): Terminated {rc=256} 17:11:44.112428 --- ParallelTerminationStrategy: PID 32636 died... 17:11:44.131065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32636): Terminated: ok {rc=0} 17:11:44.174917 --- ParallelTerminationStrategy: PID 32637 died... 17:11:44.193438 run iperf3-srv_10.42.42.10(pid=32637): Terminated {rc=256} 17:11:44.237312 --- ParallelTerminationStrategy: PID 32640 died... 17:11:44.255618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32640): Terminated: ok {rc=0} 17:11:44.299783 --- ParallelTerminationStrategy: PID 32643 died... 17:11:44.318368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32643): Terminated: ok {rc=0} 17:11:44.363010 --- ParallelTerminationStrategy: PID 32646 died... 17:11:44.381657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32646): Terminated: ok {rc=0} 17:11:44.469465 bus /gobi_4: Setting Powered False 17:11:45.569773 bus /gobi_4: Setting Powered False 17:11:46.692104 bus /gobi_1: Setting Powered False 17:11:47.805097 bus /gobi_1: Setting Powered False 17:11:48.921989 bus /gobi_0: Setting Powered False 17:11:50.021682 bus /gobi_0: Setting Powered False 17:11:51.139658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 17:11:52.243949 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:52.256151 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:11:52.298713 tst ping.py: using LAC 30310 17:11:52.426568 tst ping.py: using RAC 220 17:11:52.554861 tst ping.py: using CellId 30310 17:11:52.682324 tst ping.py: using BVCI 30311 17:11:52.800422 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:52.811999 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:52.823498 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:52.834895 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:52.846198 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:52.857498 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:52.869148 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:11:52.880558 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:11:52.995875 tst ping.py:19: start network... 17:11:53.199872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:11:53.671168 run create_hlr_db(pid=32648): Launched 17:11:53.790423 bus /gobi_6: Setting Powered False 17:11:54.850477 run create_hlr_db(pid=32648): Terminated: ok {rc=0} 17:11:55.295591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32650): Launched 17:11:55.623236 run osmo-hlr_10.42.42.2(pid=32651): Launched 17:11:55.749436 run osmo-stp_10.42.42.5: Starting osmo-stp 17:11:56.311672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32653): Launched 17:11:56.636050 run osmo-stp_10.42.42.5(pid=32654): Launched 17:11:56.759999 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:11:57.319509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32656): Launched 17:11:57.445138 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:11:57.720404 run patchelf(pid=32657): Launched 17:11:57.904120 run osmo-stp_10.42.42.5(pid=32654): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32654)] 17:11:58.041131 run osmo-stp_10.42.42.5(pid=32654): stdout: | (launched: 2022-12-12_17:11:56.575565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:58.179479 run osmo-stp_10.42.42.5(pid=32654): stderr: | 20221212171156769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171156769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171156769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171156769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171156770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171156770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171156770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:58.318188 run osmo-stp_10.42.42.5(pid=32654): stdout: | (launched: 2022-12-12_17:11:56.575565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:11:58.450886 run osmo-stp_10.42.42.5(pid=32654): stderr: | 20221212171156769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171156769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171156769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171156769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171156770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171156770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171156770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:11:58.607964 run patchelf(pid=32657): Terminating (SIGINT) 17:11:58.788855 run patchelf(pid=32657): Terminated: ok {rc=0} 17:11:58.918840 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32654): Process ended prematurely: osmo-stp_10.42.42.5(pid=32654) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32654)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 17:11:58.928545 tst ping.py:22: Test FAILED (6.7 sec) 17:11:58.956921 run osmo-hlr_10.42.42.2(pid=32651): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32651)] 17:11:59.006750 run osmo-hlr_10.42.42.2(pid=32651): stdout: | (launched: 2022-12-12_17:11:55.562537) 17:11:59.058338 run osmo-hlr_10.42.42.2(pid=32651): stderr: | 20221212171155762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171155763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171155763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171155763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171155763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171155763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171155778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171155787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171155788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171155788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:11:59.110442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32650): Terminating (SIGTERM) 17:11:59.152233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32653): Terminating (SIGTERM) 17:11:59.194127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32656): Terminating (SIGTERM) 17:11:59.236104 --- ParallelTerminationStrategy: PID 32650 died... 17:11:59.256011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32650): Terminated: ok {rc=0} 17:11:59.302893 --- ParallelTerminationStrategy: PID 32653 died... 17:11:59.322571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32653): Terminated: ok {rc=0} 17:11:59.368516 --- ParallelTerminationStrategy: PID 32656 died... 17:11:59.388277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32656): Terminated: ok {rc=0} 17:11:59.477249 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:12:00.564669 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:12:00.577274 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:12:00.622431 tst ping_idle_ping.py: using LAC 30311 17:12:00.750602 tst ping_idle_ping.py: using RAC 221 17:12:00.892189 tst ping_idle_ping.py: using CellId 30311 17:12:01.022920 tst ping_idle_ping.py: using BVCI 30312 17:12:01.144247 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:12:01.156880 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:12:01.169477 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:12:01.182223 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:12:01.194905 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:12:01.207480 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:12:01.220237 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:12:01.233694 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:12:01.372001 tst ping_idle_ping.py:24: start network... 17:12:01.603585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:02.122613 run create_hlr_db(pid=32658): Launched 17:12:02.278685 bus /gobi_6: Setting Powered False 17:12:03.340222 run create_hlr_db(pid=32658): Terminated: ok {rc=0} 17:12:03.789029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32660): Launched 17:12:04.118084 run osmo-hlr_10.42.42.2(pid=32661): Launched 17:12:04.243980 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:04.810626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32663): Launched 17:12:05.138395 run osmo-stp_10.42.42.5(pid=32664): Launched 17:12:05.263511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:12:05.826942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32666): Launched 17:12:05.952252 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:12:06.227555 run patchelf(pid=32667): Launched 17:12:06.410084 run osmo-stp_10.42.42.5(pid=32664): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32664)] 17:12:06.547500 run osmo-stp_10.42.42.5(pid=32664): stdout: | (launched: 2022-12-12_17:12:05.077966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:06.687236 run osmo-stp_10.42.42.5(pid=32664): stderr: | 20221212171205275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171205275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171205275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171205276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171205276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171205276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171205276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:06.826525 run osmo-stp_10.42.42.5(pid=32664): stdout: | (launched: 2022-12-12_17:12:05.077966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:06.959546 run osmo-stp_10.42.42.5(pid=32664): stderr: | 20221212171205275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171205275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171205275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171205276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171205276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171205276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171205276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:07.117495 run patchelf(pid=32667): Terminating (SIGINT) 17:12:07.298288 run patchelf(pid=32667): Terminated: ok {rc=0} 17:12:07.428501 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32664): Process ended prematurely: osmo-stp_10.42.42.5(pid=32664) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32664)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 17:12:07.438260 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 17:12:07.466570 run osmo-hlr_10.42.42.2(pid=32661): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32661)] 17:12:07.516297 run osmo-hlr_10.42.42.2(pid=32661): stdout: | (launched: 2022-12-12_17:12:04.057309) 17:12:07.567793 run osmo-hlr_10.42.42.2(pid=32661): stderr: | 20221212171204259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171204259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171204259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171204259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171204259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171204259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171204271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171204280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171204280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171204280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:07.619727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32660): Terminating (SIGTERM) 17:12:07.661461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32663): Terminating (SIGTERM) 17:12:07.704027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32666): Terminating (SIGTERM) 17:12:07.746414 --- ParallelTerminationStrategy: PID 32660 died... 17:12:07.766654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32660): Terminated: ok {rc=0} 17:12:07.813207 --- ParallelTerminationStrategy: PID 32663 died... 17:12:07.832711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32663): Terminated: ok {rc=0} 17:12:07.878643 --- ParallelTerminationStrategy: PID 32666 died... 17:12:07.898468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32666): Terminated: ok {rc=0} 17:12:07.986788 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:12:09.284413 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:09.292224 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:12:09.317138 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:12:09.356783 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:12:09.446325 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:12:09.470691 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:12:09.509989 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:12:10.108458 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:12:10.161840 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:10.173364 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:12:10.234910 tst cs_paging_gprs_active.py: using LAC 30312 17:12:10.368911 tst cs_paging_gprs_active.py: using RAC 222 17:12:10.497622 tst cs_paging_gprs_active.py: using CellId 30312 17:12:10.621261 tst cs_paging_gprs_active.py: using BVCI 30313 17:12:10.735645 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:10.746837 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:10.757853 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:10.768869 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:10.780152 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:10.791370 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:10.802620 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:10.813736 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:10.825143 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:12:10.946756 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:12:11.068700 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:12:11.292838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:12:11.625489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32671): Launched 17:12:11.917431 run iperf3-srv_10.42.42.10(pid=32672): Launched 17:12:12.043817 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:12:12.267593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:12:12.600807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32673): Launched 17:12:12.892088 run iperf3-srv_10.42.42.10(pid=32674): Launched 17:12:13.018715 tst cs_paging_gprs_active.py:38: start network... 17:12:13.242781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:13.759508 run create_hlr_db(pid=32675): Launched 17:12:13.896391 bus /gobi_6: Setting Powered False 17:12:14.960818 run create_hlr_db(pid=32675): Terminated: ok {rc=0} 17:12:15.402911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32677): Launched 17:12:15.715894 run osmo-hlr_10.42.42.2(pid=32678): Launched 17:12:15.861497 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:16.541579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32680): Launched 17:12:16.895456 run osmo-stp_10.42.42.5(pid=32681): Launched 17:12:17.033880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:12:17.706352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32683): Launched 17:12:17.827188 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:12:18.091060 run patchelf(pid=32684): Launched 17:12:18.263798 run osmo-stp_10.42.42.5(pid=32681): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32681)] 17:12:18.394833 run osmo-stp_10.42.42.5(pid=32681): stdout: | (launched: 2022-12-12_17:12:16.833601) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:18.527300 run osmo-stp_10.42.42.5(pid=32681): stderr: | 20221212171217201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171217201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171217201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171217202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171217202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171217202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171217202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:18.659781 run osmo-stp_10.42.42.5(pid=32681): stdout: | (launched: 2022-12-12_17:12:16.833601) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:18.786993 run osmo-stp_10.42.42.5(pid=32681): stderr: | 20221212171217201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171217201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171217201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171217202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171217202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171217202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171217202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:18.937826 run patchelf(pid=32684): Terminating (SIGINT) 17:12:19.110415 run patchelf(pid=32684): Terminated: ok {rc=0} 17:12:19.235462 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32681): Process ended prematurely: osmo-stp_10.42.42.5(pid=32681) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32681)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:12:19.245251 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 17:12:19.273319 run osmo-hlr_10.42.42.2(pid=32678): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32678)] 17:12:19.321426 run osmo-hlr_10.42.42.2(pid=32678): stdout: | (launched: 2022-12-12_17:12:15.658117) 17:12:19.371641 run osmo-hlr_10.42.42.2(pid=32678): stderr: | 20221212171215868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171215868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171215868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171215868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171215868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171215869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171215888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171215902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171215902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171215902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:19.422254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32671): Terminating (SIGTERM) 17:12:19.462604 run iperf3-srv_10.42.42.10(pid=32672): Terminating (SIGTERM) 17:12:19.502829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32673): Terminating (SIGTERM) 17:12:19.543129 run iperf3-srv_10.42.42.10(pid=32674): Terminating (SIGTERM) 17:12:19.583374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32677): Terminating (SIGTERM) 17:12:19.623723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32680): Terminating (SIGTERM) 17:12:19.663852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32683): Terminating (SIGTERM) 17:12:19.704334 --- ParallelTerminationStrategy: PID 32671 died... 17:12:19.723808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32671): Terminated: ok {rc=0} 17:12:19.769510 --- ParallelTerminationStrategy: PID 32672 died... 17:12:19.788298 run iperf3-srv_10.42.42.10(pid=32672): Terminated {rc=256} 17:12:19.833800 --- ParallelTerminationStrategy: PID 32673 died... 17:12:19.852422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32673): Terminated: ok {rc=0} 17:12:19.897164 --- ParallelTerminationStrategy: PID 32674 died... 17:12:19.915719 run iperf3-srv_10.42.42.10(pid=32674): Terminated {rc=256} 17:12:19.960398 --- ParallelTerminationStrategy: PID 32677 died... 17:12:19.979351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32677): Terminated: ok {rc=0} 17:12:20.023787 --- ParallelTerminationStrategy: PID 32680 died... 17:12:20.042533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32680): Terminated: ok {rc=0} 17:12:20.086997 --- ParallelTerminationStrategy: PID 32683 died... 17:12:20.105837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32683): Terminated: ok {rc=0} 17:12:20.191362 bus /gobi_0: Setting Powered False 17:12:21.293305 bus /gobi_0: Setting Powered False 17:12:22.407539 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:12:23.558774 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:23.571027 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:12:23.635802 tst iperf3.py: using LAC 30313 17:12:23.762154 tst iperf3.py: using RAC 223 17:12:23.883399 tst iperf3.py: using CellId 30313 17:12:24.003799 tst iperf3.py: using BVCI 30314 17:12:24.125914 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:24.137611 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:24.148910 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:24.161334 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:24.172722 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:24.184226 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:24.195759 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:24.207060 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:24.218772 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:12:24.337110 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:12:24.545755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:12:24.858578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32685): Launched 17:12:25.129395 run iperf3-srv_10.42.42.10(pid=32686): Launched 17:12:25.246715 tst iperf3.py:8: start network... 17:12:25.454383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:25.936064 run create_hlr_db(pid=32687): Launched 17:12:26.055664 bus /gobi_6: Setting Powered False 17:12:27.116886 run create_hlr_db(pid=32687): Terminated: ok {rc=0} 17:12:27.548872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32689): Launched 17:12:27.861762 run osmo-hlr_10.42.42.2(pid=32690): Launched 17:12:27.980708 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:28.514643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32692): Launched 17:12:28.826832 run osmo-stp_10.42.42.5(pid=32693): Launched 17:12:28.947469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:12:29.482067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32695): Launched 17:12:29.602975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:12:29.866237 run patchelf(pid=32696): Launched 17:12:30.040578 run osmo-stp_10.42.42.5(pid=32693): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32693)] 17:12:30.171233 run osmo-stp_10.42.42.5(pid=32693): stdout: | (launched: 2022-12-12_17:12:28.769116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:30.303594 run osmo-stp_10.42.42.5(pid=32693): stderr: | 20221212171228943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171228943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171228943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171228943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171228944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171228944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171228944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:30.436242 run osmo-stp_10.42.42.5(pid=32693): stdout: | (launched: 2022-12-12_17:12:28.769116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:30.562816 run osmo-stp_10.42.42.5(pid=32693): stderr: | 20221212171228943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171228943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171228943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171228943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171228944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171228944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171228944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:30.712936 run patchelf(pid=32696): Terminating (SIGINT) 17:12:30.923127 run patchelf(pid=32696): Terminated: ok {rc=0} 17:12:31.069460 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32693): Process ended prematurely: osmo-stp_10.42.42.5(pid=32693) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32693)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 17:12:31.080615 tst iperf3.py:8: Test FAILED (7.6 sec) 17:12:31.111010 run osmo-hlr_10.42.42.2(pid=32690): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32690)] 17:12:31.164707 run osmo-hlr_10.42.42.2(pid=32690): stdout: | (launched: 2022-12-12_17:12:27.803637) 17:12:31.219473 run osmo-hlr_10.42.42.2(pid=32690): stderr: | 20221212171227986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171227986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171227986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171227986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171227986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171227986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171227998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171228006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171228007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171228007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:31.273809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32685): Terminating (SIGTERM) 17:12:31.317894 run iperf3-srv_10.42.42.10(pid=32686): Terminating (SIGTERM) 17:12:31.366350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32689): Terminating (SIGTERM) 17:12:31.410154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32692): Terminating (SIGTERM) 17:12:31.455605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32695): Terminating (SIGTERM) 17:12:31.502166 --- ParallelTerminationStrategy: PID 32685 died... 17:12:31.523399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32685): Terminated: ok {rc=0} 17:12:31.573890 --- ParallelTerminationStrategy: PID 32686 died... 17:12:31.595036 run iperf3-srv_10.42.42.10(pid=32686): Terminated {rc=256} 17:12:31.642422 --- ParallelTerminationStrategy: PID 32689 died... 17:12:31.663029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32689): Terminated: ok {rc=0} 17:12:31.711827 --- ParallelTerminationStrategy: PID 32692 died... 17:12:31.732306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32692): Terminated: ok {rc=0} 17:12:31.780440 --- ParallelTerminationStrategy: PID 32695 died... 17:12:31.801394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32695): Terminated: ok {rc=0} 17:12:31.893159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:12:33.050512 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:33.063010 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:12:33.125397 tst iperf3m4.py: using LAC 30314 17:12:33.255919 tst iperf3m4.py: using RAC 224 17:12:33.388913 tst iperf3m4.py: using CellId 30314 17:12:33.518473 tst iperf3m4.py: using BVCI 30315 17:12:33.640059 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:33.651668 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:33.663128 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:33.674722 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:33.686062 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:33.698031 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:33.709866 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:33.721408 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:33.733141 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:12:33.851998 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:12:33.971498 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:12:34.092698 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:12:34.212594 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:12:34.437687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:12:34.771806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32697): Launched 17:12:35.061504 run iperf3-srv_10.42.42.10(pid=32698): Launched 17:12:35.186543 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:12:35.410139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:12:35.744440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32699): Launched 17:12:36.036587 run iperf3-srv_10.42.42.10(pid=32700): Launched 17:12:36.161355 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:12:36.384397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:12:36.718497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32701): Launched 17:12:37.009147 run iperf3-srv_10.42.42.10(pid=32702): Launched 17:12:37.135150 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:12:37.358377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:12:37.691709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32703): Launched 17:12:37.983633 run iperf3-srv_10.42.42.10(pid=32704): Launched 17:12:38.110006 tst iperf3m4.py:8: start network... 17:12:38.332130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:38.847735 run create_hlr_db(pid=32705): Launched 17:12:38.983942 bus /gobi_6: Setting Powered False 17:12:40.048857 run create_hlr_db(pid=32705): Terminated: ok {rc=0} 17:12:40.508672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32707): Launched 17:12:40.841756 run osmo-hlr_10.42.42.2(pid=32708): Launched 17:12:40.968941 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:41.537073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32710): Launched 17:12:41.868873 run osmo-stp_10.42.42.5(pid=32711): Launched 17:12:41.996702 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:12:42.566236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32713): Launched 17:12:42.692124 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:12:42.973864 run patchelf(pid=32714): Launched 17:12:43.159162 run osmo-stp_10.42.42.5(pid=32711): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32711)] 17:12:43.298576 run osmo-stp_10.42.42.5(pid=32711): stdout: | (launched: 2022-12-12_17:12:41.807661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:43.439986 run osmo-stp_10.42.42.5(pid=32711): stderr: | 20221212171242004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171242004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171242004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171242005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171242005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171242005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171242005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:43.580511 run osmo-stp_10.42.42.5(pid=32711): stdout: | (launched: 2022-12-12_17:12:41.807661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:43.715835 run osmo-stp_10.42.42.5(pid=32711): stderr: | 20221212171242004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171242004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171242004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171242005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171242005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171242005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171242005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:43.876296 run patchelf(pid=32714): Terminating (SIGINT) 17:12:44.060802 run patchelf(pid=32714): Terminated: ok {rc=0} 17:12:44.193598 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32711): Process ended prematurely: osmo-stp_10.42.42.5(pid=32711) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32711)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:12:44.203915 tst iperf3m4.py:8: Test FAILED (11.2 sec) 17:12:44.233208 run osmo-hlr_10.42.42.2(pid=32708): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32708)] 17:12:44.283525 run osmo-hlr_10.42.42.2(pid=32708): stdout: | (launched: 2022-12-12_17:12:40.780141) 17:12:44.335870 run osmo-hlr_10.42.42.2(pid=32708): stderr: | 20221212171240984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171240984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171240984 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171240985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171240985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171240985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171240997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171241005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171241006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171241006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:44.388609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32697): Terminating (SIGTERM) 17:12:44.431087 run iperf3-srv_10.42.42.10(pid=32698): Terminating (SIGTERM) 17:12:44.473552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32699): Terminating (SIGTERM) 17:12:44.515799 run iperf3-srv_10.42.42.10(pid=32700): Terminating (SIGTERM) 17:12:44.558273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32701): Terminating (SIGTERM) 17:12:44.600538 run iperf3-srv_10.42.42.10(pid=32702): Terminating (SIGTERM) 17:12:44.642894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32703): Terminating (SIGTERM) 17:12:44.685317 run iperf3-srv_10.42.42.10(pid=32704): Terminating (SIGTERM) 17:12:44.727827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32707): Terminating (SIGTERM) 17:12:44.770499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32710): Terminating (SIGTERM) 17:12:44.812774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32713): Terminating (SIGTERM) 17:12:44.855342 --- ParallelTerminationStrategy: PID 32697 died... 17:12:44.875658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32697): Terminated: ok {rc=0} 17:12:44.922579 --- ParallelTerminationStrategy: PID 32698 died... 17:12:44.942367 run iperf3-srv_10.42.42.10(pid=32698): Terminated {rc=256} 17:12:44.988825 --- ParallelTerminationStrategy: PID 32699 died... 17:12:45.008874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32699): Terminated: ok {rc=0} 17:12:45.055273 --- ParallelTerminationStrategy: PID 32700 died... 17:12:45.074810 run iperf3-srv_10.42.42.10(pid=32700): Terminated {rc=256} 17:12:45.120530 --- ParallelTerminationStrategy: PID 32701 died... 17:12:45.140313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32701): Terminated: ok {rc=0} 17:12:45.186437 --- ParallelTerminationStrategy: PID 32702 died... 17:12:45.206116 run iperf3-srv_10.42.42.10(pid=32702): Terminated {rc=256} 17:12:45.251825 --- ParallelTerminationStrategy: PID 32703 died... 17:12:45.271609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32703): Terminated: ok {rc=0} 17:12:45.317790 --- ParallelTerminationStrategy: PID 32704 died... 17:12:45.337541 run iperf3-srv_10.42.42.10(pid=32704): Terminated {rc=256} 17:12:45.383296 --- ParallelTerminationStrategy: PID 32707 died... 17:12:45.402932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32707): Terminated: ok {rc=0} 17:12:45.448868 --- ParallelTerminationStrategy: PID 32710 died... 17:12:45.468591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32710): Terminated: ok {rc=0} 17:12:45.514570 --- ParallelTerminationStrategy: PID 32713 died... 17:12:45.534331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32713): Terminated: ok {rc=0} 17:12:45.621536 bus /gobi_4: Setting Powered False 17:12:46.727484 bus /gobi_4: Setting Powered False 17:12:47.858445 bus /gobi_1: Setting Powered False 17:12:48.957143 bus /gobi_1: Setting Powered False 17:12:50.073782 bus /gobi_0: Setting Powered False 17:12:51.172859 bus /gobi_0: Setting Powered False 17:12:52.289464 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:12:53.394195 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:53.406074 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:12:53.466748 tst ping.py: using LAC 30315 17:12:53.584764 tst ping.py: using RAC 225 17:12:53.703513 tst ping.py: using CellId 30315 17:12:53.823975 tst ping.py: using BVCI 30316 17:12:53.935357 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:53.946537 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:53.957398 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:53.968467 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:53.979691 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:53.990951 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:54.002260 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:12:54.013143 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:12:54.134249 tst ping.py:19: start network... 17:12:54.352737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:54.855901 run create_hlr_db(pid=32715): Launched 17:12:54.989988 bus /gobi_6: Setting Powered False 17:12:56.054776 run create_hlr_db(pid=32715): Terminated: ok {rc=0} 17:12:56.489419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32717): Launched 17:12:56.796456 run osmo-hlr_10.42.42.2(pid=32718): Launched 17:12:56.912594 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:57.444035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32720): Launched 17:12:57.750305 run osmo-stp_10.42.42.5(pid=32721): Launched 17:12:57.866622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:12:58.392722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32723): Launched 17:12:58.510025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:12:58.766654 run patchelf(pid=32724): Launched 17:12:58.937398 run osmo-stp_10.42.42.5(pid=32721): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32721)] 17:12:59.065618 run osmo-stp_10.42.42.5(pid=32721): stdout: | (launched: 2022-12-12_17:12:57.693380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:59.195879 run osmo-stp_10.42.42.5(pid=32721): stderr: | 20221212171257867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171257867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171257867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171257867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171257868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171257868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171257868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:59.325842 run osmo-stp_10.42.42.5(pid=32721): stdout: | (launched: 2022-12-12_17:12:57.693380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:59.450465 run osmo-stp_10.42.42.5(pid=32721): stderr: | 20221212171257867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171257867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171257867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171257867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171257868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171257868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171257868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:59.597748 run patchelf(pid=32724): Terminating (SIGINT) 17:12:59.767009 run patchelf(pid=32724): Terminated: ok {rc=0} 17:12:59.889542 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32721): Process ended prematurely: osmo-stp_10.42.42.5(pid=32721) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32721)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 17:12:59.898592 tst ping.py:22: Test FAILED (6.5 sec) 17:12:59.925734 run osmo-hlr_10.42.42.2(pid=32718): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32718)] 17:12:59.973381 run osmo-hlr_10.42.42.2(pid=32718): stdout: | (launched: 2022-12-12_17:12:56.739598) 17:13:00.022974 run osmo-hlr_10.42.42.2(pid=32718): stderr: | 20221212171256919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171256919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171256919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171256919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171256919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171256919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171256931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171256943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171256943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171256943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:00.072728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32717): Terminating (SIGTERM) 17:13:00.112751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32720): Terminating (SIGTERM) 17:13:00.152672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32723): Terminating (SIGTERM) 17:13:00.193127 --- ParallelTerminationStrategy: PID 32717 died... 17:13:00.212182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32717): Terminated: ok {rc=0} 17:13:00.256434 --- ParallelTerminationStrategy: PID 32720 died... 17:13:00.274950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32720): Terminated: ok {rc=0} 17:13:00.319215 --- ParallelTerminationStrategy: PID 32723 died... 17:13:00.337889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32723): Terminated: ok {rc=0} 17:13:00.423554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:13:01.514623 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:13:01.530832 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:13:01.603392 tst ping_idle_ping.py: using LAC 30316 17:13:01.734422 tst ping_idle_ping.py: using RAC 226 17:13:01.859350 tst ping_idle_ping.py: using CellId 30316 17:13:02.003438 tst ping_idle_ping.py: using BVCI 30317 17:13:02.125699 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:13:02.138069 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:13:02.150811 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:13:02.164061 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:13:02.176460 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:13:02.188682 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:13:02.201215 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:13:02.213357 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:13:02.336782 tst ping_idle_ping.py:24: start network... 17:13:02.555897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:03.063844 run create_hlr_db(pid=32726): Launched 17:13:03.196041 bus /gobi_6: Setting Powered False 17:13:04.259550 run create_hlr_db(pid=32726): Terminated: ok {rc=0} 17:13:04.696839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32728): Launched 17:13:05.002690 run osmo-hlr_10.42.42.2(pid=32729): Launched 17:13:05.121760 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:05.651267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32731): Launched 17:13:05.958027 run osmo-stp_10.42.42.5(pid=32732): Launched 17:13:06.074427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:13:06.602299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32734): Launched 17:13:06.720347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:13:06.978151 run patchelf(pid=32735): Launched 17:13:07.149753 run osmo-stp_10.42.42.5(pid=32732): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32732)] 17:13:07.278027 run osmo-stp_10.42.42.5(pid=32732): stdout: | (launched: 2022-12-12_17:13:05.900902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:07.408274 run osmo-stp_10.42.42.5(pid=32732): stderr: | 20221212171306073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171306073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171306074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171306074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171306074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171306075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171306075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:07.538548 run osmo-stp_10.42.42.5(pid=32732): stdout: | (launched: 2022-12-12_17:13:05.900902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:07.663399 run osmo-stp_10.42.42.5(pid=32732): stderr: | 20221212171306073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171306073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171306074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171306074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171306074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171306075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171306075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:07.810869 run patchelf(pid=32735): Terminating (SIGINT) 17:13:07.980387 run patchelf(pid=32735): Terminated: ok {rc=0} 17:13:08.102752 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32732): Process ended prematurely: osmo-stp_10.42.42.5(pid=32732) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32732)] [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:13:08.111769 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:13:08.139662 run osmo-hlr_10.42.42.2(pid=32729): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32729)] 17:13:08.187633 run osmo-hlr_10.42.42.2(pid=32729): stdout: | (launched: 2022-12-12_17:13:04.945724) 17:13:08.237258 run osmo-hlr_10.42.42.2(pid=32729): stderr: | 20221212171305121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171305121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171305121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171305121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171305121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171305121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171305134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171305143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171305143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171305143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:08.287092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32728): Terminating (SIGTERM) 17:13:08.327002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32731): Terminating (SIGTERM) 17:13:08.367107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32734): Terminating (SIGTERM) 17:13:08.407393 --- ParallelTerminationStrategy: PID 32728 died... 17:13:08.426631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32728): Terminated: ok {rc=0} 17:13:08.471174 --- ParallelTerminationStrategy: PID 32731 died... 17:13:08.489938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32731): Terminated: ok {rc=0} 17:13:08.534018 --- ParallelTerminationStrategy: PID 32734 died... 17:13:08.552739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32734): Terminated: ok {rc=0} 17:13:08.639180 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 17:13:09.931615 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:09.940920 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:13:09.965943 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:13:10.001351 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:13:10.055272 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:13:10.079678 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:13:10.114897 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:13:10.679303 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:13:10.684568 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:13:10.696673 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:13:10.759007 tst switch_tch_pdch.py: using LAC 30317 17:13:10.885426 tst switch_tch_pdch.py: using RAC 227 17:13:11.012742 tst switch_tch_pdch.py: using CellId 30317 17:13:11.141169 tst switch_tch_pdch.py: using BVCI 30318 17:13:11.258820 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:13:11.270951 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:13:11.282952 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:13:11.294912 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:13:11.306925 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:13:11.318867 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:13:11.331012 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:13:11.343120 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:13:11.461488 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:13:11.580647 tst switch_tch_pdch.py:51: start network... 17:13:11.800365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:12.304903 run create_hlr_db(pid=32741): Launched 17:13:12.438411 bus /gobi_6: Setting Powered False 17:13:13.502660 run create_hlr_db(pid=32741): Terminated: ok {rc=0} 17:13:13.955407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32743): Launched 17:13:14.283722 run osmo-hlr_10.42.42.2(pid=32744): Launched 17:13:14.409973 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:14.970130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32746): Launched 17:13:15.294866 run osmo-stp_10.42.42.5(pid=32747): Launched 17:13:15.419712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:13:15.998754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32749): Launched 17:13:16.138490 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:13:16.420849 run patchelf(pid=32750): Launched 17:13:16.617824 run osmo-stp_10.42.42.5(pid=32747): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32747)] 17:13:16.757572 run osmo-stp_10.42.42.5(pid=32747): stdout: | (launched: 2022-12-12_17:13:15.234528) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:16.898308 run osmo-stp_10.42.42.5(pid=32747): stderr: | 20221212171315429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171315429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171315429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171315430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171315430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171315430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171315430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:17.038943 run osmo-stp_10.42.42.5(pid=32747): stdout: | (launched: 2022-12-12_17:13:15.234528) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:17.173252 run osmo-stp_10.42.42.5(pid=32747): stderr: | 20221212171315429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171315429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171315429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171315430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171315430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171315430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171315430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:17.330614 run patchelf(pid=32750): Terminating (SIGINT) 17:13:17.510742 run patchelf(pid=32750): Terminated: ok {rc=0} 17:13:17.640847 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32747): Process ended prematurely: osmo-stp_10.42.42.5(pid=32747) [trial-2379↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32747)] [trial-2379↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:13:17.650605 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 17:13:17.678620 run osmo-hlr_10.42.42.2(pid=32744): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32744)] 17:13:17.728634 run osmo-hlr_10.42.42.2(pid=32744): stdout: | (launched: 2022-12-12_17:13:14.222913) 17:13:17.780195 run osmo-hlr_10.42.42.2(pid=32744): stderr: | 20221212171314423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171314423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171314423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171314423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171314424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171314424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171314437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171314445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171314445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171314445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:17.832323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32743): Terminating (SIGTERM) 17:13:17.874130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32746): Terminating (SIGTERM) 17:13:17.915806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32749): Terminating (SIGTERM) 17:13:17.957764 --- ParallelTerminationStrategy: PID 32743 died... 17:13:17.977369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32743): Terminated: ok {rc=0} 17:13:18.023196 --- ParallelTerminationStrategy: PID 32746 died... 17:13:18.042791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32746): Terminated: ok {rc=0} 17:13:18.088884 --- ParallelTerminationStrategy: PID 32749 died... 17:13:18.108508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32749): Terminated: ok {rc=0} 17:13:18.196324 bus /gobi_0: Setting Powered False 17:13:19.297885 bus /gobi_0: Setting Powered False 17:13:20.413891 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 sms:nanobts+band-900 --------------------------------------------------------------------- 17:13:21.661580 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:21.666916 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 17:13:21.700599 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 17:13:21.728367 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 17:13:21.781896 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 17:13:21.815920 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 17:13:21.843385 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 17:13:22.390866 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 17:13:22.396117 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:22.407137 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 17:13:22.453651 tst mo_mt_sms.py: using LAC 30318 17:13:22.575962 tst mo_mt_sms.py: using RAC 228 17:13:22.694748 tst mo_mt_sms.py: using CellId 30318 17:13:22.816253 tst mo_mt_sms.py: using BVCI 30319 17:13:22.927666 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:22.938349 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:22.948836 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:22.959738 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:22.970573 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:22.981400 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 17:13:23.100435 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 17:13:23.220543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:23.723256 run create_hlr_db(pid=32754): Launched 17:13:23.855358 bus /gobi_6: Setting Powered False 17:13:24.919636 run create_hlr_db(pid=32754): Terminated: ok {rc=0} 17:13:25.352915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32756): Launched 17:13:25.657165 run osmo-hlr_10.42.42.2(pid=32757): Launched 17:13:25.774087 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:26.309691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32759): Launched 17:13:26.615856 run osmo-stp_10.42.42.5(pid=32760): Launched 17:13:26.732933 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:27.282887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32762): Launched 17:13:27.588498 run osmo-msc_10.42.42.6(pid=32763): Launched 17:13:27.759754 run osmo-stp_10.42.42.5(pid=32760): ERR: Terminated: ERROR {rc=1} [trial-2379↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32760)] 17:13:27.888919 run osmo-stp_10.42.42.5(pid=32760): stdout: | (launched: 2022-12-12_17:13:26.559157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:28.017944 run osmo-stp_10.42.42.5(pid=32760): stderr: | 20221212171326732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171326732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171326732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171326733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171326733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171326733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171326733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:28.144382 run osmo-stp_10.42.42.5(pid=32760): stdout: | (launched: 2022-12-12_17:13:26.559157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:28.264620 run osmo-stp_10.42.42.5(pid=32760): stderr: | 20221212171326732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171326732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171326732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171326733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171326733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171326733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171326733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:28.409982 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32760): Process ended prematurely: osmo-stp_10.42.42.5(pid=32760) [trial-2379↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32760)] [trial-2379↪sms:nanobts+band-900↪mo_mt_sms.py:16] 17:13:28.418349 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 17:13:28.445149 run osmo-hlr_10.42.42.2(pid=32757): ERR: Terminated: ERROR {rc=237} [trial-2379↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32757)] 17:13:28.492759 run osmo-hlr_10.42.42.2(pid=32757): stdout: | (launched: 2022-12-12_17:13:25.600531) 17:13:28.542232 run osmo-hlr_10.42.42.2(pid=32757): stderr: | 20221212171325780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171325781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171325781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171325781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171325781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171325781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171325792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171325800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171325801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171325801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:28.611425 run osmo-msc_10.42.42.6(pid=32763): ERR: Terminated: ERROR {rc=2} [trial-2379↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32763)] 17:13:28.659322 run osmo-msc_10.42.42.6(pid=32763): stdout: | (launched: 2022-12-12_17:13:27.531686) 17:13:28.709197 run osmo-msc_10.42.42.6(pid=32763): stderr: | 20221212171327807 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171327807 DLGLOBAL DEBUG validating counter group 0x7f3d8e293c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171327807 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171327807 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171327808 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171327808 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171327810 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171327810 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171327810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171327810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:28.758940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32756): Terminating (SIGTERM) 17:13:28.798856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32759): Terminating (SIGTERM) 17:13:28.838797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32762): Terminating (SIGTERM) 17:13:28.879337 --- ParallelTerminationStrategy: PID 32756 died... 17:13:28.898647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32756): Terminated: ok {rc=0} 17:13:28.943156 --- ParallelTerminationStrategy: PID 32759 died... 17:13:28.962184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32759): Terminated: ok {rc=0} 17:13:29.006179 --- ParallelTerminationStrategy: PID 32762 died... 17:13:29.024674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32762): Terminated: ok {rc=0} 17:13:29.108437 bus /sierra_3: Setting Powered False 17:13:30.204154 bus /sierra_3: Setting Powered False 17:13:31.319461 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 17:13:32.551829 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:32.558087 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 17:13:32.591083 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 17:13:32.598104 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 17:13:32.633902 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 17:13:32.667397 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 17:13:32.674365 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 17:13:33.194516 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 17:13:33.199925 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 17:13:33.211219 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 17:13:33.259533 tst assert_extension.py: using LAC 30319 17:13:33.381738 tst assert_extension.py: using RAC 229 17:13:33.511405 tst assert_extension.py: using CellId 30319 17:13:33.638555 tst assert_extension.py: using BVCI 30320 17:13:33.758855 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 17:13:33.875923 tst assert_extension.py:10: start nitb and bts... 17:13:34.079852 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:13:34.702769 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=300): Launched 17:13:35.009699 run osmo-nitb_10.42.42.2(pid=301): Launched 17:13:35.178372 run osmo-nitb_10.42.42.2(pid=301): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=301)] 17:13:35.314422 run osmo-nitb_10.42.42.2(pid=301): stdout: | (launched: 2022-12-12_17:13:34.952411) 17:13:35.451834 run osmo-nitb_10.42.42.2(pid=301): stderr: | (launched: 2022-12-12_17:13:34.997691) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:13:35.589437 run osmo-nitb_10.42.42.2(pid=301): stdout: | (launched: 2022-12-12_17:13:34.952411) 17:13:35.721936 run osmo-nitb_10.42.42.2(pid=301): stderr: | (launched: 2022-12-12_17:13:34.997691) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=301): Process ended prematurely: osmo-nitb_10.42.42.2(pid=301) [trial-2379↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=301)] 17:13:36.124740 tst osmo-nitb_10.42.42.2(pid=301): stdout: | (launched: 2022-12-12_17:13:34.952411) 17:13:36.247568 tst osmo-nitb_10.42.42.2(pid=301): stderr: | (launched: 2022-12-12_17:13:34.997691) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:13:36.392011 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=301): Process ended prematurely: osmo-nitb_10.42.42.2(pid=301) [trial-2379↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=301)] [trial-2379↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 17:13:36.401384 tst assert_extension.py:12: Test FAILED (3.2 sec) 17:13:36.408026 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=300): Terminating (SIGTERM) 17:13:36.619026 --- ParallelTerminationStrategy: PID 300 died... 17:13:36.639761 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=300): Terminated: ok {rc=0} 17:13:36.726946 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 ussd:nanobts+band-900 --------------------------------------------------------------------- 17:13:37.905948 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:37.911086 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 17:13:37.944003 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 17:13:37.970631 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 17:13:38.006056 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 17:13:38.039199 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 17:13:38.066175 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 17:13:38.593234 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 17:13:38.598396 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:38.609201 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 17:13:38.658241 tst assert_extension.py: using LAC 30320 17:13:38.781081 tst assert_extension.py: using RAC 230 17:13:38.910061 tst assert_extension.py: using CellId 30320 17:13:39.039330 tst assert_extension.py: using BVCI 30321 17:13:39.157676 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:39.169080 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:39.180137 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:39.191161 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:39.202341 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:13:39.213428 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 17:13:39.328912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:39.801752 run create_hlr_db(pid=305): Launched 17:13:39.919045 bus /sierra_2: Setting Powered False 17:13:40.979902 run create_hlr_db(pid=305): Terminated: ok {rc=0} 17:13:41.426054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=307): Launched 17:13:41.754353 run osmo-hlr_10.42.42.2(pid=308): Launched 17:13:41.880807 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:42.445587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=310): Launched 17:13:42.774541 run osmo-stp_10.42.42.5(pid=311): Launched 17:13:42.898653 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:43.490873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=313): Launched 17:13:43.817986 run osmo-msc_10.42.42.6(pid=314): Launched 17:13:44.000449 run osmo-stp_10.42.42.5(pid=311): ERR: Terminated: ERROR {rc=1} [trial-2379↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=311)] 17:13:44.137311 run osmo-stp_10.42.42.5(pid=311): stdout: | (launched: 2022-12-12_17:13:42.713400) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:44.274324 run osmo-stp_10.42.42.5(pid=311): stderr: | 20221212171342908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171342909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171342909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171342909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171342910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171342910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171342910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:44.410588 run osmo-stp_10.42.42.5(pid=311): stdout: | (launched: 2022-12-12_17:13:42.713400) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:44.540642 run osmo-stp_10.42.42.5(pid=311): stderr: | 20221212171342908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171342909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171342909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171342909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171342910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171342910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171342910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:44.695485 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=311): Process ended prematurely: osmo-stp_10.42.42.5(pid=311) [trial-2379↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=311)] [trial-2379↪ussd:nanobts+band-900↪assert_extension.py:17] 17:13:44.704497 tst assert_extension.py:17: Test FAILED (6.1 sec) 17:13:44.732452 run osmo-hlr_10.42.42.2(pid=308): ERR: Terminated: ERROR {rc=237} [trial-2379↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=308)] 17:13:44.783427 run osmo-hlr_10.42.42.2(pid=308): stdout: | (launched: 2022-12-12_17:13:41.693301) 17:13:44.835694 run osmo-hlr_10.42.42.2(pid=308): stderr: | 20221212171341895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171341895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171341895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171341895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171341895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171341895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171341940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171341950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171341950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171341950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:44.908793 run osmo-msc_10.42.42.6(pid=314): ERR: Terminated: ERROR {rc=2} [trial-2379↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=314)] 17:13:44.959370 run osmo-msc_10.42.42.6(pid=314): stdout: | (launched: 2022-12-12_17:13:43.757424) 17:13:45.011705 run osmo-msc_10.42.42.6(pid=314): stderr: | 20221212171344083 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171344083 DLGLOBAL DEBUG validating counter group 0x7fdeee5c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171344083 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171344083 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171344083 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171344083 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171344085 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171344085 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171344086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171344086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:45.064272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=307): Terminating (SIGTERM) 17:13:45.106522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=310): Terminating (SIGTERM) 17:13:45.148449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=313): Terminating (SIGTERM) 17:13:45.190724 --- ParallelTerminationStrategy: PID 307 died... 17:13:45.211098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=307): Terminated: ok {rc=0} 17:13:45.258004 --- ParallelTerminationStrategy: PID 310 died... 17:13:45.278437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=310): Terminated: ok {rc=0} 17:13:45.325081 --- ParallelTerminationStrategy: PID 313 died... 17:13:45.344830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=313): Terminated: ok {rc=0} 17:13:45.434349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:13:46.644634 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:46.653892 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:13:46.690417 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:13:46.719441 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:13:46.774230 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:13:46.817482 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:13:46.852696 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:13:47.384561 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:13:47.435300 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:47.446846 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:13:47.512925 tst mo_mt_call.py: using LAC 30321 17:13:47.634583 tst mo_mt_call.py: using RAC 231 17:13:47.757319 tst mo_mt_call.py: using CellId 30321 17:13:47.881492 tst mo_mt_call.py: using BVCI 30322 17:13:47.994363 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:48.005682 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:48.016724 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:48.028134 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:48.039598 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:48.051010 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:48.172289 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:48.289570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:48.771714 run create_hlr_db(pid=319): Launched 17:13:48.890897 bus /sierra_2: Setting Powered False 17:13:49.953193 run create_hlr_db(pid=319): Terminated: ok {rc=0} 17:13:50.383914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=321): Launched 17:13:50.694501 run osmo-hlr_10.42.42.2(pid=322): Launched 17:13:50.813606 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:51.359875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=324): Launched 17:13:51.691790 run osmo-stp_10.42.42.5(pid=325): Launched 17:13:51.819104 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:52.417528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=327): Launched 17:13:52.751146 run osmo-msc_10.42.42.6(pid=328): Launched 17:13:52.936266 run osmo-stp_10.42.42.5(pid=325): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=325)] 17:13:53.075016 run osmo-stp_10.42.42.5(pid=325): stdout: | (launched: 2022-12-12_17:13:51.631160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:53.214661 run osmo-stp_10.42.42.5(pid=325): stderr: | 20221212171351824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171351824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171351824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171351825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171351825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171351825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171351825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:53.352275 run osmo-stp_10.42.42.5(pid=325): stdout: | (launched: 2022-12-12_17:13:51.631160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:53.483254 run osmo-stp_10.42.42.5(pid=325): stderr: | 20221212171351824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171351824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171351824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171351825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171351825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171351825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171351825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:53.639858 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=325): Process ended prematurely: osmo-stp_10.42.42.5(pid=325) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=325)] [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:13:53.649666 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:13:53.677552 run osmo-hlr_10.42.42.2(pid=322): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=322)] 17:13:53.727330 run osmo-hlr_10.42.42.2(pid=322): stdout: | (launched: 2022-12-12_17:13:50.636652) 17:13:53.779138 run osmo-hlr_10.42.42.2(pid=322): stderr: | 20221212171350815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171350816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171350816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171350816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171350816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171350816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171350828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171350836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171350836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171350836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:53.851436 run osmo-msc_10.42.42.6(pid=328): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=328)] 17:13:53.901314 run osmo-msc_10.42.42.6(pid=328): stdout: | (launched: 2022-12-12_17:13:52.689597) 17:13:53.952651 run osmo-msc_10.42.42.6(pid=328): stderr: | 20221212171353015 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171353015 DLGLOBAL DEBUG validating counter group 0x7f90b5577c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171353015 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171353015 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171353015 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171353016 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171353017 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171353018 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171353018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171353018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:54.004515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=321): Terminating (SIGTERM) 17:13:54.046180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=324): Terminating (SIGTERM) 17:13:54.087867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=327): Terminating (SIGTERM) 17:13:54.129871 --- ParallelTerminationStrategy: PID 321 died... 17:13:54.149821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=321): Terminated: ok {rc=0} 17:13:54.195957 --- ParallelTerminationStrategy: PID 324 died... 17:13:54.215471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=324): Terminated: ok {rc=0} 17:13:54.261318 --- ParallelTerminationStrategy: PID 327 died... 17:13:54.280754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=327): Terminated: ok {rc=0} 17:13:54.368866 bus /sierra_3: Setting Powered False 17:13:55.467666 bus /sierra_3: Setting Powered False 17:13:56.580884 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:13:57.730887 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:57.743829 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:13:57.814325 tst mo_mt_call_osmux.py: using LAC 30322 17:13:57.944806 tst mo_mt_call_osmux.py: using RAC 232 17:13:58.074499 tst mo_mt_call_osmux.py: using CellId 30322 17:13:58.204859 tst mo_mt_call_osmux.py: using BVCI 30323 17:13:58.326788 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:58.338557 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:58.350226 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:58.361974 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:58.373709 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:58.385282 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:58.505630 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:58.629696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:59.145563 run create_hlr_db(pid=330): Launched 17:13:59.280908 bus /sierra_2: Setting Powered False 17:14:00.346691 run create_hlr_db(pid=330): Terminated: ok {rc=0} 17:14:00.788890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=333): Launched 17:14:01.137317 run osmo-hlr_10.42.42.2(pid=334): Launched 17:14:01.330961 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:01.996860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=336): Launched 17:14:02.347322 run osmo-stp_10.42.42.5(pid=337): Launched 17:14:02.488796 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:03.051371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=339): Launched 17:14:03.363694 run osmo-msc_10.42.42.6(pid=340): Launched 17:14:03.538828 run osmo-stp_10.42.42.5(pid=337): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=337)] 17:14:03.669565 run osmo-stp_10.42.42.5(pid=337): stdout: | (launched: 2022-12-12_17:14:02.286199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:03.800363 run osmo-stp_10.42.42.5(pid=337): stderr: | 20221212171402487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171402487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171402487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171402488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171402488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171402488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171402488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:03.929181 run osmo-stp_10.42.42.5(pid=337): stdout: | (launched: 2022-12-12_17:14:02.286199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:04.052308 run osmo-stp_10.42.42.5(pid=337): stderr: | 20221212171402487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171402487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171402487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171402488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171402488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171402488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171402488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:04.200039 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=337): Process ended prematurely: osmo-stp_10.42.42.5(pid=337) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=337)] [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:14:04.209367 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:14:04.236331 run osmo-hlr_10.42.42.2(pid=334): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=334)] 17:14:04.284179 run osmo-hlr_10.42.42.2(pid=334): stdout: | (launched: 2022-12-12_17:14:01.074901) 17:14:04.333608 run osmo-hlr_10.42.42.2(pid=334): stderr: | 20221212171401357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171401358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171401358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171401358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171401358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171401358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171401378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171401403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171401403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171401403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:04.402906 run osmo-msc_10.42.42.6(pid=340): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=340)] 17:14:04.450506 run osmo-msc_10.42.42.6(pid=340): stdout: | (launched: 2022-12-12_17:14:03.306079) 17:14:04.499802 run osmo-msc_10.42.42.6(pid=340): stderr: | 20221212171403581 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171403581 DLGLOBAL DEBUG validating counter group 0x7f135656ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171403581 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171403581 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171403581 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171403581 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171403583 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171403583 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171403584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171403584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:04.549631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=333): Terminating (SIGTERM) 17:14:04.589297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=336): Terminating (SIGTERM) 17:14:04.629236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=339): Terminating (SIGTERM) 17:14:04.670213 --- ParallelTerminationStrategy: PID 333 died... 17:14:04.689356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=333): Terminated: ok {rc=0} 17:14:04.733599 --- ParallelTerminationStrategy: PID 336 died... 17:14:04.752033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=336): Terminated: ok {rc=0} 17:14:04.796134 --- ParallelTerminationStrategy: PID 339 died... 17:14:04.814942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=339): Terminated: ok {rc=0} 17:14:04.900930 bus /sierra_3: Setting Powered False 17:14:06.002470 bus /sierra_3: Setting Powered False 17:14:07.118117 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:14:08.376274 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:08.385455 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:14:08.418620 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:14:08.445625 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:14:08.497910 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:14:08.530827 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:14:08.557982 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:14:09.107305 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:14:09.157516 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:09.168898 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:14:09.238032 tst mo_mt_call.py: using LAC 30323 17:14:09.359437 tst mo_mt_call.py: using RAC 233 17:14:09.488675 tst mo_mt_call.py: using CellId 30323 17:14:09.616942 tst mo_mt_call.py: using BVCI 30324 17:14:09.737142 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:09.749436 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:09.761152 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:09.772737 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:09.784345 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:09.795890 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:14:09.912623 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:14:10.032861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:10.546830 run create_hlr_db(pid=345): Launched 17:14:10.683815 bus /sierra_2: Setting Powered False 17:14:11.750123 run create_hlr_db(pid=345): Terminated: ok {rc=0} 17:14:12.191344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=349): Launched 17:14:12.502682 run osmo-hlr_10.42.42.2(pid=355): Launched 17:14:12.622418 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:13.169142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=358): Launched 17:14:13.479024 run osmo-stp_10.42.42.5(pid=359): Launched 17:14:13.600250 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:14.160383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=361): Launched 17:14:14.470872 run osmo-msc_10.42.42.6(pid=362): Launched 17:14:14.648635 run osmo-stp_10.42.42.5(pid=359): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=359)] 17:14:14.780544 run osmo-stp_10.42.42.5(pid=359): stdout: | (launched: 2022-12-12_17:14:13.421435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:14.911580 run osmo-stp_10.42.42.5(pid=359): stderr: | 20221212171413595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171413595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171413595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171413596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171413596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171413596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171413596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:15.040391 run osmo-stp_10.42.42.5(pid=359): stdout: | (launched: 2022-12-12_17:14:13.421435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:15.163388 run osmo-stp_10.42.42.5(pid=359): stderr: | 20221212171413595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171413595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171413595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171413596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171413596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171413596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171413596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:15.310436 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=359): Process ended prematurely: osmo-stp_10.42.42.5(pid=359) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=359)] [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:14:15.319650 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:14:15.346378 run osmo-hlr_10.42.42.2(pid=355): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=355)] 17:14:15.395350 run osmo-hlr_10.42.42.2(pid=355): stdout: | (launched: 2022-12-12_17:14:12.445159) 17:14:15.445389 run osmo-hlr_10.42.42.2(pid=355): stderr: | 20221212171412622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171412622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171412622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171412622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171412622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171412622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171412636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171412645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171412645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171412645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:15.514509 run osmo-msc_10.42.42.6(pid=362): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=362)] 17:14:15.562439 run osmo-msc_10.42.42.6(pid=362): stdout: | (launched: 2022-12-12_17:14:14.413163) 17:14:15.611508 run osmo-msc_10.42.42.6(pid=362): stderr: | 20221212171414688 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171414688 DLGLOBAL DEBUG validating counter group 0x7fdfbd0c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171414688 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171414688 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171414688 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171414688 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171414690 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171414691 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171414691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171414691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:15.660930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=349): Terminating (SIGTERM) 17:14:15.700909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=358): Terminating (SIGTERM) 17:14:15.740660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=361): Terminating (SIGTERM) 17:14:15.780608 --- ParallelTerminationStrategy: PID 349 died... 17:14:15.800035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=349): Terminated: ok {rc=0} 17:14:15.859815 --- ParallelTerminationStrategy: PID 358 died... 17:14:15.880520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=358): Terminated: ok {rc=0} 17:14:15.930164 --- ParallelTerminationStrategy: PID 361 died... 17:14:15.950566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=361): Terminated: ok {rc=0} 17:14:16.049437 bus /sierra_3: Setting Powered False 17:14:17.150096 bus /sierra_3: Setting Powered False 17:14:18.269801 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:14:19.417678 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:19.429823 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:14:19.498249 tst mo_mt_call_osmux.py: using LAC 30324 17:14:19.630568 tst mo_mt_call_osmux.py: using RAC 234 17:14:19.761719 tst mo_mt_call_osmux.py: using CellId 30324 17:14:19.885271 tst mo_mt_call_osmux.py: using BVCI 30325 17:14:19.997723 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:20.009144 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:20.020309 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:20.031866 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:20.043147 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:14:20.054837 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:14:20.176277 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:14:20.298745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:20.815839 run create_hlr_db(pid=369): Launched 17:14:20.952301 bus /sierra_2: Setting Powered False 17:14:22.016859 run create_hlr_db(pid=369): Terminated: ok {rc=0} 17:14:22.459292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=371): Launched 17:14:22.771482 run osmo-hlr_10.42.42.2(pid=372): Launched 17:14:22.891106 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:23.439576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=374): Launched 17:14:23.750445 run osmo-stp_10.42.42.5(pid=375): Launched 17:14:23.870528 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:24.430577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=377): Launched 17:14:24.741673 run osmo-msc_10.42.42.6(pid=378): Launched 17:14:24.917939 run osmo-stp_10.42.42.5(pid=375): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=375)] 17:14:25.049076 run osmo-stp_10.42.42.5(pid=375): stdout: | (launched: 2022-12-12_17:14:23.692745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:25.179707 run osmo-stp_10.42.42.5(pid=375): stderr: | 20221212171423864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171423865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171423865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171423865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171423866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171423866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171423866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:25.308378 run osmo-stp_10.42.42.5(pid=375): stdout: | (launched: 2022-12-12_17:14:23.692745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:25.431491 run osmo-stp_10.42.42.5(pid=375): stderr: | 20221212171423864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171423865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171423865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171423865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171423866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171423866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171423866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:25.578560 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=375): Process ended prematurely: osmo-stp_10.42.42.5(pid=375) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=375)] [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:14:25.587674 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:14:25.614557 run osmo-hlr_10.42.42.2(pid=372): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=372)] 17:14:25.662519 run osmo-hlr_10.42.42.2(pid=372): stdout: | (launched: 2022-12-12_17:14:22.712774) 17:14:25.712120 run osmo-hlr_10.42.42.2(pid=372): stderr: | 20221212171422889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171422889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171422889 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171422889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171422889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171422889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171422902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171422910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171422910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171422910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:25.781168 run osmo-msc_10.42.42.6(pid=378): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=378)] 17:14:25.828815 run osmo-msc_10.42.42.6(pid=378): stdout: | (launched: 2022-12-12_17:14:24.684086) 17:14:25.877979 run osmo-msc_10.42.42.6(pid=378): stderr: | 20221212171424961 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171424961 DLGLOBAL DEBUG validating counter group 0x7f0a1f858c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171424961 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171424961 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171424962 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171424962 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171424963 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171424964 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171424964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171424964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:25.927754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=371): Terminating (SIGTERM) 17:14:25.967632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=374): Terminating (SIGTERM) 17:14:26.007241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=377): Terminating (SIGTERM) 17:14:26.047137 --- ParallelTerminationStrategy: PID 371 died... 17:14:26.066083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=371): Terminated: ok {rc=0} 17:14:26.110095 --- ParallelTerminationStrategy: PID 374 died... 17:14:26.128583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=374): Terminated: ok {rc=0} 17:14:26.172634 --- ParallelTerminationStrategy: PID 377 died... 17:14:26.191423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=377): Terminated: ok {rc=0} 17:14:26.277707 bus /sierra_3: Setting Powered False 17:14:27.376723 bus /sierra_3: Setting Powered False 17:14:28.492256 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:14:29.747045 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:29.755334 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:14:29.791595 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:14:29.818510 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:14:29.869780 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:14:29.902318 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:14:29.929187 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:14:30.479866 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:14:30.530575 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:30.542060 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:14:30.611484 tst mo_mt_call.py: using LAC 30325 17:14:30.732478 tst mo_mt_call.py: using RAC 235 17:14:30.882155 tst mo_mt_call.py: using CellId 30325 17:14:31.024513 tst mo_mt_call.py: using BVCI 30326 17:14:31.149902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:31.163700 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:31.176570 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:31.191079 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:31.204807 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:31.217761 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:14:31.346051 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:14:31.465085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:31.988782 run create_hlr_db(pid=383): Launched 17:14:32.143965 bus /sierra_2: Setting Powered False 17:14:33.204712 run create_hlr_db(pid=383): Terminated: ok {rc=0} 17:14:33.634960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=385): Launched 17:14:33.946825 run osmo-hlr_10.42.42.2(pid=386): Launched 17:14:34.066694 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:34.621367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=389): Launched 17:14:34.933483 run osmo-stp_10.42.42.5(pid=390): Launched 17:14:35.050933 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:35.608919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=392): Launched 17:14:35.919517 run osmo-msc_10.42.42.6(pid=393): Launched 17:14:36.093220 run osmo-stp_10.42.42.5(pid=390): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=390)] 17:14:36.224182 run osmo-stp_10.42.42.5(pid=390): stdout: | (launched: 2022-12-12_17:14:34.875233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:36.354684 run osmo-stp_10.42.42.5(pid=390): stderr: | 20221212171435050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171435050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171435050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171435050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171435051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171435051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171435051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:36.482906 run osmo-stp_10.42.42.5(pid=390): stdout: | (launched: 2022-12-12_17:14:34.875233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:36.605510 run osmo-stp_10.42.42.5(pid=390): stderr: | 20221212171435050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171435050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171435050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171435050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171435051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171435051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171435051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:36.752556 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=390): Process ended prematurely: osmo-stp_10.42.42.5(pid=390) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=390)] [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:14:36.761604 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:14:36.788665 run osmo-hlr_10.42.42.2(pid=386): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=386)] 17:14:36.836578 run osmo-hlr_10.42.42.2(pid=386): stdout: | (launched: 2022-12-12_17:14:33.889104) 17:14:36.886551 run osmo-hlr_10.42.42.2(pid=386): stderr: | 20221212171434068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171434068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171434068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171434068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171434068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171434068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171434081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171434090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171434090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171434090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:36.956575 run osmo-msc_10.42.42.6(pid=393): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=393)] 17:14:37.004728 run osmo-msc_10.42.42.6(pid=393): stdout: | (launched: 2022-12-12_17:14:35.861546) 17:14:37.054153 run osmo-msc_10.42.42.6(pid=393): stderr: | 20221212171436138 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171436139 DLGLOBAL DEBUG validating counter group 0x7fc3318eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171436139 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171436139 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171436139 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171436139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171436141 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171436141 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171436142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171436142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:37.103899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=385): Terminating (SIGTERM) 17:14:37.143578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=389): Terminating (SIGTERM) 17:14:37.183180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=392): Terminating (SIGTERM) 17:14:37.223004 --- ParallelTerminationStrategy: PID 385 died... 17:14:37.242053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=385): Terminated: ok {rc=0} 17:14:37.285957 --- ParallelTerminationStrategy: PID 389 died... 17:14:37.304172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=389): Terminated: ok {rc=0} 17:14:37.348282 --- ParallelTerminationStrategy: PID 392 died... 17:14:37.366751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=392): Terminated: ok {rc=0} 17:14:37.452176 bus /sierra_3: Setting Powered False 17:14:38.552336 bus /sierra_3: Setting Powered False 17:14:39.668163 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:14:40.815136 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:40.827261 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:14:40.894889 tst mo_mt_call_osmux.py: using LAC 30326 17:14:41.016304 tst mo_mt_call_osmux.py: using RAC 236 17:14:41.138816 tst mo_mt_call_osmux.py: using CellId 30326 17:14:41.259698 tst mo_mt_call_osmux.py: using BVCI 30327 17:14:41.372936 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:41.384383 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:41.395623 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:41.407049 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:41.418761 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:14:41.430195 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:14:41.550471 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:14:41.672180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:42.154541 run create_hlr_db(pid=395): Launched 17:14:42.274924 bus /sierra_2: Setting Powered False 17:14:43.335882 run create_hlr_db(pid=395): Terminated: ok {rc=0} 17:14:43.767687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=397): Launched 17:14:44.078532 run osmo-hlr_10.42.42.2(pid=398): Launched 17:14:44.199426 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:44.734386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=400): Launched 17:14:45.043767 run osmo-stp_10.42.42.5(pid=401): Launched 17:14:45.164500 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:45.726266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=403): Launched 17:14:46.057196 run osmo-msc_10.42.42.6(pid=404): Launched 17:14:46.452086 run osmo-stp_10.42.42.5(pid=401): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=401)] 17:14:46.698483 run osmo-stp_10.42.42.5(pid=401): stdout: | (launched: 2022-12-12_17:14:44.985886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:46.870703 run osmo-stp_10.42.42.5(pid=401): stderr: | 20221212171445157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171445157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171445158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171445158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171445158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171445158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171445159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:47.023309 run osmo-stp_10.42.42.5(pid=401): stdout: | (launched: 2022-12-12_17:14:44.985886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:47.158457 run osmo-stp_10.42.42.5(pid=401): stderr: | 20221212171445157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171445157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171445158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171445158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171445158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171445158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171445159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:47.327364 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=401): Process ended prematurely: osmo-stp_10.42.42.5(pid=401) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=401)] [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:14:47.337386 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:14:47.365360 run osmo-hlr_10.42.42.2(pid=398): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=398)] 17:14:47.415699 run osmo-hlr_10.42.42.2(pid=398): stdout: | (launched: 2022-12-12_17:14:44.020727) 17:14:47.467290 run osmo-hlr_10.42.42.2(pid=398): stderr: | 20221212171444200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171444200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171444200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171444200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171444200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171444201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171444213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171444221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171444221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171444221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:47.540398 run osmo-msc_10.42.42.6(pid=404): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=404)] 17:14:47.590653 run osmo-msc_10.42.42.6(pid=404): stdout: | (launched: 2022-12-12_17:14:45.998099) 17:14:47.642747 run osmo-msc_10.42.42.6(pid=404): stderr: | 20221212171446453 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171446454 DLGLOBAL DEBUG validating counter group 0x7efeb0ea4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171446454 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171446454 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171446454 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171446454 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171446458 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171446458 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171446458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171446458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:47.694548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=397): Terminating (SIGTERM) 17:14:47.736254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=400): Terminating (SIGTERM) 17:14:47.778512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=403): Terminating (SIGTERM) 17:14:47.820496 --- ParallelTerminationStrategy: PID 397 died... 17:14:47.840508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=397): Terminated: ok {rc=0} 17:14:47.886437 --- ParallelTerminationStrategy: PID 400 died... 17:14:47.905916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=400): Terminated: ok {rc=0} 17:14:47.951464 --- ParallelTerminationStrategy: PID 403 died... 17:14:47.971000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=403): Terminated: ok {rc=0} 17:14:48.058696 bus /sierra_3: Setting Powered False 17:14:49.157266 bus /sierra_3: Setting Powered False 17:14:50.273983 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:14:51.530051 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:51.538181 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:14:51.571471 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:14:51.598844 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:14:51.652099 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:14:51.685113 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:14:51.712826 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:14:52.267192 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:14:52.319875 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:52.331563 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:14:52.400600 tst mo_mt_call.py: using LAC 30327 17:14:52.522899 tst mo_mt_call.py: using RAC 237 17:14:52.645888 tst mo_mt_call.py: using CellId 30327 17:14:52.766727 tst mo_mt_call.py: using BVCI 30328 17:14:52.880511 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:52.891826 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:52.902943 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:52.914439 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:52.925931 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:52.937307 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:53.057991 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:53.180235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:53.694104 run create_hlr_db(pid=409): Launched 17:14:53.831418 bus /sierra_2: Setting Powered False 17:14:54.897095 run create_hlr_db(pid=409): Terminated: ok {rc=0} 17:14:55.338315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=411): Launched 17:14:55.648078 run osmo-hlr_10.42.42.2(pid=412): Launched 17:14:55.767777 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:56.313677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=414): Launched 17:14:56.625572 run osmo-stp_10.42.42.5(pid=415): Launched 17:14:56.745975 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:57.307096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=417): Launched 17:14:57.617656 run osmo-msc_10.42.42.6(pid=418): Launched 17:14:57.792091 run osmo-stp_10.42.42.5(pid=415): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=415)] 17:14:57.922989 run osmo-stp_10.42.42.5(pid=415): stdout: | (launched: 2022-12-12_17:14:56.567352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:58.053113 run osmo-stp_10.42.42.5(pid=415): stderr: | 20221212171456740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171456740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171456741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171456741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171456742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171456742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171456742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:58.181096 run osmo-stp_10.42.42.5(pid=415): stdout: | (launched: 2022-12-12_17:14:56.567352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:58.303503 run osmo-stp_10.42.42.5(pid=415): stderr: | 20221212171456740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171456740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171456741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171456741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171456742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171456742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171456742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:58.450075 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=415): Process ended prematurely: osmo-stp_10.42.42.5(pid=415) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=415)] [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:14:58.458990 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:14:58.485894 run osmo-hlr_10.42.42.2(pid=412): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=412)] 17:14:58.533808 run osmo-hlr_10.42.42.2(pid=412): stdout: | (launched: 2022-12-12_17:14:55.590585) 17:14:58.583056 run osmo-hlr_10.42.42.2(pid=412): stderr: | 20221212171455769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171455769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171455769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171455769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171455769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171455769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171455782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171455790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171455791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171455791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:58.651987 run osmo-msc_10.42.42.6(pid=418): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=418)] 17:14:58.699621 run osmo-msc_10.42.42.6(pid=418): stdout: | (launched: 2022-12-12_17:14:57.559836) 17:14:58.748838 run osmo-msc_10.42.42.6(pid=418): stderr: | 20221212171457836 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171457836 DLGLOBAL DEBUG validating counter group 0x7f31024b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171457837 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171457837 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171457837 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171457837 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171457839 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171457839 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171457839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171457839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:58.798546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=411): Terminating (SIGTERM) 17:14:58.837886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=414): Terminating (SIGTERM) 17:14:58.877285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=417): Terminating (SIGTERM) 17:14:58.916924 --- ParallelTerminationStrategy: PID 411 died... 17:14:58.935944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=411): Terminated: ok {rc=0} 17:14:58.980227 --- ParallelTerminationStrategy: PID 414 died... 17:14:58.998804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=414): Terminated: ok {rc=0} 17:14:59.042667 --- ParallelTerminationStrategy: PID 417 died... 17:14:59.061443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=417): Terminated: ok {rc=0} 17:14:59.147425 bus /sierra_3: Setting Powered False 17:15:00.245464 bus /sierra_3: Setting Powered False 17:15:01.366205 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:15:02.521913 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:15:02.534548 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:15:02.602232 tst mo_mt_call_osmux.py: using LAC 30328 17:15:02.725144 tst mo_mt_call_osmux.py: using RAC 238 17:15:02.855575 tst mo_mt_call_osmux.py: using CellId 30328 17:15:02.986671 tst mo_mt_call_osmux.py: using BVCI 30329 17:15:03.107383 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:15:03.119216 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:15:03.130860 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:15:03.142455 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:15:03.154228 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:15:03.165944 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:15:03.289680 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:15:03.412423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:03.928682 run create_hlr_db(pid=423): Launched 17:15:04.064675 bus /sierra_2: Setting Powered False 17:15:05.130421 run create_hlr_db(pid=423): Terminated: ok {rc=0} 17:15:05.573212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=425): Launched 17:15:05.883548 run osmo-hlr_10.42.42.2(pid=426): Launched 17:15:06.003732 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:06.541474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=428): Launched 17:15:06.855505 run osmo-stp_10.42.42.5(pid=429): Launched 17:15:06.974139 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:07.534966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=431): Launched 17:15:07.847616 run osmo-msc_10.42.42.6(pid=432): Launched 17:15:08.023306 run osmo-stp_10.42.42.5(pid=429): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=429)] 17:15:08.155053 run osmo-stp_10.42.42.5(pid=429): stdout: | (launched: 2022-12-12_17:15:06.796814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:08.286214 run osmo-stp_10.42.42.5(pid=429): stderr: | 20221212171506970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171506970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171506971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171506971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171506972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171506972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171506972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:08.415066 run osmo-stp_10.42.42.5(pid=429): stdout: | (launched: 2022-12-12_17:15:06.796814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:08.538016 run osmo-stp_10.42.42.5(pid=429): stderr: | 20221212171506970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171506970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171506971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171506971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171506972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171506972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171506972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:08.685323 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=429): Process ended prematurely: osmo-stp_10.42.42.5(pid=429) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=429)] [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:15:08.694858 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:15:08.721882 run osmo-hlr_10.42.42.2(pid=426): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=426)] 17:15:08.769517 run osmo-hlr_10.42.42.2(pid=426): stdout: | (launched: 2022-12-12_17:15:05.826063) 17:15:08.818969 run osmo-hlr_10.42.42.2(pid=426): stderr: | 20221212171506006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171506006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171506006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171506006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171506006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171506007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171506019 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171506028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171506029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171506029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:08.888079 run osmo-msc_10.42.42.6(pid=432): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=432)] 17:15:08.935574 run osmo-msc_10.42.42.6(pid=432): stdout: | (launched: 2022-12-12_17:15:07.790156) 17:15:08.984232 run osmo-msc_10.42.42.6(pid=432): stderr: | 20221212171508063 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171508063 DLGLOBAL DEBUG validating counter group 0x7fcc8d22bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171508063 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171508064 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171508064 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171508064 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171508066 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171508066 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171508066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171508066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:09.034098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=425): Terminating (SIGTERM) 17:15:09.073680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=428): Terminating (SIGTERM) 17:15:09.113526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=431): Terminating (SIGTERM) 17:15:09.154216 --- ParallelTerminationStrategy: PID 425 died... 17:15:09.173369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=425): Terminated: ok {rc=0} 17:15:09.217472 --- ParallelTerminationStrategy: PID 428 died... 17:15:09.235787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=428): Terminated: ok {rc=0} 17:15:09.279932 --- ParallelTerminationStrategy: PID 431 died... 17:15:09.298439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=431): Terminated: ok {rc=0} 17:15:09.383311 bus /sierra_3: Setting Powered False 17:15:10.482725 bus /sierra_3: Setting Powered False 17:15:11.599204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:15:12.849865 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:12.857301 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:15:12.889924 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:15:12.916343 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:15:12.970936 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:15:13.003622 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:15:13.030037 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:15:13.580019 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:15:13.633992 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:13.646016 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:15:13.714670 tst mo_mt_call.py: using LAC 30329 17:15:13.843749 tst mo_mt_call.py: using RAC 239 17:15:13.972656 tst mo_mt_call.py: using CellId 30329 17:15:14.102234 tst mo_mt_call.py: using BVCI 30330 17:15:14.223517 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:14.235387 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:14.247041 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:14.258694 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:14.270435 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:14.282168 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:15:14.400627 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:15:14.519825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:15.001247 run create_hlr_db(pid=437): Launched 17:15:15.121261 bus /sierra_2: Setting Powered False 17:15:16.187480 run create_hlr_db(pid=437): Terminated: ok {rc=0} 17:15:16.657908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=439): Launched 17:15:17.027541 run osmo-hlr_10.42.42.2(pid=440): Launched 17:15:17.234709 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:17.768092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=442): Launched 17:15:18.077352 run osmo-stp_10.42.42.5(pid=443): Launched 17:15:18.196132 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:18.756193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=445): Launched 17:15:19.067521 run osmo-msc_10.42.42.6(pid=446): Launched 17:15:19.243049 run osmo-stp_10.42.42.5(pid=443): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=443)] 17:15:19.373951 run osmo-stp_10.42.42.5(pid=443): stdout: | (launched: 2022-12-12_17:15:18.019706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:19.504289 run osmo-stp_10.42.42.5(pid=443): stderr: | 20221212171518194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171518194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171518194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171518195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171518195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171518195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171518195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:19.632543 run osmo-stp_10.42.42.5(pid=443): stdout: | (launched: 2022-12-12_17:15:18.019706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:19.755300 run osmo-stp_10.42.42.5(pid=443): stderr: | 20221212171518194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171518194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171518194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171518195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171518195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171518195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171518195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:19.902081 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=443): Process ended prematurely: osmo-stp_10.42.42.5(pid=443) [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=443)] [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:15:19.911007 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:15:19.937768 run osmo-hlr_10.42.42.2(pid=440): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=440)] 17:15:19.985946 run osmo-hlr_10.42.42.2(pid=440): stdout: | (launched: 2022-12-12_17:15:16.966209) 17:15:20.035221 run osmo-hlr_10.42.42.2(pid=440): stderr: | 20221212171517239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171517239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171517239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171517239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171517239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171517239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171517251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171517259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171517260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171517260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:20.104222 run osmo-msc_10.42.42.6(pid=446): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=446)] 17:15:20.151945 run osmo-msc_10.42.42.6(pid=446): stdout: | (launched: 2022-12-12_17:15:19.009860) 17:15:20.201181 run osmo-msc_10.42.42.6(pid=446): stderr: | 20221212171519285 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171519285 DLGLOBAL DEBUG validating counter group 0x7f6cfe0f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171519285 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171519285 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171519285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171519286 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171519287 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171519288 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171519288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171519288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:20.250686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=439): Terminating (SIGTERM) 17:15:20.290505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=442): Terminating (SIGTERM) 17:15:20.330261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=445): Terminating (SIGTERM) 17:15:20.370434 --- ParallelTerminationStrategy: PID 439 died... 17:15:20.389440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=439): Terminated: ok {rc=0} 17:15:20.433531 --- ParallelTerminationStrategy: PID 442 died... 17:15:20.451869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=442): Terminated: ok {rc=0} 17:15:20.495825 --- ParallelTerminationStrategy: PID 445 died... 17:15:20.514268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=445): Terminated: ok {rc=0} 17:15:20.600010 bus /sierra_3: Setting Powered False 17:15:21.701053 bus /sierra_3: Setting Powered False 17:15:22.817164 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:15:23.964676 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:23.976680 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:15:24.045241 tst mo_mt_call_osmux.py: using LAC 30330 17:15:24.168324 tst mo_mt_call_osmux.py: using RAC 240 17:15:24.291271 tst mo_mt_call_osmux.py: using CellId 30330 17:15:24.413363 tst mo_mt_call_osmux.py: using BVCI 30331 17:15:24.527273 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:24.538713 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:24.549912 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:24.561433 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:24.572820 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:15:24.584601 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:15:24.701809 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:15:24.821432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:25.303971 run create_hlr_db(pid=448): Launched 17:15:25.423846 bus /sierra_2: Setting Powered False 17:15:26.486067 run create_hlr_db(pid=448): Terminated: ok {rc=0} 17:15:26.940165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=450): Launched 17:15:27.273093 run osmo-hlr_10.42.42.2(pid=451): Launched 17:15:27.401763 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:27.974154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=453): Launched 17:15:28.305511 run osmo-stp_10.42.42.5(pid=454): Launched 17:15:28.431895 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:29.032624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=456): Launched 17:15:29.366435 run osmo-msc_10.42.42.6(pid=457): Launched 17:15:29.552376 run osmo-stp_10.42.42.5(pid=454): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=454)] 17:15:29.692212 run osmo-stp_10.42.42.5(pid=454): stdout: | (launched: 2022-12-12_17:15:28.244062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:29.832682 run osmo-stp_10.42.42.5(pid=454): stderr: | 20221212171528440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171528440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171528440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171528441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171528441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171528441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171528441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:29.970829 run osmo-stp_10.42.42.5(pid=454): stdout: | (launched: 2022-12-12_17:15:28.244062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:30.102497 run osmo-stp_10.42.42.5(pid=454): stderr: | 20221212171528440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171528440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171528440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171528441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171528441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171528441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171528441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:30.260061 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=454): Process ended prematurely: osmo-stp_10.42.42.5(pid=454) [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=454)] [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:15:30.269974 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:15:30.298134 run osmo-hlr_10.42.42.2(pid=451): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=451)] 17:15:30.348442 run osmo-hlr_10.42.42.2(pid=451): stdout: | (launched: 2022-12-12_17:15:27.211989) 17:15:30.400401 run osmo-hlr_10.42.42.2(pid=451): stderr: | 20221212171527415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171527415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171527415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171527415 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171527415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171527415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171527431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171527439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171527439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171527439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:30.472865 run osmo-msc_10.42.42.6(pid=457): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=457)] 17:15:30.522901 run osmo-msc_10.42.42.6(pid=457): stdout: | (launched: 2022-12-12_17:15:29.304371) 17:15:30.574818 run osmo-msc_10.42.42.6(pid=457): stderr: | 20221212171529627 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171529627 DLGLOBAL DEBUG validating counter group 0x7f6a4d839c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171529627 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171529627 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171529628 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171529628 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171529629 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171529630 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171529630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171529630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:30.627065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=450): Terminating (SIGTERM) 17:15:30.668859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=453): Terminating (SIGTERM) 17:15:30.710904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=456): Terminating (SIGTERM) 17:15:30.753196 --- ParallelTerminationStrategy: PID 450 died... 17:15:30.773307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=450): Terminated: ok {rc=0} 17:15:30.820227 --- ParallelTerminationStrategy: PID 453 died... 17:15:30.840420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=453): Terminated: ok {rc=0} 17:15:30.886930 --- ParallelTerminationStrategy: PID 456 died... 17:15:30.906982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=456): Terminated: ok {rc=0} 17:15:30.995776 bus /sierra_3: Setting Powered False 17:15:32.093217 bus /sierra_3: Setting Powered False 17:15:33.207623 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:15:34.465072 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:34.472851 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:15:34.506134 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 17:15:34.532700 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 17:15:34.583742 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:15:34.617503 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 17:15:34.645295 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 17:15:35.197763 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 17:15:35.247697 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:35.259224 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:15:35.306850 tst mo_mt_call.py: using LAC 30331 17:15:35.426771 tst mo_mt_call.py: using RAC 241 17:15:35.546809 tst mo_mt_call.py: using CellId 30331 17:15:35.666635 tst mo_mt_call.py: using BVCI 30332 17:15:35.780089 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:35.791571 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:35.802944 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:35.814507 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:35.826311 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:35.838261 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:15:35.960040 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:15:36.080721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:36.595332 run create_hlr_db(pid=462): Launched 17:15:36.730872 bus /sierra_2: Setting Powered False 17:15:37.796765 run create_hlr_db(pid=462): Terminated: ok {rc=0} 17:15:38.239362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=464): Launched 17:15:38.551282 run osmo-hlr_10.42.42.2(pid=465): Launched 17:15:38.671728 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:39.220524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=467): Launched 17:15:39.532189 run osmo-stp_10.42.42.5(pid=468): Launched 17:15:39.652043 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:40.214646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=470): Launched 17:15:40.523422 run osmo-msc_10.42.42.6(pid=471): Launched 17:15:40.701533 run osmo-stp_10.42.42.5(pid=468): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=468)] 17:15:40.832720 run osmo-stp_10.42.42.5(pid=468): stdout: | (launched: 2022-12-12_17:15:39.474643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:40.963024 run osmo-stp_10.42.42.5(pid=468): stderr: | 20221212171539648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171539648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171539648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171539649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171539649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171539649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171539649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:41.091020 run osmo-stp_10.42.42.5(pid=468): stdout: | (launched: 2022-12-12_17:15:39.474643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:41.213242 run osmo-stp_10.42.42.5(pid=468): stderr: | 20221212171539648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171539648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171539648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171539649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171539649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171539649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171539649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:41.359877 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=468): Process ended prematurely: osmo-stp_10.42.42.5(pid=468) [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=468)] [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 17:15:41.368812 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:15:41.396021 run osmo-hlr_10.42.42.2(pid=465): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=465)] 17:15:41.443701 run osmo-hlr_10.42.42.2(pid=465): stdout: | (launched: 2022-12-12_17:15:38.493364) 17:15:41.492915 run osmo-hlr_10.42.42.2(pid=465): stderr: | 20221212171538671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171538671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171538671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171538671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171538671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171538672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171538682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171538690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171538690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171538691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:41.561820 run osmo-msc_10.42.42.6(pid=471): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=471)] 17:15:41.609302 run osmo-msc_10.42.42.6(pid=471): stdout: | (launched: 2022-12-12_17:15:40.465711) 17:15:41.658212 run osmo-msc_10.42.42.6(pid=471): stderr: | 20221212171540739 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171540740 DLGLOBAL DEBUG validating counter group 0x7fd6adc69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171540740 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171540740 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171540740 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171540740 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171540743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171540744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171540744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171540744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:41.707611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=464): Terminating (SIGTERM) 17:15:41.746929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=467): Terminating (SIGTERM) 17:15:41.786319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=470): Terminating (SIGTERM) 17:15:41.825950 --- ParallelTerminationStrategy: PID 464 died... 17:15:41.844755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=464): Terminated: ok {rc=0} 17:15:41.889609 --- ParallelTerminationStrategy: PID 467 died... 17:15:41.907897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=467): Terminated: ok {rc=0} 17:15:41.951887 --- ParallelTerminationStrategy: PID 470 died... 17:15:41.970315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=470): Terminated: ok {rc=0} 17:15:42.057297 bus /sierra_3: Setting Powered False 17:15:43.157163 bus /sierra_3: Setting Powered False 17:15:44.272291 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 17:15:45.421767 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:45.434712 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:15:45.486699 tst mo_mt_call_osmux.py: using LAC 30332 17:15:45.617750 tst mo_mt_call_osmux.py: using RAC 242 17:15:45.749151 tst mo_mt_call_osmux.py: using CellId 30332 17:15:45.917223 tst mo_mt_call_osmux.py: using BVCI 30333 17:15:46.040480 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:46.053446 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:46.067484 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:46.082238 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:46.096117 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:15:46.108715 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:15:46.234199 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:15:46.354106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:46.875858 run create_hlr_db(pid=473): Launched 17:15:47.043882 bus /sierra_2: Setting Powered False 17:15:48.108528 run create_hlr_db(pid=473): Terminated: ok {rc=0} 17:15:48.551632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=475): Launched 17:15:48.863554 run osmo-hlr_10.42.42.2(pid=476): Launched 17:15:48.984185 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:49.537328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=478): Launched 17:15:49.850856 run osmo-stp_10.42.42.5(pid=479): Launched 17:15:49.972907 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:50.534338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=481): Launched 17:15:50.847507 run osmo-msc_10.42.42.6(pid=482): Launched 17:15:51.023483 run osmo-stp_10.42.42.5(pid=479): ERR: Terminated: ERROR {rc=1} [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=479)] 17:15:51.154927 run osmo-stp_10.42.42.5(pid=479): stdout: | (launched: 2022-12-12_17:15:49.792454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:51.285879 run osmo-stp_10.42.42.5(pid=479): stderr: | 20221212171549966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171549966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171549966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171549967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171549967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171549967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171549967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:51.415073 run osmo-stp_10.42.42.5(pid=479): stdout: | (launched: 2022-12-12_17:15:49.792454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:51.538858 run osmo-stp_10.42.42.5(pid=479): stderr: | 20221212171549966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171549966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171549966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171549967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171549967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171549967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171549967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:51.686832 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=479): Process ended prematurely: osmo-stp_10.42.42.5(pid=479) [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=479)] [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 17:15:51.696110 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:15:51.723268 run osmo-hlr_10.42.42.2(pid=476): ERR: Terminated: ERROR {rc=237} [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=476)] 17:15:51.771682 run osmo-hlr_10.42.42.2(pid=476): stdout: | (launched: 2022-12-12_17:15:48.805557) 17:15:51.821739 run osmo-hlr_10.42.42.2(pid=476): stderr: | 20221212171548987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171548987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171548987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171548987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171548987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171548987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171548999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171549008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171549008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171549008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:51.891721 run osmo-msc_10.42.42.6(pid=482): ERR: Terminated: ERROR {rc=2} [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=482)] 17:15:51.939861 run osmo-msc_10.42.42.6(pid=482): stdout: | (launched: 2022-12-12_17:15:50.789442) 17:15:51.989549 run osmo-msc_10.42.42.6(pid=482): stderr: | 20221212171551063 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171551063 DLGLOBAL DEBUG validating counter group 0x7ff9e4d24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171551064 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171551064 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171551064 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171551064 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171551066 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171551066 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171551066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171551066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:52.039588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=475): Terminating (SIGTERM) 17:15:52.079667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=478): Terminating (SIGTERM) 17:15:52.119903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=481): Terminating (SIGTERM) 17:15:52.160459 --- ParallelTerminationStrategy: PID 475 died... 17:15:52.179817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=475): Terminated: ok {rc=0} 17:15:52.224545 --- ParallelTerminationStrategy: PID 478 died... 17:15:52.243320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=478): Terminated: ok {rc=0} 17:15:52.288042 --- ParallelTerminationStrategy: PID 481 died... 17:15:52.306750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=481): Terminated: ok {rc=0} 17:15:52.391520 bus /sierra_3: Setting Powered False 17:15:53.487859 bus /sierra_3: Setting Powered False 17:15:54.604332 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 emergency:nanobts+band-900 --------------------------------------------------------------------- 17:15:55.872366 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:55.878620 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 17:15:55.911701 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 17:15:55.938079 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 17:15:56.029106 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 17:15:56.062297 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 17:15:56.089483 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 17:15:56.664388 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2379 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 17:15:56.669728 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:15:56.680468 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 17:15:56.728730 tst emergency_mo_mt_call.py: using LAC 30333 17:15:56.847809 tst emergency_mo_mt_call.py: using RAC 243 17:15:56.968664 tst emergency_mo_mt_call.py: using CellId 30333 17:15:57.089094 tst emergency_mo_mt_call.py: using BVCI 30334 17:15:57.198906 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:15:57.209767 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:15:57.220309 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:15:57.231262 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:15:57.242156 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:15:57.253138 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 17:15:57.371736 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 17:15:57.490124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:57.996430 run create_hlr_db(pid=488): Launched 17:15:58.130729 bus /sierra_2: Setting Powered False 17:15:59.195004 run create_hlr_db(pid=488): Terminated: ok {rc=0} 17:15:59.630722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=490): Launched 17:15:59.936063 run osmo-hlr_10.42.42.2(pid=491): Launched 17:16:00.052500 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:00.590991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=493): Launched 17:16:00.949737 run osmo-stp_10.42.42.5(pid=494): Launched 17:16:01.281048 tst emergency_mo_mt_call.py: using MSISDN 7876 17:16:01.459472 run osmo-msc_10.42.42.6: Starting osmo-msc 17:16:02.018325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=496): Launched 17:16:02.341446 run osmo-msc_10.42.42.6(pid=497): Launched 17:16:02.514144 run osmo-stp_10.42.42.5(pid=494): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=494)] 17:16:02.644024 run osmo-stp_10.42.42.5(pid=494): stdout: | (launched: 2022-12-12_17:16:00.860806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:02.774384 run osmo-stp_10.42.42.5(pid=494): stderr: | 20221212171601167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171601167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171601167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171601168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171601171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171601171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171601171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:02.901279 run osmo-stp_10.42.42.5(pid=494): stdout: | (launched: 2022-12-12_17:16:00.860806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:03.022070 run osmo-stp_10.42.42.5(pid=494): stderr: | 20221212171601167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171601167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171601167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171601168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171601171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171601171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171601171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:03.166821 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=494): Process ended prematurely: osmo-stp_10.42.42.5(pid=494) [trial-2379↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=494)] [trial-2379↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 17:16:03.175449 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 17:16:03.202313 run osmo-hlr_10.42.42.2(pid=491): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=491)] 17:16:03.250265 run osmo-hlr_10.42.42.2(pid=491): stdout: | (launched: 2022-12-12_17:15:59.879205) 17:16:03.299864 run osmo-hlr_10.42.42.2(pid=491): stderr: | 20221212171600058 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171600058 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171600058 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171600058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171600058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171600058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171600071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171600083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171600083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171600083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:03.369385 run osmo-msc_10.42.42.6(pid=497): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=497)] 17:16:03.417588 run osmo-msc_10.42.42.6(pid=497): stdout: | (launched: 2022-12-12_17:16:02.284262) 17:16:03.466992 run osmo-msc_10.42.42.6(pid=497): stderr: | 20221212171602558 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171602558 DLGLOBAL DEBUG validating counter group 0x7f11202dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171602558 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171602558 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171602558 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171602558 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171602560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171602561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171602561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171602561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:16:03.517184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=490): Terminating (SIGTERM) 17:16:03.557322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=493): Terminating (SIGTERM) 17:16:03.597683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=496): Terminating (SIGTERM) 17:16:03.637755 --- ParallelTerminationStrategy: PID 490 died... 17:16:03.656888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=490): Terminated: ok {rc=0} 17:16:03.701352 --- ParallelTerminationStrategy: PID 493 died... 17:16:03.720316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=493): Terminated: ok {rc=0} 17:16:03.764806 --- ParallelTerminationStrategy: PID 496 died... 17:16:03.783931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=496): Terminated: ok {rc=0} 17:16:03.868565 bus /sierra_3: Setting Powered False 17:16:04.967095 bus /sierra_3: Setting Powered False 17:16:06.087049 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 17:16:07.175628 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:16:07.187231 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 17:16:07.244713 tst emergency_preemptive_call.py: using LAC 30334 17:16:07.365303 tst emergency_preemptive_call.py: using RAC 244 17:16:07.486166 tst emergency_preemptive_call.py: using CellId 30334 17:16:07.605554 tst emergency_preemptive_call.py: using BVCI 30335 17:16:07.718511 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:16:07.729478 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:16:07.740145 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:16:07.751155 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:16:07.762208 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 17:16:07.773173 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:07.893204 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:08.011241 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:08.126962 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:08.244370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:08.752113 run create_hlr_db(pid=499): Launched 17:16:08.885336 bus /sierra_2: Setting Powered False 17:16:09.949994 run create_hlr_db(pid=499): Terminated: ok {rc=0} 17:16:10.386195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=501): Launched 17:16:10.694048 run osmo-hlr_10.42.42.2(pid=502): Launched 17:16:10.812477 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:11.373283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=504): Launched 17:16:11.702063 run osmo-stp_10.42.42.5(pid=505): Launched 17:16:11.836673 tst emergency_preemptive_call.py: using MSISDN 7877 17:16:12.004188 run osmo-msc_10.42.42.6: Starting osmo-msc 17:16:12.589571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=507): Launched 17:16:12.917296 run osmo-msc_10.42.42.6(pid=508): Launched 17:16:13.099080 run osmo-stp_10.42.42.5(pid=505): ERR: Terminated: ERROR {rc=1} [trial-2379↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=505)] 17:16:13.239922 run osmo-stp_10.42.42.5(pid=505): stdout: | (launched: 2022-12-12_17:16:11.641272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:13.377464 run osmo-stp_10.42.42.5(pid=505): stderr: | 20221212171611834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171611834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171611834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171611835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171611835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171611835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171611835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:13.512414 run osmo-stp_10.42.42.5(pid=505): stdout: | (launched: 2022-12-12_17:16:11.641272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:13.642012 run osmo-stp_10.42.42.5(pid=505): stderr: | 20221212171611834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171611834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171611834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171611835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171611835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171611835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171611835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:13.797397 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=505): Process ended prematurely: osmo-stp_10.42.42.5(pid=505) [trial-2379↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=505)] [trial-2379↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 17:16:13.806688 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 17:16:13.834885 run osmo-hlr_10.42.42.2(pid=502): ERR: Terminated: ERROR {rc=237} [trial-2379↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=502)] 17:16:13.885662 run osmo-hlr_10.42.42.2(pid=502): stdout: | (launched: 2022-12-12_17:16:10.636542) 17:16:13.937866 run osmo-hlr_10.42.42.2(pid=502): stderr: | 20221212171610814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171610814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171610814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171610814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171610814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171610814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171610827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171610836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171610836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171610836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:14.011226 run osmo-msc_10.42.42.6(pid=508): ERR: Terminated: ERROR {rc=2} [trial-2379↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=508)] 17:16:14.061879 run osmo-msc_10.42.42.6(pid=508): stdout: | (launched: 2022-12-12_17:16:12.856274) 17:16:14.113904 run osmo-msc_10.42.42.6(pid=508): stderr: | 20221212171613182 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212171613182 DLGLOBAL DEBUG validating counter group 0x7f3b0838cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212171613182 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212171613182 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212171613182 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212171613182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212171613184 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212171613185 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212171613185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212171613185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:16:14.166189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=501): Terminating (SIGTERM) 17:16:14.208081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=504): Terminating (SIGTERM) 17:16:14.250379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=507): Terminating (SIGTERM) 17:16:14.292703 --- ParallelTerminationStrategy: PID 501 died... 17:16:14.313058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=501): Terminated: ok {rc=0} 17:16:14.359688 --- ParallelTerminationStrategy: PID 504 died... 17:16:14.379535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=504): Terminated: ok {rc=0} 17:16:14.425841 --- ParallelTerminationStrategy: PID 507 died... 17:16:14.445603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=507): Terminated: ok {rc=0} 17:16:14.533574 bus /sierra_9: Setting Powered False 17:16:15.632447 bus /sierra_9: Setting Powered False 17:16:16.756902 bus /sierra_8: Setting Powered False 17:16:17.865338 bus /sierra_8: Setting Powered False 17:16:18.981057 bus /sierra_3: Setting Powered False 17:16:20.080239 bus /sierra_3: Setting Powered False 17:16:21.197522 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-900 --------------------------------------------------------------------- 17:16:22.483705 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:16:22.489672 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 17:16:22.522982 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 17:16:22.562564 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 17:16:22.651943 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 17:16:22.685280 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 17:16:22.724820 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 17:16:23.318018 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 17:16:23.372026 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:23.383399 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 17:16:23.432562 tst cs_paging_gprs_active.py: using LAC 30335 17:16:23.563900 tst cs_paging_gprs_active.py: using RAC 245 17:16:23.695147 tst cs_paging_gprs_active.py: using CellId 30335 17:16:23.817716 tst cs_paging_gprs_active.py: using BVCI 30336 17:16:23.930397 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:23.941479 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:23.951962 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:23.962911 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:23.973782 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:23.987368 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:23.998941 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:24.010169 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:24.021537 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:24.140328 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:24.263587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:16:24.488860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:24.824279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=513): Launched 17:16:25.115151 run iperf3-srv_10.42.42.10(pid=514): Launched 17:16:25.240566 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:16:25.465673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:25.801429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=515): Launched 17:16:26.091892 run iperf3-srv_10.42.42.10(pid=516): Launched 17:16:26.218455 tst cs_paging_gprs_active.py:38: start network... 17:16:26.442358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:26.959352 run create_hlr_db(pid=517): Launched 17:16:27.095909 bus /sierra_2: Setting Powered False 17:16:28.160864 run create_hlr_db(pid=517): Terminated: ok {rc=0} 17:16:28.604868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=519): Launched 17:16:28.927172 run osmo-hlr_10.42.42.2(pid=520): Launched 17:16:29.041668 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:29.563684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=522): Launched 17:16:29.866181 run osmo-stp_10.42.42.5(pid=523): Launched 17:16:29.981318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:30.497736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=525): Launched 17:16:30.612429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:30.893830 run patchelf(pid=526): Launched 17:16:31.073673 run osmo-stp_10.42.42.5(pid=523): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=523)] 17:16:31.205825 run osmo-stp_10.42.42.5(pid=523): stdout: | (launched: 2022-12-12_17:16:29.810312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:31.337505 run osmo-stp_10.42.42.5(pid=523): stderr: | 20221212171629976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171629977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171629977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171629977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171629978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171629978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171629978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:31.468907 run osmo-stp_10.42.42.5(pid=523): stdout: | (launched: 2022-12-12_17:16:29.810312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:31.595911 run osmo-stp_10.42.42.5(pid=523): stderr: | 20221212171629976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171629977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171629977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171629977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171629978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171629978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171629978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:31.744923 run patchelf(pid=526): Terminating (SIGINT) 17:16:31.917267 run patchelf(pid=526): Terminated: ok {rc=0} 17:16:32.041414 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=523): Process ended prematurely: osmo-stp_10.42.42.5(pid=523) [trial-2379↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=523)] [trial-2379↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 17:16:32.052055 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:16:32.081710 run osmo-hlr_10.42.42.2(pid=520): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=520)] 17:16:32.130596 run osmo-hlr_10.42.42.2(pid=520): stdout: | (launched: 2022-12-12_17:16:28.871094) 17:16:32.181690 run osmo-hlr_10.42.42.2(pid=520): stderr: | 20221212171629044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171629044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171629044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171629044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171629044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171629044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171629056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171629065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171629065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171629066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:32.231159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=513): Terminating (SIGTERM) 17:16:32.270384 run iperf3-srv_10.42.42.10(pid=514): Terminating (SIGTERM) 17:16:32.309565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=515): Terminating (SIGTERM) 17:16:32.348590 run iperf3-srv_10.42.42.10(pid=516): Terminating (SIGTERM) 17:16:32.387647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=519): Terminating (SIGTERM) 17:16:32.426593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=522): Terminating (SIGTERM) 17:16:32.465508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=525): Terminating (SIGTERM) 17:16:32.504931 --- ParallelTerminationStrategy: PID 513 died... 17:16:32.523849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=513): Terminated: ok {rc=0} 17:16:32.568174 --- ParallelTerminationStrategy: PID 514 died... 17:16:32.586683 run iperf3-srv_10.42.42.10(pid=514): Terminated {rc=256} 17:16:32.630936 --- ParallelTerminationStrategy: PID 515 died... 17:16:32.649551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=515): Terminated: ok {rc=0} 17:16:32.693501 --- ParallelTerminationStrategy: PID 516 died... 17:16:32.711995 run iperf3-srv_10.42.42.10(pid=516): Terminated {rc=256} 17:16:32.755800 --- ParallelTerminationStrategy: PID 519 died... 17:16:32.774402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=519): Terminated: ok {rc=0} 17:16:32.818196 --- ParallelTerminationStrategy: PID 522 died... 17:16:32.836743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=522): Terminated: ok {rc=0} 17:16:32.880764 --- ParallelTerminationStrategy: PID 525 died... 17:16:32.899229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=525): Terminated: ok {rc=0} 17:16:32.984671 bus /gobi_0: Setting Powered False 17:16:34.082861 bus /gobi_0: Setting Powered False 17:16:35.195910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 17:16:36.344903 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:36.356761 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 17:16:36.409209 tst iperf3.py: using LAC 30336 17:16:36.535868 tst iperf3.py: using RAC 246 17:16:36.661874 tst iperf3.py: using CellId 30336 17:16:36.789601 tst iperf3.py: using BVCI 30337 17:16:36.907378 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:36.918830 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:36.929970 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:36.940860 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:36.951806 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:36.962754 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:36.973889 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:36.984709 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:36.995812 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:37.110374 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:16:37.311384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:37.612250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=527): Launched 17:16:37.875263 run iperf3-srv_10.42.42.10(pid=528): Launched 17:16:37.987970 tst iperf3.py:8: start network... 17:16:38.187503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:38.651900 run create_hlr_db(pid=529): Launched 17:16:38.767465 bus /gobi_6: Setting Powered False 17:16:39.825742 run create_hlr_db(pid=529): Terminated: ok {rc=0} 17:16:40.239677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=531): Launched 17:16:40.539703 run osmo-hlr_10.42.42.2(pid=532): Launched 17:16:40.653957 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:41.183362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=534): Launched 17:16:41.482607 run osmo-stp_10.42.42.5(pid=535): Launched 17:16:41.597699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:42.113388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=537): Launched 17:16:42.227846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:42.481048 run patchelf(pid=538): Launched 17:16:42.647640 run osmo-stp_10.42.42.5(pid=535): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=535)] 17:16:42.774304 run osmo-stp_10.42.42.5(pid=535): stdout: | (launched: 2022-12-12_17:16:41.426953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:42.903170 run osmo-stp_10.42.42.5(pid=535): stderr: | 20221212171641594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171641594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171641595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171641595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171641596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171641596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171641596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:43.031730 run osmo-stp_10.42.42.5(pid=535): stdout: | (launched: 2022-12-12_17:16:41.426953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:43.154425 run osmo-stp_10.42.42.5(pid=535): stderr: | 20221212171641594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171641594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171641595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171641595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171641596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171641596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171641596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:43.299548 run patchelf(pid=538): Terminating (SIGINT) 17:16:43.466466 run patchelf(pid=538): Terminated: ok {rc=0} 17:16:43.586710 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=535): Process ended prematurely: osmo-stp_10.42.42.5(pid=535) [trial-2379↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=535)] [trial-2379↪gprs:nanobts+band-900↪iperf3.py:8] 17:16:43.596203 tst iperf3.py:8: Test FAILED (7.3 sec) 17:16:43.623545 run osmo-hlr_10.42.42.2(pid=532): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=532)] 17:16:43.670791 run osmo-hlr_10.42.42.2(pid=532): stdout: | (launched: 2022-12-12_17:16:40.483923) 17:16:43.719486 run osmo-hlr_10.42.42.2(pid=532): stderr: | 20221212171640657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171640657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171640657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171640657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171640657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171640657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171640670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171640678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171640679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171640679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:43.769311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=527): Terminating (SIGTERM) 17:16:43.808597 run iperf3-srv_10.42.42.10(pid=528): Terminating (SIGTERM) 17:16:43.847977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=531): Terminating (SIGTERM) 17:16:43.887560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=534): Terminating (SIGTERM) 17:16:43.926975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=537): Terminating (SIGTERM) 17:16:43.966497 --- ParallelTerminationStrategy: PID 527 died... 17:16:43.985416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=527): Terminated: ok {rc=0} 17:16:44.029398 --- ParallelTerminationStrategy: PID 528 died... 17:16:44.047907 run iperf3-srv_10.42.42.10(pid=528): Terminated {rc=256} 17:16:44.091153 --- ParallelTerminationStrategy: PID 531 died... 17:16:44.109482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=531): Terminated: ok {rc=0} 17:16:44.152502 --- ParallelTerminationStrategy: PID 534 died... 17:16:44.171163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=534): Terminated: ok {rc=0} 17:16:44.214507 --- ParallelTerminationStrategy: PID 537 died... 17:16:44.233035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=537): Terminated: ok {rc=0} 17:16:44.317851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 17:16:45.463512 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:45.474968 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 17:16:45.523252 tst iperf3m4.py: using LAC 30337 17:16:45.644234 tst iperf3m4.py: using RAC 247 17:16:45.761945 tst iperf3m4.py: using CellId 30337 17:16:45.892284 tst iperf3m4.py: using BVCI 30338 17:16:46.007272 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:46.019080 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:46.030797 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:46.043009 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:46.055196 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:46.067387 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:46.079858 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:46.092088 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:16:46.104156 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:46.222045 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:46.364160 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:46.480682 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 17:16:46.599751 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:16:46.823997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:47.156353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=539): Launched 17:16:47.450136 run iperf3-srv_10.42.42.10(pid=540): Launched 17:16:47.570758 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:16:47.786427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:48.110011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=541): Launched 17:16:48.390603 run iperf3-srv_10.42.42.10(pid=542): Launched 17:16:48.513400 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:16:48.728074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:49.050599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=543): Launched 17:16:49.330630 run iperf3-srv_10.42.42.10(pid=544): Launched 17:16:49.450607 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:16:49.665942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:49.988094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=545): Launched 17:16:50.267533 run iperf3-srv_10.42.42.10(pid=546): Launched 17:16:50.387962 tst iperf3m4.py:8: start network... 17:16:50.603664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:51.106819 run create_hlr_db(pid=547): Launched 17:16:51.230810 bus /gobi_6: Setting Powered False 17:16:52.290354 run create_hlr_db(pid=547): Terminated: ok {rc=0} 17:16:52.728844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=549): Launched 17:16:53.051469 run osmo-hlr_10.42.42.2(pid=550): Launched 17:16:53.174296 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:53.727896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=552): Launched 17:16:54.051295 run osmo-stp_10.42.42.5(pid=553): Launched 17:16:54.175767 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:54.729625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=555): Launched 17:16:54.853139 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:55.124831 run patchelf(pid=556): Launched 17:16:55.302629 run osmo-stp_10.42.42.5(pid=553): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=553)] 17:16:55.438502 run osmo-stp_10.42.42.5(pid=553): stdout: | (launched: 2022-12-12_17:16:53.991813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:55.575679 run osmo-stp_10.42.42.5(pid=553): stderr: | 20221212171654180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171654180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171654181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171654181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171654181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171654182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171654182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:55.713557 run osmo-stp_10.42.42.5(pid=553): stdout: | (launched: 2022-12-12_17:16:53.991813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:55.845481 run osmo-stp_10.42.42.5(pid=553): stderr: | 20221212171654180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171654180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171654181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171654181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171654181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171654182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171654182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:56.002657 run patchelf(pid=556): Terminating (SIGINT) 17:16:56.181744 run patchelf(pid=556): Terminated: ok {rc=0} 17:16:56.310701 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=553): Process ended prematurely: osmo-stp_10.42.42.5(pid=553) [trial-2379↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=553)] [trial-2379↪gprs:nanobts+band-900↪iperf3m4.py:8] 17:16:56.320879 tst iperf3m4.py:8: Test FAILED (10.9 sec) 17:16:56.349428 run osmo-hlr_10.42.42.2(pid=550): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=550)] 17:16:56.398797 run osmo-hlr_10.42.42.2(pid=550): stdout: | (launched: 2022-12-12_17:16:52.991967) 17:16:56.449704 run osmo-hlr_10.42.42.2(pid=550): stderr: | 20221212171653186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171653186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171653186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171653187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171653187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171653187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171653199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171653209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171653209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171653209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:56.501297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=539): Terminating (SIGTERM) 17:16:56.542328 run iperf3-srv_10.42.42.10(pid=540): Terminating (SIGTERM) 17:16:56.583238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=541): Terminating (SIGTERM) 17:16:56.624094 run iperf3-srv_10.42.42.10(pid=542): Terminating (SIGTERM) 17:16:56.664886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=543): Terminating (SIGTERM) 17:16:56.706417 run iperf3-srv_10.42.42.10(pid=544): Terminating (SIGTERM) 17:16:56.747135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=545): Terminating (SIGTERM) 17:16:56.788090 run iperf3-srv_10.42.42.10(pid=546): Terminating (SIGTERM) 17:16:56.828648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=549): Terminating (SIGTERM) 17:16:56.870005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=552): Terminating (SIGTERM) 17:16:56.911083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=555): Terminating (SIGTERM) 17:16:56.952291 --- ParallelTerminationStrategy: PID 539 died... 17:16:56.972153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=539): Terminated: ok {rc=0} 17:16:57.018302 --- ParallelTerminationStrategy: PID 540 died... 17:16:57.037774 run iperf3-srv_10.42.42.10(pid=540): Terminated {rc=256} 17:16:57.082745 --- ParallelTerminationStrategy: PID 541 died... 17:16:57.101902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=541): Terminated: ok {rc=0} 17:16:57.147084 --- ParallelTerminationStrategy: PID 542 died... 17:16:57.166401 run iperf3-srv_10.42.42.10(pid=542): Terminated {rc=256} 17:16:57.211309 --- ParallelTerminationStrategy: PID 543 died... 17:16:57.230453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=543): Terminated: ok {rc=0} 17:16:57.275313 --- ParallelTerminationStrategy: PID 544 died... 17:16:57.294467 run iperf3-srv_10.42.42.10(pid=544): Terminated {rc=256} 17:16:57.339809 --- ParallelTerminationStrategy: PID 545 died... 17:16:57.358996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=545): Terminated: ok {rc=0} 17:16:57.403900 --- ParallelTerminationStrategy: PID 546 died... 17:16:57.423283 run iperf3-srv_10.42.42.10(pid=546): Terminated {rc=256} 17:16:57.468116 --- ParallelTerminationStrategy: PID 549 died... 17:16:57.487348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=549): Terminated: ok {rc=0} 17:16:57.532407 --- ParallelTerminationStrategy: PID 552 died... 17:16:57.551660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=552): Terminated: ok {rc=0} 17:16:57.596673 --- ParallelTerminationStrategy: PID 555 died... 17:16:57.615971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=555): Terminated: ok {rc=0} 17:16:57.702320 bus /gobi_4: Setting Powered False 17:16:58.800826 bus /gobi_4: Setting Powered False 17:16:59.916557 bus /gobi_1: Setting Powered False 17:17:01.015072 bus /gobi_1: Setting Powered False 17:17:02.129223 bus /gobi_0: Setting Powered False 17:17:03.227840 bus /gobi_0: Setting Powered False 17:17:04.340688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900 ping.py ---------------------------------------------- 17:17:05.441872 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:05.453457 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 17:17:05.502035 tst ping.py: using LAC 30338 17:17:05.627298 tst ping.py: using RAC 248 17:17:05.753420 tst ping.py: using CellId 30338 17:17:05.878401 tst ping.py: using BVCI 30339 17:17:05.994682 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:06.005904 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:06.016854 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:06.027858 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:06.038779 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:06.049652 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:06.060755 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:06.071832 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 17:17:06.188919 tst ping.py:19: start network... 17:17:06.399741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:06.887017 run create_hlr_db(pid=560): Launched 17:17:07.015249 bus /gobi_6: Setting Powered False 17:17:08.078248 run create_hlr_db(pid=560): Terminated: ok {rc=0} 17:17:08.498122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=562): Launched 17:17:08.792696 run osmo-hlr_10.42.42.2(pid=563): Launched 17:17:08.904285 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:09.416181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=565): Launched 17:17:09.710469 run osmo-stp_10.42.42.5(pid=566): Launched 17:17:09.822657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:10.328648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=568): Launched 17:17:10.442170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:10.690809 run patchelf(pid=569): Launched 17:17:10.854905 run osmo-stp_10.42.42.5(pid=566): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=566)] 17:17:10.978997 run osmo-stp_10.42.42.5(pid=566): stdout: | (launched: 2022-12-12_17:17:09.655623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:11.104529 run osmo-stp_10.42.42.5(pid=566): stderr: | 20221212171709821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171709821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171709821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171709822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171709822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171709822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171709822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:11.230689 run osmo-stp_10.42.42.5(pid=566): stdout: | (launched: 2022-12-12_17:17:09.655623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:11.351277 run osmo-stp_10.42.42.5(pid=566): stderr: | 20221212171709821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171709821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171709821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171709822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171709822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171709822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171709822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:11.493805 run patchelf(pid=569): Terminating (SIGINT) 17:17:11.657695 run patchelf(pid=569): Terminated: ok {rc=0} 17:17:11.775812 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=566): Process ended prematurely: osmo-stp_10.42.42.5(pid=566) [trial-2379↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=566)] [trial-2379↪gprs:nanobts+band-900↪ping.py:22] 17:17:11.785277 tst ping.py:22: Test FAILED (6.3 sec) 17:17:11.812035 run osmo-hlr_10.42.42.2(pid=563): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=563)] 17:17:11.859617 run osmo-hlr_10.42.42.2(pid=563): stdout: | (launched: 2022-12-12_17:17:08.737774) 17:17:11.908468 run osmo-hlr_10.42.42.2(pid=563): stderr: | 20221212171708908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171708909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171708909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171708909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171708909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171708909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171708921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171708930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171708930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171708930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:11.957500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=562): Terminating (SIGTERM) 17:17:11.997155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=565): Terminating (SIGTERM) 17:17:12.036132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=568): Terminating (SIGTERM) 17:17:12.075552 --- ParallelTerminationStrategy: PID 562 died... 17:17:12.094304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=562): Terminated: ok {rc=0} 17:17:12.138008 --- ParallelTerminationStrategy: PID 565 died... 17:17:12.156202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=565): Terminated: ok {rc=0} 17:17:12.200537 --- ParallelTerminationStrategy: PID 568 died... 17:17:12.219025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=568): Terminated: ok {rc=0} 17:17:12.304126 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 17:17:13.392673 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:13.404422 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 17:17:13.453831 tst ping_idle_ping.py: using LAC 30339 17:17:13.580066 tst ping_idle_ping.py: using RAC 249 17:17:13.704053 tst ping_idle_ping.py: using CellId 30339 17:17:13.832483 tst ping_idle_ping.py: using BVCI 30340 17:17:13.949493 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:13.960782 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:13.971774 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:13.982729 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:13.993685 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:14.004534 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:14.015665 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 17:17:14.026759 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 17:17:14.139675 tst ping_idle_ping.py:24: start network... 17:17:14.336623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:14.795786 run create_hlr_db(pid=570): Launched 17:17:14.909302 bus /gobi_6: Setting Powered False 17:17:15.997678 run create_hlr_db(pid=570): Terminated: ok {rc=0} 17:17:16.451232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=572): Launched 17:17:16.788585 run osmo-hlr_10.42.42.2(pid=573): Launched 17:17:17.015410 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:17.566640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=575): Launched 17:17:17.861246 run osmo-stp_10.42.42.5(pid=576): Launched 17:17:17.973994 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:18.482743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=578): Launched 17:17:18.596194 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:18.844870 run patchelf(pid=579): Launched 17:17:19.009473 run osmo-stp_10.42.42.5(pid=576): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=576)] 17:17:19.133801 run osmo-stp_10.42.42.5(pid=576): stdout: | (launched: 2022-12-12_17:17:17.806439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:19.259557 run osmo-stp_10.42.42.5(pid=576): stderr: | 20221212171717973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171717973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171717973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171717974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171717974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171717974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171717974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:19.385932 run osmo-stp_10.42.42.5(pid=576): stdout: | (launched: 2022-12-12_17:17:17.806439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:19.506805 run osmo-stp_10.42.42.5(pid=576): stderr: | 20221212171717973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171717973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171717973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171717974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171717974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171717974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171717974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:19.649779 run patchelf(pid=579): Terminating (SIGINT) 17:17:19.814800 run patchelf(pid=579): Terminated: ok {rc=0} 17:17:19.933912 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=576): Process ended prematurely: osmo-stp_10.42.42.5(pid=576) [trial-2379↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=576)] [trial-2379↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 17:17:19.942819 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:17:19.969918 run osmo-hlr_10.42.42.2(pid=573): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=573)] 17:17:20.016702 run osmo-hlr_10.42.42.2(pid=573): stdout: | (launched: 2022-12-12_17:17:16.727200) 17:17:20.066308 run osmo-hlr_10.42.42.2(pid=573): stderr: | 20221212171716963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171716963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171716963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171716963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171716963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171716964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171717014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171717031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171717031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171717031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:20.115714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=572): Terminating (SIGTERM) 17:17:20.155179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=575): Terminating (SIGTERM) 17:17:20.194868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=578): Terminating (SIGTERM) 17:17:20.234612 --- ParallelTerminationStrategy: PID 572 died... 17:17:20.253441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=572): Terminated: ok {rc=0} 17:17:20.297829 --- ParallelTerminationStrategy: PID 575 died... 17:17:20.316442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=575): Terminated: ok {rc=0} 17:17:20.360270 --- ParallelTerminationStrategy: PID 578 died... 17:17:20.378670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=578): Terminated: ok {rc=0} 17:17:20.463600 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 17:17:21.767924 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:17:21.774764 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:17:21.810197 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:17:21.847751 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:17:21.932723 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:17:21.964567 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:17:22.002462 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:17:22.601570 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:17:22.650224 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.661009 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:22.709764 tst cs_paging_gprs_active.py: using LAC 30340 17:17:22.829125 tst cs_paging_gprs_active.py: using RAC 250 17:17:22.957161 tst cs_paging_gprs_active.py: using CellId 30340 17:17:23.083120 tst cs_paging_gprs_active.py: using BVCI 30341 17:17:23.200259 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.211837 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.223111 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.234904 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.246506 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.258170 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.269988 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.281603 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:23.293441 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.412472 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.532152 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:17:23.749521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:24.073477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=583): Launched 17:17:24.354616 run iperf3-srv_10.42.42.10(pid=584): Launched 17:17:24.476137 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:17:24.692487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:25.015856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=585): Launched 17:17:25.296078 run iperf3-srv_10.42.42.10(pid=586): Launched 17:17:25.417403 tst cs_paging_gprs_active.py:38: start network... 17:17:25.633343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:26.130975 run create_hlr_db(pid=587): Launched 17:17:26.261871 bus /gobi_6: Setting Powered False 17:17:27.325908 run create_hlr_db(pid=587): Terminated: ok {rc=0} 17:17:27.754478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=589): Launched 17:17:28.055884 run osmo-hlr_10.42.42.2(pid=590): Launched 17:17:28.170903 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:28.685883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=592): Launched 17:17:28.986758 run osmo-stp_10.42.42.5(pid=593): Launched 17:17:29.102231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:29.619401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=595): Launched 17:17:29.734317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:29.988010 run patchelf(pid=596): Launched 17:17:30.155336 run osmo-stp_10.42.42.5(pid=593): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=593)] 17:17:30.282929 run osmo-stp_10.42.42.5(pid=593): stdout: | (launched: 2022-12-12_17:17:28.930781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:30.411418 run osmo-stp_10.42.42.5(pid=593): stderr: | 20221212171729097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171729097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171729098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171729098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171729099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171729099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171729099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:30.539956 run osmo-stp_10.42.42.5(pid=593): stdout: | (launched: 2022-12-12_17:17:28.930781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:30.663363 run osmo-stp_10.42.42.5(pid=593): stderr: | 20221212171729097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171729097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171729098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171729098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171729099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171729099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171729099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:30.809732 run patchelf(pid=596): Terminating (SIGINT) 17:17:31.002299 run patchelf(pid=596): Terminated: ok {rc=0} 17:17:31.134499 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=593): Process ended prematurely: osmo-stp_10.42.42.5(pid=593) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=593)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:17:31.145318 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 17:17:31.176816 run osmo-hlr_10.42.42.2(pid=590): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=590)] 17:17:31.227762 run osmo-hlr_10.42.42.2(pid=590): stdout: | (launched: 2022-12-12_17:17:28.000058) 17:17:31.280061 run osmo-hlr_10.42.42.2(pid=590): stderr: | 20221212171728173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171728173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171728173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171728173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171728173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171728173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171728209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171728218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171728219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171728219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:31.333294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=583): Terminating (SIGTERM) 17:17:31.377704 run iperf3-srv_10.42.42.10(pid=584): Terminating (SIGTERM) 17:17:31.423105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=585): Terminating (SIGTERM) 17:17:31.465830 run iperf3-srv_10.42.42.10(pid=586): Terminating (SIGTERM) 17:17:31.509616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=589): Terminating (SIGTERM) 17:17:31.553736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=592): Terminating (SIGTERM) 17:17:31.599422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=595): Terminating (SIGTERM) 17:17:31.644238 --- ParallelTerminationStrategy: PID 583 died... 17:17:31.665281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=583): Terminated: ok {rc=0} 17:17:31.714225 --- ParallelTerminationStrategy: PID 584 died... 17:17:31.733964 run iperf3-srv_10.42.42.10(pid=584): Terminated {rc=256} 17:17:31.781749 --- ParallelTerminationStrategy: PID 585 died... 17:17:31.802127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=585): Terminated: ok {rc=0} 17:17:31.849270 --- ParallelTerminationStrategy: PID 586 died... 17:17:31.869469 run iperf3-srv_10.42.42.10(pid=586): Terminated {rc=256} 17:17:31.917445 --- ParallelTerminationStrategy: PID 589 died... 17:17:31.937755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=589): Terminated: ok {rc=0} 17:17:31.987105 --- ParallelTerminationStrategy: PID 592 died... 17:17:32.007708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=592): Terminated: ok {rc=0} 17:17:32.056132 --- ParallelTerminationStrategy: PID 595 died... 17:17:32.076441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=595): Terminated: ok {rc=0} 17:17:32.167776 bus /gobi_0: Setting Powered False 17:17:33.266182 bus /gobi_0: Setting Powered False 17:17:34.379978 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:17:35.522915 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:35.534431 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:35.585720 tst iperf3.py: using LAC 30341 17:17:35.706822 tst iperf3.py: using RAC 251 17:17:35.825778 tst iperf3.py: using CellId 30341 17:17:35.943349 tst iperf3.py: using BVCI 30342 17:17:36.051892 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:36.062867 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:36.073663 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:36.084608 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:36.095194 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:36.106370 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:36.117595 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:36.128365 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:36.139433 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:36.256789 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:17:36.474279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:36.797433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=597): Launched 17:17:37.078907 run iperf3-srv_10.42.42.10(pid=598): Launched 17:17:37.200465 tst iperf3.py:8: start network... 17:17:37.417617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:37.917936 run create_hlr_db(pid=599): Launched 17:17:38.049828 bus /gobi_6: Setting Powered False 17:17:39.112634 run create_hlr_db(pid=599): Terminated: ok {rc=0} 17:17:39.541196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=601): Launched 17:17:39.842112 run osmo-hlr_10.42.42.2(pid=602): Launched 17:17:39.955885 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:40.473160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=604): Launched 17:17:40.773750 run osmo-stp_10.42.42.5(pid=605): Launched 17:17:40.887687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:41.404115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=607): Launched 17:17:41.519567 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:41.780648 run patchelf(pid=608): Launched 17:17:41.959958 run osmo-stp_10.42.42.5(pid=605): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=605)] 17:17:42.095643 run osmo-stp_10.42.42.5(pid=605): stdout: | (launched: 2022-12-12_17:17:40.718123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:42.233708 run osmo-stp_10.42.42.5(pid=605): stderr: | 20221212171740887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171740887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171740888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171740888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171740889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171740889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171740889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:42.372159 run osmo-stp_10.42.42.5(pid=605): stdout: | (launched: 2022-12-12_17:17:40.718123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:42.503574 run osmo-stp_10.42.42.5(pid=605): stderr: | 20221212171740887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171740887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171740888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171740888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171740889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171740889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171740889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:42.659523 run patchelf(pid=608): Terminating (SIGINT) 17:17:42.838568 run patchelf(pid=608): Terminated: ok {rc=0} 17:17:42.968068 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=605): Process ended prematurely: osmo-stp_10.42.42.5(pid=605) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=605)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 17:17:42.978246 tst iperf3.py:8: Test FAILED (7.5 sec) 17:17:43.006702 run osmo-hlr_10.42.42.2(pid=602): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=602)] 17:17:43.055795 run osmo-hlr_10.42.42.2(pid=602): stdout: | (launched: 2022-12-12_17:17:39.786494) 17:17:43.106814 run osmo-hlr_10.42.42.2(pid=602): stderr: | 20221212171739960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171739960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171739960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171739960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171739961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171739961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171739974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171739983 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171739983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171739983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:43.157856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=597): Terminating (SIGTERM) 17:17:43.199054 run iperf3-srv_10.42.42.10(pid=598): Terminating (SIGTERM) 17:17:43.240375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=601): Terminating (SIGTERM) 17:17:43.281933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=604): Terminating (SIGTERM) 17:17:43.323398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=607): Terminating (SIGTERM) 17:17:43.365101 --- ParallelTerminationStrategy: PID 597 died... 17:17:43.385138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=597): Terminated: ok {rc=0} 17:17:43.431232 --- ParallelTerminationStrategy: PID 598 died... 17:17:43.450678 run iperf3-srv_10.42.42.10(pid=598): Terminated {rc=256} 17:17:43.496101 --- ParallelTerminationStrategy: PID 601 died... 17:17:43.515504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=601): Terminated: ok {rc=0} 17:17:43.561090 --- ParallelTerminationStrategy: PID 604 died... 17:17:43.580575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=604): Terminated: ok {rc=0} 17:17:43.626031 --- ParallelTerminationStrategy: PID 607 died... 17:17:43.645649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=607): Terminated: ok {rc=0} 17:17:43.732169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:17:44.879773 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:44.891952 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:44.946348 tst iperf3m4.py: using LAC 30342 17:17:45.068778 tst iperf3m4.py: using RAC 252 17:17:45.188314 tst iperf3m4.py: using CellId 30342 17:17:45.305901 tst iperf3m4.py: using BVCI 30343 17:17:45.416549 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:45.427624 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:45.438358 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:45.450029 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:45.461495 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:45.473027 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:45.484646 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:45.496003 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:45.507601 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:45.628675 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:45.753067 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:45.886317 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:46.014387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:17:46.223242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:46.535760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=609): Launched 17:17:46.821932 run iperf3-srv_10.42.42.10(pid=610): Launched 17:17:46.939377 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:17:47.146170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:47.451117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=611): Launched 17:17:47.713800 run iperf3-srv_10.42.42.10(pid=612): Launched 17:17:47.827020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:17:48.027105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:48.328371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=613): Launched 17:17:48.590827 run iperf3-srv_10.42.42.10(pid=614): Launched 17:17:48.703879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:17:48.904142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:49.205607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=615): Launched 17:17:49.468121 run iperf3-srv_10.42.42.10(pid=616): Launched 17:17:49.580926 tst iperf3m4.py:8: start network... 17:17:49.780941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:50.245484 run create_hlr_db(pid=617): Launched 17:17:50.359930 bus /gobi_6: Setting Powered False 17:17:51.420102 run create_hlr_db(pid=617): Terminated: ok {rc=0} 17:17:51.838435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=619): Launched 17:17:52.138547 run osmo-hlr_10.42.42.2(pid=620): Launched 17:17:52.252766 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:52.775303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=622): Launched 17:17:53.077633 run osmo-stp_10.42.42.5(pid=623): Launched 17:17:53.192862 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:53.710668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=625): Launched 17:17:53.826087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:54.079533 run patchelf(pid=626): Launched 17:17:54.246349 run osmo-stp_10.42.42.5(pid=623): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=623)] 17:17:54.372539 run osmo-stp_10.42.42.5(pid=623): stdout: | (launched: 2022-12-12_17:17:53.021548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:54.501559 run osmo-stp_10.42.42.5(pid=623): stderr: | 20221212171753189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171753189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171753190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171753190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171753190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171753191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171753191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:54.630384 run osmo-stp_10.42.42.5(pid=623): stdout: | (launched: 2022-12-12_17:17:53.021548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:54.752596 run osmo-stp_10.42.42.5(pid=623): stderr: | 20221212171753189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171753189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171753190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171753190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171753190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171753191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171753191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:54.898307 run patchelf(pid=626): Terminating (SIGINT) 17:17:55.065284 run patchelf(pid=626): Terminated: ok {rc=0} 17:17:55.185449 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=623): Process ended prematurely: osmo-stp_10.42.42.5(pid=623) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=623)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 17:17:55.194907 tst iperf3m4.py:8: Test FAILED (10.4 sec) 17:17:55.222646 run osmo-hlr_10.42.42.2(pid=620): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=620)] 17:17:55.269698 run osmo-hlr_10.42.42.2(pid=620): stdout: | (launched: 2022-12-12_17:17:52.082411) 17:17:55.318203 run osmo-hlr_10.42.42.2(pid=620): stderr: | 20221212171752256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171752256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171752256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171752256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171752256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171752256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171752269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171752277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171752278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171752278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:55.367118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=609): Terminating (SIGTERM) 17:17:55.406106 run iperf3-srv_10.42.42.10(pid=610): Terminating (SIGTERM) 17:17:55.445071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=611): Terminating (SIGTERM) 17:17:55.484009 run iperf3-srv_10.42.42.10(pid=612): Terminating (SIGTERM) 17:17:55.523114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=613): Terminating (SIGTERM) 17:17:55.562039 run iperf3-srv_10.42.42.10(pid=614): Terminating (SIGTERM) 17:17:55.601195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=615): Terminating (SIGTERM) 17:17:55.640229 run iperf3-srv_10.42.42.10(pid=616): Terminating (SIGTERM) 17:17:55.679271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=619): Terminating (SIGTERM) 17:17:55.718363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=622): Terminating (SIGTERM) 17:17:55.757540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=625): Terminating (SIGTERM) 17:17:55.796991 --- ParallelTerminationStrategy: PID 609 died... 17:17:55.815765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=609): Terminated: ok {rc=0} 17:17:55.859305 --- ParallelTerminationStrategy: PID 610 died... 17:17:55.877536 run iperf3-srv_10.42.42.10(pid=610): Terminated {rc=256} 17:17:55.920841 --- ParallelTerminationStrategy: PID 611 died... 17:17:55.939479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=611): Terminated: ok {rc=0} 17:17:55.982760 --- ParallelTerminationStrategy: PID 612 died... 17:17:56.001117 run iperf3-srv_10.42.42.10(pid=612): Terminated {rc=256} 17:17:56.044573 --- ParallelTerminationStrategy: PID 613 died... 17:17:56.062838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=613): Terminated: ok {rc=0} 17:17:56.106312 --- ParallelTerminationStrategy: PID 614 died... 17:17:56.124688 run iperf3-srv_10.42.42.10(pid=614): Terminated {rc=256} 17:17:56.168313 --- ParallelTerminationStrategy: PID 615 died... 17:17:56.186662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=615): Terminated: ok {rc=0} 17:17:56.230208 --- ParallelTerminationStrategy: PID 616 died... 17:17:56.248581 run iperf3-srv_10.42.42.10(pid=616): Terminated {rc=256} 17:17:56.292138 --- ParallelTerminationStrategy: PID 619 died... 17:17:56.310330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=619): Terminated: ok {rc=0} 17:17:56.354278 --- ParallelTerminationStrategy: PID 622 died... 17:17:56.372638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=622): Terminated: ok {rc=0} 17:17:56.416093 --- ParallelTerminationStrategy: PID 625 died... 17:17:56.434373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=625): Terminated: ok {rc=0} 17:17:56.516876 bus /gobi_4: Setting Powered False 17:17:57.614396 bus /gobi_4: Setting Powered False 17:17:58.728349 bus /gobi_1: Setting Powered False 17:17:59.825729 bus /gobi_1: Setting Powered False 17:18:00.955286 bus /gobi_0: Setting Powered False 17:18:02.075002 bus /gobi_0: Setting Powered False 17:18:03.205982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 17:18:04.309244 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:04.321421 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:18:04.373811 tst ping.py: using LAC 30343 17:18:04.499706 tst ping.py: using RAC 253 17:18:04.626293 tst ping.py: using CellId 30343 17:18:04.750256 tst ping.py: using BVCI 30344 17:18:04.866519 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:04.878456 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:04.889781 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:04.901020 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:04.912112 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:04.923381 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:04.934836 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:04.946033 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:18:05.063782 tst ping.py:19: start network... 17:18:05.275215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:05.764098 run create_hlr_db(pid=627): Launched 17:18:05.893143 bus /gobi_6: Setting Powered False 17:18:06.955797 run create_hlr_db(pid=627): Terminated: ok {rc=0} 17:18:07.379573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=629): Launched 17:18:07.675175 run osmo-hlr_10.42.42.2(pid=630): Launched 17:18:07.786665 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:08.294679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=632): Launched 17:18:08.589924 run osmo-stp_10.42.42.5(pid=633): Launched 17:18:08.703197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:09.212607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=635): Launched 17:18:09.335402 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:09.603839 run patchelf(pid=636): Launched 17:18:09.780831 run osmo-stp_10.42.42.5(pid=633): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=633)] 17:18:09.915006 run osmo-stp_10.42.42.5(pid=633): stdout: | (launched: 2022-12-12_17:18:08.534367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:10.050633 run osmo-stp_10.42.42.5(pid=633): stderr: | 20221212171808700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171808700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171808700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171808701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171808701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171808701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171808701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:10.186579 run osmo-stp_10.42.42.5(pid=633): stdout: | (launched: 2022-12-12_17:18:08.534367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:10.316743 run osmo-stp_10.42.42.5(pid=633): stderr: | 20221212171808700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171808700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171808700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171808701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171808701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171808701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171808701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:10.470414 run patchelf(pid=636): Terminating (SIGINT) 17:18:10.647108 run patchelf(pid=636): Terminated: ok {rc=0} 17:18:10.774222 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=633): Process ended prematurely: osmo-stp_10.42.42.5(pid=633) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=633)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 17:18:10.783701 tst ping.py:22: Test FAILED (6.5 sec) 17:18:10.811857 run osmo-hlr_10.42.42.2(pid=630): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=630)] 17:18:10.861648 run osmo-hlr_10.42.42.2(pid=630): stdout: | (launched: 2022-12-12_17:18:07.620226) 17:18:10.913965 run osmo-hlr_10.42.42.2(pid=630): stderr: | 20221212171807793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171807793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171807793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171807793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171807793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171807793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171807806 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171807815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171807815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171807815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:10.966485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=629): Terminating (SIGTERM) 17:18:11.008573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=632): Terminating (SIGTERM) 17:18:11.050925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=635): Terminating (SIGTERM) 17:18:11.093649 --- ParallelTerminationStrategy: PID 629 died... 17:18:11.114071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=629): Terminated: ok {rc=0} 17:18:11.161018 --- ParallelTerminationStrategy: PID 632 died... 17:18:11.180882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=632): Terminated: ok {rc=0} 17:18:11.227447 --- ParallelTerminationStrategy: PID 635 died... 17:18:11.247414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=635): Terminated: ok {rc=0} 17:18:11.335784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:18:12.424376 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:12.436854 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:18:12.490576 tst ping_idle_ping.py: using LAC 30344 17:18:12.616467 tst ping_idle_ping.py: using RAC 254 17:18:12.740662 tst ping_idle_ping.py: using CellId 30344 17:18:12.864940 tst ping_idle_ping.py: using BVCI 30345 17:18:12.980543 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:12.992129 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:13.003534 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:13.014810 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:13.025966 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:13.037169 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:13.048468 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:18:13.059737 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:18:13.177879 tst ping_idle_ping.py:24: start network... 17:18:13.391982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:13.887057 run create_hlr_db(pid=637): Launched 17:18:14.017425 bus /gobi_6: Setting Powered False 17:18:15.080439 run create_hlr_db(pid=637): Terminated: ok {rc=0} 17:18:15.523487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=639): Launched 17:18:15.846678 run osmo-hlr_10.42.42.2(pid=640): Launched 17:18:16.106319 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:16.687477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=642): Launched 17:18:17.029320 run osmo-stp_10.42.42.5(pid=643): Launched 17:18:17.330039 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:17.948664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=645): Launched 17:18:18.070159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:18.338127 run patchelf(pid=646): Launched 17:18:18.515310 run osmo-stp_10.42.42.5(pid=643): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=643)] 17:18:18.649304 run osmo-stp_10.42.42.5(pid=643): stdout: | (launched: 2022-12-12_17:18:16.971109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:18.784625 run osmo-stp_10.42.42.5(pid=643): stderr: | 20221212171817211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171817211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171817212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171817212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171817213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171817213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171817213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:18.920072 run osmo-stp_10.42.42.5(pid=643): stdout: | (launched: 2022-12-12_17:18:16.971109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:19.049761 run osmo-stp_10.42.42.5(pid=643): stderr: | 20221212171817211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171817211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171817212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171817212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171817213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171817213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171817213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:19.202910 run patchelf(pid=646): Terminating (SIGINT) 17:18:19.379479 run patchelf(pid=646): Terminated: ok {rc=0} 17:18:19.506619 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=643): Process ended prematurely: osmo-stp_10.42.42.5(pid=643) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=643)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 17:18:19.516259 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 17:18:19.544325 run osmo-hlr_10.42.42.2(pid=640): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=640)] 17:18:19.593579 run osmo-hlr_10.42.42.2(pid=640): stdout: | (launched: 2022-12-12_17:18:15.783048) 17:18:19.644136 run osmo-hlr_10.42.42.2(pid=640): stderr: | 20221212171816072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171816072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171816072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171816073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171816073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171816073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171816092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171816100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171816113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171816113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:19.695101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=639): Terminating (SIGTERM) 17:18:19.736246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=642): Terminating (SIGTERM) 17:18:19.777680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=645): Terminating (SIGTERM) 17:18:19.819439 --- ParallelTerminationStrategy: PID 639 died... 17:18:19.839297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=639): Terminated: ok {rc=0} 17:18:19.885405 --- ParallelTerminationStrategy: PID 642 died... 17:18:19.904644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=642): Terminated: ok {rc=0} 17:18:19.950715 --- ParallelTerminationStrategy: PID 645 died... 17:18:19.970327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=645): Terminated: ok {rc=0} 17:18:20.057860 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:18:21.361256 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:18:21.369270 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:18:21.402667 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:18:21.441950 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:18:21.530237 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:18:21.563062 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:18:21.602411 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:18:22.193507 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:18:22.246358 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:22.258004 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:22.326455 tst cs_paging_gprs_active.py: using LAC 30345 17:18:22.451631 tst cs_paging_gprs_active.py: using RAC 255 17:18:22.577468 tst cs_paging_gprs_active.py: using CellId 30345 17:18:22.703398 tst cs_paging_gprs_active.py: using BVCI 30346 17:18:22.819308 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:22.830716 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:22.841964 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:22.853285 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:22.864326 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:22.875887 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:22.887215 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:22.898496 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:22.909822 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:23.028413 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:23.145634 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:18:23.346045 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:23.647379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=650): Launched 17:18:23.909867 run iperf3-srv_10.42.42.10(pid=651): Launched 17:18:24.022865 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:18:24.223216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:24.524640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=652): Launched 17:18:24.787263 run iperf3-srv_10.42.42.10(pid=653): Launched 17:18:24.900162 tst cs_paging_gprs_active.py:38: start network... 17:18:25.100156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:25.564175 run create_hlr_db(pid=654): Launched 17:18:25.680248 bus /gobi_6: Setting Powered False 17:18:26.739783 run create_hlr_db(pid=654): Terminated: ok {rc=0} 17:18:27.178819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=656): Launched 17:18:27.501558 run osmo-hlr_10.42.42.2(pid=657): Launched 17:18:27.625242 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:28.184383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=659): Launched 17:18:28.506931 run osmo-stp_10.42.42.5(pid=660): Launched 17:18:28.632859 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:29.189457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=662): Launched 17:18:29.313445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:29.585718 run patchelf(pid=663): Launched 17:18:29.764492 run osmo-stp_10.42.42.5(pid=660): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=660)] 17:18:29.900504 run osmo-stp_10.42.42.5(pid=660): stdout: | (launched: 2022-12-12_17:18:28.447519) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:30.037680 run osmo-stp_10.42.42.5(pid=660): stderr: | 20221212171828636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171828636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171828636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171828637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171828637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171828638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171828638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:30.174757 run osmo-stp_10.42.42.5(pid=660): stdout: | (launched: 2022-12-12_17:18:28.447519) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:30.306553 run osmo-stp_10.42.42.5(pid=660): stderr: | 20221212171828636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171828636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171828636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171828637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171828637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171828638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171828638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:30.462641 run patchelf(pid=663): Terminating (SIGINT) 17:18:30.641861 run patchelf(pid=663): Terminated: ok {rc=0} 17:18:30.771869 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=660): Process ended prematurely: osmo-stp_10.42.42.5(pid=660) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=660)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:18:30.782566 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:18:30.811014 run osmo-hlr_10.42.42.2(pid=657): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=657)] 17:18:30.861089 run osmo-hlr_10.42.42.2(pid=657): stdout: | (launched: 2022-12-12_17:18:27.442215) 17:18:30.919072 run osmo-hlr_10.42.42.2(pid=657): stderr: | 20221212171827636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171827636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171827636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171827636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171827636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171827636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171827650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171827659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171827659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171827659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:30.971164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=650): Terminating (SIGTERM) 17:18:31.013947 run iperf3-srv_10.42.42.10(pid=651): Terminating (SIGTERM) 17:18:31.060248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=652): Terminating (SIGTERM) 17:18:31.103152 run iperf3-srv_10.42.42.10(pid=653): Terminating (SIGTERM) 17:18:31.147897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=656): Terminating (SIGTERM) 17:18:31.190102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=659): Terminating (SIGTERM) 17:18:31.231953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=662): Terminating (SIGTERM) 17:18:31.274190 --- ParallelTerminationStrategy: PID 650 died... 17:18:31.294294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=650): Terminated: ok {rc=0} 17:18:31.340729 --- ParallelTerminationStrategy: PID 651 died... 17:18:31.360651 run iperf3-srv_10.42.42.10(pid=651): Terminated {rc=256} 17:18:31.407326 --- ParallelTerminationStrategy: PID 652 died... 17:18:31.427316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=652): Terminated: ok {rc=0} 17:18:31.473488 --- ParallelTerminationStrategy: PID 653 died... 17:18:31.493350 run iperf3-srv_10.42.42.10(pid=653): Terminated {rc=256} 17:18:31.539754 --- ParallelTerminationStrategy: PID 656 died... 17:18:31.559756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=656): Terminated: ok {rc=0} 17:18:31.605817 --- ParallelTerminationStrategy: PID 659 died... 17:18:31.625668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=659): Terminated: ok {rc=0} 17:18:31.672361 --- ParallelTerminationStrategy: PID 662 died... 17:18:31.692323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=662): Terminated: ok {rc=0} 17:18:31.780008 bus /gobi_0: Setting Powered False 17:18:32.878454 bus /gobi_0: Setting Powered False 17:18:33.995412 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:18:35.139188 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:35.150698 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:35.220780 tst iperf3.py: using LAC 30346 17:18:35.338131 tst iperf3.py: using RAC 1 17:18:35.458279 tst iperf3.py: using CellId 30346 17:18:35.575857 tst iperf3.py: using BVCI 30347 17:18:35.685991 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:35.696878 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:35.708034 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:35.719066 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:35.730130 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:35.741151 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:35.752176 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:35.763077 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:35.774373 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:35.892137 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:18:36.108859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:36.432127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=664): Launched 17:18:36.714556 run iperf3-srv_10.42.42.10(pid=665): Launched 17:18:36.836583 tst iperf3.py:8: start network... 17:18:37.053815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:37.554762 run create_hlr_db(pid=666): Launched 17:18:37.686660 bus /gobi_6: Setting Powered False 17:18:38.750153 run create_hlr_db(pid=666): Terminated: ok {rc=0} 17:18:39.180354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=668): Launched 17:18:39.481253 run osmo-hlr_10.42.42.2(pid=669): Launched 17:18:39.595941 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:40.123410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=671): Launched 17:18:40.423663 run osmo-stp_10.42.42.5(pid=672): Launched 17:18:40.537985 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:41.055134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=674): Launched 17:18:41.169780 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:41.422895 run patchelf(pid=675): Launched 17:18:41.589553 run osmo-stp_10.42.42.5(pid=672): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=672)] 17:18:41.715859 run osmo-stp_10.42.42.5(pid=672): stdout: | (launched: 2022-12-12_17:18:40.367984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:41.844342 run osmo-stp_10.42.42.5(pid=672): stderr: | 20221212171840534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171840534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171840535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171840535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171840535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171840536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171840536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:41.972786 run osmo-stp_10.42.42.5(pid=672): stdout: | (launched: 2022-12-12_17:18:40.367984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:42.095379 run osmo-stp_10.42.42.5(pid=672): stderr: | 20221212171840534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171840534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171840535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171840535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171840535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171840536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171840536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:42.240563 run patchelf(pid=675): Terminating (SIGINT) 17:18:42.407838 run patchelf(pid=675): Terminated: ok {rc=0} 17:18:42.528439 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=672): Process ended prematurely: osmo-stp_10.42.42.5(pid=672) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=672)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 17:18:42.538083 tst iperf3.py:8: Test FAILED (7.4 sec) 17:18:42.565254 run osmo-hlr_10.42.42.2(pid=669): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=669)] 17:18:42.612292 run osmo-hlr_10.42.42.2(pid=669): stdout: | (launched: 2022-12-12_17:18:39.425249) 17:18:42.660570 run osmo-hlr_10.42.42.2(pid=669): stderr: | 20221212171839600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171839600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171839600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171839600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171839600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171839600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171839612 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171839621 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171839622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171839622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:42.709637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=664): Terminating (SIGTERM) 17:18:42.748692 run iperf3-srv_10.42.42.10(pid=665): Terminating (SIGTERM) 17:18:42.787696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=668): Terminating (SIGTERM) 17:18:42.827009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=671): Terminating (SIGTERM) 17:18:42.866170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=674): Terminating (SIGTERM) 17:18:42.905841 --- ParallelTerminationStrategy: PID 664 died... 17:18:42.924435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=664): Terminated: ok {rc=0} 17:18:42.968353 --- ParallelTerminationStrategy: PID 665 died... 17:18:42.986629 run iperf3-srv_10.42.42.10(pid=665): Terminated {rc=256} 17:18:43.030107 --- ParallelTerminationStrategy: PID 668 died... 17:18:43.048358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=668): Terminated: ok {rc=0} 17:18:43.091624 --- ParallelTerminationStrategy: PID 671 died... 17:18:43.109822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=671): Terminated: ok {rc=0} 17:18:43.153219 --- ParallelTerminationStrategy: PID 674 died... 17:18:43.171350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=674): Terminated: ok {rc=0} 17:18:43.255863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:18:44.402384 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.414042 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:44.481142 tst iperf3m4.py: using LAC 30347 17:18:44.598108 tst iperf3m4.py: using RAC 2 17:18:44.717269 tst iperf3m4.py: using CellId 30347 17:18:44.836047 tst iperf3m4.py: using BVCI 30348 17:18:44.945384 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.956315 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.967059 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.978143 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.989212 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.000131 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.011326 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.022223 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:45.033367 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:45.151907 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:45.270489 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:45.389787 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:45.505096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:18:45.707052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:46.068224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=676): Launched 17:18:46.388696 run iperf3-srv_10.42.42.10(pid=677): Launched 17:18:46.517736 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:18:46.723577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:47.040273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=678): Launched 17:18:47.322081 run iperf3-srv_10.42.42.10(pid=679): Launched 17:18:47.437279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:18:47.639328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:47.943922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=680): Launched 17:18:48.208841 run iperf3-srv_10.42.42.10(pid=681): Launched 17:18:48.322663 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:18:48.524149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:48.828607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=682): Launched 17:18:49.094141 run iperf3-srv_10.42.42.10(pid=683): Launched 17:18:49.208384 tst iperf3m4.py:8: start network... 17:18:49.410363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:49.881437 run create_hlr_db(pid=684): Launched 17:18:49.997874 bus /gobi_6: Setting Powered False 17:18:51.057935 run create_hlr_db(pid=684): Terminated: ok {rc=0} 17:18:51.501981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=686): Launched 17:18:51.828499 run osmo-hlr_10.42.42.2(pid=687): Launched 17:18:51.953394 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:52.515649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=689): Launched 17:18:52.841655 run osmo-stp_10.42.42.5(pid=690): Launched 17:18:52.966996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:53.527444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=692): Launched 17:18:53.651328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:53.926339 run patchelf(pid=693): Launched 17:18:54.106914 run osmo-stp_10.42.42.5(pid=690): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=690)] 17:18:54.243625 run osmo-stp_10.42.42.5(pid=690): stdout: | (launched: 2022-12-12_17:18:52.781300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:54.382823 run osmo-stp_10.42.42.5(pid=690): stderr: | 20221212171852971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171852971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171852971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171852972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171852972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171852972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171852972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:54.521589 run osmo-stp_10.42.42.5(pid=690): stdout: | (launched: 2022-12-12_17:18:52.781300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:54.654115 run osmo-stp_10.42.42.5(pid=690): stderr: | 20221212171852971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171852971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171852971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171852972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171852972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171852972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171852972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:54.811333 run patchelf(pid=693): Terminating (SIGINT) 17:18:54.992603 run patchelf(pid=693): Terminated: ok {rc=0} 17:18:55.123391 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=690): Process ended prematurely: osmo-stp_10.42.42.5(pid=690) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=690)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:18:55.133709 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:18:55.162499 run osmo-hlr_10.42.42.2(pid=687): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=687)] 17:18:55.211792 run osmo-hlr_10.42.42.2(pid=687): stdout: | (launched: 2022-12-12_17:18:51.768093) 17:18:55.262933 run osmo-hlr_10.42.42.2(pid=687): stderr: | 20221212171851963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171851963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171851963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171851963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171851963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171851963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171851979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171851988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171851989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171851989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:55.314720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=676): Terminating (SIGTERM) 17:18:55.355905 run iperf3-srv_10.42.42.10(pid=677): Terminating (SIGTERM) 17:18:55.396853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=678): Terminating (SIGTERM) 17:18:55.437981 run iperf3-srv_10.42.42.10(pid=679): Terminating (SIGTERM) 17:18:55.478995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=680): Terminating (SIGTERM) 17:18:55.520011 run iperf3-srv_10.42.42.10(pid=681): Terminating (SIGTERM) 17:18:55.562486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=682): Terminating (SIGTERM) 17:18:55.603866 run iperf3-srv_10.42.42.10(pid=683): Terminating (SIGTERM) 17:18:55.644723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=686): Terminating (SIGTERM) 17:18:55.685834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=689): Terminating (SIGTERM) 17:18:55.726670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=692): Terminating (SIGTERM) 17:18:55.767874 --- ParallelTerminationStrategy: PID 676 died... 17:18:55.787676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=676): Terminated: ok {rc=0} 17:18:55.833240 --- ParallelTerminationStrategy: PID 677 died... 17:18:55.852554 run iperf3-srv_10.42.42.10(pid=677): Terminated {rc=256} 17:18:55.898001 --- ParallelTerminationStrategy: PID 678 died... 17:18:55.917297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=678): Terminated: ok {rc=0} 17:18:55.963191 --- ParallelTerminationStrategy: PID 679 died... 17:18:55.982733 run iperf3-srv_10.42.42.10(pid=679): Terminated {rc=256} 17:18:56.028376 --- ParallelTerminationStrategy: PID 680 died... 17:18:56.047695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=680): Terminated: ok {rc=0} 17:18:56.093418 --- ParallelTerminationStrategy: PID 681 died... 17:18:56.112791 run iperf3-srv_10.42.42.10(pid=681): Terminated {rc=256} 17:18:56.158312 --- ParallelTerminationStrategy: PID 682 died... 17:18:56.177609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=682): Terminated: ok {rc=0} 17:18:56.223201 --- ParallelTerminationStrategy: PID 683 died... 17:18:56.242721 run iperf3-srv_10.42.42.10(pid=683): Terminated {rc=256} 17:18:56.288159 --- ParallelTerminationStrategy: PID 686 died... 17:18:56.307428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=686): Terminated: ok {rc=0} 17:18:56.352701 --- ParallelTerminationStrategy: PID 689 died... 17:18:56.372093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=689): Terminated: ok {rc=0} 17:18:56.417444 --- ParallelTerminationStrategy: PID 692 died... 17:18:56.437028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=692): Terminated: ok {rc=0} 17:18:56.524524 bus /gobi_4: Setting Powered False 17:18:57.623218 bus /gobi_4: Setting Powered False 17:18:58.738521 bus /gobi_1: Setting Powered False 17:18:59.838486 bus /gobi_1: Setting Powered False 17:19:00.964763 bus /gobi_0: Setting Powered False 17:19:02.063759 bus /gobi_0: Setting Powered False 17:19:03.182026 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:19:04.284271 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:04.296010 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:19:04.365199 tst ping.py: using LAC 30348 17:19:04.485032 tst ping.py: using RAC 3 17:19:04.603679 tst ping.py: using CellId 30348 17:19:04.730958 tst ping.py: using BVCI 30349 17:19:04.848091 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:04.860010 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:04.871459 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:04.882910 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:04.894167 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:04.905999 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:04.917636 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:04.928865 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:19:05.042779 tst ping.py:19: start network... 17:19:05.241171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:05.703051 run create_hlr_db(pid=694): Launched 17:19:05.817177 bus /gobi_6: Setting Powered False 17:19:06.877154 run create_hlr_db(pid=694): Terminated: ok {rc=0} 17:19:07.314670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=696): Launched 17:19:07.636489 run osmo-hlr_10.42.42.2(pid=697): Launched 17:19:07.760542 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:08.314131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=699): Launched 17:19:08.635576 run osmo-stp_10.42.42.5(pid=700): Launched 17:19:08.757240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:09.309784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=702): Launched 17:19:09.432850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:09.703772 run patchelf(pid=703): Launched 17:19:09.882444 run osmo-stp_10.42.42.5(pid=700): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=700)] 17:19:10.017959 run osmo-stp_10.42.42.5(pid=700): stdout: | (launched: 2022-12-12_17:19:08.576022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:10.155041 run osmo-stp_10.42.42.5(pid=700): stderr: | 20221212171908764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171908764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171908764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171908765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171908765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171908765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171908765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:10.291785 run osmo-stp_10.42.42.5(pid=700): stdout: | (launched: 2022-12-12_17:19:08.576022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:10.423427 run osmo-stp_10.42.42.5(pid=700): stderr: | 20221212171908764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171908764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171908764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171908765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171908765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171908765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171908765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:10.578985 run patchelf(pid=703): Terminating (SIGINT) 17:19:10.757687 run patchelf(pid=703): Terminated: ok {rc=0} 17:19:10.886112 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=700): Process ended prematurely: osmo-stp_10.42.42.5(pid=700) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=700)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 17:19:10.895856 tst ping.py:22: Test FAILED (6.6 sec) 17:19:10.925596 run osmo-hlr_10.42.42.2(pid=697): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=697)] 17:19:10.975847 run osmo-hlr_10.42.42.2(pid=697): stdout: | (launched: 2022-12-12_17:19:07.577277) 17:19:11.027479 run osmo-hlr_10.42.42.2(pid=697): stderr: | 20221212171907772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171907772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171907772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171907772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171907772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171907772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171907786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171907794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171907794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171907794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:11.079542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=696): Terminating (SIGTERM) 17:19:11.121259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=699): Terminating (SIGTERM) 17:19:11.163250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=702): Terminating (SIGTERM) 17:19:11.205908 --- ParallelTerminationStrategy: PID 696 died... 17:19:11.226044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=696): Terminated: ok {rc=0} 17:19:11.273084 --- ParallelTerminationStrategy: PID 699 died... 17:19:11.292475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=699): Terminated: ok {rc=0} 17:19:11.339518 --- ParallelTerminationStrategy: PID 702 died... 17:19:11.359064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=702): Terminated: ok {rc=0} 17:19:11.446665 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:19:12.535501 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:12.547524 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:19:12.617541 tst ping_idle_ping.py: using LAC 30349 17:19:12.744839 tst ping_idle_ping.py: using RAC 4 17:19:12.874095 tst ping_idle_ping.py: using CellId 30349 17:19:12.998925 tst ping_idle_ping.py: using BVCI 30350 17:19:13.116808 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:13.128353 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:13.139767 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:13.151105 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:13.162414 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:13.173806 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:13.185833 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:19:13.197120 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:19:13.312893 tst ping_idle_ping.py:24: start network... 17:19:13.512777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:13.979965 run create_hlr_db(pid=705): Launched 17:19:14.094923 bus /gobi_6: Setting Powered False 17:19:15.155807 run create_hlr_db(pid=705): Terminated: ok {rc=0} 17:19:15.593661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=707): Launched 17:19:15.933274 run osmo-hlr_10.42.42.2(pid=708): Launched 17:19:16.111714 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:16.982170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=710): Launched 17:19:17.315577 run osmo-stp_10.42.42.5(pid=711): Launched 17:19:17.438082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:17.992063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=713): Launched 17:19:18.115548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:18.386708 run patchelf(pid=714): Launched 17:19:18.565221 run osmo-stp_10.42.42.5(pid=711): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=711)] 17:19:18.700457 run osmo-stp_10.42.42.5(pid=711): stdout: | (launched: 2022-12-12_17:19:17.255496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:18.837252 run osmo-stp_10.42.42.5(pid=711): stderr: | 20221212171917443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171917443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171917444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171917444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171917445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171917445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171917445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:18.974704 run osmo-stp_10.42.42.5(pid=711): stdout: | (launched: 2022-12-12_17:19:17.255496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:19.105640 run osmo-stp_10.42.42.5(pid=711): stderr: | 20221212171917443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171917443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171917444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171917444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171917445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171917445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171917445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:19.261562 run patchelf(pid=714): Terminating (SIGINT) 17:19:19.439957 run patchelf(pid=714): Terminated: ok {rc=0} 17:19:19.568382 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=711): Process ended prematurely: osmo-stp_10.42.42.5(pid=711) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=711)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:19:19.578028 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 17:19:19.606074 run osmo-hlr_10.42.42.2(pid=708): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=708)] 17:19:19.655631 run osmo-hlr_10.42.42.2(pid=708): stdout: | (launched: 2022-12-12_17:19:15.858458) 17:19:19.707389 run osmo-hlr_10.42.42.2(pid=708): stderr: | 20221212171916224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171916224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171916224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171916224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171916224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171916224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171916243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171916266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171916267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171916267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:19.758927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=707): Terminating (SIGTERM) 17:19:19.800434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=710): Terminating (SIGTERM) 17:19:19.842359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=713): Terminating (SIGTERM) 17:19:19.884025 --- ParallelTerminationStrategy: PID 707 died... 17:19:19.904349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=707): Terminated: ok {rc=0} 17:19:19.950057 --- ParallelTerminationStrategy: PID 710 died... 17:19:19.969810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=710): Terminated: ok {rc=0} 17:19:20.015687 --- ParallelTerminationStrategy: PID 713 died... 17:19:20.035303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=713): Terminated: ok {rc=0} 17:19:20.122810 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:19:21.431335 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:19:21.439021 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:19:21.473756 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 17:19:21.512494 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 17:19:21.599103 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:19:21.631617 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 17:19:21.669946 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 17:19:22.266488 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 17:19:22.316366 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:22.327737 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:19:22.377414 tst cs_paging_gprs_active.py: using LAC 30350 17:19:22.498588 tst cs_paging_gprs_active.py: using RAC 5 17:19:22.614658 tst cs_paging_gprs_active.py: using CellId 30350 17:19:22.732603 tst cs_paging_gprs_active.py: using BVCI 30351 17:19:22.842716 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:22.854101 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:22.865259 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:22.876538 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:22.887845 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:22.899326 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:22.910974 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:22.922957 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:22.934691 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:19:23.056372 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:19:23.172848 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:19:23.373982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:23.675297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=719): Launched 17:19:23.937117 run iperf3-srv_10.42.42.10(pid=720): Launched 17:19:24.050458 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:19:24.250895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:24.553003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=721): Launched 17:19:24.815108 run iperf3-srv_10.42.42.10(pid=722): Launched 17:19:24.928252 tst cs_paging_gprs_active.py:38: start network... 17:19:25.129312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:25.597517 run create_hlr_db(pid=723): Launched 17:19:25.712723 bus /gobi_6: Setting Powered False 17:19:26.771559 run create_hlr_db(pid=723): Terminated: ok {rc=0} 17:19:27.191814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=725): Launched 17:19:27.493470 run osmo-hlr_10.42.42.2(pid=726): Launched 17:19:27.609062 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:28.139546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=728): Launched 17:19:28.441720 run osmo-stp_10.42.42.5(pid=729): Launched 17:19:28.556853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:29.075106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=731): Launched 17:19:29.190409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:29.446050 run patchelf(pid=732): Launched 17:19:29.612772 run osmo-stp_10.42.42.5(pid=729): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=729)] 17:19:29.739857 run osmo-stp_10.42.42.5(pid=729): stdout: | (launched: 2022-12-12_17:19:28.385518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:29.868216 run osmo-stp_10.42.42.5(pid=729): stderr: | 20221212171928553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171928553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171928553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171928554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171928554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171928554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171928554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:29.996783 run osmo-stp_10.42.42.5(pid=729): stdout: | (launched: 2022-12-12_17:19:28.385518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:30.120227 run osmo-stp_10.42.42.5(pid=729): stderr: | 20221212171928553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171928553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171928553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171928554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171928554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171928554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171928554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:30.266322 run patchelf(pid=732): Terminating (SIGINT) 17:19:30.434312 run patchelf(pid=732): Terminated: ok {rc=0} 17:19:30.556058 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=729): Process ended prematurely: osmo-stp_10.42.42.5(pid=729) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=729)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 17:19:30.565832 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 17:19:30.593217 run osmo-hlr_10.42.42.2(pid=726): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=726)] 17:19:30.640673 run osmo-hlr_10.42.42.2(pid=726): stdout: | (launched: 2022-12-12_17:19:27.437315) 17:19:30.689767 run osmo-hlr_10.42.42.2(pid=726): stderr: | 20221212171927610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171927610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171927610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171927610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171927610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171927610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171927622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171927631 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171927631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171927631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:30.739421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=719): Terminating (SIGTERM) 17:19:30.778879 run iperf3-srv_10.42.42.10(pid=720): Terminating (SIGTERM) 17:19:30.823361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=721): Terminating (SIGTERM) 17:19:30.871720 run iperf3-srv_10.42.42.10(pid=722): Terminating (SIGTERM) 17:19:30.917252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=725): Terminating (SIGTERM) 17:19:30.960498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=728): Terminating (SIGTERM) 17:19:31.007123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=731): Terminating (SIGTERM) 17:19:31.051732 --- ParallelTerminationStrategy: PID 719 died... 17:19:31.072097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=719): Terminated: ok {rc=0} 17:19:31.120356 --- ParallelTerminationStrategy: PID 720 died... 17:19:31.140422 run iperf3-srv_10.42.42.10(pid=720): Terminated {rc=256} 17:19:31.188388 --- ParallelTerminationStrategy: PID 721 died... 17:19:31.208661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=721): Terminated: ok {rc=0} 17:19:31.256001 --- ParallelTerminationStrategy: PID 722 died... 17:19:31.277037 run iperf3-srv_10.42.42.10(pid=722): Terminated {rc=256} 17:19:31.323461 --- ParallelTerminationStrategy: PID 725 died... 17:19:31.344016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=725): Terminated: ok {rc=0} 17:19:31.391912 --- ParallelTerminationStrategy: PID 728 died... 17:19:31.412162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=728): Terminated: ok {rc=0} 17:19:31.458496 --- ParallelTerminationStrategy: PID 731 died... 17:19:31.478777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=731): Terminated: ok {rc=0} 17:19:31.568229 bus /gobi_0: Setting Powered False 17:19:32.665980 bus /gobi_0: Setting Powered False 17:19:33.779851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 17:19:34.928133 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:34.940809 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:19:34.992031 tst iperf3.py: using LAC 30351 17:19:35.112691 tst iperf3.py: using RAC 6 17:19:35.239995 tst iperf3.py: using CellId 30351 17:19:35.367709 tst iperf3.py: using BVCI 30352 17:19:35.483886 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:35.495976 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:35.507606 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:35.519256 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:35.530961 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:35.542760 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:35.554546 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:35.566143 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:35.578123 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:19:35.696650 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:19:35.897951 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:36.198782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=733): Launched 17:19:36.459873 run iperf3-srv_10.42.42.10(pid=734): Launched 17:19:36.572444 tst iperf3.py:8: start network... 17:19:36.771411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:37.236676 run create_hlr_db(pid=735): Launched 17:19:37.353524 bus /gobi_6: Setting Powered False 17:19:38.412759 run create_hlr_db(pid=735): Terminated: ok {rc=0} 17:19:38.835267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=737): Launched 17:19:39.135208 run osmo-hlr_10.42.42.2(pid=738): Launched 17:19:39.249496 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:39.782201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=740): Launched 17:19:40.083176 run osmo-stp_10.42.42.5(pid=741): Launched 17:19:40.198332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:40.717126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=743): Launched 17:19:40.831956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:41.086280 run patchelf(pid=744): Launched 17:19:41.253095 run osmo-stp_10.42.42.5(pid=741): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=741)] 17:19:41.381382 run osmo-stp_10.42.42.5(pid=741): stdout: | (launched: 2022-12-12_17:19:40.027013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:41.510557 run osmo-stp_10.42.42.5(pid=741): stderr: | 20221212171940194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171940194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171940194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171940195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171940195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171940195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171940195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:41.639920 run osmo-stp_10.42.42.5(pid=741): stdout: | (launched: 2022-12-12_17:19:40.027013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:41.763389 run osmo-stp_10.42.42.5(pid=741): stderr: | 20221212171940194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171940194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171940194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171940195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171940195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171940195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171940195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:41.910158 run patchelf(pid=744): Terminating (SIGINT) 17:19:42.078277 run patchelf(pid=744): Terminated: ok {rc=0} 17:19:42.199634 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=741): Process ended prematurely: osmo-stp_10.42.42.5(pid=741) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=741)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 17:19:42.209450 tst iperf3.py:8: Test FAILED (7.3 sec) 17:19:42.236884 run osmo-hlr_10.42.42.2(pid=738): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=738)] 17:19:42.284138 run osmo-hlr_10.42.42.2(pid=738): stdout: | (launched: 2022-12-12_17:19:39.079122) 17:19:42.333389 run osmo-hlr_10.42.42.2(pid=738): stderr: | 20221212171939252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171939252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171939252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171939252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171939252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171939253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171939269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171939279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171939279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171939279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:42.383327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=733): Terminating (SIGTERM) 17:19:42.422360 run iperf3-srv_10.42.42.10(pid=734): Terminating (SIGTERM) 17:19:42.462107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=737): Terminating (SIGTERM) 17:19:42.501652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=740): Terminating (SIGTERM) 17:19:42.541057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=743): Terminating (SIGTERM) 17:19:42.580544 --- ParallelTerminationStrategy: PID 733 died... 17:19:42.599410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=733): Terminated: ok {rc=0} 17:19:42.642726 --- ParallelTerminationStrategy: PID 734 died... 17:19:42.661409 run iperf3-srv_10.42.42.10(pid=734): Terminated {rc=256} 17:19:42.704785 --- ParallelTerminationStrategy: PID 737 died... 17:19:42.722890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=737): Terminated: ok {rc=0} 17:19:42.766515 --- ParallelTerminationStrategy: PID 740 died... 17:19:42.784791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=740): Terminated: ok {rc=0} 17:19:42.828397 --- ParallelTerminationStrategy: PID 743 died... 17:19:42.846792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=743): Terminated: ok {rc=0} 17:19:42.932089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 17:19:44.078503 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:44.090724 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:19:44.144059 tst iperf3m4.py: using LAC 30352 17:19:44.261359 tst iperf3m4.py: using RAC 7 17:19:44.379005 tst iperf3m4.py: using CellId 30352 17:19:44.501262 tst iperf3m4.py: using BVCI 30353 17:19:44.611745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:44.623133 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:44.634470 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:44.646227 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:44.657951 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:44.669556 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:44.681316 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:44.692771 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:19:44.704763 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:19:44.824317 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:19:44.949449 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:19:45.066377 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:19:45.182240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:19:45.386274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:45.691066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=745): Launched 17:19:46.006207 run iperf3-srv_10.42.42.10(pid=746): Launched 17:19:46.145342 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:19:46.369177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:46.705095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=747): Launched 17:19:47.003336 run iperf3-srv_10.42.42.10(pid=748): Launched 17:19:47.140711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:19:47.357201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:47.680811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=749): Launched 17:19:47.961660 run iperf3-srv_10.42.42.10(pid=750): Launched 17:19:48.082339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:19:48.298706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:48.622222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=751): Launched 17:19:48.903400 run iperf3-srv_10.42.42.10(pid=752): Launched 17:19:49.024493 tst iperf3m4.py:8: start network... 17:19:49.240580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:49.741687 run create_hlr_db(pid=753): Launched 17:19:49.871358 bus /gobi_6: Setting Powered False 17:19:50.934748 run create_hlr_db(pid=753): Terminated: ok {rc=0} 17:19:51.382664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=755): Launched 17:19:51.704390 run osmo-hlr_10.42.42.2(pid=756): Launched 17:19:51.826455 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:52.379867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=758): Launched 17:19:52.702425 run osmo-stp_10.42.42.5(pid=759): Launched 17:19:52.824159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:53.379558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=761): Launched 17:19:53.496228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:53.752200 run patchelf(pid=762): Launched 17:19:53.919969 run osmo-stp_10.42.42.5(pid=759): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=759)] 17:19:54.047505 run osmo-stp_10.42.42.5(pid=759): stdout: | (launched: 2022-12-12_17:19:52.642678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:54.177144 run osmo-stp_10.42.42.5(pid=759): stderr: | 20221212171952833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171952833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171952833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171952834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171952834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171952834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171952834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:54.306247 run osmo-stp_10.42.42.5(pid=759): stdout: | (launched: 2022-12-12_17:19:52.642678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:54.430449 run osmo-stp_10.42.42.5(pid=759): stderr: | 20221212171952833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212171952833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212171952833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212171952834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212171952834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212171952834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212171952834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:54.576836 run patchelf(pid=762): Terminating (SIGINT) 17:19:54.745272 run patchelf(pid=762): Terminated: ok {rc=0} 17:19:54.866861 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=759): Process ended prematurely: osmo-stp_10.42.42.5(pid=759) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=759)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 17:19:54.876386 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:19:54.904149 run osmo-hlr_10.42.42.2(pid=756): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=756)] 17:19:54.952282 run osmo-hlr_10.42.42.2(pid=756): stdout: | (launched: 2022-12-12_17:19:51.644477) 17:19:55.001473 run osmo-hlr_10.42.42.2(pid=756): stderr: | 20221212171951841 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212171951841 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212171951841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212171951841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212171951841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212171951841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212171951854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212171951862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212171951862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212171951862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:55.050901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=745): Terminating (SIGTERM) 17:19:55.090530 run iperf3-srv_10.42.42.10(pid=746): Terminating (SIGTERM) 17:19:55.130220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=747): Terminating (SIGTERM) 17:19:55.169870 run iperf3-srv_10.42.42.10(pid=748): Terminating (SIGTERM) 17:19:55.209420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=749): Terminating (SIGTERM) 17:19:55.249660 run iperf3-srv_10.42.42.10(pid=750): Terminating (SIGTERM) 17:19:55.289049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=751): Terminating (SIGTERM) 17:19:55.328530 run iperf3-srv_10.42.42.10(pid=752): Terminating (SIGTERM) 17:19:55.367879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=755): Terminating (SIGTERM) 17:19:55.407493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=758): Terminating (SIGTERM) 17:19:55.447110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=761): Terminating (SIGTERM) 17:19:55.486824 --- ParallelTerminationStrategy: PID 745 died... 17:19:55.505711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=745): Terminated: ok {rc=0} 17:19:55.549746 --- ParallelTerminationStrategy: PID 746 died... 17:19:55.568055 run iperf3-srv_10.42.42.10(pid=746): Terminated {rc=256} 17:19:55.612062 --- ParallelTerminationStrategy: PID 747 died... 17:19:55.630644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=747): Terminated: ok {rc=0} 17:19:55.674398 --- ParallelTerminationStrategy: PID 748 died... 17:19:55.693200 run iperf3-srv_10.42.42.10(pid=748): Terminated {rc=256} 17:19:55.737136 --- ParallelTerminationStrategy: PID 749 died... 17:19:55.755436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=749): Terminated: ok {rc=0} 17:19:55.799223 --- ParallelTerminationStrategy: PID 750 died... 17:19:55.817707 run iperf3-srv_10.42.42.10(pid=750): Terminated {rc=256} 17:19:55.861931 --- ParallelTerminationStrategy: PID 751 died... 17:19:55.880182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=751): Terminated: ok {rc=0} 17:19:55.923644 --- ParallelTerminationStrategy: PID 752 died... 17:19:55.942029 run iperf3-srv_10.42.42.10(pid=752): Terminated {rc=256} 17:19:55.985344 --- ParallelTerminationStrategy: PID 755 died... 17:19:56.003730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=755): Terminated: ok {rc=0} 17:19:56.047211 --- ParallelTerminationStrategy: PID 758 died... 17:19:56.065715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=758): Terminated: ok {rc=0} 17:19:56.109278 --- ParallelTerminationStrategy: PID 761 died... 17:19:56.127647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=761): Terminated: ok {rc=0} 17:19:56.212160 bus /gobi_4: Setting Powered False 17:19:57.310153 bus /gobi_4: Setting Powered False 17:19:58.425850 bus /gobi_1: Setting Powered False 17:19:59.522504 bus /gobi_1: Setting Powered False 17:20:00.634653 bus /gobi_0: Setting Powered False 17:20:01.738184 bus /gobi_0: Setting Powered False 17:20:02.869092 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 17:20:03.967634 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:03.980625 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:20:04.030771 tst ping.py: using LAC 30353 17:20:04.148495 tst ping.py: using RAC 8 17:20:04.264732 tst ping.py: using CellId 30353 17:20:04.379805 tst ping.py: using BVCI 30354 17:20:04.486619 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:04.498183 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:04.509492 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:04.520873 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:04.532320 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:04.543967 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:04.555521 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:04.566871 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:20:04.682784 tst ping.py:19: start network... 17:20:04.879697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:05.337438 run create_hlr_db(pid=766): Launched 17:20:05.450804 bus /gobi_6: Setting Powered False 17:20:06.510388 run create_hlr_db(pid=766): Terminated: ok {rc=0} 17:20:06.943534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=768): Launched 17:20:07.261036 run osmo-hlr_10.42.42.2(pid=769): Launched 17:20:07.381674 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:07.927281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=771): Launched 17:20:08.244560 run osmo-stp_10.42.42.5(pid=772): Launched 17:20:08.364694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:20:08.909582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=774): Launched 17:20:09.030708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:20:09.297521 run patchelf(pid=775): Launched 17:20:09.473278 run osmo-stp_10.42.42.5(pid=772): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=772)] 17:20:09.607495 run osmo-stp_10.42.42.5(pid=772): stdout: | (launched: 2022-12-12_17:20:08.185615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:09.742592 run osmo-stp_10.42.42.5(pid=772): stderr: | 20221212172008373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172008373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172008373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172008374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172008375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172008375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172008375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:09.877622 run osmo-stp_10.42.42.5(pid=772): stdout: | (launched: 2022-12-12_17:20:08.185615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:10.007487 run osmo-stp_10.42.42.5(pid=772): stderr: | 20221212172008373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172008373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172008373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172008374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172008375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172008375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172008375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:10.160512 run patchelf(pid=775): Terminating (SIGINT) 17:20:10.337073 run patchelf(pid=775): Terminated: ok {rc=0} 17:20:10.464295 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=772): Process ended prematurely: osmo-stp_10.42.42.5(pid=772) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=772)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 17:20:10.474140 tst ping.py:22: Test FAILED (6.5 sec) 17:20:10.502080 run osmo-hlr_10.42.42.2(pid=769): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=769)] 17:20:10.551671 run osmo-hlr_10.42.42.2(pid=769): stdout: | (launched: 2022-12-12_17:20:07.202204) 17:20:10.603031 run osmo-hlr_10.42.42.2(pid=769): stderr: | 20221212172007397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172007397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172007397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172007397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172007397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172007397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172007409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172007417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172007418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172007418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:10.654894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=768): Terminating (SIGTERM) 17:20:10.696640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=771): Terminating (SIGTERM) 17:20:10.738579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=774): Terminating (SIGTERM) 17:20:10.780734 --- ParallelTerminationStrategy: PID 768 died... 17:20:10.800775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=768): Terminated: ok {rc=0} 17:20:10.846892 --- ParallelTerminationStrategy: PID 771 died... 17:20:10.866424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=771): Terminated: ok {rc=0} 17:20:10.912064 --- ParallelTerminationStrategy: PID 774 died... 17:20:10.931893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=774): Terminated: ok {rc=0} 17:20:11.019025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 17:20:12.106153 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:12.118879 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:20:12.171375 tst ping_idle_ping.py: using LAC 30354 17:20:12.297717 tst ping_idle_ping.py: using RAC 9 17:20:12.422670 tst ping_idle_ping.py: using CellId 30354 17:20:12.545244 tst ping_idle_ping.py: using BVCI 30355 17:20:12.655800 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:12.667628 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:12.679136 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:12.691470 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:12.703546 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:12.715538 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:12.727690 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:20:12.739743 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:20:12.859781 tst ping_idle_ping.py:24: start network... 17:20:13.074421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:13.570426 run create_hlr_db(pid=776): Launched 17:20:13.701074 bus /gobi_6: Setting Powered False 17:20:14.763998 run create_hlr_db(pid=776): Terminated: ok {rc=0} 17:20:15.191184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=778): Launched 17:20:15.490968 run osmo-hlr_10.42.42.2(pid=779): Launched 17:20:15.606076 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:16.186057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=781): Launched 17:20:16.522115 run osmo-stp_10.42.42.5(pid=782): Launched 17:20:16.808574 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:20:17.363523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=784): Launched 17:20:17.485410 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:20:17.754911 run patchelf(pid=785): Launched 17:20:17.932002 run osmo-stp_10.42.42.5(pid=782): ERR: Terminated: ERROR {rc=1} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=782)] 17:20:18.066618 run osmo-stp_10.42.42.5(pid=782): stdout: | (launched: 2022-12-12_17:20:16.461591) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:18.202932 run osmo-stp_10.42.42.5(pid=782): stderr: | 20221212172016658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172016658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172016658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172016659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172016659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172016659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172016659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:18.339226 run osmo-stp_10.42.42.5(pid=782): stdout: | (launched: 2022-12-12_17:20:16.461591) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:18.469219 run osmo-stp_10.42.42.5(pid=782): stderr: | 20221212172016658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172016658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172016658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172016659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172016659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172016659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172016659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:18.623340 run patchelf(pid=785): Terminating (SIGINT) 17:20:18.800426 run patchelf(pid=785): Terminated: ok {rc=0} 17:20:18.928119 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=782): Process ended prematurely: osmo-stp_10.42.42.5(pid=782) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=782)] [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 17:20:18.938383 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 17:20:18.966641 run osmo-hlr_10.42.42.2(pid=779): ERR: Terminated: ERROR {rc=237} [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=779)] 17:20:19.016389 run osmo-hlr_10.42.42.2(pid=779): stdout: | (launched: 2022-12-12_17:20:15.434945) 17:20:19.067820 run osmo-hlr_10.42.42.2(pid=779): stderr: | 20221212172015609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172015609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172015609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172015609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172015610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172015610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172015622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172015633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172015633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172015633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:19.119717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=778): Terminating (SIGTERM) 17:20:19.161445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=781): Terminating (SIGTERM) 17:20:19.203317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=784): Terminating (SIGTERM) 17:20:19.245492 --- ParallelTerminationStrategy: PID 778 died... 17:20:19.265484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=778): Terminated: ok {rc=0} 17:20:19.312750 --- ParallelTerminationStrategy: PID 781 died... 17:20:19.332097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=781): Terminated: ok {rc=0} 17:20:19.377772 --- ParallelTerminationStrategy: PID 784 died... 17:20:19.397135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=784): Terminated: ok {rc=0} 17:20:19.484701 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 17:20:20.800926 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:20.808670 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:20:20.841527 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:20:20.875958 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:20:20.928832 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:20:20.961338 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:20:20.995484 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:20:21.554690 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2379 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:20:21.560184 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:21.571842 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:20:21.639876 tst switch_tch_pdch.py: using LAC 30355 17:20:21.765367 tst switch_tch_pdch.py: using RAC 10 17:20:21.889044 tst switch_tch_pdch.py: using CellId 30355 17:20:22.013803 tst switch_tch_pdch.py: using BVCI 30356 17:20:22.129492 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:22.141502 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:22.153466 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:22.165309 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:22.177163 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:22.188806 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:22.200747 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:22.212670 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:20:22.327088 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:20:22.446086 tst switch_tch_pdch.py:51: start network... 17:20:22.657967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:23.147956 run create_hlr_db(pid=790): Launched 17:20:23.276739 bus /gobi_6: Setting Powered False 17:20:24.339700 run create_hlr_db(pid=790): Terminated: ok {rc=0} 17:20:24.762298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=792): Launched 17:20:25.059069 run osmo-hlr_10.42.42.2(pid=793): Launched 17:20:25.171698 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:25.694578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=795): Launched 17:20:25.992717 run osmo-stp_10.42.42.5(pid=796): Launched 17:20:26.106344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:20:26.619235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=798): Launched 17:20:26.733482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:20:26.985118 run patchelf(pid=799): Launched 17:20:27.150975 run osmo-stp_10.42.42.5(pid=796): ERR: Terminated: ERROR {rc=1} [trial-2379↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=796)] 17:20:27.276603 run osmo-stp_10.42.42.5(pid=796): stdout: | (launched: 2022-12-12_17:20:25.937135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:27.404091 run osmo-stp_10.42.42.5(pid=796): stderr: | 20221212172026102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172026103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172026103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172026103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172026104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172026104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172026104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:27.531825 run osmo-stp_10.42.42.5(pid=796): stdout: | (launched: 2022-12-12_17:20:25.937135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:27.654004 run osmo-stp_10.42.42.5(pid=796): stderr: | 20221212172026102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172026103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172026103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172026103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172026104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172026104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172026104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:27.798883 run patchelf(pid=799): Terminating (SIGINT) 17:20:27.964866 run patchelf(pid=799): Terminated: ok {rc=0} 17:20:28.084559 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=796): Process ended prematurely: osmo-stp_10.42.42.5(pid=796) [trial-2379↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=796)] [trial-2379↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:20:28.093743 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:20:28.120046 run osmo-hlr_10.42.42.2(pid=793): ERR: Terminated: ERROR {rc=237} [trial-2379↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=793)] 17:20:28.168351 run osmo-hlr_10.42.42.2(pid=793): stdout: | (launched: 2022-12-12_17:20:25.003797) 17:20:28.217676 run osmo-hlr_10.42.42.2(pid=793): stderr: | 20221212172025177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172025177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172025177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172025177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172025177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172025177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172025189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172025198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172025198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172025198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:28.267559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=792): Terminating (SIGTERM) 17:20:28.307076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=795): Terminating (SIGTERM) 17:20:28.347312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=798): Terminating (SIGTERM) 17:20:28.387205 --- ParallelTerminationStrategy: PID 792 died... 17:20:28.406044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=792): Terminated: ok {rc=0} 17:20:28.450579 --- ParallelTerminationStrategy: PID 795 died... 17:20:28.469498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=795): Terminated: ok {rc=0} 17:20:28.513314 --- ParallelTerminationStrategy: PID 798 died... 17:20:28.531543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=798): Terminated: ok {rc=0} 17:20:28.618193 bus /gobi_0: Setting Powered False 17:20:29.716717 bus /gobi_0: Setting Powered False 17:20:30.850783 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2379 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 nitb_smpp --------------------------------------------------------------------- 17:20:32.120796 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:32.123525 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 17:20:32.148776 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 17:20:32.157865 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 17:20:32.195868 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 17:20:32.217792 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 17:20:32.226467 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 17:20:32.742728 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2379 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 17:20:32.748851 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 17:20:32.768168 tst esme_connect_policy_acceptall.py: using MSISDN 7878 17:20:32.906294 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:33.471828 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=804): Launched 17:20:33.776848 run osmo-nitb_10.42.42.2(pid=805): Launched 17:20:33.945246 run osmo-nitb_10.42.42.2(pid=805): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=805)] 17:20:34.080560 run osmo-nitb_10.42.42.2(pid=805): stdout: | (launched: 2022-12-12_17:20:33.720454) 17:20:34.217090 run osmo-nitb_10.42.42.2(pid=805): stderr: | (launched: 2022-12-12_17:20:33.765774) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:34.353563 run osmo-nitb_10.42.42.2(pid=805): stdout: | (launched: 2022-12-12_17:20:33.720454) 17:20:34.484628 run osmo-nitb_10.42.42.2(pid=805): stderr: | (launched: 2022-12-12_17:20:33.765774) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=805): Process ended prematurely: osmo-nitb_10.42.42.2(pid=805) [trial-2379↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=805)] 17:20:34.891629 tst osmo-nitb_10.42.42.2(pid=805): stdout: | (launched: 2022-12-12_17:20:33.720454) 17:20:35.013828 tst osmo-nitb_10.42.42.2(pid=805): stderr: | (launched: 2022-12-12_17:20:33.765774) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:35.157736 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=805): Process ended prematurely: osmo-nitb_10.42.42.2(pid=805) [trial-2379↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=805)] [trial-2379↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 17:20:35.166132 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 17:20:35.172668 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=804): Terminating (SIGTERM) 17:20:35.381753 --- ParallelTerminationStrategy: PID 804 died... 17:20:35.402518 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=804): Terminated: ok {rc=0} ---------------------------------------------- trial-2379 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 17:20:35.451044 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 17:20:35.472713 tst esme_connect_policy_closed.py: using MSISDN 7879 17:20:35.595210 tst esme_connect_policy_closed.py: using MSISDN 7880 17:20:35.703945 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:36.269389 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=806): Launched 17:20:36.574540 run osmo-nitb_10.42.42.2(pid=807): Launched 17:20:36.738545 run osmo-nitb_10.42.42.2(pid=807): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=807)] 17:20:36.863030 run osmo-nitb_10.42.42.2(pid=807): stdout: | (launched: 2022-12-12_17:20:36.518046) 17:20:36.988865 run osmo-nitb_10.42.42.2(pid=807): stderr: | (launched: 2022-12-12_17:20:36.563231) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:37.114828 run osmo-nitb_10.42.42.2(pid=807): stdout: | (launched: 2022-12-12_17:20:36.518046) 17:20:37.235190 run osmo-nitb_10.42.42.2(pid=807): stderr: | (launched: 2022-12-12_17:20:36.563231) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:37.379343 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=807): Process ended prematurely: osmo-nitb_10.42.42.2(pid=807) [trial-2379↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=807)] [trial-2379↪nitb_smpp↪esme_connect_policy_closed.py:24] 17:20:37.387799 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 17:20:37.394333 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=806): Terminating (SIGTERM) 17:20:37.602848 --- ParallelTerminationStrategy: PID 806 died... 17:20:37.623122 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=806): Terminated: ok {rc=0} ---------------------------------------------- trial-2379 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 17:20:37.671215 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 17:20:37.682348 tst nitb_smpp: Using 1 x bts (candidates: 1) 17:20:37.718261 tst esme_ms_sms_storeforward.py: using LAC 30356 17:20:37.840884 tst esme_ms_sms_storeforward.py: using RAC 11 17:20:37.959360 tst esme_ms_sms_storeforward.py: using CellId 30356 17:20:38.080192 tst esme_ms_sms_storeforward.py: using BVCI 30357 17:20:38.190439 tst nitb_smpp: Using 1 x modem (candidates: 1) 17:20:38.320078 tst esme_ms_sms_storeforward.py: using MSISDN 7881 17:20:38.439366 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 17:20:38.658351 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:39.323111 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=808): Launched 17:20:39.649388 run osmo-nitb_10.42.42.2(pid=809): Launched 17:20:39.825860 run osmo-nitb_10.42.42.2(pid=809): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=809)] 17:20:39.960348 run osmo-nitb_10.42.42.2(pid=809): stdout: | (launched: 2022-12-12_17:20:39.589580) 17:20:40.095582 run osmo-nitb_10.42.42.2(pid=809): stderr: | (launched: 2022-12-12_17:20:39.637939) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:40.230916 run osmo-nitb_10.42.42.2(pid=809): stdout: | (launched: 2022-12-12_17:20:39.589580) 17:20:40.360031 run osmo-nitb_10.42.42.2(pid=809): stderr: | (launched: 2022-12-12_17:20:39.637939) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:40.514484 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=809): Process ended prematurely: osmo-nitb_10.42.42.2(pid=809) [trial-2379↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=809)] [trial-2379↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 17:20:40.523447 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 17:20:40.530429 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=808): Terminating (SIGTERM) 17:20:40.740085 --- ParallelTerminationStrategy: PID 808 died... 17:20:40.761167 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=808): Terminated: ok {rc=0} 17:20:40.847377 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 17:20:41.934098 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 17:20:41.946376 tst nitb_smpp: Using 1 x bts (candidates: 1) 17:20:41.982763 tst esme_ms_sms_transaction.py: using LAC 30357 17:20:42.111437 tst esme_ms_sms_transaction.py: using RAC 12 17:20:42.240157 tst esme_ms_sms_transaction.py: using CellId 30357 17:20:42.367196 tst esme_ms_sms_transaction.py: using BVCI 30358 17:20:42.485016 tst nitb_smpp: Using 1 x modem (candidates: 1) 17:20:42.613784 tst esme_ms_sms_transaction.py: using MSISDN 7882 17:20:42.732445 tst esme_ms_sms_transaction.py:18: start nitb and bts... 17:20:42.952158 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:43.613111 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=810): Launched 17:20:43.938541 run osmo-nitb_10.42.42.2(pid=811): Launched 17:20:44.121104 run osmo-nitb_10.42.42.2(pid=811): ERR: Terminated: ERROR {rc=2} [trial-2379↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=811)] 17:20:44.265586 run osmo-nitb_10.42.42.2(pid=811): stdout: | (launched: 2022-12-12_17:20:43.878660) 17:20:44.411104 run osmo-nitb_10.42.42.2(pid=811): stderr: | (launched: 2022-12-12_17:20:43.926954) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:44.557468 run osmo-nitb_10.42.42.2(pid=811): stdout: | (launched: 2022-12-12_17:20:43.878660) 17:20:44.698014 run osmo-nitb_10.42.42.2(pid=811): stderr: | (launched: 2022-12-12_17:20:43.926954) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=811): Process ended prematurely: osmo-nitb_10.42.42.2(pid=811) [trial-2379↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=811)] 17:20:45.063826 tst osmo-nitb_10.42.42.2(pid=811): stdout: | (launched: 2022-12-12_17:20:43.878660) 17:20:45.194807 tst osmo-nitb_10.42.42.2(pid=811): stderr: | (launched: 2022-12-12_17:20:43.926954) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:45.349246 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=811): Process ended prematurely: osmo-nitb_10.42.42.2(pid=811) [trial-2379↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=811)] [trial-2379↪nitb_smpp↪esme_ms_sms_transaction.py:21] 17:20:45.358491 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 17:20:45.365602 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=810): Terminating (SIGTERM) 17:20:45.575823 --- ParallelTerminationStrategy: PID 810 died... 17:20:45.597240 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=810): Terminated: ok {rc=0} 17:20:45.686171 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 smpp --------------------------------------------------------------------- 17:20:46.854944 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:46.860289 tst smpp: Verifying 1 x bts (candidates: 11) 17:20:46.888696 tst smpp: Verifying 6 x ip_address (candidates: 9) 17:20:46.926095 tst smpp: Verifying 1 x modem (candidates: 12) 17:20:46.968920 tst smpp: Reserving 1 x bts (candidates: 11) 17:20:46.998065 tst smpp: Reserving 6 x ip_address (candidates: 9) 17:20:47.033580 tst smpp: Reserving 1 x modem (candidates: 12) 17:20:47.546044 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 17:20:47.551286 tst smpp: Using 1 x ip_address (candidates: 6) 17:20:47.562162 tst smpp: Using 1 x ip_address (candidates: 6) 17:20:47.572715 tst smpp: Using 1 x ip_address (candidates: 6) 17:20:47.583475 tst smpp: Using 1 x ip_address (candidates: 6) 17:20:47.602536 tst esme_connect_policy_acceptall.py: using MSISDN 7883 17:20:47.721553 run osmo-stp_10.42.42.4: Starting osmo-stp 17:20:48.278629 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=815): Launched 17:20:48.605468 run osmo-stp_10.42.42.4(pid=816): Launched 17:20:48.729843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:49.235916 run create_hlr_db(pid=817): Launched 17:20:49.362233 bus /sierra_2: Setting Powered False 17:20:50.423232 run create_hlr_db(pid=817): Terminated: ok {rc=0} 17:20:50.875280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=820): Launched 17:20:51.209127 run osmo-hlr_10.42.42.2(pid=821): Launched 17:20:51.335579 run osmo-msc_10.42.42.5: Starting osmo-msc 17:20:51.936646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=824): Launched 17:20:52.269713 run osmo-msc_10.42.42.5(pid=825): Launched 17:20:52.454759 run osmo-hlr_10.42.42.2(pid=821): ERR: Terminated: ERROR {rc=237} [trial-2379↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=821)] 17:20:52.595997 run osmo-hlr_10.42.42.2(pid=821): stdout: | (launched: 2022-12-12_17:20:51.147939) 17:20:52.735719 run osmo-hlr_10.42.42.2(pid=821): stderr: | 20221212172051344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172051344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172051344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172051344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172051344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172051344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172051357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172051366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172051366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172051366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:52.875122 run osmo-hlr_10.42.42.2(pid=821): stdout: | (launched: 2022-12-12_17:20:51.147939) 17:20:53.007487 run osmo-hlr_10.42.42.2(pid=821): stderr: | 20221212172051344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172051344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172051344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172051344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172051344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172051344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172051357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172051366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172051366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172051366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:53.165228 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=821): Process ended prematurely: osmo-hlr_10.42.42.2(pid=821) [trial-2379↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=821)] [trial-2379↪smpp↪esme_connect_policy_acceptall.py:23] 17:20:53.174204 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 17:20:53.201836 run osmo-msc_10.42.42.5(pid=825): ERR: Terminated: ERROR {rc=9} [trial-2379↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=825)] 17:20:53.252063 run osmo-msc_10.42.42.5(pid=825): stdout: | (launched: 2022-12-12_17:20:52.208629) 17:20:53.304226 run osmo-msc_10.42.42.5(pid=825): stderr: | 20221212172052574 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221212172052574 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221212172052574 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172052574 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221212172052574 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221212172052575 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221212172052576 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221212172052576 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212172052576 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 17:20:53.356923 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=815): Terminating (SIGTERM) 17:20:53.398794 run osmo-stp_10.42.42.4(pid=816): Terminating (SIGTERM) 17:20:53.440590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=820): Terminating (SIGTERM) 17:20:53.484037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=824): Terminating (SIGTERM) 17:20:53.529066 --- ParallelTerminationStrategy: PID 815 died... 17:20:53.549705 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=815): Terminated: ok {rc=0} 17:20:53.597918 --- ParallelTerminationStrategy: PID 816 died... 17:20:53.617330 run osmo-stp_10.42.42.4(pid=816): Terminated: ok {rc=0} 17:20:53.663260 --- ParallelTerminationStrategy: PID 820 died... 17:20:53.682775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=820): Terminated: ok {rc=0} 17:20:53.728649 --- ParallelTerminationStrategy: PID 824 died... 17:20:53.748045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=824): Terminated: ok {rc=0} ---------------------------------------------- trial-2379 smpp esme_connect_policy_closed.py ---------------------------------------------- 17:20:53.798745 tst smpp: Using 1 x ip_address (candidates: 6) 17:20:53.810395 tst smpp: Using 1 x bts (candidates: 1) 17:20:53.846102 tst esme_connect_policy_closed.py: using LAC 30358 17:20:53.977516 tst esme_connect_policy_closed.py: using RAC 13 17:20:54.108085 tst esme_connect_policy_closed.py: using CellId 30358 17:20:54.239786 tst esme_connect_policy_closed.py: using BVCI 30359 17:20:54.360402 tst smpp: Using 1 x ip_address (candidates: 6) 17:20:54.371534 tst smpp: Using 1 x ip_address (candidates: 6) 17:20:54.382426 tst smpp: Using 1 x ip_address (candidates: 6) 17:20:54.403781 tst esme_connect_policy_closed.py: using MSISDN 7884 17:20:54.526710 tst esme_connect_policy_closed.py: using MSISDN 7885 17:20:54.640342 run osmo-stp_10.42.42.4: Starting osmo-stp 17:20:55.167538 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=828): Launched 17:20:55.478024 run osmo-stp_10.42.42.4(pid=831): Launched 17:20:55.596817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:56.078005 run create_hlr_db(pid=833): Launched 17:20:57.252090 run create_hlr_db(pid=833): Terminated: ok {rc=0} 17:20:57.581069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=835): Launched 17:20:57.892296 run osmo-hlr_10.42.42.2(pid=836): Launched 17:20:58.011577 run osmo-msc_10.42.42.5: Starting osmo-msc 17:20:58.584767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=838): Launched 17:20:58.895933 run osmo-msc_10.42.42.5(pid=839): Launched 17:20:59.072035 run osmo-hlr_10.42.42.2(pid=836): ERR: Terminated: ERROR {rc=237} [trial-2379↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=836)] 17:20:59.208491 run osmo-hlr_10.42.42.2(pid=836): stdout: | (launched: 2022-12-12_17:20:57.834956) 17:20:59.350735 run osmo-hlr_10.42.42.2(pid=836): stderr: | 20221212172058012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172058012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172058012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172058012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172058012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172058012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172058024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172058032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172058033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172058033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:59.489862 run osmo-hlr_10.42.42.2(pid=836): stdout: | (launched: 2022-12-12_17:20:57.834956) 17:20:59.621781 run osmo-hlr_10.42.42.2(pid=836): stderr: | 20221212172058012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172058012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172058012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172058012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172058012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172058012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172058024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172058032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172058033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172058033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:59.779492 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=836): Process ended prematurely: osmo-hlr_10.42.42.2(pid=836) [trial-2379↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=836)] [trial-2379↪smpp↪esme_connect_policy_closed.py:31] 17:20:59.788610 tst esme_connect_policy_closed.py:31: Test FAILED (6.0 sec) 17:20:59.816392 run osmo-msc_10.42.42.5(pid=839): ERR: Terminated: ERROR {rc=9} [trial-2379↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=839)] 17:20:59.866779 run osmo-msc_10.42.42.5(pid=839): stdout: | (launched: 2022-12-12_17:20:58.838484) 17:20:59.918786 run osmo-msc_10.42.42.5(pid=839): stderr: | 20221212172059157 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221212172059157 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221212172059157 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172059157 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221212172059157 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221212172059157 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221212172059157 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221212172059158 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212172059158 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 17:20:59.971455 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=828): Terminating (SIGTERM) 17:21:00.013543 run osmo-stp_10.42.42.4(pid=831): Terminating (SIGTERM) 17:21:00.055294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=835): Terminating (SIGTERM) 17:21:00.099388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=838): Terminating (SIGTERM) 17:21:00.144926 --- ParallelTerminationStrategy: PID 828 died... 17:21:00.165447 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=828): Terminated: ok {rc=0} 17:21:00.214088 --- ParallelTerminationStrategy: PID 831 died... 17:21:00.233577 run osmo-stp_10.42.42.4(pid=831): Terminated: ok {rc=0} 17:21:00.279311 --- ParallelTerminationStrategy: PID 835 died... 17:21:00.298960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=835): Terminated: ok {rc=0} 17:21:00.344884 --- ParallelTerminationStrategy: PID 838 died... 17:21:00.364504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=838): Terminated: ok {rc=0} ---------------------------------------------- trial-2379 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 17:21:00.415398 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:00.426953 tst smpp: Using 1 x bts (candidates: 1) 17:21:00.463787 tst esme_ms_sms_storeforward.py: using LAC 30359 17:21:00.596923 tst esme_ms_sms_storeforward.py: using RAC 14 17:21:00.719748 tst esme_ms_sms_storeforward.py: using CellId 30359 17:21:00.854217 tst esme_ms_sms_storeforward.py: using BVCI 30360 17:21:00.977066 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:00.988707 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:01.000206 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:01.014851 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:01.030218 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:01.046003 tst smpp: Using 1 x modem (candidates: 1) 17:21:01.197489 tst esme_ms_sms_storeforward.py: using MSISDN 7886 17:21:01.322310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:01.851487 run create_hlr_db(pid=842): Launched 17:21:03.089477 run create_hlr_db(pid=842): Terminated: ok {rc=0} 17:21:03.439564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=845): Launched 17:21:03.773366 run osmo-hlr_10.42.42.2(pid=846): Launched 17:21:03.899194 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:04.474795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=848): Launched 17:21:04.809749 run osmo-stp_10.42.42.5(pid=849): Launched 17:21:04.935795 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:05.536838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=851): Launched 17:21:05.871976 run osmo-msc_10.42.42.6(pid=852): Launched 17:21:06.057889 run osmo-stp_10.42.42.5(pid=849): ERR: Terminated: ERROR {rc=1} [trial-2379↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=849)] 17:21:06.197073 run osmo-stp_10.42.42.5(pid=849): stdout: | (launched: 2022-12-12_17:21:04.748037) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:06.336264 run osmo-stp_10.42.42.5(pid=849): stderr: | 20221212172104939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172104939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172104939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172104940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172104940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172104940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172104940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:06.474174 run osmo-stp_10.42.42.5(pid=849): stdout: | (launched: 2022-12-12_17:21:04.748037) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:06.605735 run osmo-stp_10.42.42.5(pid=849): stderr: | 20221212172104939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172104939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172104939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172104940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172104940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172104940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172104940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:06.763091 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=849): Process ended prematurely: osmo-stp_10.42.42.5(pid=849) [trial-2379↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=849)] [trial-2379↪smpp↪esme_ms_sms_storeforward.py:30] 17:21:06.771959 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.3 sec) 17:21:06.799344 run osmo-hlr_10.42.42.2(pid=846): ERR: Terminated: ERROR {rc=237} [trial-2379↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=846)] 17:21:06.849286 run osmo-hlr_10.42.42.2(pid=846): stdout: | (launched: 2022-12-12_17:21:03.712244) 17:21:06.900783 run osmo-hlr_10.42.42.2(pid=846): stderr: | 20221212172103911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172103911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172103911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172103911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172103911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172103911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172103923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172103932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172103932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172103932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:06.972942 run osmo-msc_10.42.42.6(pid=852): ERR: Terminated: ERROR {rc=2} [trial-2379↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=852)] 17:21:07.022974 run osmo-msc_10.42.42.6(pid=852): stdout: | (launched: 2022-12-12_17:21:05.811083) 17:21:07.074632 run osmo-msc_10.42.42.6(pid=852): stderr: | 20221212172106133 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172106133 DLGLOBAL DEBUG validating counter group 0x7f3c97278c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172106133 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172106134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172106134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172106134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172106136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172106136 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172106136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172106136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:07.126750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=845): Terminating (SIGTERM) 17:21:07.168393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=848): Terminating (SIGTERM) 17:21:07.209965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=851): Terminating (SIGTERM) 17:21:07.251499 --- ParallelTerminationStrategy: PID 845 died... 17:21:07.271503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=845): Terminated: ok {rc=0} 17:21:07.317424 --- ParallelTerminationStrategy: PID 848 died... 17:21:07.336610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=848): Terminated: ok {rc=0} 17:21:07.382831 --- ParallelTerminationStrategy: PID 851 died... 17:21:07.402384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=851): Terminated: ok {rc=0} 17:21:07.490542 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 smpp esme_ms_sms_transaction.py ---------------------------------------------- 17:21:08.576295 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:08.588108 tst smpp: Using 1 x bts (candidates: 1) 17:21:08.626606 tst esme_ms_sms_transaction.py: using LAC 30360 17:21:08.750391 tst esme_ms_sms_transaction.py: using RAC 15 17:21:08.872099 tst esme_ms_sms_transaction.py: using CellId 30360 17:21:08.996351 tst esme_ms_sms_transaction.py: using BVCI 30361 17:21:09.109423 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:09.119814 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:09.130296 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:09.141642 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:09.152714 tst smpp: Using 1 x ip_address (candidates: 6) 17:21:09.164089 tst smpp: Using 1 x modem (candidates: 1) 17:21:09.290840 tst esme_ms_sms_transaction.py: using MSISDN 7887 17:21:09.403609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:09.882966 run create_hlr_db(pid=854): Launched 17:21:10.003750 bus /sierra_2: Setting Powered False 17:21:11.065316 run create_hlr_db(pid=854): Terminated: ok {rc=0} 17:21:11.498035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=856): Launched 17:21:11.811364 run osmo-hlr_10.42.42.2(pid=857): Launched 17:21:11.932228 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:12.463437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=859): Launched 17:21:12.774035 run osmo-stp_10.42.42.5(pid=860): Launched 17:21:12.892936 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:13.453116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=862): Launched 17:21:13.765696 run osmo-msc_10.42.42.6(pid=863): Launched 17:21:13.938965 run osmo-stp_10.42.42.5(pid=860): ERR: Terminated: ERROR {rc=1} [trial-2379↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=860)] 17:21:14.069805 run osmo-stp_10.42.42.5(pid=860): stdout: | (launched: 2022-12-12_17:21:12.716797) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:14.200255 run osmo-stp_10.42.42.5(pid=860): stderr: | 20221212172112886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172112886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172112886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172112886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172112887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172112887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172112887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:14.329523 run osmo-stp_10.42.42.5(pid=860): stdout: | (launched: 2022-12-12_17:21:12.716797) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:14.453564 run osmo-stp_10.42.42.5(pid=860): stderr: | 20221212172112886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172112886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172112886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172112886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172112887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172112887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172112887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:14.600784 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=860): Process ended prematurely: osmo-stp_10.42.42.5(pid=860) [trial-2379↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=860)] [trial-2379↪smpp↪esme_ms_sms_transaction.py:28] 17:21:14.609261 tst esme_ms_sms_transaction.py:28: Test FAILED (6.0 sec) 17:21:14.635773 run osmo-hlr_10.42.42.2(pid=857): ERR: Terminated: ERROR {rc=237} [trial-2379↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=857)] 17:21:14.683689 run osmo-hlr_10.42.42.2(pid=857): stdout: | (launched: 2022-12-12_17:21:11.754085) 17:21:14.733113 run osmo-hlr_10.42.42.2(pid=857): stderr: | 20221212172111928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172111928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172111928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172111928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172111928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172111928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172111941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172111949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172111949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172111949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:14.802268 run osmo-msc_10.42.42.6(pid=863): ERR: Terminated: ERROR {rc=2} [trial-2379↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=863)] 17:21:14.850283 run osmo-msc_10.42.42.6(pid=863): stdout: | (launched: 2022-12-12_17:21:13.707646) 17:21:14.899915 run osmo-msc_10.42.42.6(pid=863): stderr: | 20221212172113980 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172113980 DLGLOBAL DEBUG validating counter group 0x7fe5c727dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172113981 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172113981 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172113981 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172113981 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172113983 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172113983 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172113984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172113984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:14.949961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=856): Terminating (SIGTERM) 17:21:14.989859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=859): Terminating (SIGTERM) 17:21:15.029815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=862): Terminating (SIGTERM) 17:21:15.070196 --- ParallelTerminationStrategy: PID 856 died... 17:21:15.089291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=856): Terminated: ok {rc=0} 17:21:15.134635 --- ParallelTerminationStrategy: PID 859 died... 17:21:15.153468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=859): Terminated: ok {rc=0} 17:21:15.197904 --- ParallelTerminationStrategy: PID 862 died... 17:21:15.216431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=862): Terminated: ok {rc=0} 17:21:15.303395 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 encryption --------------------------------------------------------------------- 17:21:16.500771 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:21:16.504609 tst encryption: Verifying 1 x bts (candidates: 11) 17:21:16.526478 tst encryption: Verifying 6 x ip_address (candidates: 9) 17:21:16.556672 tst encryption: Verifying 1 x modem (candidates: 12) 17:21:16.594226 tst encryption: Reserving 1 x bts (candidates: 11) 17:21:16.615482 tst encryption: Reserving 6 x ip_address (candidates: 9) 17:21:16.642972 tst encryption: Reserving 1 x modem (candidates: 12) 17:21:17.173480 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2379 encryption register_a5_0_authopt.py ---------------------------------------------- 17:21:17.234114 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:17.245719 tst encryption: Using 1 x bts (candidates: 1) 17:21:17.282791 tst register_a5_0_authopt.py: using LAC 30361 17:21:17.415789 tst register_a5_0_authopt.py: using RAC 16 17:21:17.547013 tst register_a5_0_authopt.py: using CellId 30361 17:21:17.682973 tst register_a5_0_authopt.py: using BVCI 30362 17:21:17.805811 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:17.816619 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:17.827402 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:17.838244 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:17.849063 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:17.859798 tst encryption: Using 1 x modem (candidates: 1) 17:21:17.975255 tst register_a5_0_authopt.py:8: start network... 17:21:18.187085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:18.674258 run create_hlr_db(pid=868): Launched 17:21:18.797411 bus /sierra_2: Setting Powered False 17:21:19.859328 run create_hlr_db(pid=868): Terminated: ok {rc=0} 17:21:20.318182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=870): Launched 17:21:20.655141 run osmo-hlr_10.42.42.2(pid=871): Launched 17:21:20.785485 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:21.367078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=887): Launched 17:21:21.702043 run osmo-stp_10.42.42.5(pid=888): Launched 17:21:21.831214 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:22.473777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=890): Launched 17:21:22.809841 run osmo-msc_10.42.42.6(pid=891): Launched 17:21:22.997992 run osmo-stp_10.42.42.5(pid=888): ERR: Terminated: ERROR {rc=1} [trial-2379↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=888)] 17:21:23.138964 run osmo-stp_10.42.42.5(pid=888): stdout: | (launched: 2022-12-12_17:21:21.640339) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:23.280235 run osmo-stp_10.42.42.5(pid=888): stderr: | 20221212172121833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172121834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172121834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172121834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172121835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172121835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172121835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:23.419836 run osmo-stp_10.42.42.5(pid=888): stdout: | (launched: 2022-12-12_17:21:21.640339) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:23.552609 run osmo-stp_10.42.42.5(pid=888): stderr: | 20221212172121833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172121834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172121834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172121834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172121835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172121835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172121835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:23.711693 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=888): Process ended prematurely: osmo-stp_10.42.42.5(pid=888) [trial-2379↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=888)] [trial-2379↪encryption↪register_a5_0_authopt.py:8] 17:21:23.721432 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 17:21:23.748932 run osmo-hlr_10.42.42.2(pid=871): ERR: Terminated: ERROR {rc=237} [trial-2379↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=871)] 17:21:23.799106 run osmo-hlr_10.42.42.2(pid=871): stdout: | (launched: 2022-12-12_17:21:20.593640) 17:21:23.850922 run osmo-hlr_10.42.42.2(pid=871): stderr: | 20221212172120793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172120793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172120793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172120793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172120793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172120793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172120805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172120814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172120814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172120814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:23.923211 run osmo-msc_10.42.42.6(pid=891): ERR: Terminated: ERROR {rc=2} [trial-2379↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=891)] 17:21:23.973993 run osmo-msc_10.42.42.6(pid=891): stdout: | (launched: 2022-12-12_17:21:22.748091) 17:21:24.025803 run osmo-msc_10.42.42.6(pid=891): stderr: | 20221212172123070 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172123070 DLGLOBAL DEBUG validating counter group 0x7f64882c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172123071 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172123071 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172123071 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172123071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172123073 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172123073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172123073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172123073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:24.077649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=870): Terminating (SIGTERM) 17:21:24.119771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=887): Terminating (SIGTERM) 17:21:24.162165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=890): Terminating (SIGTERM) 17:21:24.204671 --- ParallelTerminationStrategy: PID 870 died... 17:21:24.224993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=870): Terminated: ok {rc=0} 17:21:24.271709 --- ParallelTerminationStrategy: PID 887 died... 17:21:24.291503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=887): Terminated: ok {rc=0} 17:21:24.337845 --- ParallelTerminationStrategy: PID 890 died... 17:21:24.357575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=890): Terminated: ok {rc=0} 17:21:24.447058 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 encryption register_a5_0_authreq.py ---------------------------------------------- 17:21:25.601814 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:25.613592 tst encryption: Using 1 x bts (candidates: 1) 17:21:25.650664 tst register_a5_0_authreq.py: using LAC 30362 17:21:25.782490 tst register_a5_0_authreq.py: using RAC 17 17:21:25.912865 tst register_a5_0_authreq.py: using CellId 30362 17:21:26.044057 tst register_a5_0_authreq.py: using BVCI 30363 17:21:26.166534 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:26.177580 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:26.188325 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:26.199094 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:26.209963 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:26.220615 tst encryption: Using 1 x modem (candidates: 1) 17:21:26.337186 tst register_a5_0_authreq.py:8: start network... 17:21:26.549212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:27.036062 run create_hlr_db(pid=893): Launched 17:21:27.158006 bus /sierra_2: Setting Powered False 17:21:28.219940 run create_hlr_db(pid=893): Terminated: ok {rc=0} 17:21:28.679153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=895): Launched 17:21:29.018854 run osmo-hlr_10.42.42.2(pid=896): Launched 17:21:29.149176 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:29.727616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=898): Launched 17:21:30.066073 run osmo-stp_10.42.42.5(pid=899): Launched 17:21:30.197037 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:30.809023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=901): Launched 17:21:31.163753 run osmo-msc_10.42.42.6(pid=902): Launched 17:21:31.541513 run osmo-stp_10.42.42.5(pid=899): ERR: Terminated: ERROR {rc=1} [trial-2379↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=899)] 17:21:31.816817 run osmo-stp_10.42.42.5(pid=899): stdout: | (launched: 2022-12-12_17:21:30.004086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:31.988084 run osmo-stp_10.42.42.5(pid=899): stderr: | 20221212172130197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172130197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172130198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172130198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172130199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172130199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172130199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:32.130883 run osmo-stp_10.42.42.5(pid=899): stdout: | (launched: 2022-12-12_17:21:30.004086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:32.265978 run osmo-stp_10.42.42.5(pid=899): stderr: | 20221212172130197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172130197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172130198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172130198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172130199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172130199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172130199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:32.425981 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=899): Process ended prematurely: osmo-stp_10.42.42.5(pid=899) [trial-2379↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=899)] [trial-2379↪encryption↪register_a5_0_authreq.py:8] 17:21:32.435870 tst register_a5_0_authreq.py:8: Test FAILED (6.9 sec) 17:21:32.464483 run osmo-hlr_10.42.42.2(pid=896): ERR: Terminated: ERROR {rc=237} [trial-2379↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=896)] 17:21:32.514844 run osmo-hlr_10.42.42.2(pid=896): stdout: | (launched: 2022-12-12_17:21:28.956605) 17:21:32.566928 run osmo-hlr_10.42.42.2(pid=896): stderr: | 20221212172129154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172129154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172129154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172129154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172129154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172129154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172129166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172129175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172129175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172129176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:32.640078 run osmo-msc_10.42.42.6(pid=902): ERR: Terminated: ERROR {rc=2} [trial-2379↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=902)] 17:21:32.691206 run osmo-msc_10.42.42.6(pid=902): stdout: | (launched: 2022-12-12_17:21:31.101945) 17:21:32.744200 run osmo-msc_10.42.42.6(pid=902): stderr: | 20221212172131596 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172131596 DLGLOBAL DEBUG validating counter group 0x7f66f3b3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172131596 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172131596 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172131597 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172131597 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172131599 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172131599 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172131599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172131599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:32.797385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=895): Terminating (SIGTERM) 17:21:32.840141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=898): Terminating (SIGTERM) 17:21:32.883012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=901): Terminating (SIGTERM) 17:21:32.926135 --- ParallelTerminationStrategy: PID 895 died... 17:21:32.946676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=895): Terminated: ok {rc=0} 17:21:32.994435 --- ParallelTerminationStrategy: PID 898 died... 17:21:33.014696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=898): Terminated: ok {rc=0} 17:21:33.061462 --- ParallelTerminationStrategy: PID 901 died... 17:21:33.081416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=901): Terminated: ok {rc=0} 17:21:33.170755 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 encryption register_a5_1_authreq.py ---------------------------------------------- 17:21:34.325963 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:34.337793 tst encryption: Using 1 x bts (candidates: 1) 17:21:34.373132 tst register_a5_1_authreq.py: using LAC 30363 17:21:34.504045 tst register_a5_1_authreq.py: using RAC 18 17:21:34.626711 tst register_a5_1_authreq.py: using CellId 30363 17:21:34.752531 tst register_a5_1_authreq.py: using BVCI 30364 17:21:34.868269 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:34.878989 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:34.889555 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:34.900276 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:34.911152 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:34.921678 tst encryption: Using 1 x modem (candidates: 1) 17:21:35.043061 tst register_a5_1_authreq.py:8: start network... 17:21:35.271299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:35.792132 run create_hlr_db(pid=904): Launched 17:21:35.930256 bus /sierra_2: Setting Powered False 17:21:36.996300 run create_hlr_db(pid=904): Terminated: ok {rc=0} 17:21:37.444707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=906): Launched 17:21:37.760146 run osmo-hlr_10.42.42.2(pid=907): Launched 17:21:37.880845 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:38.438242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=909): Launched 17:21:38.754684 run osmo-stp_10.42.42.5(pid=910): Launched 17:21:38.875883 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:39.443741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=912): Launched 17:21:39.759137 run osmo-msc_10.42.42.6(pid=913): Launched 17:21:39.934767 run osmo-stp_10.42.42.5(pid=910): ERR: Terminated: ERROR {rc=1} [trial-2379↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=910)] 17:21:40.067556 run osmo-stp_10.42.42.5(pid=910): stdout: | (launched: 2022-12-12_17:21:38.696489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:40.200850 run osmo-stp_10.42.42.5(pid=910): stderr: | 20221212172138866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172138866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172138866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172138866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172138867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172138867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172138867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:40.332536 run osmo-stp_10.42.42.5(pid=910): stdout: | (launched: 2022-12-12_17:21:38.696489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:40.457672 run osmo-stp_10.42.42.5(pid=910): stderr: | 20221212172138866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172138866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172138866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172138866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172138867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172138867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172138867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:40.607315 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=910): Process ended prematurely: osmo-stp_10.42.42.5(pid=910) [trial-2379↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=910)] [trial-2379↪encryption↪register_a5_1_authreq.py:8] 17:21:40.616486 tst register_a5_1_authreq.py:8: Test FAILED (6.3 sec) 17:21:40.643649 run osmo-hlr_10.42.42.2(pid=907): ERR: Terminated: ERROR {rc=237} [trial-2379↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=907)] 17:21:40.692028 run osmo-hlr_10.42.42.2(pid=907): stdout: | (launched: 2022-12-12_17:21:37.702174) 17:21:40.741902 run osmo-hlr_10.42.42.2(pid=907): stderr: | 20221212172137878 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172137878 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172137878 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172137878 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172137878 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172137878 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172137890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172137898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172137899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172137899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:40.811748 run osmo-msc_10.42.42.6(pid=913): ERR: Terminated: ERROR {rc=2} [trial-2379↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=913)] 17:21:40.859937 run osmo-msc_10.42.42.6(pid=913): stdout: | (launched: 2022-12-12_17:21:39.700835) 17:21:40.909904 run osmo-msc_10.42.42.6(pid=913): stderr: | 20221212172139974 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172139974 DLGLOBAL DEBUG validating counter group 0x7f5736edbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172139974 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172139974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172139975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172139975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172139978 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172139978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172139978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172139978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:40.960081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=906): Terminating (SIGTERM) 17:21:41.000223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=909): Terminating (SIGTERM) 17:21:41.040546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=912): Terminating (SIGTERM) 17:21:41.080881 --- ParallelTerminationStrategy: PID 906 died... 17:21:41.100131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=906): Terminated: ok {rc=0} 17:21:41.145483 --- ParallelTerminationStrategy: PID 909 died... 17:21:41.164050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=909): Terminated: ok {rc=0} 17:21:41.208652 --- ParallelTerminationStrategy: PID 912 died... 17:21:41.227355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=912): Terminated: ok {rc=0} 17:21:41.311859 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2379 encryption register_a5_3_authreq.py ---------------------------------------------- 17:21:42.459380 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:42.470601 tst encryption: Using 1 x bts (candidates: 1) 17:21:42.507596 tst register_a5_3_authreq.py: using LAC 30364 17:21:42.640812 tst register_a5_3_authreq.py: using RAC 19 17:21:42.772834 tst register_a5_3_authreq.py: using CellId 30364 17:21:42.904750 tst register_a5_3_authreq.py: using BVCI 30365 17:21:43.027885 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:43.038916 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:43.049975 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:43.060713 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:43.071662 tst encryption: Using 1 x ip_address (candidates: 6) 17:21:43.082607 tst encryption: Using 1 x modem (candidates: 1) 17:21:43.210832 tst register_a5_3_authreq.py:8: start network... 17:21:43.422412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:43.907275 run create_hlr_db(pid=915): Launched 17:21:44.029542 bus /sierra_2: Setting Powered False 17:21:45.091405 run create_hlr_db(pid=915): Terminated: ok {rc=0} 17:21:45.527849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=917): Launched 17:21:45.865832 run osmo-hlr_10.42.42.2(pid=918): Launched 17:21:46.108797 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:46.840727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=920): Launched 17:21:47.176439 run osmo-stp_10.42.42.5(pid=921): Launched 17:21:47.334182 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:47.939395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=923): Launched 17:21:48.253098 run osmo-msc_10.42.42.6(pid=924): Launched 17:21:48.429638 run osmo-stp_10.42.42.5(pid=921): ERR: Terminated: ERROR {rc=1} [trial-2379↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=921)] 17:21:48.562791 run osmo-stp_10.42.42.5(pid=921): stdout: | (launched: 2022-12-12_17:21:47.113262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:48.695360 run osmo-stp_10.42.42.5(pid=921): stderr: | 20221212172147432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172147432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172147432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172147433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172147433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172147433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172147433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:48.826803 run osmo-stp_10.42.42.5(pid=921): stdout: | (launched: 2022-12-12_17:21:47.113262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:48.951430 run osmo-stp_10.42.42.5(pid=921): stderr: | 20221212172147432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172147432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172147432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172147433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172147433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172147433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172147433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:49.101114 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=921): Process ended prematurely: osmo-stp_10.42.42.5(pid=921) [trial-2379↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=921)] [trial-2379↪encryption↪register_a5_3_authreq.py:8] 17:21:49.110137 tst register_a5_3_authreq.py:8: Test FAILED (6.7 sec) 17:21:49.136583 run osmo-hlr_10.42.42.2(pid=918): ERR: Terminated: ERROR {rc=237} [trial-2379↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=918)] 17:21:49.184381 run osmo-hlr_10.42.42.2(pid=918): stdout: | (launched: 2022-12-12_17:21:45.784418) 17:21:49.234084 run osmo-hlr_10.42.42.2(pid=918): stderr: | 20221212172146120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172146121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172146121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172146121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172146121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172146121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172146140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172146152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172146152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172146152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:49.303119 run osmo-msc_10.42.42.6(pid=924): ERR: Terminated: ERROR {rc=2} [trial-2379↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=924)] 17:21:49.351129 run osmo-msc_10.42.42.6(pid=924): stdout: | (launched: 2022-12-12_17:21:48.195266) 17:21:49.400694 run osmo-msc_10.42.42.6(pid=924): stderr: | 20221212172148468 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172148468 DLGLOBAL DEBUG validating counter group 0x7f922aa9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172148468 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172148468 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172148468 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172148468 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172148470 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172148471 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172148471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172148471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:49.450306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=917): Terminating (SIGTERM) 17:21:49.489997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=920): Terminating (SIGTERM) 17:21:49.529792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=923): Terminating (SIGTERM) 17:21:49.569576 --- ParallelTerminationStrategy: PID 917 died... 17:21:49.588481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=917): Terminated: ok {rc=0} 17:21:49.632567 --- ParallelTerminationStrategy: PID 920 died... 17:21:49.651115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=920): Terminated: ok {rc=0} 17:21:49.695307 --- ParallelTerminationStrategy: PID 923 died... 17:21:49.713824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=923): Terminated: ok {rc=0} 17:21:49.800558 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 17:21:51.009188 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:21:51.014685 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 17:21:51.033597 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 17:21:51.061593 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 17:21:51.089140 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 17:21:51.107026 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 17:21:51.133251 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 17:21:51.645092 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2379 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 17:21:51.649624 tst handover.py:11: TEST_CONFIG: {} 17:21:51.863313 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 17:21:51.880205 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 17:21:51.904181 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 17:21:51.955068 tst handover.py: using MSISDN 7888 17:21:52.079727 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7888', subscriber_id=0} 17:21:52.196790 run srsepc_10.42.42.118: Starting srsepc 17:21:54.135608 run rm-remote-dir(pid=931): Launched 17:21:54.270064 bus /sierra_2: Setting Powered False 17:21:55.341153 run rm-remote-dir(pid=931): Terminated: ok {rc=0} 17:21:55.804182 run mk-remote-dir(pid=932): Launched 17:21:56.986684 run mk-remote-dir(pid=932): Terminated: ok {rc=0} 17:21:57.279659 run scp-inst-to-remote(pid=933): Launched 17:21:59.464042 run scp-inst-to-remote(pid=933): Terminated: ok {rc=0} 17:21:59.827387 run rm-remote-dir(pid=936): Launched 17:22:01.039430 run rm-remote-dir(pid=936): Terminated: ok {rc=0} 17:22:01.457767 run mk-remote-dir(pid=937): Launched 17:22:02.649186 run mk-remote-dir(pid=937): Terminated: ok {rc=0} 17:22:02.942168 run scp-cfg-to-remote(pid=938): Launched 17:22:04.121252 run scp-cfg-to-remote(pid=938): Terminated: ok {rc=0} 17:22:04.412215 run scp-db-to-remote(pid=940): Launched 17:22:05.593032 run scp-db-to-remote(pid=940): Terminated: ok {rc=0} 17:22:05.726953 run srsepc_10.42.42.118: Setting RPATH for srsepc 17:22:06.042871 run patchelf(pid=942): Launched 17:22:07.222295 run patchelf(pid=942): Terminated: ok {rc=0} 17:22:07.355691 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 17:22:07.671230 run setcap-netadm(pid=943): Launched 17:22:08.851222 run setcap-netadm(pid=943): Terminated: ok {rc=0} 17:22:09.180800 run srsepc(pid=944): Launched 17:22:09.297690 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 17:22:10.424030 run rm-remote-dir(pid=945): Launched 17:22:10.604892 run srsepc(pid=944): ERR: Terminated: ERROR {rc=127} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=944)] 17:22:10.741846 run srsepc(pid=944): stdout: | (launched: 2022-12-12_17:22:09.122958) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:22:10.879744 run srsepc(pid=944): stderr: | (launched: 2022-12-12_17:22:09.169294) | Connection to 10.42.42.116 closed. 17:22:11.017272 run srsepc(pid=944): stdout: | (launched: 2022-12-12_17:22:09.122958) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:22:11.148862 run srsepc(pid=944): stderr: | (launched: 2022-12-12_17:22:09.169294) | Connection to 10.42.42.116 closed. 17:22:11.304632 run rm-remote-dir(pid=945): Terminating (SIGINT) 17:22:11.484140 run rm-remote-dir(pid=945): Terminated: ok {rc=0} 17:22:11.614348 tst handover.py:37: ERR: Error: srsepc(pid=944): Process ended prematurely: srsepc(pid=944) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=944)] [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 17:22:11.624287 tst handover.py:37: Test FAILED (20.0 sec) 17:22:11.702702 run scp-back-log(pid=946): Launched 17:22:12.782241 run scp-back-log(pid=946): ERR: Terminated: ERROR {rc=1} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=946)] 17:22:12.843192 run scp-back-log(pid=946): stdout: | (launched: 2022-12-12_17:22:11.671420) 17:22:12.905503 run scp-back-log(pid=946): stderr: | (launched: 2022-12-12_17:22:11.691114) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 17:22:12.975394 tst srsepc_10.42.42.118: Error('scp-back-log(pid=946): launch_sync(): local process exited with status 1 [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=946)]') ---------------------------------------------- trial-2379 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 17:22:13.020596 tst iperf3_bidir.py:13: Number of physical ue: 1 17:22:13.231274 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 17:22:13.273736 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 17:22:13.482773 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 17:22:13.498671 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 17:22:13.530835 tst iperf3_bidir.py: using MSISDN 7889 17:22:13.645968 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7889', subscriber_id=0} 17:22:13.755656 run srsepc_10.42.42.118: Starting srsepc 17:22:14.397337 run rm-remote-dir(pid=948): Launched 17:22:15.580195 run rm-remote-dir(pid=948): Terminated: ok {rc=0} 17:22:15.941697 run mk-remote-dir(pid=949): Launched 17:22:17.248191 run mk-remote-dir(pid=949): Terminated: ok {rc=0} 17:22:17.545389 run scp-inst-to-remote(pid=950): Launched 17:22:19.730430 run scp-inst-to-remote(pid=950): Terminated: ok {rc=0} 17:22:20.094407 run rm-remote-dir(pid=953): Launched 17:22:21.290344 run rm-remote-dir(pid=953): Terminated: ok {rc=0} 17:22:21.655179 run mk-remote-dir(pid=954): Launched 17:22:22.850508 run mk-remote-dir(pid=954): Terminated: ok {rc=0} 17:22:23.162290 run scp-cfg-to-remote(pid=955): Launched 17:22:24.354708 run scp-cfg-to-remote(pid=955): Terminated: ok {rc=0} 17:22:24.664654 run scp-db-to-remote(pid=958): Launched 17:22:25.858071 run scp-db-to-remote(pid=958): Terminated: ok {rc=0} 17:22:26.000767 run srsepc_10.42.42.118: Setting RPATH for srsepc 17:22:26.337245 run patchelf(pid=960): Launched 17:22:27.531229 run patchelf(pid=960): Terminated: ok {rc=0} 17:22:27.675784 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 17:22:28.012310 run setcap-netadm(pid=963): Launched 17:22:29.199623 run setcap-netadm(pid=963): Terminated: ok {rc=0} 17:22:29.532549 run srsepc(pid=964): Launched 17:22:29.649623 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 17:22:30.776156 run rm-remote-dir(pid=965): Launched 17:22:30.981519 run srsepc(pid=964): ERR: Terminated: ERROR {rc=127} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=964)] 17:22:31.143516 run srsepc(pid=964): stdout: | (launched: 2022-12-12_17:22:29.474605) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:22:31.285571 run srsepc(pid=964): stderr: | (launched: 2022-12-12_17:22:29.521131) | Connection to 10.42.42.116 closed. 17:22:31.427783 run srsepc(pid=964): stdout: | (launched: 2022-12-12_17:22:29.474605) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:22:31.564201 run srsepc(pid=964): stderr: | (launched: 2022-12-12_17:22:29.521131) | Connection to 10.42.42.116 closed. 17:22:31.725761 run rm-remote-dir(pid=965): Terminating (SIGINT) 17:22:31.912213 run rm-remote-dir(pid=965): Terminated: ok {rc=0} 17:22:32.046738 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=964): Process ended prematurely: srsepc(pid=964) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=964)] [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 17:22:32.058158 tst iperf3_bidir.py:42: Test FAILED (19.0 sec) 17:22:32.145787 run scp-back-log(pid=966): Launched 17:22:33.261079 run scp-back-log(pid=966): ERR: Terminated: ERROR {rc=1} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=966)] 17:22:33.322541 run scp-back-log(pid=966): stdout: | (launched: 2022-12-12_17:22:32.108910) 17:22:33.385621 run scp-back-log(pid=966): stderr: | (launched: 2022-12-12_17:22:32.129183) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 17:22:33.456469 tst srsepc_10.42.42.118: Error('scp-back-log(pid=966): launch_sync(): local process exited with status 1 [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=966)]') ---------------------------------------------- trial-2379 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 17:22:33.502695 tst iperf3_dl.py:13: Number of physical ue: 1 17:22:33.713442 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 17:22:33.758413 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 17:22:33.965773 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 17:22:33.981707 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 17:22:34.015214 tst iperf3_dl.py: using MSISDN 7890 17:22:34.128429 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7890', subscriber_id=0} 17:22:34.238162 run srsepc_10.42.42.118: Starting srsepc 17:22:34.878697 run rm-remote-dir(pid=968): Launched 17:22:36.063044 run rm-remote-dir(pid=968): Terminated: ok {rc=0} 17:22:36.404190 run mk-remote-dir(pid=969): Launched 17:22:37.585114 run mk-remote-dir(pid=969): Terminated: ok {rc=0} 17:22:37.875981 run scp-inst-to-remote(pid=970): Launched 17:22:40.059664 run scp-inst-to-remote(pid=970): Terminated: ok {rc=0} 17:22:40.423592 run rm-remote-dir(pid=972): Launched 17:22:41.615310 run rm-remote-dir(pid=972): Terminated: ok {rc=0} 17:22:41.956741 run mk-remote-dir(pid=973): Launched 17:22:43.137496 run mk-remote-dir(pid=973): Terminated: ok {rc=0} 17:22:43.428765 run scp-cfg-to-remote(pid=974): Launched 17:22:44.608535 run scp-cfg-to-remote(pid=974): Terminated: ok {rc=0} 17:22:44.898618 run scp-db-to-remote(pid=976): Launched 17:22:46.079038 run scp-db-to-remote(pid=976): Terminated: ok {rc=0} 17:22:46.215995 run srsepc_10.42.42.118: Setting RPATH for srsepc 17:22:46.540876 run patchelf(pid=978): Launched 17:22:47.780452 run patchelf(pid=978): Terminated: ok {rc=0} 17:22:47.923288 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 17:22:48.260102 run setcap-netadm(pid=979): Launched 17:22:49.450093 run setcap-netadm(pid=979): Terminated: ok {rc=0} 17:22:49.781149 run srsepc(pid=980): Launched 17:22:49.897143 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 17:22:51.027148 run rm-remote-dir(pid=981): Launched 17:22:51.208071 run srsepc(pid=980): ERR: Terminated: ERROR {rc=127} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=980)] 17:22:51.344576 run srsepc(pid=980): stdout: | (launched: 2022-12-12_17:22:49.722904) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:22:51.482372 run srsepc(pid=980): stderr: | (launched: 2022-12-12_17:22:49.769663) | Connection to 10.42.42.116 closed. 17:22:51.619815 run srsepc(pid=980): stdout: | (launched: 2022-12-12_17:22:49.722904) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:22:51.752046 run srsepc(pid=980): stderr: | (launched: 2022-12-12_17:22:49.769663) | Connection to 10.42.42.116 closed. 17:22:51.909750 run rm-remote-dir(pid=981): Terminating (SIGINT) 17:22:52.090357 run rm-remote-dir(pid=981): Terminated: ok {rc=0} 17:22:52.221911 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=980): Process ended prematurely: srsepc(pid=980) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=980)] [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 17:22:52.232106 tst iperf3_dl.py:42: Test FAILED (18.7 sec) 17:22:52.311652 run scp-back-log(pid=982): Launched 17:22:53.389420 run scp-back-log(pid=982): ERR: Terminated: ERROR {rc=1} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=982)] 17:22:53.450458 run scp-back-log(pid=982): stdout: | (launched: 2022-12-12_17:22:52.279773) 17:22:53.512828 run scp-back-log(pid=982): stderr: | (launched: 2022-12-12_17:22:52.299518) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 17:22:53.583512 tst srsepc_10.42.42.118: Error('scp-back-log(pid=982): launch_sync(): local process exited with status 1 [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=982)]') ---------------------------------------------- trial-2379 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 17:22:53.629119 tst iperf3_ul.py:13: Number of physical ue: 1 17:22:53.838585 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 17:22:53.881435 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 17:22:54.088147 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 17:22:54.103953 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 17:22:54.136624 tst iperf3_ul.py: using MSISDN 7891 17:22:54.249625 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7891', subscriber_id=0} 17:22:54.358496 run srsepc_10.42.42.118: Starting srsepc 17:22:55.000348 run rm-remote-dir(pid=984): Launched 17:22:56.183255 run rm-remote-dir(pid=984): Terminated: ok {rc=0} 17:22:56.526935 run mk-remote-dir(pid=985): Launched 17:22:57.709159 run mk-remote-dir(pid=985): Terminated: ok {rc=0} 17:22:58.002065 run scp-inst-to-remote(pid=986): Launched 17:23:00.186873 run scp-inst-to-remote(pid=986): Terminated: ok {rc=0} 17:23:00.527675 run rm-remote-dir(pid=989): Launched 17:23:01.714684 run rm-remote-dir(pid=989): Terminated: ok {rc=0} 17:23:02.065164 run mk-remote-dir(pid=990): Launched 17:23:03.259361 run mk-remote-dir(pid=990): Terminated: ok {rc=0} 17:23:03.551715 run scp-cfg-to-remote(pid=994): Launched 17:23:04.731869 run scp-cfg-to-remote(pid=994): Terminated: ok {rc=0} 17:23:05.022688 run scp-db-to-remote(pid=997): Launched 17:23:06.206635 run scp-db-to-remote(pid=997): Terminated: ok {rc=0} 17:23:06.349348 run srsepc_10.42.42.118: Setting RPATH for srsepc 17:23:06.686441 run patchelf(pid=999): Launched 17:23:07.881305 run patchelf(pid=999): Terminated: ok {rc=0} 17:23:08.025009 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 17:23:08.362023 run setcap-netadm(pid=1000): Launched 17:23:09.555693 run setcap-netadm(pid=1000): Terminated: ok {rc=0} 17:23:09.909080 run srsepc(pid=1001): Launched 17:23:10.036942 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 17:23:11.253204 run rm-remote-dir(pid=1002): Launched 17:23:11.447480 run srsepc(pid=1001): ERR: Terminated: ERROR {rc=127} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1001)] 17:23:11.594440 run srsepc(pid=1001): stdout: | (launched: 2022-12-12_17:23:09.847451) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:23:11.740519 run srsepc(pid=1001): stderr: | (launched: 2022-12-12_17:23:09.897266) | Connection to 10.42.42.116 closed. 17:23:11.886793 run srsepc(pid=1001): stdout: | (launched: 2022-12-12_17:23:09.847451) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:23:12.028144 run srsepc(pid=1001): stderr: | (launched: 2022-12-12_17:23:09.897266) | Connection to 10.42.42.116 closed. 17:23:12.195226 run rm-remote-dir(pid=1002): Terminating (SIGINT) 17:23:12.387039 run rm-remote-dir(pid=1002): Terminated: ok {rc=0} 17:23:12.526334 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=1001): Process ended prematurely: srsepc(pid=1001) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1001)] [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 17:23:12.537184 tst iperf3_ul.py:42: Test FAILED (18.9 sec) 17:23:12.619452 run scp-back-log(pid=1003): Launched 17:23:13.700188 run scp-back-log(pid=1003): ERR: Terminated: ERROR {rc=1} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1003)] 17:23:13.764394 run scp-back-log(pid=1003): stdout: | (launched: 2022-12-12_17:23:12.586418) 17:23:13.830477 run scp-back-log(pid=1003): stderr: | (launched: 2022-12-12_17:23:12.607296) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 17:23:13.904793 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1003): launch_sync(): local process exited with status 1 [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1003)]') ---------------------------------------------- trial-2379 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 17:23:13.953517 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 17:23:13.971003 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 17:23:13.994557 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 17:23:14.046697 tst ping.py: using MSISDN 7892 17:23:14.171638 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7892', subscriber_id=0} 17:23:14.288676 run srsepc_10.42.42.118: Starting srsepc 17:23:14.975189 run rm-remote-dir(pid=1005): Launched 17:23:16.167091 run rm-remote-dir(pid=1005): Terminated: ok {rc=0} 17:23:16.517262 run mk-remote-dir(pid=1006): Launched 17:23:17.722587 run mk-remote-dir(pid=1006): Terminated: ok {rc=0} 17:23:18.015192 run scp-inst-to-remote(pid=1007): Launched 17:23:20.198612 run scp-inst-to-remote(pid=1007): Terminated: ok {rc=0} 17:23:20.560766 run rm-remote-dir(pid=1009): Launched 17:23:21.755481 run rm-remote-dir(pid=1009): Terminated: ok {rc=0} 17:23:22.120605 run mk-remote-dir(pid=1010): Launched 17:23:23.315867 run mk-remote-dir(pid=1010): Terminated: ok {rc=0} 17:23:23.627176 run scp-cfg-to-remote(pid=1011): Launched 17:23:24.819253 run scp-cfg-to-remote(pid=1011): Terminated: ok {rc=0} 17:23:25.128433 run scp-db-to-remote(pid=1013): Launched 17:23:26.320405 run scp-db-to-remote(pid=1013): Terminated: ok {rc=0} 17:23:26.462142 run srsepc_10.42.42.118: Setting RPATH for srsepc 17:23:26.798265 run patchelf(pid=1015): Launched 17:23:27.989965 run patchelf(pid=1015): Terminated: ok {rc=0} 17:23:28.132339 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 17:23:28.467582 run setcap-netadm(pid=1016): Launched 17:23:29.661886 run setcap-netadm(pid=1016): Terminated: ok {rc=0} 17:23:30.014017 run srsepc(pid=1017): Launched 17:23:30.141848 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 17:23:31.388199 run rm-remote-dir(pid=1018): Launched 17:23:31.696509 run srsepc(pid=1017): ERR: Terminated: ERROR {rc=127} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1017)] 17:23:31.844077 run srsepc(pid=1017): stdout: | (launched: 2022-12-12_17:23:29.952221) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:23:32.030001 run srsepc(pid=1017): stderr: | (launched: 2022-12-12_17:23:30.002115) | Connection to 10.42.42.116 closed. 17:23:32.174778 run srsepc(pid=1017): stdout: | (launched: 2022-12-12_17:23:29.952221) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:23:32.309220 run srsepc(pid=1017): stderr: | (launched: 2022-12-12_17:23:30.002115) | Connection to 10.42.42.116 closed. 17:23:32.466860 run rm-remote-dir(pid=1018): Terminating (SIGINT) 17:23:32.648316 run rm-remote-dir(pid=1018): Terminated: ok {rc=0} 17:23:32.780009 tst ping.py:16: ERR: Error: srsepc(pid=1017): Process ended prematurely: srsepc(pid=1017) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1017)] [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 17:23:32.790572 tst ping.py:16: Test FAILED (18.8 sec) 17:23:32.870801 run scp-back-log(pid=1019): Launched 17:23:33.949249 run scp-back-log(pid=1019): ERR: Terminated: ERROR {rc=1} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1019)] 17:23:34.009993 run scp-back-log(pid=1019): stdout: | (launched: 2022-12-12_17:23:32.838399) 17:23:34.072556 run scp-back-log(pid=1019): stderr: | (launched: 2022-12-12_17:23:32.858368) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 17:23:34.142647 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1019): launch_sync(): local process exited with status 1 [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1019)]') ---------------------------------------------- trial-2379 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 17:23:34.189267 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 17:23:34.206109 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 17:23:34.229496 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 17:23:34.281164 tst rrc_idle_mo_ping.py: using MSISDN 7893 17:23:34.398130 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7893', subscriber_id=0} 17:23:34.506979 run srsepc_10.42.42.118: Starting srsepc 17:23:35.144839 run rm-remote-dir(pid=1021): Launched 17:23:36.330589 run rm-remote-dir(pid=1021): Terminated: ok {rc=0} 17:23:36.696255 run mk-remote-dir(pid=1022): Launched 17:23:37.891969 run mk-remote-dir(pid=1022): Terminated: ok {rc=0} 17:23:38.204187 run scp-inst-to-remote(pid=1023): Launched 17:23:40.398500 run scp-inst-to-remote(pid=1023): Terminated: ok {rc=0} 17:23:40.761564 run rm-remote-dir(pid=1025): Launched 17:23:41.957954 run rm-remote-dir(pid=1025): Terminated: ok {rc=0} 17:23:42.323158 run mk-remote-dir(pid=1026): Launched 17:23:43.518548 run mk-remote-dir(pid=1026): Terminated: ok {rc=0} 17:23:43.829898 run scp-cfg-to-remote(pid=1027): Launched 17:23:45.023719 run scp-cfg-to-remote(pid=1027): Terminated: ok {rc=0} 17:23:45.334251 run scp-db-to-remote(pid=1029): Launched 17:23:46.562461 run scp-db-to-remote(pid=1029): Terminated: ok {rc=0} 17:23:46.721314 run srsepc_10.42.42.118: Setting RPATH for srsepc 17:23:47.116310 run patchelf(pid=1101): Launched 17:23:48.418122 run patchelf(pid=1101): Terminated: ok {rc=0} 17:23:48.588259 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 17:23:48.932590 run setcap-netadm(pid=1316): Launched 17:23:50.191203 run setcap-netadm(pid=1316): Terminated: ok {rc=0} 17:23:50.561697 run srsepc(pid=1318): Launched 17:23:50.693559 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 17:23:51.879189 run rm-remote-dir(pid=1320): Launched 17:23:52.114819 run srsepc(pid=1318): ERR: Terminated: ERROR {rc=127} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1318)] 17:23:52.295455 run srsepc(pid=1318): stdout: | (launched: 2022-12-12_17:23:50.492022) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:23:52.445537 run srsepc(pid=1318): stderr: | (launched: 2022-12-12_17:23:50.543375) | Connection to 10.42.42.116 closed. 17:23:52.595771 run srsepc(pid=1318): stdout: | (launched: 2022-12-12_17:23:50.492022) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:23:52.741366 run srsepc(pid=1318): stderr: | (launched: 2022-12-12_17:23:50.543375) | Connection to 10.42.42.116 closed. 17:23:52.911441 run rm-remote-dir(pid=1320): Terminating (SIGINT) 17:23:53.107824 run rm-remote-dir(pid=1320): Terminated: ok {rc=0} 17:23:53.250855 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=1318): Process ended prematurely: srsepc(pid=1318) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1318)] [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 17:23:53.262827 tst rrc_idle_mo_ping.py:16: Test FAILED (19.1 sec) 17:23:53.346419 run scp-back-log(pid=1321): Launched 17:23:54.465398 run scp-back-log(pid=1321): ERR: Terminated: ERROR {rc=1} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1321)] 17:23:54.532830 run scp-back-log(pid=1321): stdout: | (launched: 2022-12-12_17:23:53.314028) 17:23:54.603252 run scp-back-log(pid=1321): stderr: | (launched: 2022-12-12_17:23:53.335274) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 17:23:54.679906 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1321): launch_sync(): local process exited with status 1 [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1321)]') ---------------------------------------------- trial-2379 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 17:23:54.732017 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 17:23:54.750589 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 17:23:54.775830 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 17:23:54.828246 tst rrc_idle_mt_ping.py: using MSISDN 7894 17:23:54.954960 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7894', subscriber_id=0} 17:23:55.075717 run srsepc_10.42.42.118: Starting srsepc 17:23:55.783098 run rm-remote-dir(pid=1323): Launched 17:23:57.046968 run rm-remote-dir(pid=1323): Terminated: ok {rc=0} 17:23:57.421739 run mk-remote-dir(pid=1324): Launched 17:23:58.685888 run mk-remote-dir(pid=1324): Terminated: ok {rc=0} 17:23:59.010265 run scp-inst-to-remote(pid=1325): Launched 17:24:01.283865 run scp-inst-to-remote(pid=1325): Terminated: ok {rc=0} 17:24:01.656177 run rm-remote-dir(pid=1327): Launched 17:24:02.897455 run rm-remote-dir(pid=1327): Terminated: ok {rc=0} 17:24:03.251885 run mk-remote-dir(pid=1328): Launched 17:24:04.485625 run mk-remote-dir(pid=1328): Terminated: ok {rc=0} 17:24:04.813469 run scp-cfg-to-remote(pid=1329): Launched 17:24:06.046647 run scp-cfg-to-remote(pid=1329): Terminated: ok {rc=0} 17:24:06.349146 run scp-db-to-remote(pid=1331): Launched 17:24:07.563780 run scp-db-to-remote(pid=1331): Terminated: ok {rc=0} 17:24:07.713154 run srsepc_10.42.42.118: Setting RPATH for srsepc 17:24:08.062390 run patchelf(pid=1333): Launched 17:24:09.334950 run patchelf(pid=1333): Terminated: ok {rc=0} 17:24:09.484533 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 17:24:09.841050 run setcap-netadm(pid=1334): Launched 17:24:11.030115 run setcap-netadm(pid=1334): Terminated: ok {rc=0} 17:24:11.361730 run srsepc(pid=1336): Launched 17:24:11.478771 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 17:24:12.606279 run rm-remote-dir(pid=1337): Launched 17:24:12.785586 run srsepc(pid=1336): ERR: Terminated: ERROR {rc=127} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1336)] 17:24:12.921940 run srsepc(pid=1336): stdout: | (launched: 2022-12-12_17:24:11.303369) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:24:13.059393 run srsepc(pid=1336): stderr: | (launched: 2022-12-12_17:24:11.350004) | Connection to 10.42.42.116 closed. 17:24:13.196534 run srsepc(pid=1336): stdout: | (launched: 2022-12-12_17:24:11.303369) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 17:24:13.328350 run srsepc(pid=1336): stderr: | (launched: 2022-12-12_17:24:11.350004) | Connection to 10.42.42.116 closed. 17:24:13.485419 run rm-remote-dir(pid=1337): Terminating (SIGINT) 17:24:13.665884 run rm-remote-dir(pid=1337): Terminated: ok {rc=0} 17:24:13.796910 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=1336): Process ended prematurely: srsepc(pid=1336) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1336)] [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 17:24:13.807128 tst rrc_idle_mt_ping.py:16: Test FAILED (19.1 sec) 17:24:13.886303 run scp-back-log(pid=1338): Launched 17:24:14.964088 run scp-back-log(pid=1338): ERR: Terminated: ERROR {rc=1} [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1338)] 17:24:15.025450 run scp-back-log(pid=1338): stdout: | (launched: 2022-12-12_17:24:13.854626) 17:24:15.088426 run scp-back-log(pid=1338): stderr: | (launched: 2022-12-12_17:24:13.874537) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 17:24:15.159009 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1338): launch_sync(): local process exited with status 1 [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1338)]') --------------------------------------------------------------------- trial-2379 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 17:24:15.294834 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:24:15.302487 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 17:24:15.347349 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 17:24:15.375088 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 17:24:15.429685 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 17:24:15.474612 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 17:24:15.502457 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 17:24:16.072253 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 17:24:16.081607 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 17:24:16.098224 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 17:24:16.142640 tst handover.py: using LAC 30365 17:24:16.289709 tst handover.py: using RAC 20 17:24:16.450461 tst handover.py: using CellId 30365 17:24:16.605124 tst handover.py: using BVCI 30366 17:24:16.729637 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 17:24:16.765877 tst handover.py: using LAC 30366 17:24:16.903107 tst handover.py: using RAC 21 17:24:17.036718 tst handover.py: using CellId 30366 17:24:17.168071 tst handover.py: using BVCI 30367 17:24:17.291962 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 17:24:17.303394 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 17:24:17.314514 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 17:24:17.326427 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 17:24:17.338287 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 17:24:17.349987 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 17:24:17.469736 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 17:24:17.587250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:18.067044 run create_hlr_db(pid=1343): Launched 17:24:19.248672 run create_hlr_db(pid=1343): Terminated: ok {rc=0} 17:24:19.575668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1345): Launched 17:24:19.885317 run osmo-hlr_10.42.42.2(pid=1346): Launched 17:24:20.003427 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:20.533695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1348): Launched 17:24:20.842571 run osmo-stp_10.42.42.5(pid=1349): Launched 17:24:20.963108 run osmo-msc_10.42.42.6: Starting osmo-msc 17:24:21.521088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1351): Launched 17:24:21.830691 run osmo-msc_10.42.42.6(pid=1352): Launched 17:24:22.004897 run osmo-stp_10.42.42.5(pid=1349): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1349)] 17:24:22.135174 run osmo-stp_10.42.42.5(pid=1349): stdout: | (launched: 2022-12-12_17:24:20.785073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:22.264613 run osmo-stp_10.42.42.5(pid=1349): stderr: | 20221212172420953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172420953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172420953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172420953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172420954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172420954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172420954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:22.393423 run osmo-stp_10.42.42.5(pid=1349): stdout: | (launched: 2022-12-12_17:24:20.785073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:22.515497 run osmo-stp_10.42.42.5(pid=1349): stderr: | 20221212172420953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172420953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172420953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172420953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172420954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172420954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172420954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:22.662057 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1349): Process ended prematurely: osmo-stp_10.42.42.5(pid=1349) [trial-2379↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1349)] [trial-2379↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 17:24:22.670353 tst handover.py:18: Test FAILED (6.6 sec) 17:24:22.696622 run osmo-hlr_10.42.42.2(pid=1346): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1346)] 17:24:22.744586 run osmo-hlr_10.42.42.2(pid=1346): stdout: | (launched: 2022-12-12_17:24:19.827752) 17:24:22.793888 run osmo-hlr_10.42.42.2(pid=1346): stderr: | 20221212172420002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172420002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172420003 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172420003 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172420003 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172420003 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172420039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172420050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172420050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172420050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:22.862799 run osmo-msc_10.42.42.6(pid=1352): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1352)] 17:24:22.910374 run osmo-msc_10.42.42.6(pid=1352): stdout: | (launched: 2022-12-12_17:24:21.773192) 17:24:22.959734 run osmo-msc_10.42.42.6(pid=1352): stderr: | 20221212172422043 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172422043 DLGLOBAL DEBUG validating counter group 0x7f4ea2539c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172422043 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172422043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172422043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172422043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172422045 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172422046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172422046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172422046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:24:23.009512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1345): Terminating (SIGTERM) 17:24:23.049286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1348): Terminating (SIGTERM) 17:24:23.089136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1351): Terminating (SIGTERM) 17:24:23.129742 --- ParallelTerminationStrategy: PID 1345 died... 17:24:23.148501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1345): Terminated: ok {rc=0} 17:24:23.192684 --- ParallelTerminationStrategy: PID 1348 died... 17:24:23.211014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1348): Terminated: ok {rc=0} 17:24:23.255445 --- ParallelTerminationStrategy: PID 1351 died... 17:24:23.273854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1351): Terminated: ok {rc=0} 17:24:23.360590 bus /sierra_3: Setting Powered False 17:24:24.462221 bus /sierra_3: Setting Powered False 17:24:25.578599 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 17:24:26.829701 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:24:26.835353 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 17:24:26.876169 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 17:24:26.903285 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 17:24:26.956241 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 17:24:26.996584 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 17:24:27.023524 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 17:24:27.578842 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 17:24:27.584283 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:24:27.595582 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 17:24:27.634074 tst handover.py: using LAC 30367 17:24:27.769385 tst handover.py: using RAC 22 17:24:27.898838 tst handover.py: using CellId 30367 17:24:28.029365 tst handover.py: using BVCI 30368 17:24:28.150520 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 17:24:28.189218 tst handover.py: using LAC 30368 17:24:28.322323 tst handover.py: using RAC 23 17:24:28.452061 tst handover.py: using CellId 30368 17:24:28.575122 tst handover.py: using BVCI 30369 17:24:28.690527 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:24:28.701511 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:24:28.712354 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:24:28.724034 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:24:28.735701 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:24:28.747245 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 17:24:28.870105 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 17:24:28.992631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:29.448637 run create_hlr_db(pid=1359): Launched 17:24:29.574248 bus /sierra_2: Setting Powered False 17:24:30.635510 run create_hlr_db(pid=1359): Terminated: ok {rc=0} 17:24:31.075465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1361): Launched 17:24:31.426790 run osmo-hlr_10.42.42.2(pid=1362): Launched 17:24:31.617386 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:32.330756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1364): Launched 17:24:32.654702 run osmo-stp_10.42.42.5(pid=1365): Launched 17:24:32.776459 run osmo-msc_10.42.42.6: Starting osmo-msc 17:24:33.312115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1367): Launched 17:24:33.624326 run osmo-msc_10.42.42.6(pid=1368): Launched 17:24:33.799382 run osmo-stp_10.42.42.5(pid=1365): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1365)] 17:24:33.930840 run osmo-stp_10.42.42.5(pid=1365): stdout: | (launched: 2022-12-12_17:24:32.597112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:34.062015 run osmo-stp_10.42.42.5(pid=1365): stderr: | 20221212172432765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172432765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172432766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172432766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172432766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172432767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172432767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:34.191041 run osmo-stp_10.42.42.5(pid=1365): stdout: | (launched: 2022-12-12_17:24:32.597112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:34.314215 run osmo-stp_10.42.42.5(pid=1365): stderr: | 20221212172432765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172432765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172432766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172432766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172432766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172432767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172432767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:34.471467 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1365): Process ended prematurely: osmo-stp_10.42.42.5(pid=1365) [trial-2379↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1365)] [trial-2379↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 17:24:34.480578 tst handover.py:18: Test FAILED (6.9 sec) 17:24:34.508311 run osmo-hlr_10.42.42.2(pid=1362): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1362)] 17:24:34.559315 run osmo-hlr_10.42.42.2(pid=1362): stdout: | (launched: 2022-12-12_17:24:31.363432) 17:24:34.612004 run osmo-hlr_10.42.42.2(pid=1362): stderr: | 20221212172431767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172431767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172431768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172431768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172431768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172431769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172431810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172431821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172431821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172431821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:34.685644 run osmo-msc_10.42.42.6(pid=1368): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1368)] 17:24:34.736529 run osmo-msc_10.42.42.6(pid=1368): stdout: | (launched: 2022-12-12_17:24:33.566134) 17:24:34.789141 run osmo-msc_10.42.42.6(pid=1368): stderr: | 20221212172433838 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172433839 DLGLOBAL DEBUG validating counter group 0x7fdbeb011c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172433839 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172433839 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172433839 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172433839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172433841 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172433841 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172433842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172433842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:24:34.841949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1361): Terminating (SIGTERM) 17:24:34.884218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1364): Terminating (SIGTERM) 17:24:34.926747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1367): Terminating (SIGTERM) 17:24:34.969481 --- ParallelTerminationStrategy: PID 1361 died... 17:24:34.989692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1361): Terminated: ok {rc=0} 17:24:35.036263 --- ParallelTerminationStrategy: PID 1364 died... 17:24:35.056330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1364): Terminated: ok {rc=0} 17:24:35.102882 --- ParallelTerminationStrategy: PID 1367 died... 17:24:35.122638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1367): Terminated: ok {rc=0} 17:24:35.212033 bus /sierra_3: Setting Powered False 17:24:36.312026 bus /sierra_3: Setting Powered False 17:24:37.428721 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 17:24:38.678657 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:24:38.684296 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 17:24:38.738809 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 17:24:38.765892 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 17:24:38.819010 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 17:24:38.873438 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 17:24:38.900383 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 17:24:39.452055 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 17:24:39.457483 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:24:39.468626 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 17:24:39.507267 tst handover.py: using LAC 30369 17:24:39.638120 tst handover.py: using RAC 24 17:24:39.767387 tst handover.py: using CellId 30369 17:24:39.897550 tst handover.py: using BVCI 30370 17:24:40.013145 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 17:24:40.061861 tst handover.py: using LAC 30370 17:24:40.183359 tst handover.py: using RAC 25 17:24:40.307550 tst handover.py: using CellId 30370 17:24:40.439361 tst handover.py: using BVCI 30371 17:24:40.554384 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:24:40.565774 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:24:40.577349 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:24:40.588379 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:24:40.599592 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:24:40.610578 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 17:24:40.732674 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 17:24:40.850830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:41.304573 run create_hlr_db(pid=1376): Launched 17:24:41.430873 bus /sierra_2: Setting Powered False 17:24:42.492254 run create_hlr_db(pid=1376): Terminated: ok {rc=0} 17:24:42.915850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1378): Launched 17:24:43.251138 run osmo-hlr_10.42.42.2(pid=1379): Launched 17:24:43.379754 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:43.918426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1381): Launched 17:24:44.250521 run osmo-stp_10.42.42.5(pid=1382): Launched 17:24:44.378698 run osmo-msc_10.42.42.6: Starting osmo-msc 17:24:44.948395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1384): Launched 17:24:45.282770 run osmo-msc_10.42.42.6(pid=1387): Launched 17:24:45.468489 run osmo-stp_10.42.42.5(pid=1382): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1382)] 17:24:45.607628 run osmo-stp_10.42.42.5(pid=1382): stdout: | (launched: 2022-12-12_17:24:44.189437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:45.748354 run osmo-stp_10.42.42.5(pid=1382): stderr: | 20221212172444381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172444381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172444381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172444382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172444382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172444382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172444382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:45.893705 run osmo-stp_10.42.42.5(pid=1382): stdout: | (launched: 2022-12-12_17:24:44.189437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:46.021680 run osmo-stp_10.42.42.5(pid=1382): stderr: | 20221212172444381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172444381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172444381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172444382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172444382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172444382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172444382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:46.174926 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1382): Process ended prematurely: osmo-stp_10.42.42.5(pid=1382) [trial-2379↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1382)] [trial-2379↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 17:24:46.184385 tst handover.py:18: Test FAILED (6.7 sec) 17:24:46.214379 run osmo-hlr_10.42.42.2(pid=1379): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1379)] 17:24:46.266319 run osmo-hlr_10.42.42.2(pid=1379): stdout: | (launched: 2022-12-12_17:24:43.189968) 17:24:46.318778 run osmo-hlr_10.42.42.2(pid=1379): stderr: | 20221212172443387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172443387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172443387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172443387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172443387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172443387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172443400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172443410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172443411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172443411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:46.391114 run osmo-msc_10.42.42.6(pid=1387): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1387)] 17:24:46.443456 run osmo-msc_10.42.42.6(pid=1387): stdout: | (launched: 2022-12-12_17:24:45.221533) 17:24:46.495575 run osmo-msc_10.42.42.6(pid=1387): stderr: | 20221212172445543 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172445543 DLGLOBAL DEBUG validating counter group 0x7f39bafe1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172445543 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172445544 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172445544 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172445544 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172445546 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172445546 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172445546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172445546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:24:46.548917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1378): Terminating (SIGTERM) 17:24:46.591874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1381): Terminating (SIGTERM) 17:24:46.638528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1384): Terminating (SIGTERM) 17:24:46.684182 --- ParallelTerminationStrategy: PID 1378 died... 17:24:46.704315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1378): Terminated: ok {rc=0} 17:24:46.754069 --- ParallelTerminationStrategy: PID 1381 died... 17:24:46.774245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1381): Terminated: ok {rc=0} 17:24:46.822963 --- ParallelTerminationStrategy: PID 1384 died... 17:24:46.842685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1384): Terminated: ok {rc=0} 17:24:46.932634 bus /sierra_3: Setting Powered False 17:24:48.029983 bus /sierra_3: Setting Powered False 17:24:49.147482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 17:24:50.406348 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:24:50.412631 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 17:24:50.463423 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 17:24:50.490766 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 17:24:50.543853 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 17:24:50.594410 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 17:24:50.621563 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 17:24:51.176867 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 17:24:51.182392 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:24:51.193936 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:24:51.233100 tst handover.py: using LAC 30371 17:24:51.362237 tst handover.py: using RAC 26 17:24:51.491848 tst handover.py: using CellId 30371 17:24:51.623189 tst handover.py: using BVCI 30372 17:24:51.744591 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:24:51.791860 tst handover.py: using LAC 30372 17:24:51.922682 tst handover.py: using RAC 27 17:24:52.052567 tst handover.py: using CellId 30372 17:24:52.182596 tst handover.py: using BVCI 30373 17:24:52.303640 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:24:52.315181 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:24:52.326474 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:24:52.337985 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:24:52.349407 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:24:52.360717 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:24:52.476124 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:24:52.596626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:53.081973 run create_hlr_db(pid=1392): Launched 17:24:53.216448 bus /sierra_2: Setting Powered False 17:24:54.282120 run create_hlr_db(pid=1392): Terminated: ok {rc=0} 17:24:54.697401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1394): Launched 17:24:55.007241 run osmo-hlr_10.42.42.2(pid=1395): Launched 17:24:55.125649 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:55.643311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1397): Launched 17:24:55.954726 run osmo-stp_10.42.42.5(pid=1398): Launched 17:24:56.075355 run osmo-msc_10.42.42.6: Starting osmo-msc 17:24:56.611810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1400): Launched 17:24:56.923731 run osmo-msc_10.42.42.6(pid=1401): Launched 17:24:57.097273 run osmo-stp_10.42.42.5(pid=1398): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1398)] 17:24:57.228104 run osmo-stp_10.42.42.5(pid=1398): stdout: | (launched: 2022-12-12_17:24:55.897192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:57.358756 run osmo-stp_10.42.42.5(pid=1398): stderr: | 20221212172456069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172456069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172456069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172456069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172456070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172456070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172456070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:57.487318 run osmo-stp_10.42.42.5(pid=1398): stdout: | (launched: 2022-12-12_17:24:55.897192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:57.610150 run osmo-stp_10.42.42.5(pid=1398): stderr: | 20221212172456069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172456069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172456069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172456069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172456070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172456070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172456070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:57.756914 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1398): Process ended prematurely: osmo-stp_10.42.42.5(pid=1398) [trial-2379↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1398)] [trial-2379↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 17:24:57.765396 tst handover.py:18: Test FAILED (6.6 sec) 17:24:57.791785 run osmo-hlr_10.42.42.2(pid=1395): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1395)] 17:24:57.840183 run osmo-hlr_10.42.42.2(pid=1395): stdout: | (launched: 2022-12-12_17:24:54.949899) 17:24:57.889664 run osmo-hlr_10.42.42.2(pid=1395): stderr: | 20221212172455125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172455125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172455125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172455125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172455125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172455125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172455137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172455145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172455145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172455146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:57.958665 run osmo-msc_10.42.42.6(pid=1401): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1401)] 17:24:58.006551 run osmo-msc_10.42.42.6(pid=1401): stdout: | (launched: 2022-12-12_17:24:56.866186) 17:24:58.056019 run osmo-msc_10.42.42.6(pid=1401): stderr: | 20221212172457135 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172457135 DLGLOBAL DEBUG validating counter group 0x7fd763fadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172457136 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172457136 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172457136 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172457136 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172457138 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172457138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172457138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172457138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:24:58.105747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1394): Terminating (SIGTERM) 17:24:58.145939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1397): Terminating (SIGTERM) 17:24:58.185620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1400): Terminating (SIGTERM) 17:24:58.225565 --- ParallelTerminationStrategy: PID 1394 died... 17:24:58.244387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1394): Terminated: ok {rc=0} 17:24:58.288717 --- ParallelTerminationStrategy: PID 1397 died... 17:24:58.307249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1397): Terminated: ok {rc=0} 17:24:58.351900 --- ParallelTerminationStrategy: PID 1400 died... 17:24:58.370345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1400): Terminated: ok {rc=0} 17:24:58.456184 bus /sierra_3: Setting Powered False 17:24:59.555513 bus /sierra_3: Setting Powered False 17:25:00.670641 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 17:25:01.979791 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:25:01.984935 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 17:25:02.044548 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:25:02.073132 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:25:02.128771 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 17:25:02.185530 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:25:02.213285 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:25:02.763710 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 17:25:02.770414 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:25:02.782519 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:25:02.822643 tst handover.py: using LAC 30373 17:25:02.953016 tst handover.py: using RAC 28 17:25:03.081480 tst handover.py: using CellId 30373 17:25:03.209767 tst handover.py: using BVCI 30374 17:25:03.330148 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:25:03.379631 tst handover.py: using LAC 30374 17:25:03.506781 tst handover.py: using RAC 29 17:25:03.634744 tst handover.py: using CellId 30374 17:25:03.762300 tst handover.py: using BVCI 30375 17:25:03.884534 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:25:03.896291 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:25:03.907623 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:25:03.919120 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:25:03.930507 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:25:03.941942 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:25:04.058620 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:25:04.174281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:04.626147 run create_hlr_db(pid=1409): Launched 17:25:04.744434 bus /sierra_2: Setting Powered False 17:25:05.805548 run create_hlr_db(pid=1409): Terminated: ok {rc=0} 17:25:06.229465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1411): Launched 17:25:06.561422 run osmo-hlr_10.42.42.2(pid=1412): Launched 17:25:06.688732 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:07.230179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1414): Launched 17:25:07.562362 run osmo-stp_10.42.42.5(pid=1415): Launched 17:25:07.690754 run osmo-msc_10.42.42.6: Starting osmo-msc 17:25:08.260895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1417): Launched 17:25:08.592804 run osmo-msc_10.42.42.6(pid=1418): Launched 17:25:08.778779 run osmo-stp_10.42.42.5(pid=1415): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1415)] 17:25:08.917249 run osmo-stp_10.42.42.5(pid=1415): stdout: | (launched: 2022-12-12_17:25:07.500884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:09.056150 run osmo-stp_10.42.42.5(pid=1415): stderr: | 20221212172507695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172507695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172507696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172507696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172507696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172507696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172507697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:09.194313 run osmo-stp_10.42.42.5(pid=1415): stdout: | (launched: 2022-12-12_17:25:07.500884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:09.325715 run osmo-stp_10.42.42.5(pid=1415): stderr: | 20221212172507695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172507695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172507696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172507696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172507696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172507696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172507697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:09.482461 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1415): Process ended prematurely: osmo-stp_10.42.42.5(pid=1415) [trial-2379↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1415)] [trial-2379↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 17:25:09.491476 tst handover.py:18: Test FAILED (6.7 sec) 17:25:09.518977 run osmo-hlr_10.42.42.2(pid=1412): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1412)] 17:25:09.569105 run osmo-hlr_10.42.42.2(pid=1412): stdout: | (launched: 2022-12-12_17:25:06.500271) 17:25:09.620787 run osmo-hlr_10.42.42.2(pid=1412): stderr: | 20221212172506700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172506700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172506700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172506700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172506700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172506700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172506717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172506727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172506727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172506727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:09.693109 run osmo-msc_10.42.42.6(pid=1418): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1418)] 17:25:09.743161 run osmo-msc_10.42.42.6(pid=1418): stdout: | (launched: 2022-12-12_17:25:08.531762) 17:25:09.794734 run osmo-msc_10.42.42.6(pid=1418): stderr: | 20221212172508856 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172508856 DLGLOBAL DEBUG validating counter group 0x7f8783788c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172508856 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172508857 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172508857 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172508857 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172508859 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172508859 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172508859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172508859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:25:09.846887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1411): Terminating (SIGTERM) 17:25:09.888548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1414): Terminating (SIGTERM) 17:25:09.930818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1417): Terminating (SIGTERM) 17:25:09.973427 --- ParallelTerminationStrategy: PID 1411 died... 17:25:09.993562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1411): Terminated: ok {rc=0} 17:25:10.040090 --- ParallelTerminationStrategy: PID 1414 died... 17:25:10.059646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1414): Terminated: ok {rc=0} 17:25:10.106636 --- ParallelTerminationStrategy: PID 1417 died... 17:25:10.126290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1417): Terminated: ok {rc=0} 17:25:10.214187 bus /sierra_3: Setting Powered False 17:25:11.313152 bus /sierra_3: Setting Powered False 17:25:12.431523 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 17:25:13.702161 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:25:13.707814 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:25:13.750094 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:25:13.777576 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:25:13.831278 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:25:13.874021 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:25:13.901372 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:25:14.452937 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 17:25:14.458353 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:25:14.469676 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 17:25:14.508056 tst handover.py: using LAC 30375 17:25:14.639523 tst handover.py: using RAC 30 17:25:14.770534 tst handover.py: using CellId 30375 17:25:14.901975 tst handover.py: using BVCI 30376 17:25:15.023341 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 17:25:15.059032 tst handover.py: using LAC 30376 17:25:15.191814 tst handover.py: using RAC 31 17:25:15.323228 tst handover.py: using CellId 30376 17:25:15.454529 tst handover.py: using BVCI 30377 17:25:15.574955 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:25:15.586404 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:25:15.597600 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:25:15.609321 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:25:15.621146 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:25:15.632835 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 17:25:15.750908 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 17:25:15.894676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:16.391572 run create_hlr_db(pid=1423): Launched 17:25:16.551756 bus /sierra_2: Setting Powered False 17:25:17.612609 run create_hlr_db(pid=1423): Terminated: ok {rc=0} 17:25:18.018163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1425): Launched 17:25:18.328366 run osmo-hlr_10.42.42.2(pid=1426): Launched 17:25:18.446874 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:18.952292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1428): Launched 17:25:19.262290 run osmo-stp_10.42.42.5(pid=1429): Launched 17:25:19.383999 run osmo-msc_10.42.42.6: Starting osmo-msc 17:25:19.917073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1431): Launched 17:25:20.227867 run osmo-msc_10.42.42.6(pid=1432): Launched 17:25:20.402487 run osmo-stp_10.42.42.5(pid=1429): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1429)] 17:25:20.533347 run osmo-stp_10.42.42.5(pid=1429): stdout: | (launched: 2022-12-12_17:25:19.204577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:20.663854 run osmo-stp_10.42.42.5(pid=1429): stderr: | 20221212172519374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172519374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172519375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172519375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172519375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172519376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172519376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:20.792779 run osmo-stp_10.42.42.5(pid=1429): stdout: | (launched: 2022-12-12_17:25:19.204577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:20.916182 run osmo-stp_10.42.42.5(pid=1429): stderr: | 20221212172519374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172519374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172519375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172519375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172519375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172519376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172519376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:21.063273 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1429): Process ended prematurely: osmo-stp_10.42.42.5(pid=1429) [trial-2379↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1429)] [trial-2379↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 17:25:21.071703 tst handover.py:18: Test FAILED (6.6 sec) 17:25:21.098492 run osmo-hlr_10.42.42.2(pid=1426): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1426)] 17:25:21.146896 run osmo-hlr_10.42.42.2(pid=1426): stdout: | (launched: 2022-12-12_17:25:18.270929) 17:25:21.196674 run osmo-hlr_10.42.42.2(pid=1426): stderr: | 20221212172518448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172518448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172518448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172518448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172518448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172518448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172518460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172518468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172518469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172518469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:21.266533 run osmo-msc_10.42.42.6(pid=1432): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1432)] 17:25:21.314676 run osmo-msc_10.42.42.6(pid=1432): stdout: | (launched: 2022-12-12_17:25:20.170125) 17:25:21.364582 run osmo-msc_10.42.42.6(pid=1432): stderr: | 20221212172520442 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172520442 DLGLOBAL DEBUG validating counter group 0x7fd14d809c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172520442 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172520442 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172520442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172520442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172520444 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172520444 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172520445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172520445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:25:21.414786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1425): Terminating (SIGTERM) 17:25:21.454955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1428): Terminating (SIGTERM) 17:25:21.495075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1431): Terminating (SIGTERM) 17:25:21.535759 --- ParallelTerminationStrategy: PID 1425 died... 17:25:21.554959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1425): Terminated: ok {rc=0} 17:25:21.599611 --- ParallelTerminationStrategy: PID 1428 died... 17:25:21.618322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1428): Terminated: ok {rc=0} 17:25:21.662656 --- ParallelTerminationStrategy: PID 1431 died... 17:25:21.681636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1431): Terminated: ok {rc=0} 17:25:21.766200 bus /sierra_3: Setting Powered False 17:25:22.863320 bus /sierra_3: Setting Powered False 17:25:23.982041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 17:25:25.228081 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:25:25.233735 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:25:25.287150 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:25:25.313336 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:25:25.366998 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:25:25.420117 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:25:25.446073 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:25:25.997692 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 17:25:26.004862 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:25:26.016811 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:25:26.061541 tst handover.py: using LAC 30377 17:25:26.192000 tst handover.py: using RAC 32 17:25:26.322942 tst handover.py: using CellId 30377 17:25:26.452517 tst handover.py: using BVCI 30378 17:25:26.573153 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:25:26.624689 tst handover.py: using LAC 30378 17:25:26.754023 tst handover.py: using RAC 33 17:25:26.883348 tst handover.py: using CellId 30378 17:25:27.011507 tst handover.py: using BVCI 30379 17:25:27.131982 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:25:27.143288 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:25:27.154444 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:25:27.165641 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:25:27.176858 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:25:27.188105 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:25:27.305262 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:25:27.421118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:27.877659 run create_hlr_db(pid=1437): Launched 17:25:28.010376 bus /sierra_2: Setting Powered False 17:25:29.075704 run create_hlr_db(pid=1437): Terminated: ok {rc=0} 17:25:29.507449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1439): Launched 17:25:29.840756 run osmo-hlr_10.42.42.2(pid=1440): Launched 17:25:29.968878 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:30.510747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1442): Launched 17:25:30.865693 run osmo-stp_10.42.42.5(pid=1443): Launched 17:25:31.060472 run osmo-msc_10.42.42.6: Starting osmo-msc 17:25:31.647145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1445): Launched 17:25:31.993049 run osmo-msc_10.42.42.6(pid=1446): Launched 17:25:32.318534 run osmo-stp_10.42.42.5(pid=1443): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1443)] 17:25:32.452306 run osmo-stp_10.42.42.5(pid=1443): stdout: | (launched: 2022-12-12_17:25:30.781257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:32.584107 run osmo-stp_10.42.42.5(pid=1443): stderr: | 20221212172531132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172531133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172531133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172531133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172531134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172531134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172531134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:32.714153 run osmo-stp_10.42.42.5(pid=1443): stdout: | (launched: 2022-12-12_17:25:30.781257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:32.837581 run osmo-stp_10.42.42.5(pid=1443): stderr: | 20221212172531132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172531133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172531133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172531133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172531134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172531134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172531134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:32.984795 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1443): Process ended prematurely: osmo-stp_10.42.42.5(pid=1443) [trial-2379↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1443)] [trial-2379↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 17:25:32.993387 tst handover.py:18: Test FAILED (7.0 sec) 17:25:33.020130 run osmo-hlr_10.42.42.2(pid=1440): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1440)] 17:25:33.069290 run osmo-hlr_10.42.42.2(pid=1440): stdout: | (launched: 2022-12-12_17:25:29.779727) 17:25:33.119556 run osmo-hlr_10.42.42.2(pid=1440): stderr: | 20221212172529977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172529977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172529977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172529977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172529977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172529977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172529992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172530001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172530002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172530002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:33.189914 run osmo-msc_10.42.42.6(pid=1446): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1446)] 17:25:33.238262 run osmo-msc_10.42.42.6(pid=1446): stdout: | (launched: 2022-12-12_17:25:31.931449) 17:25:33.288284 run osmo-msc_10.42.42.6(pid=1446): stderr: | 20221212172532350 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172532350 DLGLOBAL DEBUG validating counter group 0x7fe43ac58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172532350 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172532351 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172532351 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172532351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172532353 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172532353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172532353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172532353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:25:33.339040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1439): Terminating (SIGTERM) 17:25:33.379470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1442): Terminating (SIGTERM) 17:25:33.419964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1445): Terminating (SIGTERM) 17:25:33.460619 --- ParallelTerminationStrategy: PID 1439 died... 17:25:33.480020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1439): Terminated: ok {rc=0} 17:25:33.525468 --- ParallelTerminationStrategy: PID 1442 died... 17:25:33.544035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1442): Terminated: ok {rc=0} 17:25:33.589041 --- ParallelTerminationStrategy: PID 1445 died... 17:25:33.607673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1445): Terminated: ok {rc=0} 17:25:33.695820 bus /sierra_3: Setting Powered False 17:25:34.795459 bus /sierra_3: Setting Powered False 17:25:35.910769 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 17:25:37.173188 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:25:37.179192 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:25:37.233351 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:25:37.260709 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:25:37.314513 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:25:37.369064 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:25:37.396099 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:25:37.947171 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 17:25:37.952605 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:25:37.963900 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:25:38.002303 tst handover.py: using LAC 30379 17:25:38.131128 tst handover.py: using RAC 34 17:25:38.257463 tst handover.py: using CellId 30379 17:25:38.380078 tst handover.py: using BVCI 30380 17:25:38.501831 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:25:38.549494 tst handover.py: using LAC 30380 17:25:38.670757 tst handover.py: using RAC 35 17:25:38.796503 tst handover.py: using CellId 30380 17:25:38.918674 tst handover.py: using BVCI 30381 17:25:39.041110 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:25:39.052446 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:25:39.063640 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:25:39.074924 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:25:39.086687 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:25:39.097905 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:25:39.219792 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:25:39.335184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:39.789527 run create_hlr_db(pid=1453): Launched 17:25:39.908600 bus /sierra_2: Setting Powered False 17:25:40.970211 run create_hlr_db(pid=1453): Terminated: ok {rc=0} 17:25:41.375433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1455): Launched 17:25:41.686636 run osmo-hlr_10.42.42.2(pid=1456): Launched 17:25:41.805226 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:42.384038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1458): Launched 17:25:42.716532 run osmo-stp_10.42.42.5(pid=1459): Launched 17:25:42.844633 run osmo-msc_10.42.42.6: Starting osmo-msc 17:25:43.415705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1461): Launched 17:25:43.748198 run osmo-msc_10.42.42.6(pid=1462): Launched 17:25:43.934653 run osmo-stp_10.42.42.5(pid=1459): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1459)] 17:25:44.074441 run osmo-stp_10.42.42.5(pid=1459): stdout: | (launched: 2022-12-12_17:25:42.655545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:44.215891 run osmo-stp_10.42.42.5(pid=1459): stderr: | 20221212172542850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172542851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172542851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172542851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172542852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172542852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172542852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:44.354198 run osmo-stp_10.42.42.5(pid=1459): stdout: | (launched: 2022-12-12_17:25:42.655545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:44.486101 run osmo-stp_10.42.42.5(pid=1459): stderr: | 20221212172542850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172542851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172542851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172542851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172542852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172542852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172542852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:44.643784 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1459): Process ended prematurely: osmo-stp_10.42.42.5(pid=1459) [trial-2379↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1459)] [trial-2379↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 17:25:44.652667 tst handover.py:18: Test FAILED (6.7 sec) 17:25:44.680029 run osmo-hlr_10.42.42.2(pid=1456): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1456)] 17:25:44.730255 run osmo-hlr_10.42.42.2(pid=1456): stdout: | (launched: 2022-12-12_17:25:41.629341) 17:25:44.782346 run osmo-hlr_10.42.42.2(pid=1456): stderr: | 20221212172541807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172541807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172541807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172541807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172541807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172541807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172541819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172541830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172541831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172541831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:44.855131 run osmo-msc_10.42.42.6(pid=1462): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1462)] 17:25:44.905659 run osmo-msc_10.42.42.6(pid=1462): stdout: | (launched: 2022-12-12_17:25:43.686499) 17:25:44.958909 run osmo-msc_10.42.42.6(pid=1462): stderr: | 20221212172544010 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172544010 DLGLOBAL DEBUG validating counter group 0x7ff2814a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172544010 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172544010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172544010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172544010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172544012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172544013 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172544013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172544013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:25:45.011109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1455): Terminating (SIGTERM) 17:25:45.053168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1458): Terminating (SIGTERM) 17:25:45.095395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1461): Terminating (SIGTERM) 17:25:45.137701 --- ParallelTerminationStrategy: PID 1455 died... 17:25:45.157844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1455): Terminated: ok {rc=0} 17:25:45.203999 --- ParallelTerminationStrategy: PID 1458 died... 17:25:45.223535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1458): Terminated: ok {rc=0} 17:25:45.269668 --- ParallelTerminationStrategy: PID 1461 died... 17:25:45.289213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1461): Terminated: ok {rc=0} 17:25:45.377282 bus /sierra_3: Setting Powered False 17:25:46.487494 bus /sierra_3: Setting Powered False 17:25:47.617525 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 17:25:48.872762 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:25:48.878008 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 17:25:48.915588 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 17:25:48.942177 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 17:25:48.994503 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 17:25:49.031268 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 17:25:49.057807 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 17:25:49.605791 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 17:25:49.610863 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:25:49.621607 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 17:25:49.657229 tst handover.py: using LAC 30381 17:25:49.778563 tst handover.py: using RAC 36 17:25:49.901263 tst handover.py: using CellId 30381 17:25:50.026672 tst handover.py: using BVCI 30382 17:25:50.139711 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 17:25:50.173454 tst handover.py: using LAC 30382 17:25:50.303410 tst handover.py: using RAC 37 17:25:50.431793 tst handover.py: using CellId 30382 17:25:50.557548 tst handover.py: using BVCI 30383 17:25:50.671142 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:25:50.681931 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:25:50.692409 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:25:50.703400 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:25:50.714322 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 17:25:50.725355 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 17:25:50.845408 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 17:25:50.969525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:51.456480 run create_hlr_db(pid=1467): Launched 17:25:51.594222 bus /sierra_2: Setting Powered False 17:25:52.659056 run create_hlr_db(pid=1467): Terminated: ok {rc=0} 17:25:53.074690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1469): Launched 17:25:53.385935 run osmo-hlr_10.42.42.2(pid=1470): Launched 17:25:53.504466 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:54.027048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1472): Launched 17:25:54.338493 run osmo-stp_10.42.42.5(pid=1473): Launched 17:25:54.458053 run osmo-msc_10.42.42.6: Starting osmo-msc 17:25:54.993258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1475): Launched 17:25:55.305575 run osmo-msc_10.42.42.6(pid=1476): Launched 17:25:55.479503 run osmo-stp_10.42.42.5(pid=1473): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1473)] 17:25:55.611631 run osmo-stp_10.42.42.5(pid=1473): stdout: | (launched: 2022-12-12_17:25:54.280687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:55.742781 run osmo-stp_10.42.42.5(pid=1473): stderr: | 20221212172554451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172554451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172554451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172554452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172554452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172554452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172554452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:55.871588 run osmo-stp_10.42.42.5(pid=1473): stdout: | (launched: 2022-12-12_17:25:54.280687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:55.994648 run osmo-stp_10.42.42.5(pid=1473): stderr: | 20221212172554451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172554451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172554451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172554452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172554452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172554452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172554452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:56.142244 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1473): Process ended prematurely: osmo-stp_10.42.42.5(pid=1473) [trial-2379↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1473)] [trial-2379↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 17:25:56.150609 tst handover.py:18: Test FAILED (6.5 sec) 17:25:56.177193 run osmo-hlr_10.42.42.2(pid=1470): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1470)] 17:25:56.225362 run osmo-hlr_10.42.42.2(pid=1470): stdout: | (launched: 2022-12-12_17:25:53.328189) 17:25:56.275340 run osmo-hlr_10.42.42.2(pid=1470): stderr: | 20221212172553506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172553506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172553506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172553506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172553506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172553506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172553518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172553529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172553529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172553529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:56.345224 run osmo-msc_10.42.42.6(pid=1476): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1476)] 17:25:56.393179 run osmo-msc_10.42.42.6(pid=1476): stdout: | (launched: 2022-12-12_17:25:55.247702) 17:25:56.442484 run osmo-msc_10.42.42.6(pid=1476): stderr: | 20221212172555519 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172555520 DLGLOBAL DEBUG validating counter group 0x7f2c64adbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172555520 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172555520 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172555520 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172555520 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172555522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172555522 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172555523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172555523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:25:56.492155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1469): Terminating (SIGTERM) 17:25:56.532156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1472): Terminating (SIGTERM) 17:25:56.572215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1475): Terminating (SIGTERM) 17:25:56.612424 --- ParallelTerminationStrategy: PID 1469 died... 17:25:56.631692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1469): Terminated: ok {rc=0} 17:25:56.676406 --- ParallelTerminationStrategy: PID 1472 died... 17:25:56.695035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1472): Terminated: ok {rc=0} 17:25:56.739177 --- ParallelTerminationStrategy: PID 1475 died... 17:25:56.757798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1475): Terminated: ok {rc=0} 17:25:56.841326 bus /sierra_3: Setting Powered False 17:25:57.941097 bus /sierra_3: Setting Powered False 17:25:59.058882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 17:26:00.297527 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:26:00.302738 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 17:26:00.353124 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 17:26:00.379220 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 17:26:00.430918 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 17:26:00.480404 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 17:26:00.506468 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 17:26:01.070710 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 17:26:01.076733 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:26:01.088104 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 17:26:01.124921 tst handover.py: using LAC 30383 17:26:01.252931 tst handover.py: using RAC 38 17:26:01.389424 tst handover.py: using CellId 30383 17:26:01.547112 tst handover.py: using BVCI 30384 17:26:01.700910 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 17:26:01.756497 tst handover.py: using LAC 30384 17:26:01.918844 tst handover.py: using RAC 39 17:26:02.094211 tst handover.py: using CellId 30384 17:26:02.265349 tst handover.py: using BVCI 30385 17:26:02.390490 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:26:02.402450 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:26:02.414213 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:26:02.426747 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:26:02.438781 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:26:02.450697 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 17:26:02.573119 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 17:26:02.694199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:03.150681 run create_hlr_db(pid=1481): Launched 17:26:03.272174 bus /sierra_2: Setting Powered False 17:26:04.334442 run create_hlr_db(pid=1481): Terminated: ok {rc=0} 17:26:04.759732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1483): Launched 17:26:05.094586 run osmo-hlr_10.42.42.2(pid=1484): Launched 17:26:05.224001 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:05.774692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1486): Launched 17:26:06.108847 run osmo-stp_10.42.42.5(pid=1487): Launched 17:26:06.236197 run osmo-msc_10.42.42.6: Starting osmo-msc 17:26:06.807732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1489): Launched 17:26:07.133958 run osmo-msc_10.42.42.6(pid=1490): Launched 17:26:07.310582 run osmo-stp_10.42.42.5(pid=1487): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1487)] 17:26:07.443458 run osmo-stp_10.42.42.5(pid=1487): stdout: | (launched: 2022-12-12_17:26:06.047091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:07.574920 run osmo-stp_10.42.42.5(pid=1487): stderr: | 20221212172606241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172606241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172606241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172606242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172606242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172606242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172606242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:07.704590 run osmo-stp_10.42.42.5(pid=1487): stdout: | (launched: 2022-12-12_17:26:06.047091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:07.827718 run osmo-stp_10.42.42.5(pid=1487): stderr: | 20221212172606241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172606241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172606241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172606242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172606242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172606242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172606242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:07.974411 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1487): Process ended prematurely: osmo-stp_10.42.42.5(pid=1487) [trial-2379↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1487)] [trial-2379↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 17:26:07.983024 tst handover.py:18: Test FAILED (6.9 sec) 17:26:08.009730 run osmo-hlr_10.42.42.2(pid=1484): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1484)] 17:26:08.057652 run osmo-hlr_10.42.42.2(pid=1484): stdout: | (launched: 2022-12-12_17:26:05.033374) 17:26:08.107161 run osmo-hlr_10.42.42.2(pid=1484): stderr: | 20221212172605234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172605234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172605234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172605234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172605234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172605234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172605246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172605255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172605256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172605256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:08.176212 run osmo-msc_10.42.42.6(pid=1490): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1490)] 17:26:08.223971 run osmo-msc_10.42.42.6(pid=1490): stdout: | (launched: 2022-12-12_17:26:07.076213) 17:26:08.273205 run osmo-msc_10.42.42.6(pid=1490): stderr: | 20221212172607347 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172607347 DLGLOBAL DEBUG validating counter group 0x7fe94980ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172607347 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172607347 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172607348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172607348 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172607350 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172607350 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172607350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172607350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:26:08.322672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1483): Terminating (SIGTERM) 17:26:08.362685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1486): Terminating (SIGTERM) 17:26:08.402777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1489): Terminating (SIGTERM) 17:26:08.443026 --- ParallelTerminationStrategy: PID 1483 died... 17:26:08.462297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1483): Terminated: ok {rc=0} 17:26:08.507222 --- ParallelTerminationStrategy: PID 1486 died... 17:26:08.525707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1486): Terminated: ok {rc=0} 17:26:08.570733 --- ParallelTerminationStrategy: PID 1489 died... 17:26:08.589380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1489): Terminated: ok {rc=0} 17:26:08.674025 bus /sierra_3: Setting Powered False 17:26:09.772105 bus /sierra_3: Setting Powered False 17:26:10.891655 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 17:26:12.144618 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:26:12.149941 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 17:26:12.196588 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 17:26:12.222965 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 17:26:12.274925 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 17:26:12.321300 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 17:26:12.347471 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 17:26:12.905163 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 17:26:12.911562 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:26:12.923592 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:26:12.961460 tst handover.py: using LAC 30385 17:26:13.091620 tst handover.py: using RAC 40 17:26:13.224109 tst handover.py: using CellId 30385 17:26:13.354397 tst handover.py: using BVCI 30386 17:26:13.476779 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:26:13.523550 tst handover.py: using LAC 30386 17:26:13.655355 tst handover.py: using RAC 41 17:26:13.787453 tst handover.py: using CellId 30386 17:26:13.920055 tst handover.py: using BVCI 30387 17:26:14.042096 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:26:14.053598 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:26:14.064840 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:26:14.076681 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:26:14.088580 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:26:14.100811 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:26:14.219379 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:26:14.340566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:14.827703 run create_hlr_db(pid=1495): Launched 17:26:14.963325 bus /sierra_2: Setting Powered False 17:26:16.027588 run create_hlr_db(pid=1495): Terminated: ok {rc=0} 17:26:16.473600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1497): Launched 17:26:16.816606 run osmo-hlr_10.42.42.2(pid=1498): Launched 17:26:16.968912 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:17.593230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1500): Launched 17:26:17.928711 run osmo-stp_10.42.42.5(pid=1501): Launched 17:26:18.057180 run osmo-msc_10.42.42.6: Starting osmo-msc 17:26:18.635518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1503): Launched 17:26:18.968085 run osmo-msc_10.42.42.6(pid=1504): Launched 17:26:19.152393 run osmo-stp_10.42.42.5(pid=1501): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1501)] 17:26:19.291500 run osmo-stp_10.42.42.5(pid=1501): stdout: | (launched: 2022-12-12_17:26:17.866023) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:19.431422 run osmo-stp_10.42.42.5(pid=1501): stderr: | 20221212172618063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172618063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172618064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172618064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172618064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172618065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172618065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:19.570057 run osmo-stp_10.42.42.5(pid=1501): stdout: | (launched: 2022-12-12_17:26:17.866023) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:19.701725 run osmo-stp_10.42.42.5(pid=1501): stderr: | 20221212172618063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172618063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172618064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172618064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172618064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172618065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172618065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:19.859250 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1501): Process ended prematurely: osmo-stp_10.42.42.5(pid=1501) [trial-2379↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1501)] [trial-2379↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 17:26:19.868177 tst handover.py:18: Test FAILED (7.0 sec) 17:26:19.895595 run osmo-hlr_10.42.42.2(pid=1498): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1498)] 17:26:19.945436 run osmo-hlr_10.42.42.2(pid=1498): stdout: | (launched: 2022-12-12_17:26:16.754574) 17:26:19.997288 run osmo-hlr_10.42.42.2(pid=1498): stderr: | 20221212172617088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172617088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172617088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172617088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172617088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172617088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172617103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172617115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172617115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172617116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:20.069492 run osmo-msc_10.42.42.6(pid=1504): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1504)] 17:26:20.119934 run osmo-msc_10.42.42.6(pid=1504): stdout: | (launched: 2022-12-12_17:26:18.906894) 17:26:20.171666 run osmo-msc_10.42.42.6(pid=1504): stderr: | 20221212172619230 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172619230 DLGLOBAL DEBUG validating counter group 0x7fae5d10ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172619230 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172619230 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172619231 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172619231 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172619232 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172619233 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172619233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172619233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:26:20.223739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1497): Terminating (SIGTERM) 17:26:20.265379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1500): Terminating (SIGTERM) 17:26:20.306913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1503): Terminating (SIGTERM) 17:26:20.348721 --- ParallelTerminationStrategy: PID 1497 died... 17:26:20.368658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1497): Terminated: ok {rc=0} 17:26:20.414449 --- ParallelTerminationStrategy: PID 1500 died... 17:26:20.433828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1500): Terminated: ok {rc=0} 17:26:20.480014 --- ParallelTerminationStrategy: PID 1503 died... 17:26:20.499494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1503): Terminated: ok {rc=0} 17:26:20.586581 bus /sierra_3: Setting Powered False 17:26:21.685510 bus /sierra_3: Setting Powered False 17:26:22.801121 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 17:26:24.062917 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:26:24.068527 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 17:26:24.121175 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:26:24.148381 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:26:24.199806 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 17:26:24.251429 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:26:24.278421 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:26:24.836714 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 17:26:24.843230 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:26:24.855764 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:26:24.894478 tst handover.py: using LAC 30387 17:26:25.023312 tst handover.py: using RAC 42 17:26:25.152201 tst handover.py: using CellId 30387 17:26:25.279950 tst handover.py: using BVCI 30388 17:26:25.402025 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:26:25.451009 tst handover.py: using LAC 30388 17:26:25.580935 tst handover.py: using RAC 43 17:26:25.709127 tst handover.py: using CellId 30388 17:26:25.837139 tst handover.py: using BVCI 30389 17:26:25.957496 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:26:25.968836 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:26:25.980097 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:26:25.991460 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:26:26.002849 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:26:26.014062 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:26:26.133107 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:26:26.254769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:26.740812 run create_hlr_db(pid=1509): Launched 17:26:26.875807 bus /sierra_2: Setting Powered False 17:26:27.941025 run create_hlr_db(pid=1509): Terminated: ok {rc=0} 17:26:28.373720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1511): Launched 17:26:28.706260 run osmo-hlr_10.42.42.2(pid=1512): Launched 17:26:28.834530 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:29.375826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1514): Launched 17:26:29.708390 run osmo-stp_10.42.42.5(pid=1515): Launched 17:26:29.836902 run osmo-msc_10.42.42.6: Starting osmo-msc 17:26:30.406864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1517): Launched 17:26:30.739766 run osmo-msc_10.42.42.6(pid=1518): Launched 17:26:30.941379 run osmo-stp_10.42.42.5(pid=1515): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1515)] 17:26:31.102272 run osmo-stp_10.42.42.5(pid=1515): stdout: | (launched: 2022-12-12_17:26:29.647352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:31.408754 run osmo-stp_10.42.42.5(pid=1515): stderr: | 20221212172629840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172629840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172629841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172629841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172629841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172629842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172629842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:31.574442 run osmo-stp_10.42.42.5(pid=1515): stdout: | (launched: 2022-12-12_17:26:29.647352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:31.708382 run osmo-stp_10.42.42.5(pid=1515): stderr: | 20221212172629840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172629840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172629841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172629841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172629841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172629842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172629842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:31.868788 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1515): Process ended prematurely: osmo-stp_10.42.42.5(pid=1515) [trial-2379↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1515)] [trial-2379↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 17:26:31.878385 tst handover.py:18: Test FAILED (7.0 sec) 17:26:31.907631 run osmo-hlr_10.42.42.2(pid=1512): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1512)] 17:26:31.959140 run osmo-hlr_10.42.42.2(pid=1512): stdout: | (launched: 2022-12-12_17:26:28.645020) 17:26:32.012285 run osmo-hlr_10.42.42.2(pid=1512): stderr: | 20221212172628846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172628846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172628846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172628846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172628846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172628846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172628858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172628869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172628869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172628869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:32.086067 run osmo-msc_10.42.42.6(pid=1518): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1518)] 17:26:32.138030 run osmo-msc_10.42.42.6(pid=1518): stdout: | (launched: 2022-12-12_17:26:30.678552) 17:26:32.191290 run osmo-msc_10.42.42.6(pid=1518): stderr: | 20221212172631207 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172631207 DLGLOBAL DEBUG validating counter group 0x7fca46a8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172631207 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172631207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172631207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172631208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172631209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172631210 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172631210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172631210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:26:32.245153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1511): Terminating (SIGTERM) 17:26:32.288119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1514): Terminating (SIGTERM) 17:26:32.331589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1517): Terminating (SIGTERM) 17:26:32.376285 --- ParallelTerminationStrategy: PID 1511 died... 17:26:32.396449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1511): Terminated: ok {rc=0} 17:26:32.443582 --- ParallelTerminationStrategy: PID 1514 died... 17:26:32.463150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1514): Terminated: ok {rc=0} 17:26:32.510474 --- ParallelTerminationStrategy: PID 1517 died... 17:26:32.529905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1517): Terminated: ok {rc=0} 17:26:32.619047 bus /sierra_3: Setting Powered False 17:26:33.717771 bus /sierra_3: Setting Powered False 17:26:34.834687 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 17:26:36.100194 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:26:36.105880 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:26:36.149060 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:26:36.175464 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:26:36.227655 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:26:36.268010 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:26:36.295814 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:26:36.845595 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 17:26:36.851216 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:26:36.862666 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 17:26:36.898752 tst handover.py: using LAC 30389 17:26:37.019847 tst handover.py: using RAC 44 17:26:37.140851 tst handover.py: using CellId 30389 17:26:37.259885 tst handover.py: using BVCI 30390 17:26:37.372012 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 17:26:37.406229 tst handover.py: using LAC 30390 17:26:37.534671 tst handover.py: using RAC 45 17:26:37.662218 tst handover.py: using CellId 30390 17:26:37.790203 tst handover.py: using BVCI 30391 17:26:37.911934 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:26:37.923185 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:26:37.934304 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:26:37.945337 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:26:37.956343 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:26:37.967613 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 17:26:38.088356 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 17:26:38.205840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:38.690483 run create_hlr_db(pid=1523): Launched 17:26:38.827000 bus /sierra_2: Setting Powered False 17:26:39.892114 run create_hlr_db(pid=1523): Terminated: ok {rc=0} 17:26:40.323495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1525): Launched 17:26:40.655676 run osmo-hlr_10.42.42.2(pid=1526): Launched 17:26:40.782326 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:41.326340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1528): Launched 17:26:41.659437 run osmo-stp_10.42.42.5(pid=1529): Launched 17:26:41.785945 run osmo-msc_10.42.42.6: Starting osmo-msc 17:26:42.355654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1531): Launched 17:26:42.687687 run osmo-msc_10.42.42.6(pid=1532): Launched 17:26:42.872301 run osmo-stp_10.42.42.5(pid=1529): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1529)] 17:26:43.010964 run osmo-stp_10.42.42.5(pid=1529): stdout: | (launched: 2022-12-12_17:26:41.597676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:43.151201 run osmo-stp_10.42.42.5(pid=1529): stderr: | 20221212172641794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172641794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172641794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172641795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172641795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172641795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172641795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:43.289441 run osmo-stp_10.42.42.5(pid=1529): stdout: | (launched: 2022-12-12_17:26:41.597676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:43.420450 run osmo-stp_10.42.42.5(pid=1529): stderr: | 20221212172641794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172641794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172641794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172641795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172641795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172641795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172641795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:43.578350 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1529): Process ended prematurely: osmo-stp_10.42.42.5(pid=1529) [trial-2379↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1529)] [trial-2379↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 17:26:43.587318 tst handover.py:18: Test FAILED (6.7 sec) 17:26:43.614897 run osmo-hlr_10.42.42.2(pid=1526): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1526)] 17:26:43.664554 run osmo-hlr_10.42.42.2(pid=1526): stdout: | (launched: 2022-12-12_17:26:40.594057) 17:26:43.716287 run osmo-hlr_10.42.42.2(pid=1526): stderr: | 20221212172640795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172640795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172640795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172640795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172640795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172640795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172640808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172640816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172640816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172640816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:43.788017 run osmo-msc_10.42.42.6(pid=1532): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1532)] 17:26:43.837381 run osmo-msc_10.42.42.6(pid=1532): stdout: | (launched: 2022-12-12_17:26:42.625751) 17:26:43.888721 run osmo-msc_10.42.42.6(pid=1532): stderr: | 20221212172642949 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172642950 DLGLOBAL DEBUG validating counter group 0x7fb66794ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172642950 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172642950 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172642950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172642950 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172642952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172642952 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172642952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172642952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:26:43.940502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1525): Terminating (SIGTERM) 17:26:43.981862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1528): Terminating (SIGTERM) 17:26:44.023207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1531): Terminating (SIGTERM) 17:26:44.065054 --- ParallelTerminationStrategy: PID 1525 died... 17:26:44.085177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1525): Terminated: ok {rc=0} 17:26:44.131708 --- ParallelTerminationStrategy: PID 1528 died... 17:26:44.151062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1528): Terminated: ok {rc=0} 17:26:44.197210 --- ParallelTerminationStrategy: PID 1531 died... 17:26:44.216501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1531): Terminated: ok {rc=0} 17:26:44.303586 bus /sierra_3: Setting Powered False 17:26:45.402826 bus /sierra_3: Setting Powered False 17:26:46.519746 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 17:26:47.766316 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:26:47.771592 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:26:47.822181 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:26:47.848267 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:26:47.901102 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:26:47.951964 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:26:47.978364 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:26:48.529321 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 17:26:48.534682 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:26:48.545536 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:26:48.582682 tst handover.py: using LAC 30391 17:26:48.706176 tst handover.py: using RAC 46 17:26:48.826864 tst handover.py: using CellId 30391 17:26:48.954786 tst handover.py: using BVCI 30392 17:26:49.068828 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:26:49.125313 tst handover.py: using LAC 30392 17:26:49.246841 tst handover.py: using RAC 47 17:26:49.367965 tst handover.py: using CellId 30392 17:26:49.488114 tst handover.py: using BVCI 30393 17:26:49.600312 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:26:49.611130 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:26:49.621824 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:26:49.633022 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:26:49.643951 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:26:49.654997 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:26:49.773539 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:26:49.893686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:50.381265 run create_hlr_db(pid=1537): Launched 17:26:50.516456 bus /sierra_2: Setting Powered False 17:26:51.582145 run create_hlr_db(pid=1537): Terminated: ok {rc=0} 17:26:51.998074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1539): Launched 17:26:52.308369 run osmo-hlr_10.42.42.2(pid=1540): Launched 17:26:52.427777 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:52.938737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1542): Launched 17:26:53.250492 run osmo-stp_10.42.42.5(pid=1543): Launched 17:26:53.369883 run osmo-msc_10.42.42.6: Starting osmo-msc 17:26:53.902282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1545): Launched 17:26:54.237022 run osmo-msc_10.42.42.6(pid=1546): Launched 17:26:54.421622 run osmo-stp_10.42.42.5(pid=1543): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1543)] 17:26:54.562218 run osmo-stp_10.42.42.5(pid=1543): stdout: | (launched: 2022-12-12_17:26:53.193251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:54.704128 run osmo-stp_10.42.42.5(pid=1543): stderr: | 20221212172653363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172653363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172653363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172653363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172653364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172653364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172653364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:54.842825 run osmo-stp_10.42.42.5(pid=1543): stdout: | (launched: 2022-12-12_17:26:53.193251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:54.974213 run osmo-stp_10.42.42.5(pid=1543): stderr: | 20221212172653363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172653363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172653363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172653363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172653364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172653364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172653364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:55.132190 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1543): Process ended prematurely: osmo-stp_10.42.42.5(pid=1543) [trial-2379↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1543)] [trial-2379↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 17:26:55.141662 tst handover.py:18: Test FAILED (6.6 sec) 17:26:55.169279 run osmo-hlr_10.42.42.2(pid=1540): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1540)] 17:26:55.219531 run osmo-hlr_10.42.42.2(pid=1540): stdout: | (launched: 2022-12-12_17:26:52.251064) 17:26:55.271286 run osmo-hlr_10.42.42.2(pid=1540): stderr: | 20221212172652429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172652430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172652430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172652430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172652430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172652430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172652443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172652453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172652453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172652453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:55.343083 run osmo-msc_10.42.42.6(pid=1546): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1546)] 17:26:55.392889 run osmo-msc_10.42.42.6(pid=1546): stdout: | (launched: 2022-12-12_17:26:54.175792) 17:26:55.444103 run osmo-msc_10.42.42.6(pid=1546): stderr: | 20221212172654498 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172654498 DLGLOBAL DEBUG validating counter group 0x7fac12fa3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172654498 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172654498 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172654498 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172654499 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172654500 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172654501 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172654501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172654501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:26:55.495859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1539): Terminating (SIGTERM) 17:26:55.537457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1542): Terminating (SIGTERM) 17:26:55.579360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1545): Terminating (SIGTERM) 17:26:55.622025 --- ParallelTerminationStrategy: PID 1539 died... 17:26:55.642164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1539): Terminated: ok {rc=0} 17:26:55.688899 --- ParallelTerminationStrategy: PID 1542 died... 17:26:55.708601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1542): Terminated: ok {rc=0} 17:26:55.755100 --- ParallelTerminationStrategy: PID 1545 died... 17:26:55.774725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1545): Terminated: ok {rc=0} 17:26:55.862510 bus /sierra_3: Setting Powered False 17:26:56.961164 bus /sierra_3: Setting Powered False 17:26:58.079837 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 17:26:59.335471 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:26:59.340697 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:26:59.390680 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:26:59.416996 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:26:59.469126 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:26:59.518526 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:26:59.544775 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:27:00.094739 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 17:27:00.100121 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:27:00.111153 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:27:00.145911 tst handover.py: using LAC 30393 17:27:00.277194 tst handover.py: using RAC 48 17:27:00.409401 tst handover.py: using CellId 30393 17:27:00.544340 tst handover.py: using BVCI 30394 17:27:00.664739 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:27:00.712800 tst handover.py: using LAC 30394 17:27:00.847586 tst handover.py: using RAC 49 17:27:00.981390 tst handover.py: using CellId 30394 17:27:01.112325 tst handover.py: using BVCI 30395 17:27:01.259439 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:27:01.271844 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:27:01.284157 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:27:01.298871 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:27:01.311079 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:27:01.324154 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:27:01.464076 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:27:01.608293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:02.112522 run create_hlr_db(pid=1551): Launched 17:27:02.270455 bus /sierra_2: Setting Powered False 17:27:03.332346 run create_hlr_db(pid=1551): Terminated: ok {rc=0} 17:27:03.739539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1553): Launched 17:27:04.051374 run osmo-hlr_10.42.42.2(pid=1554): Launched 17:27:04.170564 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:04.679902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1556): Launched 17:27:04.992339 run osmo-stp_10.42.42.5(pid=1557): Launched 17:27:05.111347 run osmo-msc_10.42.42.6: Starting osmo-msc 17:27:05.646537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1559): Launched 17:27:05.959329 run osmo-msc_10.42.42.6(pid=1560): Launched 17:27:06.135105 run osmo-stp_10.42.42.5(pid=1557): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1557)] 17:27:06.266183 run osmo-stp_10.42.42.5(pid=1557): stdout: | (launched: 2022-12-12_17:27:04.934777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:06.396802 run osmo-stp_10.42.42.5(pid=1557): stderr: | 20221212172705107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172705108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172705108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172705108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172705109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172705109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172705109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:06.525710 run osmo-stp_10.42.42.5(pid=1557): stdout: | (launched: 2022-12-12_17:27:04.934777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:06.648489 run osmo-stp_10.42.42.5(pid=1557): stderr: | 20221212172705107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172705108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172705108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172705108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172705109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172705109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172705109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:06.795745 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1557): Process ended prematurely: osmo-stp_10.42.42.5(pid=1557) [trial-2379↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1557)] [trial-2379↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 17:27:06.804249 tst handover.py:18: Test FAILED (6.7 sec) 17:27:06.830987 run osmo-hlr_10.42.42.2(pid=1554): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1554)] 17:27:06.879388 run osmo-hlr_10.42.42.2(pid=1554): stdout: | (launched: 2022-12-12_17:27:03.993863) 17:27:06.929570 run osmo-hlr_10.42.42.2(pid=1554): stderr: | 20221212172704169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172704169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172704169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172704169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172704169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172704169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172704181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172704190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172704190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172704190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:06.998933 run osmo-msc_10.42.42.6(pid=1560): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1560)] 17:27:07.046755 run osmo-msc_10.42.42.6(pid=1560): stdout: | (launched: 2022-12-12_17:27:05.901495) 17:27:07.096416 run osmo-msc_10.42.42.6(pid=1560): stderr: | 20221212172706174 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172706174 DLGLOBAL DEBUG validating counter group 0x7f4759a7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172706174 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172706174 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172706174 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172706175 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172706176 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172706177 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172706177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172706177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:27:07.146521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1553): Terminating (SIGTERM) 17:27:07.186477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1556): Terminating (SIGTERM) 17:27:07.226658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1559): Terminating (SIGTERM) 17:27:07.266897 --- ParallelTerminationStrategy: PID 1553 died... 17:27:07.286028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1553): Terminated: ok {rc=0} 17:27:07.330688 --- ParallelTerminationStrategy: PID 1556 died... 17:27:07.349200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1556): Terminated: ok {rc=0} 17:27:07.393948 --- ParallelTerminationStrategy: PID 1559 died... 17:27:07.412550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1559): Terminated: ok {rc=0} 17:27:07.499332 bus /sierra_3: Setting Powered False 17:27:08.599987 bus /sierra_3: Setting Powered False 17:27:09.716294 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 17:27:10.967554 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:27:10.972897 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 17:27:11.022239 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 17:27:11.048634 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 17:27:11.102730 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 17:27:11.152357 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 17:27:11.178943 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 17:27:11.725718 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 17:27:11.731100 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:27:11.742073 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 17:27:11.775568 tst handover.py: using LAC 30395 17:27:11.896382 tst handover.py: using RAC 50 17:27:12.019285 tst handover.py: using CellId 30395 17:27:12.142287 tst handover.py: using BVCI 30396 17:27:12.256420 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 17:27:12.308355 tst handover.py: using LAC 30396 17:27:12.429347 tst handover.py: using RAC 51 17:27:12.553748 tst handover.py: using CellId 30396 17:27:12.680456 tst handover.py: using BVCI 30397 17:27:12.794692 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:27:12.805756 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:27:12.816480 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:27:12.827604 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:27:12.838619 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 17:27:12.849812 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 17:27:12.969118 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 17:27:13.088323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:13.574199 run create_hlr_db(pid=1565): Launched 17:27:13.711144 bus /sierra_2: Setting Powered False 17:27:14.775181 run create_hlr_db(pid=1565): Terminated: ok {rc=0} 17:27:15.209334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1567): Launched 17:27:15.542243 run osmo-hlr_10.42.42.2(pid=1568): Launched 17:27:15.671521 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:16.265574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1570): Launched 17:27:16.606777 run osmo-stp_10.42.42.5(pid=1571): Launched 17:27:16.837219 run osmo-msc_10.42.42.6: Starting osmo-msc 17:27:17.466507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1573): Launched 17:27:17.778551 run osmo-msc_10.42.42.6(pid=1574): Launched 17:27:17.952235 run osmo-stp_10.42.42.5(pid=1571): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1571)] 17:27:18.084085 run osmo-stp_10.42.42.5(pid=1571): stdout: | (launched: 2022-12-12_17:27:16.542087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:18.215642 run osmo-stp_10.42.42.5(pid=1571): stderr: | 20221212172716824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172716825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172716830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172716831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172716831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172716831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172716831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:18.345150 run osmo-stp_10.42.42.5(pid=1571): stdout: | (launched: 2022-12-12_17:27:16.542087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:18.468540 run osmo-stp_10.42.42.5(pid=1571): stderr: | 20221212172716824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172716825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172716830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172716831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172716831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172716831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172716831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:18.616242 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1571): Process ended prematurely: osmo-stp_10.42.42.5(pid=1571) [trial-2379↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1571)] [trial-2379↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 17:27:18.624698 tst handover.py:18: Test FAILED (6.9 sec) 17:27:18.651579 run osmo-hlr_10.42.42.2(pid=1568): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1568)] 17:27:18.700258 run osmo-hlr_10.42.42.2(pid=1568): stdout: | (launched: 2022-12-12_17:27:15.480845) 17:27:18.750099 run osmo-hlr_10.42.42.2(pid=1568): stderr: | 20221212172715682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172715682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172715682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172715682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172715683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172715683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172715695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172715704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172715704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172715704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:18.819938 run osmo-msc_10.42.42.6(pid=1574): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1574)] 17:27:18.867956 run osmo-msc_10.42.42.6(pid=1574): stdout: | (launched: 2022-12-12_17:27:17.720694) 17:27:18.917736 run osmo-msc_10.42.42.6(pid=1574): stderr: | 20221212172717991 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172717991 DLGLOBAL DEBUG validating counter group 0x7f9545919c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172717992 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172717992 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172717992 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172717992 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172717994 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172717994 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172717994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172717994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:27:18.968185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1567): Terminating (SIGTERM) 17:27:19.008329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1570): Terminating (SIGTERM) 17:27:19.048341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1573): Terminating (SIGTERM) 17:27:19.088425 --- ParallelTerminationStrategy: PID 1567 died... 17:27:19.107530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1567): Terminated: ok {rc=0} 17:27:19.152754 --- ParallelTerminationStrategy: PID 1570 died... 17:27:19.171371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1570): Terminated: ok {rc=0} 17:27:19.215434 --- ParallelTerminationStrategy: PID 1573 died... 17:27:19.234015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1573): Terminated: ok {rc=0} 17:27:19.319494 bus /sierra_3: Setting Powered False 17:27:20.419632 bus /sierra_3: Setting Powered False 17:27:21.535048 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 17:27:22.789882 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:27:22.796166 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 17:27:22.842269 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 17:27:22.869887 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 17:27:22.923437 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 17:27:22.969509 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 17:27:22.996491 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 17:27:23.546664 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 17:27:23.552380 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:27:23.563679 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:27:23.598915 tst handover.py: using LAC 30397 17:27:23.722344 tst handover.py: using RAC 52 17:27:23.842786 tst handover.py: using CellId 30397 17:27:23.965096 tst handover.py: using BVCI 30398 17:27:24.079144 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:27:24.124157 tst handover.py: using LAC 30398 17:27:24.245612 tst handover.py: using RAC 53 17:27:24.369410 tst handover.py: using CellId 30398 17:27:24.490955 tst handover.py: using BVCI 30399 17:27:24.604476 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:27:24.615712 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:27:24.626851 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:27:24.638512 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:27:24.650011 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:27:24.661535 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:27:24.782315 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:27:24.905575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:25.392488 run create_hlr_db(pid=1579): Launched 17:27:25.529180 bus /sierra_2: Setting Powered False 17:27:26.595051 run create_hlr_db(pid=1579): Terminated: ok {rc=0} 17:27:27.028699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1581): Launched 17:27:27.364148 run osmo-hlr_10.42.42.2(pid=1582): Launched 17:27:27.493088 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:28.036731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1584): Launched 17:27:28.371179 run osmo-stp_10.42.42.5(pid=1585): Launched 17:27:28.499631 run osmo-msc_10.42.42.6: Starting osmo-msc 17:27:29.070847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1587): Launched 17:27:29.404616 run osmo-msc_10.42.42.6(pid=1588): Launched 17:27:29.594248 run osmo-stp_10.42.42.5(pid=1585): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1585)] 17:27:29.733205 run osmo-stp_10.42.42.5(pid=1585): stdout: | (launched: 2022-12-12_17:27:28.309966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:29.872760 run osmo-stp_10.42.42.5(pid=1585): stderr: | 20221212172728503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172728503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172728503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172728504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172728504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172728504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172728505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:30.011224 run osmo-stp_10.42.42.5(pid=1585): stdout: | (launched: 2022-12-12_17:27:28.309966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:30.142987 run osmo-stp_10.42.42.5(pid=1585): stderr: | 20221212172728503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172728503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172728503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172728504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172728504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172728504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172728505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:30.300604 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1585): Process ended prematurely: osmo-stp_10.42.42.5(pid=1585) [trial-2379↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1585)] [trial-2379↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 17:27:30.309663 tst handover.py:18: Test FAILED (6.8 sec) 17:27:30.337332 run osmo-hlr_10.42.42.2(pid=1582): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1582)] 17:27:30.387401 run osmo-hlr_10.42.42.2(pid=1582): stdout: | (launched: 2022-12-12_17:27:27.302816) 17:27:30.439144 run osmo-hlr_10.42.42.2(pid=1582): stderr: | 20221212172727504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172727504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172727504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172727505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172727505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172727505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172727517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172727526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172727526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172727526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:30.511342 run osmo-msc_10.42.42.6(pid=1588): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1588)] 17:27:30.561539 run osmo-msc_10.42.42.6(pid=1588): stdout: | (launched: 2022-12-12_17:27:29.343183) 17:27:30.613531 run osmo-msc_10.42.42.6(pid=1588): stderr: | 20221212172729667 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172729668 DLGLOBAL DEBUG validating counter group 0x7f2223dd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172729668 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172729668 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172729668 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172729668 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172729670 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172729670 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172729670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172729670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:27:30.665494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1581): Terminating (SIGTERM) 17:27:30.707375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1584): Terminating (SIGTERM) 17:27:30.749997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1587): Terminating (SIGTERM) 17:27:30.792074 --- ParallelTerminationStrategy: PID 1581 died... 17:27:30.812141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1581): Terminated: ok {rc=0} 17:27:30.870734 --- ParallelTerminationStrategy: PID 1584 died... 17:27:30.897098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1584): Terminated: ok {rc=0} 17:27:30.944337 --- ParallelTerminationStrategy: PID 1587 died... 17:27:30.964591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1587): Terminated: ok {rc=0} 17:27:31.059782 bus /sierra_3: Setting Powered False 17:27:32.177317 bus /sierra_3: Setting Powered False 17:27:33.310373 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 17:27:34.567117 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:27:34.573273 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 17:27:34.623719 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:27:34.650955 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:27:34.704662 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 17:27:34.754818 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:27:34.781497 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:27:35.334329 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 17:27:35.339836 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:27:35.351286 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:27:35.385971 tst handover.py: using LAC 30399 17:27:35.515336 tst handover.py: using RAC 54 17:27:35.644698 tst handover.py: using CellId 30399 17:27:35.774511 tst handover.py: using BVCI 30400 17:27:35.896259 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:27:35.947229 tst handover.py: using LAC 30400 17:27:36.077167 tst handover.py: using RAC 55 17:27:36.206831 tst handover.py: using CellId 30400 17:27:36.338360 tst handover.py: using BVCI 30401 17:27:36.460075 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:27:36.471564 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:27:36.482902 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:27:36.494312 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:27:36.505732 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:27:36.517039 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:27:36.633229 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:27:36.749497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:37.203452 run create_hlr_db(pid=1593): Launched 17:27:37.322844 bus /sierra_2: Setting Powered False 17:27:38.383874 run create_hlr_db(pid=1593): Terminated: ok {rc=0} 17:27:38.806988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1595): Launched 17:27:39.139576 run osmo-hlr_10.42.42.2(pid=1596): Launched 17:27:39.267336 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:39.809153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1598): Launched 17:27:40.145166 run osmo-stp_10.42.42.5(pid=1599): Launched 17:27:40.271346 run osmo-msc_10.42.42.6: Starting osmo-msc 17:27:40.840710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1601): Launched 17:27:41.174408 run osmo-msc_10.42.42.6(pid=1602): Launched 17:27:41.359514 run osmo-stp_10.42.42.5(pid=1599): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1599)] 17:27:41.498956 run osmo-stp_10.42.42.5(pid=1599): stdout: | (launched: 2022-12-12_17:27:40.083893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:41.639351 run osmo-stp_10.42.42.5(pid=1599): stderr: | 20221212172740276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172740277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172740277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172740277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172740278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172740278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172740278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:41.777589 run osmo-stp_10.42.42.5(pid=1599): stdout: | (launched: 2022-12-12_17:27:40.083893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:41.910020 run osmo-stp_10.42.42.5(pid=1599): stderr: | 20221212172740276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172740277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172740277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172740277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172740278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172740278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172740278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:42.067743 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1599): Process ended prematurely: osmo-stp_10.42.42.5(pid=1599) [trial-2379↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1599)] [trial-2379↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 17:27:42.076768 tst handover.py:18: Test FAILED (6.7 sec) 17:27:42.104767 run osmo-hlr_10.42.42.2(pid=1596): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1596)] 17:27:42.155382 run osmo-hlr_10.42.42.2(pid=1596): stdout: | (launched: 2022-12-12_17:27:39.077982) 17:27:42.207129 run osmo-hlr_10.42.42.2(pid=1596): stderr: | 20221212172739278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172739278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172739279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172739279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172739279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172739279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172739291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172739302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172739302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172739302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:42.278801 run osmo-msc_10.42.42.6(pid=1602): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1602)] 17:27:42.328524 run osmo-msc_10.42.42.6(pid=1602): stdout: | (launched: 2022-12-12_17:27:41.112221) 17:27:42.380202 run osmo-msc_10.42.42.6(pid=1602): stderr: | 20221212172741438 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172741438 DLGLOBAL DEBUG validating counter group 0x7fd545d9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172741438 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172741438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172741438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172741438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172741440 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172741440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172741441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172741441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:27:42.431951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1595): Terminating (SIGTERM) 17:27:42.473424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1598): Terminating (SIGTERM) 17:27:42.514931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1601): Terminating (SIGTERM) 17:27:42.556792 --- ParallelTerminationStrategy: PID 1595 died... 17:27:42.576939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1595): Terminated: ok {rc=0} 17:27:42.623782 --- ParallelTerminationStrategy: PID 1598 died... 17:27:42.643603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1598): Terminated: ok {rc=0} 17:27:42.690056 --- ParallelTerminationStrategy: PID 1601 died... 17:27:42.709946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1601): Terminated: ok {rc=0} 17:27:42.798309 bus /sierra_3: Setting Powered False 17:27:43.898846 bus /sierra_3: Setting Powered False 17:27:45.014589 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 17:27:46.277946 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:27:46.284065 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:27:46.324746 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:27:46.353389 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:27:46.411831 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:27:46.459683 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:27:46.495866 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:27:47.049859 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 17:27:47.057704 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:27:47.070246 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 17:27:47.108816 tst handover.py: using LAC 30401 17:27:47.236657 tst handover.py: using RAC 56 17:27:47.358559 tst handover.py: using CellId 30401 17:27:47.482269 tst handover.py: using BVCI 30402 17:27:47.597210 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 17:27:47.630699 tst handover.py: using LAC 30402 17:27:47.760528 tst handover.py: using RAC 57 17:27:47.890642 tst handover.py: using CellId 30402 17:27:48.019423 tst handover.py: using BVCI 30403 17:27:48.139859 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:27:48.151524 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:27:48.162699 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:27:48.173822 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:27:48.184871 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:27:48.195963 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 17:27:48.313664 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 17:27:48.430496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:48.885403 run create_hlr_db(pid=1607): Launched 17:27:49.004687 bus /sierra_2: Setting Powered False 17:27:50.066203 run create_hlr_db(pid=1607): Terminated: ok {rc=0} 17:27:50.471339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1609): Launched 17:27:50.783397 run osmo-hlr_10.42.42.2(pid=1610): Launched 17:27:50.903526 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:51.425576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1612): Launched 17:27:51.736389 run osmo-stp_10.42.42.5(pid=1613): Launched 17:27:51.855461 run osmo-msc_10.42.42.6: Starting osmo-msc 17:27:52.465426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1615): Launched 17:27:52.799482 run osmo-msc_10.42.42.6(pid=1616): Launched 17:27:52.985249 run osmo-stp_10.42.42.5(pid=1613): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1613)] 17:27:53.124454 run osmo-stp_10.42.42.5(pid=1613): stdout: | (launched: 2022-12-12_17:27:51.678866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:53.265498 run osmo-stp_10.42.42.5(pid=1613): stderr: | 20221212172751850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172751850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172751850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172751851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172751851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172751851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172751851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:53.403657 run osmo-stp_10.42.42.5(pid=1613): stdout: | (launched: 2022-12-12_17:27:51.678866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:53.535497 run osmo-stp_10.42.42.5(pid=1613): stderr: | 20221212172751850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172751850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172751850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172751851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172751851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172751851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172751851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:53.693126 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1613): Process ended prematurely: osmo-stp_10.42.42.5(pid=1613) [trial-2379↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1613)] [trial-2379↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 17:27:53.702299 tst handover.py:18: Test FAILED (6.6 sec) 17:27:53.729983 run osmo-hlr_10.42.42.2(pid=1610): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1610)] 17:27:53.779908 run osmo-hlr_10.42.42.2(pid=1610): stdout: | (launched: 2022-12-12_17:27:50.726083) 17:27:53.831503 run osmo-hlr_10.42.42.2(pid=1610): stderr: | 20221212172750904 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172750904 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172750904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172750904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172750904 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172750904 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172750916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172750924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172750924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172750924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:53.903679 run osmo-msc_10.42.42.6(pid=1616): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1616)] 17:27:53.953599 run osmo-msc_10.42.42.6(pid=1616): stdout: | (launched: 2022-12-12_17:27:52.738302) 17:27:54.005117 run osmo-msc_10.42.42.6(pid=1616): stderr: | 20221212172753062 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172753062 DLGLOBAL DEBUG validating counter group 0x7f47634d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172753062 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172753062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172753062 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172753063 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172753064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172753065 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172753065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172753065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:27:54.056925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1609): Terminating (SIGTERM) 17:27:54.098621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1612): Terminating (SIGTERM) 17:27:54.140465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1615): Terminating (SIGTERM) 17:27:54.183038 --- ParallelTerminationStrategy: PID 1609 died... 17:27:54.203464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1609): Terminated: ok {rc=0} 17:27:54.249652 --- ParallelTerminationStrategy: PID 1612 died... 17:27:54.269173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1612): Terminated: ok {rc=0} 17:27:54.314872 --- ParallelTerminationStrategy: PID 1615 died... 17:27:54.334401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1615): Terminated: ok {rc=0} 17:27:54.421992 bus /sierra_3: Setting Powered False 17:27:55.520016 bus /sierra_3: Setting Powered False 17:27:56.636107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 17:27:57.872465 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:27:57.877910 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:27:57.926974 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:27:57.953573 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:27:58.006319 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:27:58.055001 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:27:58.081962 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:27:58.629189 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 17:27:58.634575 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:27:58.645640 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:27:58.683642 tst handover.py: using LAC 30403 17:27:58.805108 tst handover.py: using RAC 58 17:27:58.927353 tst handover.py: using CellId 30403 17:27:59.048827 tst handover.py: using BVCI 30404 17:27:59.161226 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:27:59.208043 tst handover.py: using LAC 30404 17:27:59.328397 tst handover.py: using RAC 59 17:27:59.447325 tst handover.py: using CellId 30404 17:27:59.566569 tst handover.py: using BVCI 30405 17:27:59.681071 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:27:59.691794 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:27:59.702513 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:27:59.713525 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:27:59.724387 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:27:59.735288 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:27:59.853872 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:27:59.968719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:00.422798 run create_hlr_db(pid=1621): Launched 17:28:00.543067 bus /sierra_2: Setting Powered False 17:28:01.610352 run create_hlr_db(pid=1621): Terminated: ok {rc=0} 17:28:02.084256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1623): Launched 17:28:02.429812 run osmo-hlr_10.42.42.2(pid=1624): Launched 17:28:02.558731 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:03.106518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1626): Launched 17:28:03.439567 run osmo-stp_10.42.42.5(pid=1627): Launched 17:28:03.566911 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:04.137260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1629): Launched 17:28:04.471708 run osmo-msc_10.42.42.6(pid=1630): Launched 17:28:04.658077 run osmo-stp_10.42.42.5(pid=1627): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1627)] 17:28:04.796864 run osmo-stp_10.42.42.5(pid=1627): stdout: | (launched: 2022-12-12_17:28:03.378390) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:04.936394 run osmo-stp_10.42.42.5(pid=1627): stderr: | 20221212172803571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172803571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172803571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172803572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172803572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172803572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172803572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:05.075034 run osmo-stp_10.42.42.5(pid=1627): stdout: | (launched: 2022-12-12_17:28:03.378390) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:05.207334 run osmo-stp_10.42.42.5(pid=1627): stderr: | 20221212172803571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172803571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172803571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172803572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172803572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172803572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172803572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:05.365515 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1627): Process ended prematurely: osmo-stp_10.42.42.5(pid=1627) [trial-2379↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1627)] [trial-2379↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 17:28:05.374597 tst handover.py:18: Test FAILED (6.7 sec) 17:28:05.402109 run osmo-hlr_10.42.42.2(pid=1624): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1624)] 17:28:05.453727 run osmo-hlr_10.42.42.2(pid=1624): stdout: | (launched: 2022-12-12_17:28:02.368320) 17:28:05.505550 run osmo-hlr_10.42.42.2(pid=1624): stderr: | 20221212172802568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172802568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172802569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172802569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172802569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172802569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172802580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172802589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172802589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172802590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:05.577921 run osmo-msc_10.42.42.6(pid=1630): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1630)] 17:28:05.628098 run osmo-msc_10.42.42.6(pid=1630): stdout: | (launched: 2022-12-12_17:28:04.410306) 17:28:05.680222 run osmo-msc_10.42.42.6(pid=1630): stderr: | 20221212172804736 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172804736 DLGLOBAL DEBUG validating counter group 0x7fc4c0904c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172804736 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172804736 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172804736 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172804736 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172804738 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172804740 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172804740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172804740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:05.732396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1623): Terminating (SIGTERM) 17:28:05.774175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1626): Terminating (SIGTERM) 17:28:05.815908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1629): Terminating (SIGTERM) 17:28:05.857944 --- ParallelTerminationStrategy: PID 1623 died... 17:28:05.878011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1623): Terminated: ok {rc=0} 17:28:05.923785 --- ParallelTerminationStrategy: PID 1626 died... 17:28:05.943125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1626): Terminated: ok {rc=0} 17:28:05.989163 --- ParallelTerminationStrategy: PID 1629 died... 17:28:06.008688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1629): Terminated: ok {rc=0} 17:28:06.096379 bus /sierra_3: Setting Powered False 17:28:07.196755 bus /sierra_3: Setting Powered False 17:28:08.314039 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 17:28:09.565120 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:09.570938 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:28:09.619947 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:28:09.646707 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:28:09.700288 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:28:09.749760 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:28:09.776591 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:28:10.323172 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 17:28:10.328601 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:28:10.339625 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:28:10.373464 tst handover.py: using LAC 30405 17:28:10.509954 tst handover.py: using RAC 60 17:28:10.644002 tst handover.py: using CellId 30405 17:28:10.773494 tst handover.py: using BVCI 30406 17:28:10.888792 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:28:10.935721 tst handover.py: using LAC 30406 17:28:11.056237 tst handover.py: using RAC 61 17:28:11.176137 tst handover.py: using CellId 30406 17:28:11.296926 tst handover.py: using BVCI 30407 17:28:11.411657 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:28:11.422751 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:28:11.433692 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:28:11.445418 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:28:11.457324 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:28:11.469022 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:28:11.591007 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:28:11.714912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:12.203294 run create_hlr_db(pid=1635): Launched 17:28:12.339077 bus /sierra_2: Setting Powered False 17:28:13.405102 run create_hlr_db(pid=1635): Terminated: ok {rc=0} 17:28:13.822425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1637): Launched 17:28:14.134466 run osmo-hlr_10.42.42.2(pid=1638): Launched 17:28:14.253741 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:14.777167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1640): Launched 17:28:15.087315 run osmo-stp_10.42.42.5(pid=1641): Launched 17:28:15.207761 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:15.744195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1643): Launched 17:28:16.093627 run osmo-msc_10.42.42.6(pid=1644): Launched 17:28:16.448051 run osmo-stp_10.42.42.5(pid=1641): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1641)] 17:28:16.605313 run osmo-stp_10.42.42.5(pid=1641): stdout: | (launched: 2022-12-12_17:28:15.029718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:16.773403 run osmo-stp_10.42.42.5(pid=1641): stderr: | 20221212172815201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172815202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172815202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172815202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172815203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172815203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172815203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:17.118840 run osmo-stp_10.42.42.5(pid=1641): stdout: | (launched: 2022-12-12_17:28:15.029718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:17.249056 run osmo-stp_10.42.42.5(pid=1641): stderr: | 20221212172815201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172815202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172815202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172815202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172815203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172815203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172815203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:17.414405 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1641): Process ended prematurely: osmo-stp_10.42.42.5(pid=1641) [trial-2379↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1641)] [trial-2379↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 17:28:17.423362 tst handover.py:18: Test FAILED (7.1 sec) 17:28:17.452187 run osmo-hlr_10.42.42.2(pid=1638): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1638)] 17:28:17.502897 run osmo-hlr_10.42.42.2(pid=1638): stdout: | (launched: 2022-12-12_17:28:14.076649) 17:28:17.555270 run osmo-hlr_10.42.42.2(pid=1638): stderr: | 20221212172814253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172814253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172814253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172814253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172814253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172814254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172814266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172814274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172814274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172814274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:17.628455 run osmo-msc_10.42.42.6(pid=1644): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1644)] 17:28:17.679962 run osmo-msc_10.42.42.6(pid=1644): stdout: | (launched: 2022-12-12_17:28:16.029277) 17:28:17.732249 run osmo-msc_10.42.42.6(pid=1644): stderr: | 20221212172816671 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172816671 DLGLOBAL DEBUG validating counter group 0x7f61c16b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172816672 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172816672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172816672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172816672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172816677 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172816678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172816678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172816678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:17.784591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1637): Terminating (SIGTERM) 17:28:17.826640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1640): Terminating (SIGTERM) 17:28:17.869387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1643): Terminating (SIGTERM) 17:28:17.912181 --- ParallelTerminationStrategy: PID 1637 died... 17:28:17.931730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1637): Terminated: ok {rc=0} 17:28:17.976005 --- ParallelTerminationStrategy: PID 1640 died... 17:28:17.994445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1640): Terminated: ok {rc=0} 17:28:18.038328 --- ParallelTerminationStrategy: PID 1643 died... 17:28:18.057944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1643): Terminated: ok {rc=0} 17:28:18.145203 bus /sierra_3: Setting Powered False 17:28:19.246116 bus /sierra_3: Setting Powered False 17:28:20.363288 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 17:28:21.613742 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:21.619980 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 17:28:21.679849 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 17:28:21.707196 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 17:28:21.760651 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 17:28:21.819347 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 17:28:21.845982 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 17:28:22.400811 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 17:28:22.406332 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:28:22.417766 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:28:22.467232 tst handover.py: using LAC 30407 17:28:22.597945 tst handover.py: using RAC 62 17:28:22.732237 tst handover.py: using CellId 30407 17:28:22.865944 tst handover.py: using BVCI 30408 17:28:22.987244 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 17:28:23.031498 tst handover.py: using LAC 30408 17:28:23.160794 tst handover.py: using RAC 63 17:28:23.292475 tst handover.py: using CellId 30408 17:28:23.422518 tst handover.py: using BVCI 30409 17:28:23.545915 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:28:23.557435 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:28:23.568702 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:28:23.580162 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:28:23.591450 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 17:28:23.602713 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:28:23.718877 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 17:28:23.836262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:24.290832 run create_hlr_db(pid=1649): Launched 17:28:24.411843 bus /sierra_2: Setting Powered False 17:28:25.473240 run create_hlr_db(pid=1649): Terminated: ok {rc=0} 17:28:25.879368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1651): Launched 17:28:26.190680 run osmo-hlr_10.42.42.2(pid=1652): Launched 17:28:26.309893 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:26.830029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1654): Launched 17:28:27.141784 run osmo-stp_10.42.42.5(pid=1655): Launched 17:28:27.260598 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:27.794903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1657): Launched 17:28:28.106967 run osmo-msc_10.42.42.6(pid=1658): Launched 17:28:28.281841 run osmo-stp_10.42.42.5(pid=1655): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1655)] 17:28:28.412488 run osmo-stp_10.42.42.5(pid=1655): stdout: | (launched: 2022-12-12_17:28:27.084051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:28.543171 run osmo-stp_10.42.42.5(pid=1655): stderr: | 20221212172827256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172827256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172827256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172827257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172827257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172827257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172827258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:28.671982 run osmo-stp_10.42.42.5(pid=1655): stdout: | (launched: 2022-12-12_17:28:27.084051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:28.794862 run osmo-stp_10.42.42.5(pid=1655): stderr: | 20221212172827256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172827256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172827256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172827257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172827257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172827257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172827258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:28.942038 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1655): Process ended prematurely: osmo-stp_10.42.42.5(pid=1655) [trial-2379↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1655)] [trial-2379↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 17:28:28.950508 tst handover.py:18: Test FAILED (6.5 sec) 17:28:28.977638 run osmo-hlr_10.42.42.2(pid=1652): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1652)] 17:28:29.025862 run osmo-hlr_10.42.42.2(pid=1652): stdout: | (launched: 2022-12-12_17:28:26.133214) 17:28:29.075813 run osmo-hlr_10.42.42.2(pid=1652): stderr: | 20221212172826310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172826310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172826310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172826310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172826310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172826310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172826322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172826330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172826331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172826331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:29.145431 run osmo-msc_10.42.42.6(pid=1658): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1658)] 17:28:29.193328 run osmo-msc_10.42.42.6(pid=1658): stdout: | (launched: 2022-12-12_17:28:28.049156) 17:28:29.243115 run osmo-msc_10.42.42.6(pid=1658): stderr: | 20221212172828321 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172828321 DLGLOBAL DEBUG validating counter group 0x7fa68315ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172828321 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172828321 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172828321 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172828321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172828323 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172828324 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172828324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172828324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:29.292808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1651): Terminating (SIGTERM) 17:28:29.333241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1654): Terminating (SIGTERM) 17:28:29.373427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1657): Terminating (SIGTERM) 17:28:29.414108 --- ParallelTerminationStrategy: PID 1651 died... 17:28:29.433206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1651): Terminated: ok {rc=0} 17:28:29.478297 --- ParallelTerminationStrategy: PID 1654 died... 17:28:29.497155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1654): Terminated: ok {rc=0} 17:28:29.541668 --- ParallelTerminationStrategy: PID 1657 died... 17:28:29.560122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1657): Terminated: ok {rc=0} 17:28:29.646949 bus /sierra_3: Setting Powered False 17:28:30.745311 bus /sierra_3: Setting Powered False 17:28:31.880038 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 17:28:33.168206 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:33.173645 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 17:28:33.236667 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:28:33.262939 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:28:33.316372 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 17:28:33.379484 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:28:33.406063 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:28:33.954705 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 17:28:33.959958 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:28:33.970946 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:28:34.018597 tst handover.py: using LAC 30409 17:28:34.141653 tst handover.py: using RAC 64 17:28:34.273231 tst handover.py: using CellId 30409 17:28:34.404858 tst handover.py: using BVCI 30410 17:28:34.525398 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:28:34.575936 tst handover.py: using LAC 30410 17:28:34.707630 tst handover.py: using RAC 65 17:28:34.840848 tst handover.py: using CellId 30410 17:28:34.969961 tst handover.py: using BVCI 30411 17:28:35.090389 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:28:35.102000 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:28:35.113264 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:28:35.124651 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:28:35.136032 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:28:35.147301 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:28:35.268749 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:28:35.389324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:35.844895 run create_hlr_db(pid=1663): Launched 17:28:35.964874 bus /sierra_2: Setting Powered False 17:28:37.026325 run create_hlr_db(pid=1663): Terminated: ok {rc=0} 17:28:37.450889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1665): Launched 17:28:37.783179 run osmo-hlr_10.42.42.2(pid=1666): Launched 17:28:37.910841 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:38.453684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1668): Launched 17:28:38.783779 run osmo-stp_10.42.42.5(pid=1669): Launched 17:28:38.911072 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:39.481112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1671): Launched 17:28:39.814339 run osmo-msc_10.42.42.6(pid=1672): Launched 17:28:40.000345 run osmo-stp_10.42.42.5(pid=1669): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1669)] 17:28:40.139956 run osmo-stp_10.42.42.5(pid=1669): stdout: | (launched: 2022-12-12_17:28:38.722922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:40.279967 run osmo-stp_10.42.42.5(pid=1669): stderr: | 20221212172838920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172838920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172838920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172838921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172838921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172838921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172838921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:40.418048 run osmo-stp_10.42.42.5(pid=1669): stdout: | (launched: 2022-12-12_17:28:38.722922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:40.549562 run osmo-stp_10.42.42.5(pid=1669): stderr: | 20221212172838920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172838920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172838920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172838921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172838921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172838921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172838921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:40.706858 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1669): Process ended prematurely: osmo-stp_10.42.42.5(pid=1669) [trial-2379↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1669)] [trial-2379↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 17:28:40.715649 tst handover.py:18: Test FAILED (6.7 sec) 17:28:40.743233 run osmo-hlr_10.42.42.2(pid=1666): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1666)] 17:28:40.793377 run osmo-hlr_10.42.42.2(pid=1666): stdout: | (launched: 2022-12-12_17:28:37.722158) 17:28:40.845528 run osmo-hlr_10.42.42.2(pid=1666): stderr: | 20221212172837922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172837922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172837922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172837922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172837922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172837922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172837936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172837946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172837946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172837946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:40.918644 run osmo-msc_10.42.42.6(pid=1672): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1672)] 17:28:40.968666 run osmo-msc_10.42.42.6(pid=1672): stdout: | (launched: 2022-12-12_17:28:39.753209) 17:28:41.021059 run osmo-msc_10.42.42.6(pid=1672): stderr: | 20221212172840076 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172840077 DLGLOBAL DEBUG validating counter group 0x7f30553a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172840077 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172840077 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172840077 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172840077 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172840079 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172840079 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172840079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172840079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:41.073388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1665): Terminating (SIGTERM) 17:28:41.115242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1668): Terminating (SIGTERM) 17:28:41.157392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1671): Terminating (SIGTERM) 17:28:41.199706 --- ParallelTerminationStrategy: PID 1665 died... 17:28:41.219758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1665): Terminated: ok {rc=0} 17:28:41.268028 --- ParallelTerminationStrategy: PID 1668 died... 17:28:41.287599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1668): Terminated: ok {rc=0} 17:28:41.333532 --- ParallelTerminationStrategy: PID 1671 died... 17:28:41.353101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1671): Terminated: ok {rc=0} 17:28:41.440776 bus /sierra_3: Setting Powered False 17:28:42.541333 bus /sierra_3: Setting Powered False 17:28:43.658089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 17:28:44.933547 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:44.939312 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:28:44.990289 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:28:45.016898 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:28:45.069609 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:28:45.119990 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:28:45.146162 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:28:45.695285 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 17:28:45.700410 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:28:45.711208 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 17:28:45.758956 tst handover.py: using LAC 30411 17:28:45.915244 tst handover.py: using RAC 66 17:28:46.063923 tst handover.py: using CellId 30411 17:28:46.190116 tst handover.py: using BVCI 30412 17:28:46.307929 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 17:28:46.345461 tst handover.py: using LAC 30412 17:28:46.478214 tst handover.py: using RAC 67 17:28:46.634293 tst handover.py: using CellId 30412 17:28:46.788597 tst handover.py: using BVCI 30413 17:28:46.929371 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:28:46.941703 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:28:46.953825 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:28:46.966010 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:28:46.980407 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:28:46.993565 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 17:28:47.114629 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 17:28:47.235911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:47.691616 run create_hlr_db(pid=1677): Launched 17:28:47.810125 bus /sierra_2: Setting Powered False 17:28:48.871532 run create_hlr_db(pid=1677): Terminated: ok {rc=0} 17:28:49.275981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1679): Launched 17:28:49.586453 run osmo-hlr_10.42.42.2(pid=1680): Launched 17:28:49.705165 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:50.214606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1682): Launched 17:28:50.526519 run osmo-stp_10.42.42.5(pid=1683): Launched 17:28:50.647257 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:51.181411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1685): Launched 17:28:51.491338 run osmo-msc_10.42.42.6(pid=1686): Launched 17:28:51.667235 run osmo-stp_10.42.42.5(pid=1683): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1683)] 17:28:51.798530 run osmo-stp_10.42.42.5(pid=1683): stdout: | (launched: 2022-12-12_17:28:50.468540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:51.929264 run osmo-stp_10.42.42.5(pid=1683): stderr: | 20221212172850640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172850640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172850640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172850640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172850642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172850642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172850642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:52.057748 run osmo-stp_10.42.42.5(pid=1683): stdout: | (launched: 2022-12-12_17:28:50.468540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:52.180356 run osmo-stp_10.42.42.5(pid=1683): stderr: | 20221212172850640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172850640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172850640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172850640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172850642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172850642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172850642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:52.327594 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1683): Process ended prematurely: osmo-stp_10.42.42.5(pid=1683) [trial-2379↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1683)] [trial-2379↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 17:28:52.335918 tst handover.py:18: Test FAILED (6.6 sec) 17:28:52.362636 run osmo-hlr_10.42.42.2(pid=1680): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1680)] 17:28:52.410409 run osmo-hlr_10.42.42.2(pid=1680): stdout: | (launched: 2022-12-12_17:28:49.529151) 17:28:52.459962 run osmo-hlr_10.42.42.2(pid=1680): stderr: | 20221212172849706 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172849706 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172849706 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172849707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172849707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172849707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172849719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172849730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172849730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172849730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:52.529184 run osmo-msc_10.42.42.6(pid=1686): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1686)] 17:28:52.576867 run osmo-msc_10.42.42.6(pid=1686): stdout: | (launched: 2022-12-12_17:28:51.433907) 17:28:52.626202 run osmo-msc_10.42.42.6(pid=1686): stderr: | 20221212172851706 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172851706 DLGLOBAL DEBUG validating counter group 0x7f6035127c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172851706 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172851706 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172851707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172851707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172851708 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172851709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172851709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172851709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:52.675922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1679): Terminating (SIGTERM) 17:28:52.715724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1682): Terminating (SIGTERM) 17:28:52.755514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1685): Terminating (SIGTERM) 17:28:52.795451 --- ParallelTerminationStrategy: PID 1679 died... 17:28:52.814576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1679): Terminated: ok {rc=0} 17:28:52.858788 --- ParallelTerminationStrategy: PID 1682 died... 17:28:52.877295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1682): Terminated: ok {rc=0} 17:28:52.921410 --- ParallelTerminationStrategy: PID 1685 died... 17:28:52.939688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1685): Terminated: ok {rc=0} 17:28:53.023023 bus /sierra_3: Setting Powered False 17:28:54.120758 bus /sierra_3: Setting Powered False 17:28:55.236800 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 17:28:56.492611 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:56.497969 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:28:56.560212 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:28:56.586836 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:28:56.637305 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:28:56.699533 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:28:56.726060 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:28:57.277124 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 17:28:57.282312 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:28:57.293060 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:28:57.341069 tst handover.py: using LAC 30413 17:28:57.461835 tst handover.py: using RAC 68 17:28:57.582803 tst handover.py: using CellId 30413 17:28:57.705775 tst handover.py: using BVCI 30414 17:28:57.827274 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:28:57.877342 tst handover.py: using LAC 30414 17:28:58.008910 tst handover.py: using RAC 69 17:28:58.138884 tst handover.py: using CellId 30414 17:28:58.270469 tst handover.py: using BVCI 30415 17:28:58.391857 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:28:58.403237 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:28:58.414402 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:28:58.425641 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:28:58.436912 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:28:58.448076 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:28:58.569831 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:28:58.688934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:59.174494 run create_hlr_db(pid=1691): Launched 17:28:59.310970 bus /sierra_2: Setting Powered False 17:29:00.376067 run create_hlr_db(pid=1691): Terminated: ok {rc=0} 17:29:00.808845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1693): Launched 17:29:01.155949 run osmo-hlr_10.42.42.2(pid=1694): Launched 17:29:01.465677 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:02.139925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1696): Launched 17:29:02.486604 run osmo-stp_10.42.42.5(pid=1697): Launched 17:29:02.615664 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:03.192664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1699): Launched 17:29:03.527170 run osmo-msc_10.42.42.6(pid=1700): Launched 17:29:03.715061 run osmo-stp_10.42.42.5(pid=1697): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1697)] 17:29:03.855521 run osmo-stp_10.42.42.5(pid=1697): stdout: | (launched: 2022-12-12_17:29:02.424941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:03.996276 run osmo-stp_10.42.42.5(pid=1697): stderr: | 20221212172902619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172902620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172902620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172902620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172902621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172902621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172902621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:04.135215 run osmo-stp_10.42.42.5(pid=1697): stdout: | (launched: 2022-12-12_17:29:02.424941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:04.267943 run osmo-stp_10.42.42.5(pid=1697): stderr: | 20221212172902619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172902620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172902620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172902620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172902621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172902621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172902621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:04.425750 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1697): Process ended prematurely: osmo-stp_10.42.42.5(pid=1697) [trial-2379↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1697)] [trial-2379↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 17:29:04.434606 tst handover.py:18: Test FAILED (7.1 sec) 17:29:04.462311 run osmo-hlr_10.42.42.2(pid=1694): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1694)] 17:29:04.512500 run osmo-hlr_10.42.42.2(pid=1694): stdout: | (launched: 2022-12-12_17:29:01.097157) 17:29:04.564627 run osmo-hlr_10.42.42.2(pid=1694): stderr: | 20221212172901325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172901325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172901325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172901325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172901325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172901325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172901339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172901359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172901360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172901360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:04.637177 run osmo-msc_10.42.42.6(pid=1700): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1700)] 17:29:04.687224 run osmo-msc_10.42.42.6(pid=1700): stdout: | (launched: 2022-12-12_17:29:03.465647) 17:29:04.739110 run osmo-msc_10.42.42.6(pid=1700): stderr: | 20221212172903791 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172903791 DLGLOBAL DEBUG validating counter group 0x7f421501fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172903791 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172903791 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172903791 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172903791 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172903793 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172903794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172903794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172903794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:04.791452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1693): Terminating (SIGTERM) 17:29:04.833457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1696): Terminating (SIGTERM) 17:29:04.875294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1699): Terminating (SIGTERM) 17:29:04.917543 --- ParallelTerminationStrategy: PID 1693 died... 17:29:04.937716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1693): Terminated: ok {rc=0} 17:29:04.983639 --- ParallelTerminationStrategy: PID 1696 died... 17:29:05.003103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1696): Terminated: ok {rc=0} 17:29:05.049703 --- ParallelTerminationStrategy: PID 1699 died... 17:29:05.069846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1699): Terminated: ok {rc=0} 17:29:05.158989 bus /sierra_3: Setting Powered False 17:29:06.257854 bus /sierra_3: Setting Powered False 17:29:07.373946 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 17:29:08.646854 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:08.652726 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:29:08.716402 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:29:08.743733 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:29:08.799087 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:29:08.863141 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:29:08.889565 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:29:09.434038 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 17:29:09.439511 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:09.450641 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:29:09.502638 tst handover.py: using LAC 30415 17:29:09.624000 tst handover.py: using RAC 70 17:29:09.743745 tst handover.py: using CellId 30415 17:29:09.868420 tst handover.py: using BVCI 30416 17:29:09.982734 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:29:10.032093 tst handover.py: using LAC 30416 17:29:10.153172 tst handover.py: using RAC 71 17:29:10.283555 tst handover.py: using CellId 30416 17:29:10.411980 tst handover.py: using BVCI 30417 17:29:10.532196 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:10.543498 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:10.554610 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:10.565879 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:10.577130 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:10.588260 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:29:10.706517 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:29:10.823245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:11.277735 run create_hlr_db(pid=1705): Launched 17:29:11.397835 bus /sierra_2: Setting Powered False 17:29:12.460774 run create_hlr_db(pid=1705): Terminated: ok {rc=0} 17:29:12.885627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1707): Launched 17:29:13.219686 run osmo-hlr_10.42.42.2(pid=1708): Launched 17:29:13.348338 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:13.891506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1710): Launched 17:29:14.225710 run osmo-stp_10.42.42.5(pid=1711): Launched 17:29:14.355217 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:14.927774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1713): Launched 17:29:15.262994 run osmo-msc_10.42.42.6(pid=1714): Launched 17:29:15.449461 run osmo-stp_10.42.42.5(pid=1711): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1711)] 17:29:15.588413 run osmo-stp_10.42.42.5(pid=1711): stdout: | (launched: 2022-12-12_17:29:14.163689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:15.728521 run osmo-stp_10.42.42.5(pid=1711): stderr: | 20221212172914358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172914359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172914359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172914359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172914360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172914360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172914360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:15.879657 run osmo-stp_10.42.42.5(pid=1711): stdout: | (launched: 2022-12-12_17:29:14.163689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:16.014409 run osmo-stp_10.42.42.5(pid=1711): stderr: | 20221212172914358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172914359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172914359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172914359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172914360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172914360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172914360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:16.174828 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1711): Process ended prematurely: osmo-stp_10.42.42.5(pid=1711) [trial-2379↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1711)] [trial-2379↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 17:29:16.184222 tst handover.py:18: Test FAILED (6.7 sec) 17:29:16.213055 run osmo-hlr_10.42.42.2(pid=1708): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1708)] 17:29:16.265171 run osmo-hlr_10.42.42.2(pid=1708): stdout: | (launched: 2022-12-12_17:29:13.158033) 17:29:16.318650 run osmo-hlr_10.42.42.2(pid=1708): stderr: | 20221212172913358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172913358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172913358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172913358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172913358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172913358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172913370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172913379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172913380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172913380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:16.392346 run osmo-msc_10.42.42.6(pid=1714): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1714)] 17:29:16.443419 run osmo-msc_10.42.42.6(pid=1714): stdout: | (launched: 2022-12-12_17:29:15.201246) 17:29:16.496453 run osmo-msc_10.42.42.6(pid=1714): stderr: | 20221212172915525 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172915525 DLGLOBAL DEBUG validating counter group 0x7f5cb9218c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172915525 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172915525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172915526 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172915526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172915527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172915528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172915528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172915528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:16.551580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1707): Terminating (SIGTERM) 17:29:16.595604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1710): Terminating (SIGTERM) 17:29:16.640460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1713): Terminating (SIGTERM) 17:29:16.685649 --- ParallelTerminationStrategy: PID 1707 died... 17:29:16.706212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1707): Terminated: ok {rc=0} 17:29:16.753382 --- ParallelTerminationStrategy: PID 1710 died... 17:29:16.773454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1710): Terminated: ok {rc=0} 17:29:16.820487 --- ParallelTerminationStrategy: PID 1713 died... 17:29:16.841493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1713): Terminated: ok {rc=0} 17:29:16.930744 bus /sierra_3: Setting Powered False 17:29:18.030517 bus /sierra_3: Setting Powered False 17:29:19.145385 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 17:29:20.412325 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:20.417761 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 17:29:20.477672 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:29:20.504038 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:29:20.555983 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 17:29:20.615644 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:29:20.641787 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:29:21.194243 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 17:29:21.199562 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:29:21.210776 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:29:21.260220 tst handover.py: using LAC 30417 17:29:21.382453 tst handover.py: using RAC 72 17:29:21.503007 tst handover.py: using CellId 30417 17:29:21.624445 tst handover.py: using BVCI 30418 17:29:21.736655 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 17:29:21.784021 tst handover.py: using LAC 30418 17:29:21.903888 tst handover.py: using RAC 73 17:29:22.032299 tst handover.py: using CellId 30418 17:29:22.161704 tst handover.py: using BVCI 30419 17:29:22.282944 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:29:22.294702 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:29:22.306226 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:29:22.317997 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:29:22.329707 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:29:22.341239 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:29:22.458733 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:29:22.576585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:23.031555 run create_hlr_db(pid=1719): Launched 17:29:23.168004 bus /sierra_2: Setting Powered False 17:29:24.233268 run create_hlr_db(pid=1719): Terminated: ok {rc=0} 17:29:24.650747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1721): Launched 17:29:24.964451 run osmo-hlr_10.42.42.2(pid=1722): Launched 17:29:25.084262 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:25.606278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1724): Launched 17:29:25.918711 run osmo-stp_10.42.42.5(pid=1725): Launched 17:29:26.039951 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:26.578334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1727): Launched 17:29:26.891271 run osmo-msc_10.42.42.6(pid=1728): Launched 17:29:27.067703 run osmo-stp_10.42.42.5(pid=1725): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1725)] 17:29:27.199653 run osmo-stp_10.42.42.5(pid=1725): stdout: | (launched: 2022-12-12_17:29:25.860804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:27.330003 run osmo-stp_10.42.42.5(pid=1725): stderr: | 20221212172926032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172926032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172926032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172926033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172926033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172926033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172926033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:27.459161 run osmo-stp_10.42.42.5(pid=1725): stdout: | (launched: 2022-12-12_17:29:25.860804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:27.582469 run osmo-stp_10.42.42.5(pid=1725): stderr: | 20221212172926032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172926032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172926032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172926033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172926033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172926033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172926033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:27.730169 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1725): Process ended prematurely: osmo-stp_10.42.42.5(pid=1725) [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1725)] [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 17:29:27.738575 tst handover.py:18: Test FAILED (6.5 sec) 17:29:27.764803 run osmo-hlr_10.42.42.2(pid=1722): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1722)] 17:29:27.813817 run osmo-hlr_10.42.42.2(pid=1722): stdout: | (launched: 2022-12-12_17:29:24.906393) 17:29:27.864061 run osmo-hlr_10.42.42.2(pid=1722): stderr: | 20221212172925082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172925083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172925083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172925083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172925083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172925083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172925095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172925103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172925103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172925103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:27.933608 run osmo-msc_10.42.42.6(pid=1728): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1728)] 17:29:27.982315 run osmo-msc_10.42.42.6(pid=1728): stdout: | (launched: 2022-12-12_17:29:26.833442) 17:29:28.031950 run osmo-msc_10.42.42.6(pid=1728): stderr: | 20221212172927104 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172927104 DLGLOBAL DEBUG validating counter group 0x7f06626b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172927104 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172927104 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172927105 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172927105 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172927107 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172927107 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172927107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172927107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:28.082285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1721): Terminating (SIGTERM) 17:29:28.122587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1724): Terminating (SIGTERM) 17:29:28.162448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1727): Terminating (SIGTERM) 17:29:28.202645 --- ParallelTerminationStrategy: PID 1721 died... 17:29:28.221725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1721): Terminated: ok {rc=0} 17:29:28.265783 --- ParallelTerminationStrategy: PID 1724 died... 17:29:28.284084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1724): Terminated: ok {rc=0} 17:29:28.328180 --- ParallelTerminationStrategy: PID 1727 died... 17:29:28.346551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1727): Terminated: ok {rc=0} 17:29:28.431375 bus /sierra_3: Setting Powered False 17:29:29.531100 bus /sierra_3: Setting Powered False 17:29:30.646794 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 17:29:31.980064 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:31.987654 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:29:32.051657 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:29:32.081131 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:29:32.136904 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:29:32.192780 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:29:32.222330 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:29:32.760389 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 17:29:32.765746 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:29:32.776564 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 17:29:32.823957 tst handover.py: using LAC 30419 17:29:32.944122 tst handover.py: using RAC 74 17:29:33.066389 tst handover.py: using CellId 30419 17:29:33.187697 tst handover.py: using BVCI 30420 17:29:33.300320 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 17:29:33.334155 tst handover.py: using LAC 30420 17:29:33.453202 tst handover.py: using RAC 75 17:29:33.575476 tst handover.py: using CellId 30420 17:29:33.696474 tst handover.py: using BVCI 30421 17:29:33.808237 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:29:33.819269 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:29:33.830157 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:29:33.841354 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:29:33.852416 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:29:33.863538 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 17:29:33.978379 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 17:29:34.097046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:34.584230 run create_hlr_db(pid=1737): Launched 17:29:34.721164 bus /sierra_2: Setting Powered False 17:29:35.785715 run create_hlr_db(pid=1737): Terminated: ok {rc=0} 17:29:36.203793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1739): Launched 17:29:36.518463 run osmo-hlr_10.42.42.2(pid=1740): Launched 17:29:36.639455 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:37.149920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1742): Launched 17:29:37.462591 run osmo-stp_10.42.42.5(pid=1743): Launched 17:29:37.585540 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:38.118584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1745): Launched 17:29:38.431117 run osmo-msc_10.42.42.6(pid=1746): Launched 17:29:38.606877 run osmo-stp_10.42.42.5(pid=1743): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1743)] 17:29:38.737660 run osmo-stp_10.42.42.5(pid=1743): stdout: | (launched: 2022-12-12_17:29:37.404467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:38.868396 run osmo-stp_10.42.42.5(pid=1743): stderr: | 20221212172937577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172937577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172937577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172937578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172937579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172937579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172937579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:38.997470 run osmo-stp_10.42.42.5(pid=1743): stdout: | (launched: 2022-12-12_17:29:37.404467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:39.120240 run osmo-stp_10.42.42.5(pid=1743): stderr: | 20221212172937577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172937577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172937577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172937578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172937579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172937579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172937579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:39.267388 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1743): Process ended prematurely: osmo-stp_10.42.42.5(pid=1743) [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1743)] [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 17:29:39.276063 tst handover.py:18: Test FAILED (6.5 sec) 17:29:39.302822 run osmo-hlr_10.42.42.2(pid=1740): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1740)] 17:29:39.351121 run osmo-hlr_10.42.42.2(pid=1740): stdout: | (launched: 2022-12-12_17:29:36.460318) 17:29:39.400808 run osmo-hlr_10.42.42.2(pid=1740): stderr: | 20221212172936638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172936638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172936638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172936638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172936638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172936638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172936654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172936665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172936665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172936665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:39.469655 run osmo-msc_10.42.42.6(pid=1746): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1746)] 17:29:39.517063 run osmo-msc_10.42.42.6(pid=1746): stdout: | (launched: 2022-12-12_17:29:38.373461) 17:29:39.566308 run osmo-msc_10.42.42.6(pid=1746): stderr: | 20221212172938645 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172938645 DLGLOBAL DEBUG validating counter group 0x7fa9e41bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172938645 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172938646 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172938646 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172938646 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172938648 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172938648 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172938648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172938648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:39.615790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1739): Terminating (SIGTERM) 17:29:39.655801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1742): Terminating (SIGTERM) 17:29:39.695721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1745): Terminating (SIGTERM) 17:29:39.735914 --- ParallelTerminationStrategy: PID 1739 died... 17:29:39.755062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1739): Terminated: ok {rc=0} 17:29:39.799232 --- ParallelTerminationStrategy: PID 1742 died... 17:29:39.818095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1742): Terminated: ok {rc=0} 17:29:39.862235 --- ParallelTerminationStrategy: PID 1745 died... 17:29:39.880778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1745): Terminated: ok {rc=0} 17:29:39.964890 bus /sierra_3: Setting Powered False 17:29:41.063043 bus /sierra_3: Setting Powered False 17:29:42.182194 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 17:29:43.433807 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:43.440552 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:29:43.500741 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:29:43.527935 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:29:43.581291 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:29:43.642369 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:29:43.670172 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:29:44.223062 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 17:29:44.228503 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:29:44.240030 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:29:44.287836 tst handover.py: using LAC 30421 17:29:44.416839 tst handover.py: using RAC 76 17:29:44.545099 tst handover.py: using CellId 30421 17:29:44.677422 tst handover.py: using BVCI 30422 17:29:44.798807 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:29:44.846770 tst handover.py: using LAC 30422 17:29:44.966933 tst handover.py: using RAC 77 17:29:45.086778 tst handover.py: using CellId 30422 17:29:45.207970 tst handover.py: using BVCI 30423 17:29:45.329820 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:29:45.341387 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:29:45.353055 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:29:45.364478 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:29:45.375898 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:29:45.387279 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:29:45.503876 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:29:45.620177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:46.086489 run create_hlr_db(pid=1752): Launched 17:29:46.245372 bus /sierra_2: Setting Powered False 17:29:47.306266 run create_hlr_db(pid=1752): Terminated: ok {rc=0} 17:29:47.732840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1754): Launched 17:29:48.070177 run osmo-hlr_10.42.42.2(pid=1755): Launched 17:29:48.198789 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:48.748010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1757): Launched 17:29:49.082123 run osmo-stp_10.42.42.5(pid=1758): Launched 17:29:49.208618 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:49.781975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1760): Launched 17:29:50.117412 run osmo-msc_10.42.42.6(pid=1761): Launched 17:29:50.305832 run osmo-stp_10.42.42.5(pid=1758): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1758)] 17:29:50.445207 run osmo-stp_10.42.42.5(pid=1758): stdout: | (launched: 2022-12-12_17:29:49.020151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:50.584877 run osmo-stp_10.42.42.5(pid=1758): stderr: | 20221212172949214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172949214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172949214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172949214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172949215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172949215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172949215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:50.723394 run osmo-stp_10.42.42.5(pid=1758): stdout: | (launched: 2022-12-12_17:29:49.020151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:50.855236 run osmo-stp_10.42.42.5(pid=1758): stderr: | 20221212172949214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212172949214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212172949214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212172949214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212172949215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212172949215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212172949215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:51.013606 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1758): Process ended prematurely: osmo-stp_10.42.42.5(pid=1758) [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1758)] [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 17:29:51.022528 tst handover.py:18: Test FAILED (6.8 sec) 17:29:51.050143 run osmo-hlr_10.42.42.2(pid=1755): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1755)] 17:29:51.100254 run osmo-hlr_10.42.42.2(pid=1755): stdout: | (launched: 2022-12-12_17:29:48.008145) 17:29:51.152014 run osmo-hlr_10.42.42.2(pid=1755): stderr: | 20221212172948207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172948207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172948207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172948207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172948207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172948207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172948219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172948228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172948229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172948229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:51.224888 run osmo-msc_10.42.42.6(pid=1761): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1761)] 17:29:51.275021 run osmo-msc_10.42.42.6(pid=1761): stdout: | (launched: 2022-12-12_17:29:50.055537) 17:29:51.326719 run osmo-msc_10.42.42.6(pid=1761): stderr: | 20221212172950379 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212172950380 DLGLOBAL DEBUG validating counter group 0x7f21ee3e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212172950380 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212172950380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212172950380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212172950380 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212172950382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212172950382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212172950382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212172950382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:51.378699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1754): Terminating (SIGTERM) 17:29:51.420463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1757): Terminating (SIGTERM) 17:29:51.462167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1760): Terminating (SIGTERM) 17:29:51.504112 --- ParallelTerminationStrategy: PID 1754 died... 17:29:51.524250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1754): Terminated: ok {rc=0} 17:29:51.570359 --- ParallelTerminationStrategy: PID 1757 died... 17:29:51.589870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1757): Terminated: ok {rc=0} 17:29:51.635746 --- ParallelTerminationStrategy: PID 1760 died... 17:29:51.655282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1760): Terminated: ok {rc=0} 17:29:51.742614 bus /sierra_3: Setting Powered False 17:29:52.840135 bus /sierra_3: Setting Powered False 17:29:53.957883 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 17:29:55.230047 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:55.236231 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:29:55.297216 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:29:55.325036 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:29:55.379915 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:29:55.440178 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:29:55.467534 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:29:56.017877 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 17:29:56.023290 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:56.034854 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:29:56.079646 tst handover.py: using LAC 30423 17:29:56.208619 tst handover.py: using RAC 78 17:29:56.341425 tst handover.py: using CellId 30423 17:29:56.468172 tst handover.py: using BVCI 30424 17:29:56.582661 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:29:56.628617 tst handover.py: using LAC 30424 17:29:56.754684 tst handover.py: using RAC 79 17:29:56.875880 tst handover.py: using CellId 30424 17:29:56.995600 tst handover.py: using BVCI 30425 17:29:57.109443 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:57.120552 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:57.131434 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:57.142606 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:57.153907 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:29:57.165050 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:29:57.285392 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:29:57.403980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:57.860054 run create_hlr_db(pid=1766): Launched 17:29:57.978639 bus /sierra_2: Setting Powered False 17:29:59.040507 run create_hlr_db(pid=1766): Terminated: ok {rc=0} 17:29:59.447574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1768): Launched 17:29:59.759012 run osmo-hlr_10.42.42.2(pid=1769): Launched 17:29:59.877916 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:00.383227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1771): Launched 17:30:00.695555 run osmo-stp_10.42.42.5(pid=1772): Launched 17:30:00.816634 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:01.485728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1774): Launched 17:30:01.816892 run osmo-msc_10.42.42.6(pid=1775): Launched 17:30:02.099217 run osmo-stp_10.42.42.5(pid=1772): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1772)] 17:30:02.342720 run osmo-stp_10.42.42.5(pid=1772): stdout: | (launched: 2022-12-12_17:30:00.637545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:02.487874 run osmo-stp_10.42.42.5(pid=1772): stderr: | 20221212173000809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173000809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173000810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173000810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173000811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173000811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173000811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:02.627770 run osmo-stp_10.42.42.5(pid=1772): stdout: | (launched: 2022-12-12_17:30:00.637545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:02.759624 run osmo-stp_10.42.42.5(pid=1772): stderr: | 20221212173000809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173000809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173000810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173000810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173000811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173000811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173000811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:02.917522 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1772): Process ended prematurely: osmo-stp_10.42.42.5(pid=1772) [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1772)] [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 17:30:02.926418 tst handover.py:18: Test FAILED (6.9 sec) 17:30:02.953952 run osmo-hlr_10.42.42.2(pid=1769): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1769)] 17:30:03.004022 run osmo-hlr_10.42.42.2(pid=1769): stdout: | (launched: 2022-12-12_17:29:59.701299) 17:30:03.055797 run osmo-hlr_10.42.42.2(pid=1769): stderr: | 20221212172959881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212172959881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212172959881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212172959881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212172959881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212172959881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212172959932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212172959941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212172959941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212172959941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:03.128386 run osmo-msc_10.42.42.6(pid=1775): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1775)] 17:30:03.178581 run osmo-msc_10.42.42.6(pid=1775): stdout: | (launched: 2022-12-12_17:30:01.756368) 17:30:03.230651 run osmo-msc_10.42.42.6(pid=1775): stderr: | 20221212173002325 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212173002325 DLGLOBAL DEBUG validating counter group 0x7f2096c25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212173002325 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212173002325 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212173002325 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212173002326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212173002327 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212173002328 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212173002328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212173002328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:03.283039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1768): Terminating (SIGTERM) 17:30:03.324365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1771): Terminating (SIGTERM) 17:30:03.366026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1774): Terminating (SIGTERM) 17:30:03.407504 --- ParallelTerminationStrategy: PID 1768 died... 17:30:03.427560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1768): Terminated: ok {rc=0} 17:30:03.473508 --- ParallelTerminationStrategy: PID 1771 died... 17:30:03.492879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1771): Terminated: ok {rc=0} 17:30:03.539069 --- ParallelTerminationStrategy: PID 1774 died... 17:30:03.558715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1774): Terminated: ok {rc=0} 17:30:03.647917 bus /sierra_3: Setting Powered False 17:30:04.747676 bus /sierra_3: Setting Powered False 17:30:05.863734 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 17:30:07.128221 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:07.133437 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 17:30:07.184860 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 17:30:07.211368 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 17:30:07.263410 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 17:30:07.313960 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 17:30:07.340363 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 17:30:07.892155 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 17:30:07.898718 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:30:07.910601 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 17:30:07.960806 tst handover.py: using LAC 30425 17:30:08.093216 tst handover.py: using RAC 80 17:30:08.225075 tst handover.py: using CellId 30425 17:30:08.355756 tst handover.py: using BVCI 30426 17:30:08.479095 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 17:30:08.515671 tst handover.py: using LAC 30426 17:30:08.648852 tst handover.py: using RAC 81 17:30:08.781342 tst handover.py: using CellId 30426 17:30:08.911708 tst handover.py: using BVCI 30427 17:30:09.026447 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:30:09.037459 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:30:09.048232 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:30:09.059309 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:30:09.070685 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 17:30:09.081836 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 17:30:09.201437 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 17:30:09.323006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:09.812021 run create_hlr_db(pid=1784): Launched 17:30:09.949564 bus /sierra_2: Setting Powered False 17:30:11.015524 run create_hlr_db(pid=1784): Terminated: ok {rc=0} 17:30:11.433084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1786): Launched 17:30:11.746987 run osmo-hlr_10.42.42.2(pid=1787): Launched 17:30:11.868027 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:12.390498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1789): Launched 17:30:12.704048 run osmo-stp_10.42.42.5(pid=1790): Launched 17:30:12.824654 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:13.361317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1792): Launched 17:30:13.696393 run osmo-msc_10.42.42.6(pid=1793): Launched 17:30:13.882879 run osmo-stp_10.42.42.5(pid=1790): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1790)] 17:30:14.023448 run osmo-stp_10.42.42.5(pid=1790): stdout: | (launched: 2022-12-12_17:30:12.645970) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:14.164167 run osmo-stp_10.42.42.5(pid=1790): stderr: | 20221212173012818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173012818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173012818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173012818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173012819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173012819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173012819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:14.303604 run osmo-stp_10.42.42.5(pid=1790): stdout: | (launched: 2022-12-12_17:30:12.645970) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:14.436827 run osmo-stp_10.42.42.5(pid=1790): stderr: | 20221212173012818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173012818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173012818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173012818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173012819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173012819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173012819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:14.595413 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1790): Process ended prematurely: osmo-stp_10.42.42.5(pid=1790) [trial-2379↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1790)] [trial-2379↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 17:30:14.604454 tst handover.py:18: Test FAILED (6.7 sec) 17:30:14.632373 run osmo-hlr_10.42.42.2(pid=1787): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1787)] 17:30:14.683192 run osmo-hlr_10.42.42.2(pid=1787): stdout: | (launched: 2022-12-12_17:30:11.689121) 17:30:14.735415 run osmo-hlr_10.42.42.2(pid=1787): stderr: | 20221212173011865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212173011865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212173011865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212173011865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212173011865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212173011866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212173011878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212173011886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212173011886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212173011886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:14.808358 run osmo-msc_10.42.42.6(pid=1793): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1793)] 17:30:14.858967 run osmo-msc_10.42.42.6(pid=1793): stdout: | (launched: 2022-12-12_17:30:13.634846) 17:30:14.911165 run osmo-msc_10.42.42.6(pid=1793): stderr: | 20221212173013958 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212173013958 DLGLOBAL DEBUG validating counter group 0x7fadf7de7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212173013958 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212173013958 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212173013958 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212173013958 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212173013960 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212173013960 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212173013960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212173013960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:14.963920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1786): Terminating (SIGTERM) 17:30:15.006291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1789): Terminating (SIGTERM) 17:30:15.048582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1792): Terminating (SIGTERM) 17:30:15.091580 --- ParallelTerminationStrategy: PID 1786 died... 17:30:15.111973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1786): Terminated: ok {rc=0} 17:30:15.158556 --- ParallelTerminationStrategy: PID 1789 died... 17:30:15.178335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1789): Terminated: ok {rc=0} 17:30:15.225008 --- ParallelTerminationStrategy: PID 1792 died... 17:30:15.244768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1792): Terminated: ok {rc=0} 17:30:15.333299 bus /sierra_3: Setting Powered False 17:30:16.432039 bus /sierra_3: Setting Powered False 17:30:17.550789 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 17:30:18.808207 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:18.814090 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:30:18.877428 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:30:18.903635 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:30:18.955796 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:30:19.021733 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:30:19.047750 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:30:19.595035 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 17:30:19.600280 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:19.611326 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:30:19.660091 tst handover.py: using LAC 30427 17:30:19.780086 tst handover.py: using RAC 82 17:30:19.900214 tst handover.py: using CellId 30427 17:30:20.018763 tst handover.py: using BVCI 30428 17:30:20.127901 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:30:20.178522 tst handover.py: using LAC 30428 17:30:20.299686 tst handover.py: using RAC 83 17:30:20.429226 tst handover.py: using CellId 30428 17:30:20.557406 tst handover.py: using BVCI 30429 17:30:20.675114 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:20.686610 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:20.697844 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:20.709220 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:20.720502 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:20.731734 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:30:20.847524 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:30:20.964175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:21.408023 run create_hlr_db(pid=1798): Launched 17:30:21.524613 bus /sierra_2: Setting Powered False 17:30:22.585582 run create_hlr_db(pid=1798): Terminated: ok {rc=0} 17:30:23.000277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1800): Launched 17:30:23.325997 run osmo-hlr_10.42.42.2(pid=1801): Launched 17:30:23.450886 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:23.984177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1803): Launched 17:30:24.309373 run osmo-stp_10.42.42.5(pid=1804): Launched 17:30:24.434340 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:24.992192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1806): Launched 17:30:25.316875 run osmo-msc_10.42.42.6(pid=1807): Launched 17:30:25.497725 run osmo-stp_10.42.42.5(pid=1804): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1804)] 17:30:25.634057 run osmo-stp_10.42.42.5(pid=1804): stdout: | (launched: 2022-12-12_17:30:24.249357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:25.770376 run osmo-stp_10.42.42.5(pid=1804): stderr: | 20221212173024440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173024440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173024440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173024441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173024441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173024441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173024441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:25.905085 run osmo-stp_10.42.42.5(pid=1804): stdout: | (launched: 2022-12-12_17:30:24.249357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:26.033551 run osmo-stp_10.42.42.5(pid=1804): stderr: | 20221212173024440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173024440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173024440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173024441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173024441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173024441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173024441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:26.187163 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1804): Process ended prematurely: osmo-stp_10.42.42.5(pid=1804) [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1804)] [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 17:30:26.195882 tst handover.py:18: Test FAILED (6.6 sec) 17:30:26.223282 run osmo-hlr_10.42.42.2(pid=1801): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1801)] 17:30:26.273164 run osmo-hlr_10.42.42.2(pid=1801): stdout: | (launched: 2022-12-12_17:30:23.266065) 17:30:26.324362 run osmo-hlr_10.42.42.2(pid=1801): stderr: | 20221212173023462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212173023462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212173023462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212173023462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212173023462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212173023463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212173023475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212173023484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212173023484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212173023484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:26.395986 run osmo-msc_10.42.42.6(pid=1807): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1807)] 17:30:26.446164 run osmo-msc_10.42.42.6(pid=1807): stdout: | (launched: 2022-12-12_17:30:25.256375) 17:30:26.497423 run osmo-msc_10.42.42.6(pid=1807): stderr: | 20221212173025577 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212173025577 DLGLOBAL DEBUG validating counter group 0x7fd448c26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212173025577 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212173025577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212173025577 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212173025577 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212173025579 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212173025580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212173025580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212173025580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:26.549051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1800): Terminating (SIGTERM) 17:30:26.590404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1803): Terminating (SIGTERM) 17:30:26.631565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1806): Terminating (SIGTERM) 17:30:26.673238 --- ParallelTerminationStrategy: PID 1800 died... 17:30:26.693137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1800): Terminated: ok {rc=0} 17:30:26.738779 --- ParallelTerminationStrategy: PID 1803 died... 17:30:26.758142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1803): Terminated: ok {rc=0} 17:30:26.803689 --- ParallelTerminationStrategy: PID 1806 died... 17:30:26.823030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1806): Terminated: ok {rc=0} 17:30:26.910953 bus /sierra_3: Setting Powered False 17:30:28.006394 bus /sierra_3: Setting Powered False 17:30:29.120802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 17:30:30.400376 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:30.406432 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:30:30.470427 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:30:30.497682 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:30:30.548930 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:30:30.613396 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:30:30.640502 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:30:31.218225 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 17:30:31.223299 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:31.237032 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:30:31.302278 tst handover.py: using LAC 30429 17:30:31.444189 tst handover.py: using RAC 84 17:30:31.565406 tst handover.py: using CellId 30429 17:30:31.687729 tst handover.py: using BVCI 30430 17:30:31.800896 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:30:31.851267 tst handover.py: using LAC 30430 17:30:31.998223 tst handover.py: using RAC 85 17:30:32.118115 tst handover.py: using CellId 30430 17:30:32.239835 tst handover.py: using BVCI 30431 17:30:32.352017 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:32.363549 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:32.374728 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:32.386819 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:32.398463 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:32.409952 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:30:32.530389 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:30:32.648060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:33.113551 run create_hlr_db(pid=1812): Launched 17:30:33.244693 bus /sierra_2: Setting Powered False 17:30:34.308880 run create_hlr_db(pid=1812): Terminated: ok {rc=0} 17:30:34.727233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1815): Launched 17:30:35.048711 run osmo-hlr_10.42.42.2(pid=1816): Launched 17:30:35.171170 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:35.695825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1818): Launched 17:30:36.018194 run osmo-stp_10.42.42.5(pid=1820): Launched 17:30:36.140872 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:36.694288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1822): Launched 17:30:37.016061 run osmo-msc_10.42.42.6(pid=1823): Launched 17:30:37.195252 run osmo-stp_10.42.42.5(pid=1820): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1820)] 17:30:37.331523 run osmo-stp_10.42.42.5(pid=1820): stdout: | (launched: 2022-12-12_17:30:35.958945) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:37.466869 run osmo-stp_10.42.42.5(pid=1820): stderr: | 20221212173036147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173036147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173036147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173036148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173036148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173036148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173036149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:37.602023 run osmo-stp_10.42.42.5(pid=1820): stdout: | (launched: 2022-12-12_17:30:35.958945) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:37.730620 run osmo-stp_10.42.42.5(pid=1820): stderr: | 20221212173036147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173036147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173036147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173036148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173036148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173036148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173036149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:37.883966 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1820): Process ended prematurely: osmo-stp_10.42.42.5(pid=1820) [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1820)] [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 17:30:37.892802 tst handover.py:18: Test FAILED (6.7 sec) 17:30:37.920029 run osmo-hlr_10.42.42.2(pid=1816): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1816)] 17:30:37.969213 run osmo-hlr_10.42.42.2(pid=1816): stdout: | (launched: 2022-12-12_17:30:34.989826) 17:30:38.020115 run osmo-hlr_10.42.42.2(pid=1816): stderr: | 20221212173035184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212173035185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212173035185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212173035185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212173035185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212173035185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212173035202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212173035211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212173035211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212173035211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:38.091398 run osmo-msc_10.42.42.6(pid=1823): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1823)] 17:30:38.140235 run osmo-msc_10.42.42.6(pid=1823): stdout: | (launched: 2022-12-12_17:30:36.956920) 17:30:38.190732 run osmo-msc_10.42.42.6(pid=1823): stderr: | 20221212173037276 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212173037276 DLGLOBAL DEBUG validating counter group 0x7fcfb7d32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212173037276 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212173037276 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212173037276 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212173037277 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212173037278 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212173037279 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212173037279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212173037279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:38.241909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1815): Terminating (SIGTERM) 17:30:38.282794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1818): Terminating (SIGTERM) 17:30:38.323627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1822): Terminating (SIGTERM) 17:30:38.365072 --- ParallelTerminationStrategy: PID 1815 died... 17:30:38.384686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1815): Terminated: ok {rc=0} 17:30:38.429987 --- ParallelTerminationStrategy: PID 1818 died... 17:30:38.449199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1818): Terminated: ok {rc=0} 17:30:38.494191 --- ParallelTerminationStrategy: PID 1822 died... 17:30:38.513594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1822): Terminated: ok {rc=0} 17:30:38.599993 bus /sierra_3: Setting Powered False 17:30:39.696323 bus /sierra_3: Setting Powered False 17:30:40.811252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 17:30:42.078234 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:42.083281 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 17:30:42.133972 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 17:30:42.160627 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 17:30:42.215271 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 17:30:42.267000 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 17:30:42.294272 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 17:30:42.842009 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 17:30:42.848015 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:42.859262 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:30:42.895308 tst handover.py: using LAC 30431 17:30:43.012721 tst handover.py: using RAC 86 17:30:43.131365 tst handover.py: using CellId 30431 17:30:43.249045 tst handover.py: using BVCI 30432 17:30:43.359114 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 17:30:43.407398 tst handover.py: using LAC 30432 17:30:43.527394 tst handover.py: using RAC 87 17:30:43.645113 tst handover.py: using CellId 30432 17:30:43.763699 tst handover.py: using BVCI 30433 17:30:43.882443 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:43.893688 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:43.904626 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:43.915703 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:43.927179 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 17:30:43.938204 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:30:44.052282 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 17:30:44.171034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:44.645871 run create_hlr_db(pid=1828): Launched 17:30:44.776210 bus /sierra_2: Setting Powered False 17:30:45.864677 run create_hlr_db(pid=1828): Terminated: ok {rc=0} 17:30:46.282401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1830): Launched 17:30:46.667133 run osmo-hlr_10.42.42.2(pid=1831): Launched 17:30:46.904570 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:47.504018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1833): Launched 17:30:47.806799 run osmo-stp_10.42.42.5(pid=1834): Launched 17:30:47.921799 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:48.442400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1836): Launched 17:30:48.746212 run osmo-msc_10.42.42.6(pid=1837): Launched 17:30:48.915470 run osmo-stp_10.42.42.5(pid=1834): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1834)] 17:30:49.042317 run osmo-stp_10.42.42.5(pid=1834): stdout: | (launched: 2022-12-12_17:30:47.750925) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:49.169567 run osmo-stp_10.42.42.5(pid=1834): stderr: | 20221212173047919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173047919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173047919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173047920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173047920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173047920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173047920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:49.294906 run osmo-stp_10.42.42.5(pid=1834): stdout: | (launched: 2022-12-12_17:30:47.750925) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:49.414458 run osmo-stp_10.42.42.5(pid=1834): stderr: | 20221212173047919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173047919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173047919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173047920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173047920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173047920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173047920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:49.557025 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1834): Process ended prematurely: osmo-stp_10.42.42.5(pid=1834) [trial-2379↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1834)] [trial-2379↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 17:30:49.565426 tst handover.py:18: Test FAILED (6.7 sec) 17:30:49.591544 run osmo-hlr_10.42.42.2(pid=1831): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1831)] 17:30:49.638981 run osmo-hlr_10.42.42.2(pid=1831): stdout: | (launched: 2022-12-12_17:30:46.602009) 17:30:49.688020 run osmo-hlr_10.42.42.2(pid=1831): stderr: | 20221212173046841 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212173046841 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212173046841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212173046841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212173046842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212173046842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212173046863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212173046883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212173046884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212173046884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:49.756197 run osmo-msc_10.42.42.6(pid=1837): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1837)] 17:30:49.803530 run osmo-msc_10.42.42.6(pid=1837): stdout: | (launched: 2022-12-12_17:30:48.689648) 17:30:49.852495 run osmo-msc_10.42.42.6(pid=1837): stderr: | 20221212173048958 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212173048958 DLGLOBAL DEBUG validating counter group 0x7f6275038c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212173048958 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212173048958 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212173048958 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212173048959 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212173048960 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212173048961 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212173048961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212173048961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:49.901447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1830): Terminating (SIGTERM) 17:30:49.940410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1833): Terminating (SIGTERM) 17:30:49.979557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1836): Terminating (SIGTERM) 17:30:50.019530 --- ParallelTerminationStrategy: PID 1830 died... 17:30:50.038419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1830): Terminated: ok {rc=0} 17:30:50.081937 --- ParallelTerminationStrategy: PID 1833 died... 17:30:50.100078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1833): Terminated: ok {rc=0} 17:30:50.143918 --- ParallelTerminationStrategy: PID 1836 died... 17:30:50.162191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1836): Terminated: ok {rc=0} 17:30:50.244834 bus /sierra_3: Setting Powered False 17:30:51.339450 bus /sierra_3: Setting Powered False 17:30:52.453404 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 17:30:53.706778 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:53.711971 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:30:53.761930 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:30:53.788020 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:30:53.839893 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:30:53.889266 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:30:53.915354 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:30:54.466008 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 17:30:54.471201 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:54.481934 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:30:54.522387 tst handover.py: using LAC 30433 17:30:54.640845 tst handover.py: using RAC 88 17:30:54.766721 tst handover.py: using CellId 30433 17:30:54.891661 tst handover.py: using BVCI 30434 17:30:55.008084 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:30:55.057646 tst handover.py: using LAC 30434 17:30:55.184634 tst handover.py: using RAC 89 17:30:55.313821 tst handover.py: using CellId 30434 17:30:55.431726 tst handover.py: using BVCI 30435 17:30:55.540885 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:55.551643 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:55.562243 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:55.573133 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:55.583944 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:30:55.594889 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:30:55.711987 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:30:55.829222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:56.302618 run create_hlr_db(pid=1842): Launched 17:30:56.433227 bus /sierra_2: Setting Powered False 17:30:57.497549 run create_hlr_db(pid=1842): Terminated: ok {rc=0} 17:30:57.902317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1844): Launched 17:30:58.204673 run osmo-hlr_10.42.42.2(pid=1845): Launched 17:30:58.319546 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:58.825530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1847): Launched 17:30:59.127092 run osmo-stp_10.42.42.5(pid=1848): Launched 17:30:59.242042 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:59.767289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1850): Launched 17:31:00.067901 run osmo-msc_10.42.42.6(pid=1851): Launched 17:31:00.236383 run osmo-stp_10.42.42.5(pid=1848): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1848)] 17:31:00.364330 run osmo-stp_10.42.42.5(pid=1848): stdout: | (launched: 2022-12-12_17:30:59.071090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:00.491829 run osmo-stp_10.42.42.5(pid=1848): stderr: | 20221212173059238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173059239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173059239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173059239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173059240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173059240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173059240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:00.617218 run osmo-stp_10.42.42.5(pid=1848): stdout: | (launched: 2022-12-12_17:30:59.071090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:00.736348 run osmo-stp_10.42.42.5(pid=1848): stderr: | 20221212173059238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173059239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173059239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173059239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173059240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173059240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173059240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:00.888466 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1848): Process ended prematurely: osmo-stp_10.42.42.5(pid=1848) [trial-2379↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1848)] [trial-2379↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 17:31:00.897434 tst handover.py:18: Test FAILED (6.4 sec) 17:31:00.924668 run osmo-hlr_10.42.42.2(pid=1845): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1845)] 17:31:00.974278 run osmo-hlr_10.42.42.2(pid=1845): stdout: | (launched: 2022-12-12_17:30:58.148678) 17:31:01.024527 run osmo-hlr_10.42.42.2(pid=1845): stderr: | 20221212173058322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212173058322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212173058322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212173058322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212173058322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212173058322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212173058337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212173058346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212173058346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212173058346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:01.094842 run osmo-msc_10.42.42.6(pid=1851): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1851)] 17:31:01.144424 run osmo-msc_10.42.42.6(pid=1851): stdout: | (launched: 2022-12-12_17:31:00.012598) 17:31:01.195556 run osmo-msc_10.42.42.6(pid=1851): stderr: | 20221212173100279 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212173100279 DLGLOBAL DEBUG validating counter group 0x7f39cd1b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212173100279 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212173100279 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212173100279 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212173100280 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212173100281 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212173100282 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212173100282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212173100282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:01.247144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1844): Terminating (SIGTERM) 17:31:01.288828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1847): Terminating (SIGTERM) 17:31:01.330657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1850): Terminating (SIGTERM) 17:31:01.373120 --- ParallelTerminationStrategy: PID 1844 died... 17:31:01.392707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1844): Terminated: ok {rc=0} 17:31:01.439831 --- ParallelTerminationStrategy: PID 1847 died... 17:31:01.459340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1847): Terminated: ok {rc=0} 17:31:01.506225 --- ParallelTerminationStrategy: PID 1850 died... 17:31:01.525725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1850): Terminated: ok {rc=0} 17:31:01.611254 bus /sierra_3: Setting Powered False 17:31:02.707569 bus /sierra_3: Setting Powered False 17:31:03.823360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2379 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 17:31:05.083913 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:31:05.089953 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 17:31:05.152911 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:31:05.180047 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 17:31:05.233633 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 17:31:05.297723 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:31:05.324745 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 17:31:05.876048 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2379 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 17:31:05.881536 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:31:05.892664 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:31:05.949214 tst handover.py: using LAC 30435 17:31:06.074942 tst handover.py: using RAC 90 17:31:06.200867 tst handover.py: using CellId 30435 17:31:06.325635 tst handover.py: using BVCI 30436 17:31:06.442273 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 17:31:06.489508 tst handover.py: using LAC 30436 17:31:06.619738 tst handover.py: using RAC 91 17:31:06.747884 tst handover.py: using CellId 30436 17:31:06.866042 tst handover.py: using BVCI 30437 17:31:06.974889 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:31:06.985763 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:31:06.996412 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:31:07.007766 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:31:07.018771 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 17:31:07.029753 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:31:07.146531 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 17:31:07.264135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:07.704361 run create_hlr_db(pid=1856): Launched 17:31:07.819033 bus /sierra_2: Setting Powered False 17:31:08.878979 run create_hlr_db(pid=1856): Terminated: ok {rc=0} 17:31:09.290330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1858): Launched 17:31:09.596276 run osmo-hlr_10.42.42.2(pid=1859): Launched 17:31:09.711568 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:10.200723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1861): Launched 17:31:10.500764 run osmo-stp_10.42.42.5(pid=1862): Launched 17:31:10.616060 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:11.133628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1864): Launched 17:31:11.434207 run osmo-msc_10.42.42.6(pid=1865): Launched 17:31:11.603602 run osmo-stp_10.42.42.5(pid=1862): ERR: Terminated: ERROR {rc=1} [trial-2379↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1862)] 17:31:11.730843 run osmo-stp_10.42.42.5(pid=1862): stdout: | (launched: 2022-12-12_17:31:10.445581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:11.857443 run osmo-stp_10.42.42.5(pid=1862): stderr: | 20221212173110613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173110613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173110613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173110613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173110614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173110614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173110614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:11.982381 run osmo-stp_10.42.42.5(pid=1862): stdout: | (launched: 2022-12-12_17:31:10.445581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:12.101423 run osmo-stp_10.42.42.5(pid=1862): stderr: | 20221212173110613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212173110613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212173110613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212173110613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212173110614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212173110614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212173110614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:12.243776 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1862): Process ended prematurely: osmo-stp_10.42.42.5(pid=1862) [trial-2379↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1862)] [trial-2379↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 17:31:12.251963 tst handover.py:18: Test FAILED (6.4 sec) 17:31:12.278160 run osmo-hlr_10.42.42.2(pid=1859): ERR: Terminated: ERROR {rc=237} [trial-2379↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1859)] 17:31:12.325746 run osmo-hlr_10.42.42.2(pid=1859): stdout: | (launched: 2022-12-12_17:31:09.541109) 17:31:12.374637 run osmo-hlr_10.42.42.2(pid=1859): stderr: | 20221212173109716 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212173109716 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212173109716 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212173109716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212173109716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212173109717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212173109728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212173109738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212173109739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212173109739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:12.442867 run osmo-msc_10.42.42.6(pid=1865): ERR: Terminated: ERROR {rc=2} [trial-2379↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1865)] 17:31:12.490056 run osmo-msc_10.42.42.6(pid=1865): stdout: | (launched: 2022-12-12_17:31:11.379048) 17:31:12.538536 run osmo-msc_10.42.42.6(pid=1865): stderr: | 20221212173111645 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212173111645 DLGLOBAL DEBUG validating counter group 0x7f69cbdb5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212173111645 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212173111645 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212173111646 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212173111646 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212173111647 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212173111648 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212173111648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212173111648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:12.587662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1858): Terminating (SIGTERM) 17:31:12.626856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1861): Terminating (SIGTERM) 17:31:12.665931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1864): Terminating (SIGTERM) 17:31:12.705283 --- ParallelTerminationStrategy: PID 1858 died... 17:31:12.724036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1858): Terminated: ok {rc=0} 17:31:12.767566 --- ParallelTerminationStrategy: PID 1861 died... 17:31:12.786038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1861): Terminated: ok {rc=0} 17:31:12.830496 --- ParallelTerminationStrategy: PID 1864 died... 17:31:12.848793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1864): Terminated: ok {rc=0} 17:31:12.931026 bus /sierra_3: Setting Powered False 17:31:14.027369 bus /sierra_3: Setting Powered False 17:31:15.144570 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2379 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 17:31:16.476399 tst trial-2379: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/trial-2379.xml -------------------------------------------------------------------------------------------- trial-2379 FAIL -------------------------------------------------------------------------------------------- 17:31:18.526116 tst trial-2379: trial-2379: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.8 sec) Error: osmo-nitb_10.42.42.2(pid=26364): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26364) [trial-2379↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26364)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.8 sec) Error: osmo-stp_10.42.42.5(pid=26374): Process ended prematurely: osmo-stp_10.42.42.5(pid=26374) [trial-2379↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26374)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=26654): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26654) [trial-2379↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26654)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=26664): Process ended prematurely: osmo-stp_10.42.42.5(pid=26664) [trial-2379↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26664)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26679): Process ended prematurely: osmo-stp_10.42.42.5(pid=26679) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26679)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26690): Process ended prematurely: osmo-stp_10.42.42.5(pid=26690) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26690)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26704): Process ended prematurely: osmo-stp_10.42.42.5(pid=26704) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26704)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26716): Process ended prematurely: osmo-stp_10.42.42.5(pid=26716) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26716)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26730): Process ended prematurely: osmo-stp_10.42.42.5(pid=26730) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26730)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26744): Process ended prematurely: osmo-stp_10.42.42.5(pid=26744) [trial-2379↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26744)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26758): Process ended prematurely: osmo-stp_10.42.42.5(pid=26758) [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26758)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26769): Process ended prematurely: osmo-stp_10.42.42.5(pid=26769) [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26769)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26783): Process ended prematurely: osmo-stp_10.42.42.5(pid=26783) [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26783)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26794): Process ended prematurely: osmo-stp_10.42.42.5(pid=26794) [trial-2379↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26794)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26808): Process ended prematurely: osmo-stp_10.42.42.5(pid=26808) [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26808)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26819): Process ended prematurely: osmo-stp_10.42.42.5(pid=26819) [trial-2379↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26819)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26833): Process ended prematurely: osmo-stp_10.42.42.5(pid=26833) [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26833)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26844): Process ended prematurely: osmo-stp_10.42.42.5(pid=26844) [trial-2379↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26844)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26859): Process ended prematurely: osmo-stp_10.42.42.5(pid=26859) [trial-2379↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26859)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26870): Process ended prematurely: osmo-stp_10.42.42.5(pid=26870) [trial-2379↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26870)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.5 sec) Error: osmo-stp_10.42.42.5(pid=26888): Process ended prematurely: osmo-stp_10.42.42.5(pid=26888) [trial-2379↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26888)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26900): Process ended prematurely: osmo-stp_10.42.42.5(pid=26900) [trial-2379↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26900)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26918): Process ended prematurely: osmo-stp_10.42.42.5(pid=26918) [trial-2379↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26918)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26928): Process ended prematurely: osmo-stp_10.42.42.5(pid=26928) [trial-2379↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26928)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=26938): Process ended prematurely: osmo-stp_10.42.42.5(pid=26938) [trial-2379↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26938)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26956): Process ended prematurely: osmo-stp_10.42.42.5(pid=26956) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26956)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26968): Process ended prematurely: osmo-stp_10.42.42.5(pid=26968) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26968)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=26986): Process ended prematurely: osmo-stp_10.42.42.5(pid=26986) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26986)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26997): Process ended prematurely: osmo-stp_10.42.42.5(pid=26997) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26997)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27007): Process ended prematurely: osmo-stp_10.42.42.5(pid=27007) [trial-2379↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27007)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=27025): Process ended prematurely: osmo-stp_10.42.42.5(pid=27025) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27025)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27037): Process ended prematurely: osmo-stp_10.42.42.5(pid=27037) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27037)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=27055): Process ended prematurely: osmo-stp_10.42.42.5(pid=27055) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27055)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27065): Process ended prematurely: osmo-stp_10.42.42.5(pid=27065) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27065)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27078): Process ended prematurely: osmo-stp_10.42.42.5(pid=27078) [trial-2379↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27078)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=27095): Process ended prematurely: osmo-stp_10.42.42.5(pid=27095) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27095)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27107): Process ended prematurely: osmo-stp_10.42.42.5(pid=27107) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27107)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=27125): Process ended prematurely: osmo-stp_10.42.42.5(pid=27125) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27125)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27136): Process ended prematurely: osmo-stp_10.42.42.5(pid=27136) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27136)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27146): Process ended prematurely: osmo-stp_10.42.42.5(pid=27146) [trial-2379↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27146)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27160): Process ended prematurely: osmo-stp_10.42.42.5(pid=27160) [trial-2379↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27160)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27180): Process ended prematurely: osmo-stp_10.42.42.5(pid=27180) [trial-2379↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27180)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=27188): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27188) [trial-2379↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27188)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27198): Process ended prematurely: osmo-stp_10.42.42.5(pid=27198) [trial-2379↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27198)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27207): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27207) [trial-2379↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27207)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27217): Process ended prematurely: osmo-stp_10.42.42.5(pid=27217) [trial-2379↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27217)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27234): Process ended prematurely: osmo-stp_10.42.42.5(pid=27234) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27234)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27245): Process ended prematurely: osmo-stp_10.42.42.5(pid=27245) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27245)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27259): Process ended prematurely: osmo-stp_10.42.42.5(pid=27259) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27259)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27270): Process ended prematurely: osmo-stp_10.42.42.5(pid=27270) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27270)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27285): Process ended prematurely: osmo-stp_10.42.42.5(pid=27285) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27285)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27296): Process ended prematurely: osmo-stp_10.42.42.5(pid=27296) [trial-2379↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27296)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27310): Process ended prematurely: osmo-stp_10.42.42.5(pid=27310) [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27310)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27321): Process ended prematurely: osmo-stp_10.42.42.5(pid=27321) [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27321)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27335): Process ended prematurely: osmo-stp_10.42.42.5(pid=27335) [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27335)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27346): Process ended prematurely: osmo-stp_10.42.42.5(pid=27346) [trial-2379↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27346)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27360): Process ended prematurely: osmo-stp_10.42.42.5(pid=27360) [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27360)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27371): Process ended prematurely: osmo-stp_10.42.42.5(pid=27371) [trial-2379↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27371)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27385): Process ended prematurely: osmo-stp_10.42.42.5(pid=27385) [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27385)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27397): Process ended prematurely: osmo-stp_10.42.42.5(pid=27397) [trial-2379↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27397)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27412): Process ended prematurely: osmo-stp_10.42.42.5(pid=27412) [trial-2379↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27412)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27423): Process ended prematurely: osmo-stp_10.42.42.5(pid=27423) [trial-2379↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27423)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=27444): Process ended prematurely: osmo-stp_10.42.42.5(pid=27444) [trial-2379↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27444)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27456): Process ended prematurely: osmo-stp_10.42.42.5(pid=27456) [trial-2379↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27456)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=27474): Process ended prematurely: osmo-stp_10.42.42.5(pid=27474) [trial-2379↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27474)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27484): Process ended prematurely: osmo-stp_10.42.42.5(pid=27484) [trial-2379↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27484)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27494): Process ended prematurely: osmo-stp_10.42.42.5(pid=27494) [trial-2379↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27494)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=27511): Process ended prematurely: osmo-stp_10.42.42.5(pid=27511) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27511)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27523): Process ended prematurely: osmo-stp_10.42.42.5(pid=27523) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27523)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27541): Process ended prematurely: osmo-stp_10.42.42.5(pid=27541) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27541)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27551): Process ended prematurely: osmo-stp_10.42.42.5(pid=27551) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27551)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27561): Process ended prematurely: osmo-stp_10.42.42.5(pid=27561) [trial-2379↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27561)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=27580): Process ended prematurely: osmo-stp_10.42.42.5(pid=27580) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27580)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27592): Process ended prematurely: osmo-stp_10.42.42.5(pid=27592) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27592)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=27610): Process ended prematurely: osmo-stp_10.42.42.5(pid=27610) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27610)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27620): Process ended prematurely: osmo-stp_10.42.42.5(pid=27620) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27620)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27630): Process ended prematurely: osmo-stp_10.42.42.5(pid=27630) [trial-2379↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27630)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=27647): Process ended prematurely: osmo-stp_10.42.42.5(pid=27647) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27647)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27659): Process ended prematurely: osmo-stp_10.42.42.5(pid=27659) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27659)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=27677): Process ended prematurely: osmo-stp_10.42.42.5(pid=27677) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27677)] FAIL: ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=27958): Process ended prematurely: osmo-stp_10.42.42.5(pid=27958) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27958)] FAIL: ping_idle_ping.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27968): Process ended prematurely: osmo-stp_10.42.42.5(pid=27968) [trial-2379↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27968)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27982): Process ended prematurely: osmo-stp_10.42.42.5(pid=27982) [trial-2379↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27982)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27996): Process ended prematurely: osmo-stp_10.42.42.5(pid=27996) [trial-2379↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27996)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=28004): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28004) [trial-2379↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28004)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28014): Process ended prematurely: osmo-stp_10.42.42.5(pid=28014) [trial-2379↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28014)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=28023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28023) [trial-2379↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28023)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28033): Process ended prematurely: osmo-stp_10.42.42.5(pid=28033) [trial-2379↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28033)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28050): Process ended prematurely: osmo-stp_10.42.42.5(pid=28050) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28050)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28061): Process ended prematurely: osmo-stp_10.42.42.5(pid=28061) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28061)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28075): Process ended prematurely: osmo-stp_10.42.42.5(pid=28075) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28075)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28086): Process ended prematurely: osmo-stp_10.42.42.5(pid=28086) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28086)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28100): Process ended prematurely: osmo-stp_10.42.42.5(pid=28100) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28100)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28112): Process ended prematurely: osmo-stp_10.42.42.5(pid=28112) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28112)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28126): Process ended prematurely: osmo-stp_10.42.42.5(pid=28126) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28126)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28137): Process ended prematurely: osmo-stp_10.42.42.5(pid=28137) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28137)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28151): Process ended prematurely: osmo-stp_10.42.42.5(pid=28151) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28151)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28162): Process ended prematurely: osmo-stp_10.42.42.5(pid=28162) [trial-2379↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28162)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28177): Process ended prematurely: osmo-stp_10.42.42.5(pid=28177) [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28177)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28188): Process ended prematurely: osmo-stp_10.42.42.5(pid=28188) [trial-2379↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28188)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28202): Process ended prematurely: osmo-stp_10.42.42.5(pid=28202) [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28202)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28213): Process ended prematurely: osmo-stp_10.42.42.5(pid=28213) [trial-2379↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28213)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28232): Process ended prematurely: osmo-stp_10.42.42.5(pid=28232) [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28243): Process ended prematurely: osmo-stp_10.42.42.5(pid=28243) [trial-2379↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28243)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28257): Process ended prematurely: osmo-stp_10.42.42.5(pid=28257) [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28257)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28268): Process ended prematurely: osmo-stp_10.42.42.5(pid=28268) [trial-2379↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28268)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28282): Process ended prematurely: osmo-stp_10.42.42.5(pid=28282) [trial-2379↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28282)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28293): Process ended prematurely: osmo-stp_10.42.42.5(pid=28293) [trial-2379↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28293)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=28312): Process ended prematurely: osmo-stp_10.42.42.5(pid=28312) [trial-2379↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28312)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28326): Process ended prematurely: osmo-stp_10.42.42.5(pid=28326) [trial-2379↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28326)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=28344): Process ended prematurely: osmo-stp_10.42.42.5(pid=28344) [trial-2379↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28344)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28354): Process ended prematurely: osmo-stp_10.42.42.5(pid=28354) [trial-2379↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28354)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28367): Process ended prematurely: osmo-stp_10.42.42.5(pid=28367) [trial-2379↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28367)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=28384): Process ended prematurely: osmo-stp_10.42.42.5(pid=28384) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28384)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=28399): Process ended prematurely: osmo-stp_10.42.42.5(pid=28399) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28399)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=28417): Process ended prematurely: osmo-stp_10.42.42.5(pid=28417) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28417)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28427): Process ended prematurely: osmo-stp_10.42.42.5(pid=28427) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28427)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28437): Process ended prematurely: osmo-stp_10.42.42.5(pid=28437) [trial-2379↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28437)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=28454): Process ended prematurely: osmo-stp_10.42.42.5(pid=28454) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28454)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28466): Process ended prematurely: osmo-stp_10.42.42.5(pid=28466) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28466)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=28484): Process ended prematurely: osmo-stp_10.42.42.5(pid=28484) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28484)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28494): Process ended prematurely: osmo-stp_10.42.42.5(pid=28494) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28494)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28504): Process ended prematurely: osmo-stp_10.42.42.5(pid=28504) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28504)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=28523): Process ended prematurely: osmo-stp_10.42.42.5(pid=28523) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28523)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=28535): Process ended prematurely: osmo-stp_10.42.42.5(pid=28535) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28535)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=28553): Process ended prematurely: osmo-stp_10.42.42.5(pid=28553) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28553)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28563): Process ended prematurely: osmo-stp_10.42.42.5(pid=28563) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28563)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=28573): Process ended prematurely: osmo-stp_10.42.42.5(pid=28573) [trial-2379↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28573)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=28590): Process ended prematurely: osmo-stp_10.42.42.5(pid=28590) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28590)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=28603): Process ended prematurely: osmo-stp_10.42.42.5(pid=28603) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28603)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=28621): Process ended prematurely: osmo-stp_10.42.42.5(pid=28621) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28621)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28631): Process ended prematurely: osmo-stp_10.42.42.5(pid=28631) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28631)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=28642): Process ended prematurely: osmo-stp_10.42.42.5(pid=28642) [trial-2379↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28642)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28655): Process ended prematurely: osmo-stp_10.42.42.5(pid=28655) [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28655)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28668): Process ended prematurely: osmo-stp_10.42.42.5(pid=28668) [trial-2379↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28668)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=28677): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28677) [trial-2379↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28677)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28689): Process ended prematurely: osmo-stp_10.42.42.5(pid=28689) [trial-2379↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28689)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=28702): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28702) [trial-2379↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28702)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28712): Process ended prematurely: osmo-stp_10.42.42.5(pid=28712) [trial-2379↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28712)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28727): Process ended prematurely: osmo-stp_10.42.42.5(pid=28727) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28727)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28741): Process ended prematurely: osmo-stp_10.42.42.5(pid=28741) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28741)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28755): Process ended prematurely: osmo-stp_10.42.42.5(pid=28755) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28755)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28766): Process ended prematurely: osmo-stp_10.42.42.5(pid=28766) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28766)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28780): Process ended prematurely: osmo-stp_10.42.42.5(pid=28780) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28780)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28791): Process ended prematurely: osmo-stp_10.42.42.5(pid=28791) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28791)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28805): Process ended prematurely: osmo-stp_10.42.42.5(pid=28805) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28805)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28816): Process ended prematurely: osmo-stp_10.42.42.5(pid=28816) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28816)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28831): Process ended prematurely: osmo-stp_10.42.42.5(pid=28831) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28831)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28842): Process ended prematurely: osmo-stp_10.42.42.5(pid=28842) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28842)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28856): Process ended prematurely: osmo-stp_10.42.42.5(pid=28856) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28867): Process ended prematurely: osmo-stp_10.42.42.5(pid=28867) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28867)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28892): Process ended prematurely: osmo-stp_10.42.42.5(pid=28892) [trial-2379↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28892)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28909): Process ended prematurely: osmo-stp_10.42.42.5(pid=28909) [trial-2379↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28909)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28920): Process ended prematurely: osmo-stp_10.42.42.5(pid=28920) [trial-2379↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28920)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=28938): Process ended prematurely: osmo-stp_10.42.42.5(pid=28938) [trial-2379↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28938)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28950): Process ended prematurely: osmo-stp_10.42.42.5(pid=28950) [trial-2379↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28950)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=28968): Process ended prematurely: osmo-stp_10.42.42.5(pid=28968) [trial-2379↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28968)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28978): Process ended prematurely: osmo-stp_10.42.42.5(pid=28978) [trial-2379↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28978)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28988): Process ended prematurely: osmo-stp_10.42.42.5(pid=28988) [trial-2379↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28988)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=29277): Process ended prematurely: osmo-stp_10.42.42.5(pid=29277) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29277)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29289): Process ended prematurely: osmo-stp_10.42.42.5(pid=29289) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29289)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=29308): Process ended prematurely: osmo-stp_10.42.42.5(pid=29308) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29308)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29319): Process ended prematurely: osmo-stp_10.42.42.5(pid=29319) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29319)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29329): Process ended prematurely: osmo-stp_10.42.42.5(pid=29329) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29329)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29348): Process ended prematurely: osmo-stp_10.42.42.5(pid=29348) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29348)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29363): Process ended prematurely: osmo-stp_10.42.42.5(pid=29363) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29363)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29381): Process ended prematurely: osmo-stp_10.42.42.5(pid=29381) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29381)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29391): Process ended prematurely: osmo-stp_10.42.42.5(pid=29391) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29391)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29401): Process ended prematurely: osmo-stp_10.42.42.5(pid=29401) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29401)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29420): Process ended prematurely: osmo-stp_10.42.42.5(pid=29420) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29420)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29432): Process ended prematurely: osmo-stp_10.42.42.5(pid=29432) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29432)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=29450): Process ended prematurely: osmo-stp_10.42.42.5(pid=29450) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29450)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29460): Process ended prematurely: osmo-stp_10.42.42.5(pid=29460) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29460)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2379↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29484): Process ended prematurely: osmo-stp_10.42.42.5(pid=29484) [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29484)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29500): Process ended prematurely: osmo-stp_10.42.42.5(pid=29500) [trial-2379↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29500)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=29508): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29508) [trial-2379↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29508)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29518): Process ended prematurely: osmo-stp_10.42.42.5(pid=29518) [trial-2379↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=29527): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29527) [trial-2379↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29527)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29537): Process ended prematurely: osmo-stp_10.42.42.5(pid=29537) [trial-2379↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29537)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29551): Process ended prematurely: osmo-stp_10.42.42.5(pid=29551) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29551)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29562): Process ended prematurely: osmo-stp_10.42.42.5(pid=29562) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29562)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29576): Process ended prematurely: osmo-stp_10.42.42.5(pid=29576) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29576)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29587): Process ended prematurely: osmo-stp_10.42.42.5(pid=29587) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29587)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29601): Process ended prematurely: osmo-stp_10.42.42.5(pid=29601) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29601)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29612): Process ended prematurely: osmo-stp_10.42.42.5(pid=29612) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29612)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29627): Process ended prematurely: osmo-stp_10.42.42.5(pid=29627) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29627)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29638): Process ended prematurely: osmo-stp_10.42.42.5(pid=29638) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29638)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29653): Process ended prematurely: osmo-stp_10.42.42.5(pid=29653) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29653)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29665): Process ended prematurely: osmo-stp_10.42.42.5(pid=29665) [trial-2379↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29665)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29679): Process ended prematurely: osmo-stp_10.42.42.5(pid=29679) [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29679)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29691): Process ended prematurely: osmo-stp_10.42.42.5(pid=29691) [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29691)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29708): Process ended prematurely: osmo-stp_10.42.42.5(pid=29708) [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29708)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29719): Process ended prematurely: osmo-stp_10.42.42.5(pid=29719) [trial-2379↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29719)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29733): Process ended prematurely: osmo-stp_10.42.42.5(pid=29733) [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29733)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29744): Process ended prematurely: osmo-stp_10.42.42.5(pid=29744) [trial-2379↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29744)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29758): Process ended prematurely: osmo-stp_10.42.42.5(pid=29758) [trial-2379↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29758)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29769): Process ended prematurely: osmo-stp_10.42.42.5(pid=29769) [trial-2379↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29769)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=29787): Process ended prematurely: osmo-stp_10.42.42.5(pid=29787) [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29799): Process ended prematurely: osmo-stp_10.42.42.5(pid=29799) [trial-2379↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=29817): Process ended prematurely: osmo-stp_10.42.42.5(pid=29817) [trial-2379↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29817)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29827): Process ended prematurely: osmo-stp_10.42.42.5(pid=29827) [trial-2379↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29827)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29837): Process ended prematurely: osmo-stp_10.42.42.5(pid=29837) [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29837)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=29854): Process ended prematurely: osmo-stp_10.42.42.5(pid=29854) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29854)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29866): Process ended prematurely: osmo-stp_10.42.42.5(pid=29866) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29866)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=29884): Process ended prematurely: osmo-stp_10.42.42.5(pid=29884) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29884)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29894): Process ended prematurely: osmo-stp_10.42.42.5(pid=29894) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29894)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29904): Process ended prematurely: osmo-stp_10.42.42.5(pid=29904) [trial-2379↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29904)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=29921): Process ended prematurely: osmo-stp_10.42.42.5(pid=29921) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29921)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29933): Process ended prematurely: osmo-stp_10.42.42.5(pid=29933) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29933)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=29951): Process ended prematurely: osmo-stp_10.42.42.5(pid=29951) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29951)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29961): Process ended prematurely: osmo-stp_10.42.42.5(pid=29961) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29961)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29971): Process ended prematurely: osmo-stp_10.42.42.5(pid=29971) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29971)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29988): Process ended prematurely: osmo-stp_10.42.42.5(pid=29988) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29988)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30000): Process ended prematurely: osmo-stp_10.42.42.5(pid=30000) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30000)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=30027): Process ended prematurely: osmo-stp_10.42.42.5(pid=30027) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30027)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30037): Process ended prematurely: osmo-stp_10.42.42.5(pid=30037) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30037)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30050): Process ended prematurely: osmo-stp_10.42.42.5(pid=30050) [trial-2379↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30050)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=30067): Process ended prematurely: osmo-stp_10.42.42.5(pid=30067) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30067)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30079): Process ended prematurely: osmo-stp_10.42.42.5(pid=30079) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30079)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30097): Process ended prematurely: osmo-stp_10.42.42.5(pid=30097) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30097)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30107): Process ended prematurely: osmo-stp_10.42.42.5(pid=30107) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30107)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30117): Process ended prematurely: osmo-stp_10.42.42.5(pid=30117) [trial-2379↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30117)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30130): Process ended prematurely: osmo-stp_10.42.42.5(pid=30130) [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30130)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30144): Process ended prematurely: osmo-stp_10.42.42.5(pid=30144) [trial-2379↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30144)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=30152): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30152) [trial-2379↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30152)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30162): Process ended prematurely: osmo-stp_10.42.42.5(pid=30162) [trial-2379↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30162)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=30171): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30171) [trial-2379↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30171)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30181): Process ended prematurely: osmo-stp_10.42.42.5(pid=30181) [trial-2379↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30181)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30195): Process ended prematurely: osmo-stp_10.42.42.5(pid=30195) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30195)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30206): Process ended prematurely: osmo-stp_10.42.42.5(pid=30206) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30220): Process ended prematurely: osmo-stp_10.42.42.5(pid=30220) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30220)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30231): Process ended prematurely: osmo-stp_10.42.42.5(pid=30231) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30231)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30246): Process ended prematurely: osmo-stp_10.42.42.5(pid=30246) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30246)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30257): Process ended prematurely: osmo-stp_10.42.42.5(pid=30257) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30257)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30282): Process ended prematurely: osmo-stp_10.42.42.5(pid=30282) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30282)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30293): Process ended prematurely: osmo-stp_10.42.42.5(pid=30293) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30293)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30307): Process ended prematurely: osmo-stp_10.42.42.5(pid=30307) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30307)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=30318): Process ended prematurely: osmo-stp_10.42.42.5(pid=30318) [trial-2379↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30318)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=30603): Process ended prematurely: osmo-stp_10.42.42.5(pid=30603) [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30603)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30615): Process ended prematurely: osmo-stp_10.42.42.5(pid=30615) [trial-2379↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30615)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30629): Process ended prematurely: osmo-stp_10.42.42.5(pid=30629) [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30629)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30640): Process ended prematurely: osmo-stp_10.42.42.5(pid=30640) [trial-2379↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30640)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30661): Process ended prematurely: osmo-stp_10.42.42.5(pid=30661) [trial-2379↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30661)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30672): Process ended prematurely: osmo-stp_10.42.42.5(pid=30672) [trial-2379↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30672)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30693): Process ended prematurely: osmo-stp_10.42.42.5(pid=30693) [trial-2379↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30693)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30705): Process ended prematurely: osmo-stp_10.42.42.5(pid=30705) [trial-2379↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30705)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30723): Process ended prematurely: osmo-stp_10.42.42.5(pid=30723) [trial-2379↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30723)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30733): Process ended prematurely: osmo-stp_10.42.42.5(pid=30733) [trial-2379↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30733)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30743): Process ended prematurely: osmo-stp_10.42.42.5(pid=30743) [trial-2379↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30743)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30760): Process ended prematurely: osmo-stp_10.42.42.5(pid=30760) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30772): Process ended prematurely: osmo-stp_10.42.42.5(pid=30772) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30772)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=30790): Process ended prematurely: osmo-stp_10.42.42.5(pid=30790) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30790)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30800): Process ended prematurely: osmo-stp_10.42.42.5(pid=30800) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30800)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30810): Process ended prematurely: osmo-stp_10.42.42.5(pid=30810) [trial-2379↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30810)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30828): Process ended prematurely: osmo-stp_10.42.42.5(pid=30828) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30828)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30840): Process ended prematurely: osmo-stp_10.42.42.5(pid=30840) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30840)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=30858): Process ended prematurely: osmo-stp_10.42.42.5(pid=30858) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30858)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30868): Process ended prematurely: osmo-stp_10.42.42.5(pid=30868) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30868)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30878): Process ended prematurely: osmo-stp_10.42.42.5(pid=30878) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30878)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30897): Process ended prematurely: osmo-stp_10.42.42.5(pid=30897) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30897)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30909): Process ended prematurely: osmo-stp_10.42.42.5(pid=30909) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30909)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30927): Process ended prematurely: osmo-stp_10.42.42.5(pid=30927) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30927)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30937): Process ended prematurely: osmo-stp_10.42.42.5(pid=30937) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30937)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30947): Process ended prematurely: osmo-stp_10.42.42.5(pid=30947) [trial-2379↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30947)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30961): Process ended prematurely: osmo-stp_10.42.42.5(pid=30961) [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30961)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30974): Process ended prematurely: osmo-stp_10.42.42.5(pid=30974) [trial-2379↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30974)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=30982): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30982) [trial-2379↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30982)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30992): Process ended prematurely: osmo-stp_10.42.42.5(pid=30992) [trial-2379↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30992)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=31001): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31001) [trial-2379↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31001)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31012): Process ended prematurely: osmo-stp_10.42.42.5(pid=31012) [trial-2379↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31012)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31029): Process ended prematurely: osmo-stp_10.42.42.5(pid=31029) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31029)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31040): Process ended prematurely: osmo-stp_10.42.42.5(pid=31040) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31040)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31054): Process ended prematurely: osmo-stp_10.42.42.5(pid=31054) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31054)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31065): Process ended prematurely: osmo-stp_10.42.42.5(pid=31065) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31065)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31079): Process ended prematurely: osmo-stp_10.42.42.5(pid=31079) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31079)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31090): Process ended prematurely: osmo-stp_10.42.42.5(pid=31090) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31090)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31104): Process ended prematurely: osmo-stp_10.42.42.5(pid=31104) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31104)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31115): Process ended prematurely: osmo-stp_10.42.42.5(pid=31115) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31115)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31130): Process ended prematurely: osmo-stp_10.42.42.5(pid=31130) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31130)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31141): Process ended prematurely: osmo-stp_10.42.42.5(pid=31141) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31141)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31155): Process ended prematurely: osmo-stp_10.42.42.5(pid=31155) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31155)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31166): Process ended prematurely: osmo-stp_10.42.42.5(pid=31166) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31166)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31180): Process ended prematurely: osmo-stp_10.42.42.5(pid=31180) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31180)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31191): Process ended prematurely: osmo-stp_10.42.42.5(pid=31191) [trial-2379↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31191)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31205): Process ended prematurely: osmo-stp_10.42.42.5(pid=31205) [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31205)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31216): Process ended prematurely: osmo-stp_10.42.42.5(pid=31216) [trial-2379↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31216)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31235): Process ended prematurely: osmo-stp_10.42.42.5(pid=31235) [trial-2379↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31235)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31247): Process ended prematurely: osmo-stp_10.42.42.5(pid=31247) [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31247)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31265): Process ended prematurely: osmo-stp_10.42.42.5(pid=31265) [trial-2379↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31265)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31275): Process ended prematurely: osmo-stp_10.42.42.5(pid=31275) [trial-2379↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31275)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31285): Process ended prematurely: osmo-stp_10.42.42.5(pid=31285) [trial-2379↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31285)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31315): Process ended prematurely: osmo-stp_10.42.42.5(pid=31315) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31315)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=31333): Process ended prematurely: osmo-stp_10.42.42.5(pid=31333) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31333)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31346): Process ended prematurely: osmo-stp_10.42.42.5(pid=31346) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31346)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31356): Process ended prematurely: osmo-stp_10.42.42.5(pid=31356) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31356)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=31382): Process ended prematurely: osmo-stp_10.42.42.5(pid=31382) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31382)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=31601): Process ended prematurely: osmo-stp_10.42.42.5(pid=31601) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31601)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=31942): Process ended prematurely: osmo-stp_10.42.42.5(pid=31942) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31942)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31954): Process ended prematurely: osmo-stp_10.42.42.5(pid=31954) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31954)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31964): Process ended prematurely: osmo-stp_10.42.42.5(pid=31964) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31964)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=31981): Process ended prematurely: osmo-stp_10.42.42.5(pid=31981) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31981)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31993): Process ended prematurely: osmo-stp_10.42.42.5(pid=31993) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31993)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=32011): Process ended prematurely: osmo-stp_10.42.42.5(pid=32011) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32011)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32021): Process ended prematurely: osmo-stp_10.42.42.5(pid=32021) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32021)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32031): Process ended prematurely: osmo-stp_10.42.42.5(pid=32031) [trial-2379↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32031)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32044): Process ended prematurely: osmo-stp_10.42.42.5(pid=32044) [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32044)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32057): Process ended prematurely: osmo-stp_10.42.42.5(pid=32057) [trial-2379↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32057)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=32066): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32066) [trial-2379↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32066)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32076): Process ended prematurely: osmo-stp_10.42.42.5(pid=32076) [trial-2379↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32076)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32086): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32086) [trial-2379↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32086)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32097): Process ended prematurely: osmo-stp_10.42.42.5(pid=32097) [trial-2379↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32097)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32111): Process ended prematurely: osmo-stp_10.42.42.5(pid=32111) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32111)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32122): Process ended prematurely: osmo-stp_10.42.42.5(pid=32122) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32122)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32136): Process ended prematurely: osmo-stp_10.42.42.5(pid=32136) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32136)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32147): Process ended prematurely: osmo-stp_10.42.42.5(pid=32147) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32147)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32161): Process ended prematurely: osmo-stp_10.42.42.5(pid=32161) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32161)] FAIL: mo_mt_call_osmux.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=32441): Process ended prematurely: osmo-stp_10.42.42.5(pid=32441) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32441)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=32457): Process ended prematurely: osmo-stp_10.42.42.5(pid=32457) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32457)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32469): Process ended prematurely: osmo-stp_10.42.42.5(pid=32469) [trial-2379↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32469)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32485): Process ended prematurely: osmo-stp_10.42.42.5(pid=32485) [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32485)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32496): Process ended prematurely: osmo-stp_10.42.42.5(pid=32496) [trial-2379↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32496)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32510): Process ended prematurely: osmo-stp_10.42.42.5(pid=32510) [trial-2379↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32510)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32521): Process ended prematurely: osmo-stp_10.42.42.5(pid=32521) [trial-2379↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32521)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=32542): Process ended prematurely: osmo-stp_10.42.42.5(pid=32542) [trial-2379↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32542)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32554): Process ended prematurely: osmo-stp_10.42.42.5(pid=32554) [trial-2379↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32554)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=32572): Process ended prematurely: osmo-stp_10.42.42.5(pid=32572) [trial-2379↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32572)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32582): Process ended prematurely: osmo-stp_10.42.42.5(pid=32582) [trial-2379↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32582)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32592): Process ended prematurely: osmo-stp_10.42.42.5(pid=32592) [trial-2379↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32592)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=32610): Process ended prematurely: osmo-stp_10.42.42.5(pid=32610) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32610)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=32626): Process ended prematurely: osmo-stp_10.42.42.5(pid=32626) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32626)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=32644): Process ended prematurely: osmo-stp_10.42.42.5(pid=32644) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32644)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32654): Process ended prematurely: osmo-stp_10.42.42.5(pid=32654) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32654)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=32664): Process ended prematurely: osmo-stp_10.42.42.5(pid=32664) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32664)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=32681): Process ended prematurely: osmo-stp_10.42.42.5(pid=32681) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32681)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32693): Process ended prematurely: osmo-stp_10.42.42.5(pid=32693) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32693)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=32711): Process ended prematurely: osmo-stp_10.42.42.5(pid=32711) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32711)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32721): Process ended prematurely: osmo-stp_10.42.42.5(pid=32721) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32721)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32732): Process ended prematurely: osmo-stp_10.42.42.5(pid=32732) [trial-2379↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32732)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32747): Process ended prematurely: osmo-stp_10.42.42.5(pid=32747) [trial-2379↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32747)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32760): Process ended prematurely: osmo-stp_10.42.42.5(pid=32760) [trial-2379↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32760)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=301): Process ended prematurely: osmo-nitb_10.42.42.2(pid=301) [trial-2379↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=301)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=311): Process ended prematurely: osmo-stp_10.42.42.5(pid=311) [trial-2379↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=311)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=325): Process ended prematurely: osmo-stp_10.42.42.5(pid=325) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=325)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=337): Process ended prematurely: osmo-stp_10.42.42.5(pid=337) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=337)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=359): Process ended prematurely: osmo-stp_10.42.42.5(pid=359) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=359)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=375): Process ended prematurely: osmo-stp_10.42.42.5(pid=375) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=375)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=390): Process ended prematurely: osmo-stp_10.42.42.5(pid=390) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=390)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=401): Process ended prematurely: osmo-stp_10.42.42.5(pid=401) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=401)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=415): Process ended prematurely: osmo-stp_10.42.42.5(pid=415) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=415)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=429): Process ended prematurely: osmo-stp_10.42.42.5(pid=429) [trial-2379↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=429)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=443): Process ended prematurely: osmo-stp_10.42.42.5(pid=443) [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=443)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=454): Process ended prematurely: osmo-stp_10.42.42.5(pid=454) [trial-2379↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=454)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=468): Process ended prematurely: osmo-stp_10.42.42.5(pid=468) [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=468)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=479): Process ended prematurely: osmo-stp_10.42.42.5(pid=479) [trial-2379↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=479)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=494): Process ended prematurely: osmo-stp_10.42.42.5(pid=494) [trial-2379↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=494)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=505): Process ended prematurely: osmo-stp_10.42.42.5(pid=505) [trial-2379↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=505)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=523): Process ended prematurely: osmo-stp_10.42.42.5(pid=523) [trial-2379↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=523)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=535): Process ended prematurely: osmo-stp_10.42.42.5(pid=535) [trial-2379↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=535)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=553): Process ended prematurely: osmo-stp_10.42.42.5(pid=553) [trial-2379↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=553)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=566): Process ended prematurely: osmo-stp_10.42.42.5(pid=566) [trial-2379↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=566)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=576): Process ended prematurely: osmo-stp_10.42.42.5(pid=576) [trial-2379↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=576)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=593): Process ended prematurely: osmo-stp_10.42.42.5(pid=593) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=593)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=605): Process ended prematurely: osmo-stp_10.42.42.5(pid=605) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=605)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=623): Process ended prematurely: osmo-stp_10.42.42.5(pid=623) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=623)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=633): Process ended prematurely: osmo-stp_10.42.42.5(pid=633) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=633)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=643): Process ended prematurely: osmo-stp_10.42.42.5(pid=643) [trial-2379↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=643)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=660): Process ended prematurely: osmo-stp_10.42.42.5(pid=660) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=660)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=672): Process ended prematurely: osmo-stp_10.42.42.5(pid=672) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=672)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=690): Process ended prematurely: osmo-stp_10.42.42.5(pid=690) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=690)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=700): Process ended prematurely: osmo-stp_10.42.42.5(pid=700) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=700)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=711): Process ended prematurely: osmo-stp_10.42.42.5(pid=711) [trial-2379↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=711)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=729): Process ended prematurely: osmo-stp_10.42.42.5(pid=729) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=729)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=741): Process ended prematurely: osmo-stp_10.42.42.5(pid=741) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=741)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=759): Process ended prematurely: osmo-stp_10.42.42.5(pid=759) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=759)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=772): Process ended prematurely: osmo-stp_10.42.42.5(pid=772) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=772)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=782): Process ended prematurely: osmo-stp_10.42.42.5(pid=782) [trial-2379↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=782)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=796): Process ended prematurely: osmo-stp_10.42.42.5(pid=796) [trial-2379↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=796)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=805): Process ended prematurely: osmo-nitb_10.42.42.2(pid=805) [trial-2379↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=805)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=807): Process ended prematurely: osmo-nitb_10.42.42.2(pid=807) [trial-2379↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=807)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=809): Process ended prematurely: osmo-nitb_10.42.42.2(pid=809) [trial-2379↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=809)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=811): Process ended prematurely: osmo-nitb_10.42.42.2(pid=811) [trial-2379↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=811)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=821): Process ended prematurely: osmo-hlr_10.42.42.2(pid=821) [trial-2379↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=821)] FAIL: esme_connect_policy_closed.py (6.0 sec) Error: osmo-hlr_10.42.42.2(pid=836): Process ended prematurely: osmo-hlr_10.42.42.2(pid=836) [trial-2379↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=836)] FAIL: esme_ms_sms_storeforward.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=849): Process ended prematurely: osmo-stp_10.42.42.5(pid=849) [trial-2379↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=849)] FAIL: esme_ms_sms_transaction.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=860): Process ended prematurely: osmo-stp_10.42.42.5(pid=860) [trial-2379↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=860)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=888): Process ended prematurely: osmo-stp_10.42.42.5(pid=888) [trial-2379↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=888)] FAIL: register_a5_0_authreq.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=899): Process ended prematurely: osmo-stp_10.42.42.5(pid=899) [trial-2379↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=899)] FAIL: register_a5_1_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=910): Process ended prematurely: osmo-stp_10.42.42.5(pid=910) [trial-2379↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=910)] FAIL: register_a5_3_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=921): Process ended prematurely: osmo-stp_10.42.42.5(pid=921) [trial-2379↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=921)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.0 sec) Error: srsepc(pid=944): Process ended prematurely: srsepc(pid=944) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=944)] FAIL: iperf3_bidir.py (19.0 sec) Error: srsepc(pid=964): Process ended prematurely: srsepc(pid=964) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=964)] FAIL: iperf3_dl.py (18.7 sec) Error: srsepc(pid=980): Process ended prematurely: srsepc(pid=980) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=980)] FAIL: iperf3_ul.py (18.9 sec) Error: srsepc(pid=1001): Process ended prematurely: srsepc(pid=1001) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1001)] FAIL: ping.py (18.8 sec) Error: srsepc(pid=1017): Process ended prematurely: srsepc(pid=1017) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1017)] FAIL: rrc_idle_mo_ping.py (19.1 sec) Error: srsepc(pid=1318): Process ended prematurely: srsepc(pid=1318) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1318)] FAIL: rrc_idle_mt_ping.py (19.1 sec) Error: srsepc(pid=1336): Process ended prematurely: srsepc(pid=1336) [trial-2379↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1336)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1349): Process ended prematurely: osmo-stp_10.42.42.5(pid=1349) [trial-2379↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1349)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1365): Process ended prematurely: osmo-stp_10.42.42.5(pid=1365) [trial-2379↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1365)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1382): Process ended prematurely: osmo-stp_10.42.42.5(pid=1382) [trial-2379↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1382)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1398): Process ended prematurely: osmo-stp_10.42.42.5(pid=1398) [trial-2379↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1398)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1415): Process ended prematurely: osmo-stp_10.42.42.5(pid=1415) [trial-2379↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1415)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1429): Process ended prematurely: osmo-stp_10.42.42.5(pid=1429) [trial-2379↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1429)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=1443): Process ended prematurely: osmo-stp_10.42.42.5(pid=1443) [trial-2379↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1443)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1459): Process ended prematurely: osmo-stp_10.42.42.5(pid=1459) [trial-2379↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1459)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1473): Process ended prematurely: osmo-stp_10.42.42.5(pid=1473) [trial-2379↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1473)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1487): Process ended prematurely: osmo-stp_10.42.42.5(pid=1487) [trial-2379↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1487)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=1501): Process ended prematurely: osmo-stp_10.42.42.5(pid=1501) [trial-2379↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1501)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=1515): Process ended prematurely: osmo-stp_10.42.42.5(pid=1515) [trial-2379↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1515)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1529): Process ended prematurely: osmo-stp_10.42.42.5(pid=1529) [trial-2379↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1529)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1543): Process ended prematurely: osmo-stp_10.42.42.5(pid=1543) [trial-2379↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1543)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1557): Process ended prematurely: osmo-stp_10.42.42.5(pid=1557) [trial-2379↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1557)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1571): Process ended prematurely: osmo-stp_10.42.42.5(pid=1571) [trial-2379↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1571)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1585): Process ended prematurely: osmo-stp_10.42.42.5(pid=1585) [trial-2379↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1585)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1599): Process ended prematurely: osmo-stp_10.42.42.5(pid=1599) [trial-2379↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1599)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1613): Process ended prematurely: osmo-stp_10.42.42.5(pid=1613) [trial-2379↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1613)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1627): Process ended prematurely: osmo-stp_10.42.42.5(pid=1627) [trial-2379↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1627)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=1641): Process ended prematurely: osmo-stp_10.42.42.5(pid=1641) [trial-2379↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1641)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1655): Process ended prematurely: osmo-stp_10.42.42.5(pid=1655) [trial-2379↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1655)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1669): Process ended prematurely: osmo-stp_10.42.42.5(pid=1669) [trial-2379↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1669)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1683): Process ended prematurely: osmo-stp_10.42.42.5(pid=1683) [trial-2379↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1683)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=1697): Process ended prematurely: osmo-stp_10.42.42.5(pid=1697) [trial-2379↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1697)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1711): Process ended prematurely: osmo-stp_10.42.42.5(pid=1711) [trial-2379↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1711)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1725): Process ended prematurely: osmo-stp_10.42.42.5(pid=1725) [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1725)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1743): Process ended prematurely: osmo-stp_10.42.42.5(pid=1743) [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1743)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1758): Process ended prematurely: osmo-stp_10.42.42.5(pid=1758) [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1758)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1772): Process ended prematurely: osmo-stp_10.42.42.5(pid=1772) [trial-2379↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1772)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1790): Process ended prematurely: osmo-stp_10.42.42.5(pid=1790) [trial-2379↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1790)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1804): Process ended prematurely: osmo-stp_10.42.42.5(pid=1804) [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1804)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1820): Process ended prematurely: osmo-stp_10.42.42.5(pid=1820) [trial-2379↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1820)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1834): Process ended prematurely: osmo-stp_10.42.42.5(pid=1834) [trial-2379↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1834)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1848): Process ended prematurely: osmo-stp_10.42.42.5(pid=1848) [trial-2379↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1848)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1862): Process ended prematurely: osmo-stp_10.42.42.5(pid=1862) [trial-2379↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1862)] + rm -rf trial-2379/inst + cd trial-2379 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-12 16:06:05 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379-run.tgz run.2022-12-12_16-06-15 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17673.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6687.tgz osmo-hlr.build-8709.tgz osmo-hnbgw.build-2977.tgz osmo-mgw.build-8955.tgz osmo-msc.build-29293.tgz osmo-nitb.build-12983.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30076.tgz osmo-stp.build-9251.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4707.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE