Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8944 originally caused by: Started by upstream project "master-osmo-mgw" build number 9176 originally caused by: Started by upstream project "master-libosmo-netif" build number 6955 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17653 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8944 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2948 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29260 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30036 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9239 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins4847129725457189159.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 17:09:56 + trial_dir_prefix=trial- + rm -rf trial-2361 trial-2361-bin.tgz trial-2361-run.tgz + trial_dir=trial-2362 + mkdir -p trial-2362 + mv open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2948.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29260.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30036.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz trial-2362 + cat open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2948.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29260.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30036.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2948.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29260.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30036.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2362 combinations: None trial: 'trial-2362' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2362 -------------------------------------------------------------------------------------------- 17:10:07.286050 tst trial-2362: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/log --------------------------------------------------------------------- trial-2362 nitb_sms:sysmo --------------------------------------------------------------------- 17:12:15.850560 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:15.854473 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 17:12:15.877749 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 17:12:15.885750 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 17:12:15.946212 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 17:12:15.972608 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 17:12:15.981913 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 17:12:16.517547 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 17:12:16.524335 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 17:12:16.536834 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 17:12:16.932170 tst mo_mt_sms.py: using LAC 22486 17:12:17.188135 tst mo_mt_sms.py: using RAC 46 17:12:17.313323 tst mo_mt_sms.py: using CellId 22486 17:12:17.435160 tst mo_mt_sms.py: using BVCI 22487 17:12:17.549520 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 17:12:17.731835 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 17:12:17.849915 tst mo_mt_sms.py:9: start nitb and bts... 17:12:18.065508 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:12:20.394119 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25797): Launched 17:12:20.717677 run osmo-nitb_10.42.42.2(pid=25798): Launched 17:12:20.893643 run osmo-nitb_10.42.42.2(pid=25798): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25798)] 17:12:21.025406 run osmo-nitb_10.42.42.2(pid=25798): stdout: | (launched: 2022-12-09_17:12:20.657555) 17:12:21.159538 run osmo-nitb_10.42.42.2(pid=25798): stderr: | (launched: 2022-12-09_17:12:20.705711) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:21.293483 run osmo-nitb_10.42.42.2(pid=25798): stdout: | (launched: 2022-12-09_17:12:20.657555) 17:12:21.421416 run osmo-nitb_10.42.42.2(pid=25798): stderr: | (launched: 2022-12-09_17:12:20.705711) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:21.574436 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25798): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25798) [trial-2362↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25798)] [trial-2362↪nitb_sms:sysmo↪mo_mt_sms.py:11] 17:12:21.583331 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 17:12:21.590341 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25797): Terminating (SIGTERM) 17:12:21.801878 --- ParallelTerminationStrategy: PID 25797 died... 17:12:21.823590 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25797): Terminated: ok {rc=0} 17:12:21.913383 bus /sierra_3: Setting Powered False 17:12:23.016746 bus /sierra_3: Setting Powered False 17:12:24.136035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 sms:sysmo --------------------------------------------------------------------- 17:12:25.322585 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:25.326572 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 17:12:25.347395 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 17:12:25.374137 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 17:12:25.427828 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 17:12:25.448538 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 17:12:25.474754 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 17:12:26.019225 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 sms:sysmo mo_mt_sms.py ---------------------------------------------- 17:12:26.024091 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.034605 tst sms:sysmo: Using 1 x bts (candidates: 1) 17:12:26.071706 tst mo_mt_sms.py: using LAC 22487 17:12:26.189885 tst mo_mt_sms.py: using RAC 47 17:12:26.315497 tst mo_mt_sms.py: using CellId 22487 17:12:26.441548 tst mo_mt_sms.py: using BVCI 22488 17:12:26.551504 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.562332 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.572678 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.583185 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.593649 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:12:26.603921 tst sms:sysmo: Using 1 x modem (candidates: 2) 17:12:26.722245 tst sms:sysmo: Using 1 x modem (candidates: 2) 17:12:26.840864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:28.542276 run create_hlr_db(pid=25802): Launched 17:12:28.657907 bus /sierra_2: Setting Powered False 17:12:29.717821 run create_hlr_db(pid=25802): Terminated: ok {rc=0} 17:12:30.162107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25804): Launched 17:12:30.486134 run osmo-hlr_10.42.42.2(pid=25805): Launched 17:12:30.612364 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:33.194580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25807): Launched 17:12:33.520757 run osmo-stp_10.42.42.5(pid=25808): Launched 17:12:33.645505 run osmo-msc_10.42.42.6: Starting osmo-msc 17:12:38.988177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25812): Launched 17:12:39.291863 run osmo-msc_10.42.42.6(pid=25813): Launched 17:12:39.460072 run osmo-stp_10.42.42.5(pid=25808): ERR: Terminated: ERROR {rc=1} [trial-2362↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25808)] 17:12:39.586760 run osmo-stp_10.42.42.5(pid=25808): stdout: | (launched: 2022-12-09_17:12:33.460405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:39.713216 run osmo-stp_10.42.42.5(pid=25808): stderr: | 20221209171233655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171233656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171233656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171233656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171233657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171233657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171233657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:39.838171 run osmo-stp_10.42.42.5(pid=25808): stdout: | (launched: 2022-12-09_17:12:33.460405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:39.957606 run osmo-stp_10.42.42.5(pid=25808): stderr: | 20221209171233655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171233656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171233656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171233656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171233657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171233657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171233657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:40.100123 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25808): Process ended prematurely: osmo-stp_10.42.42.5(pid=25808) [trial-2362↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25808)] [trial-2362↪sms:sysmo↪mo_mt_sms.py:16] 17:12:40.108560 tst mo_mt_sms.py:16: Test FAILED (14.1 sec) 17:12:40.134620 run osmo-hlr_10.42.42.2(pid=25805): ERR: Terminated: ERROR {rc=237} [trial-2362↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25805)] 17:12:40.182931 run osmo-hlr_10.42.42.2(pid=25805): stdout: | (launched: 2022-12-09_17:12:30.426009) 17:12:40.233236 run osmo-hlr_10.42.42.2(pid=25805): stderr: | 20221209171230628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171230628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171230628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171230628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171230628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171230628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171230641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171230649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171230649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171230649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:40.302982 run osmo-msc_10.42.42.6(pid=25813): ERR: Terminated: ERROR {rc=2} [trial-2362↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25813)] 17:12:40.351805 run osmo-msc_10.42.42.6(pid=25813): stdout: | (launched: 2022-12-09_17:12:39.235221) 17:12:40.401775 run osmo-msc_10.42.42.6(pid=25813): stderr: | 20221209171239511 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171239511 DLGLOBAL DEBUG validating counter group 0x7fe313a1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171239511 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171239511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171239512 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171239512 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171239514 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171239514 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171239514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171239514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:12:40.452167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25804): Terminating (SIGTERM) 17:12:40.492359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25807): Terminating (SIGTERM) 17:12:40.532701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25812): Terminating (SIGTERM) 17:12:40.573230 --- ParallelTerminationStrategy: PID 25804 died... 17:12:40.592519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25804): Terminated: ok {rc=0} 17:12:40.637061 --- ParallelTerminationStrategy: PID 25807 died... 17:12:40.660734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25807): Terminated: ok {rc=0} 17:12:40.709561 --- ParallelTerminationStrategy: PID 25812 died... 17:12:40.729488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25812): Terminated: ok {rc=0} 17:12:40.821617 bus /sierra_3: Setting Powered False 17:12:41.922460 bus /sierra_3: Setting Powered False 17:12:43.040791 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_ussd:sysmo --------------------------------------------------------------------- 17:12:44.279120 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:44.283563 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 17:12:44.305850 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 17:12:44.313354 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 17:12:44.350941 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 17:12:44.372460 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 17:12:44.379876 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 17:12:44.897815 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 17:12:44.902722 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 17:12:44.914398 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 17:12:44.948382 tst assert_extension.py: using LAC 22488 17:12:45.071556 tst assert_extension.py: using RAC 48 17:12:45.201004 tst assert_extension.py: using CellId 22488 17:12:45.327162 tst assert_extension.py: using BVCI 22489 17:12:45.438875 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 17:12:45.552662 tst assert_extension.py:10: start nitb and bts... 17:12:45.754216 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:12:46.395747 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25819): Launched 17:12:46.715308 run osmo-nitb_10.42.42.2(pid=25820): Launched 17:12:46.936171 run osmo-nitb_10.42.42.2(pid=25820): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25820)] 17:12:47.079685 run osmo-nitb_10.42.42.2(pid=25820): stdout: | (launched: 2022-12-09_17:12:46.656575) 17:12:47.224278 run osmo-nitb_10.42.42.2(pid=25820): stderr: | (launched: 2022-12-09_17:12:46.702001) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:47.385525 run osmo-nitb_10.42.42.2(pid=25820): stdout: | (launched: 2022-12-09_17:12:46.656575) 17:12:47.519304 run osmo-nitb_10.42.42.2(pid=25820): stderr: | (launched: 2022-12-09_17:12:46.702001) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25820): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25820) [trial-2362↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25820)] 17:12:47.878083 tst osmo-nitb_10.42.42.2(pid=25820): stdout: | (launched: 2022-12-09_17:12:46.656575) 17:12:48.000057 tst osmo-nitb_10.42.42.2(pid=25820): stderr: | (launched: 2022-12-09_17:12:46.702001) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:12:48.143107 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25820): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25820) [trial-2362↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25820)] [trial-2362↪nitb_ussd:sysmo↪assert_extension.py:12] 17:12:48.151714 tst assert_extension.py:12: Test FAILED (3.2 sec) 17:12:48.158388 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25819): Terminating (SIGTERM) 17:12:48.368277 --- ParallelTerminationStrategy: PID 25819 died... 17:12:48.388742 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25819): Terminated: ok {rc=0} 17:12:48.475738 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 ussd:sysmo --------------------------------------------------------------------- 17:12:49.698013 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:49.702249 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 17:12:49.724321 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 17:12:49.751826 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 17:12:49.786312 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 17:12:49.806974 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 17:12:49.833427 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 17:12:50.363525 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 ussd:sysmo assert_extension.py ---------------------------------------------- 17:12:50.368750 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.379486 tst ussd:sysmo: Using 1 x bts (candidates: 1) 17:12:50.415110 tst assert_extension.py: using LAC 22489 17:12:50.538440 tst assert_extension.py: using RAC 49 17:12:50.662917 tst assert_extension.py: using CellId 22489 17:12:50.789976 tst assert_extension.py: using BVCI 22490 17:12:50.906491 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.917754 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.928827 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.939962 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.951092 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:12:50.961957 tst ussd:sysmo: Using 1 x modem (candidates: 1) 17:12:51.075098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:12:51.542895 run create_hlr_db(pid=25824): Launched 17:12:51.659301 bus /sierra_2: Setting Powered False 17:12:52.719923 run create_hlr_db(pid=25824): Terminated: ok {rc=0} 17:12:53.164310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25826): Launched 17:12:53.489634 run osmo-hlr_10.42.42.2(pid=25827): Launched 17:12:53.615301 run osmo-stp_10.42.42.5: Starting osmo-stp 17:12:54.174266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25829): Launched 17:12:54.498534 run osmo-stp_10.42.42.5(pid=25830): Launched 17:12:54.623218 run osmo-msc_10.42.42.6: Starting osmo-msc 17:12:55.207381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25832): Launched 17:12:55.531657 run osmo-msc_10.42.42.6(pid=25833): Launched 17:12:55.713474 run osmo-stp_10.42.42.5(pid=25830): ERR: Terminated: ERROR {rc=1} [trial-2362↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25830)] 17:12:55.850076 run osmo-stp_10.42.42.5(pid=25830): stdout: | (launched: 2022-12-09_17:12:54.438188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:55.987833 run osmo-stp_10.42.42.5(pid=25830): stderr: | 20221209171254632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171254632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171254632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171254633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171254633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171254633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171254633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:56.124758 run osmo-stp_10.42.42.5(pid=25830): stdout: | (launched: 2022-12-09_17:12:54.438188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:12:56.253516 run osmo-stp_10.42.42.5(pid=25830): stderr: | 20221209171254632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171254632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171254632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171254633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171254633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171254633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171254633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:12:56.407663 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25830): Process ended prematurely: osmo-stp_10.42.42.5(pid=25830) [trial-2362↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25830)] [trial-2362↪ussd:sysmo↪assert_extension.py:17] 17:12:56.416667 tst assert_extension.py:17: Test FAILED (6.0 sec) 17:12:56.444212 run osmo-hlr_10.42.42.2(pid=25827): ERR: Terminated: ERROR {rc=237} [trial-2362↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25827)] 17:12:56.494847 run osmo-hlr_10.42.42.2(pid=25827): stdout: | (launched: 2022-12-09_17:12:53.428748) 17:12:56.547453 run osmo-hlr_10.42.42.2(pid=25827): stderr: | 20221209171253631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171253631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171253631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171253631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171253631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171253631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171253675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171253685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171253686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171253686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:12:56.621109 run osmo-msc_10.42.42.6(pid=25833): ERR: Terminated: ERROR {rc=2} [trial-2362↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25833)] 17:12:56.671892 run osmo-msc_10.42.42.6(pid=25833): stdout: | (launched: 2022-12-09_17:12:55.471358) 17:12:56.724391 run osmo-msc_10.42.42.6(pid=25833): stderr: | 20221209171255794 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171255794 DLGLOBAL DEBUG validating counter group 0x7f7e51152c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171255794 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171255794 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171255794 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171255794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171255796 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171255796 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171255797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171255797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:12:56.777419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25826): Terminating (SIGTERM) 17:12:56.819966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25829): Terminating (SIGTERM) 17:12:56.862449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25832): Terminating (SIGTERM) 17:12:56.904849 --- ParallelTerminationStrategy: PID 25826 died... 17:12:56.925060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25826): Terminated: ok {rc=0} 17:12:56.971729 --- ParallelTerminationStrategy: PID 25829 died... 17:12:56.991630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25829): Terminated: ok {rc=0} 17:12:57.038093 --- ParallelTerminationStrategy: PID 25832 died... 17:12:57.057710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25832): Terminated: ok {rc=0} 17:12:57.146613 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:12:58.345220 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:12:58.351775 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:12:58.372737 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:12:58.401277 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:12:58.452793 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:12:58.473479 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:12:58.500105 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:12:59.050895 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:12:59.102368 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.113564 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:12:59.170412 tst mo_mt_call.py: using LAC 22490 17:12:59.297766 tst mo_mt_call.py: using RAC 50 17:12:59.418353 tst mo_mt_call.py: using CellId 22490 17:12:59.538335 tst mo_mt_call.py: using BVCI 22491 17:12:59.651629 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.662742 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.674253 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.685561 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.696827 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:12:59.708089 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:12:59.827824 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:12:59.949166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:00.462581 run create_hlr_db(pid=25838): Launched 17:13:00.596292 bus /sierra_2: Setting Powered False 17:13:01.665656 run create_hlr_db(pid=25838): Terminated: ok {rc=0} 17:13:02.109298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25840): Launched 17:13:02.434973 run osmo-hlr_10.42.42.2(pid=25841): Launched 17:13:02.555677 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:03.131353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25843): Launched 17:13:03.462537 run osmo-stp_10.42.42.5(pid=25844): Launched 17:13:03.588437 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:04.183148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25846): Launched 17:13:04.514810 run osmo-msc_10.42.42.6(pid=25847): Launched 17:13:04.698188 run osmo-stp_10.42.42.5(pid=25844): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25844)] 17:13:04.835870 run osmo-stp_10.42.42.5(pid=25844): stdout: | (launched: 2022-12-09_17:13:03.401109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:04.974278 run osmo-stp_10.42.42.5(pid=25844): stderr: | 20221209171303596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171303597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171303597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171303597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171303598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171303598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171303598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:05.112749 run osmo-stp_10.42.42.5(pid=25844): stdout: | (launched: 2022-12-09_17:13:03.401109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:05.243154 run osmo-stp_10.42.42.5(pid=25844): stderr: | 20221209171303596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171303597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171303597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171303597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171303598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171303598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171303598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:05.399453 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25844): Process ended prematurely: osmo-stp_10.42.42.5(pid=25844) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25844)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:13:05.408848 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:13:05.436614 run osmo-hlr_10.42.42.2(pid=25841): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25841)] 17:13:05.487152 run osmo-hlr_10.42.42.2(pid=25841): stdout: | (launched: 2022-12-09_17:13:02.377343) 17:13:05.539595 run osmo-hlr_10.42.42.2(pid=25841): stderr: | 20221209171302554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171302554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171302555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171302555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171302555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171302555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171302567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171302576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171302576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171302576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:05.612439 run osmo-msc_10.42.42.6(pid=25847): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25847)] 17:13:05.663154 run osmo-msc_10.42.42.6(pid=25847): stdout: | (launched: 2022-12-09_17:13:04.453448) 17:13:05.715274 run osmo-msc_10.42.42.6(pid=25847): stderr: | 20221209171304778 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171304778 DLGLOBAL DEBUG validating counter group 0x7fa8023d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171304778 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171304778 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171304778 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171304779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171304780 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171304781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171304781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171304781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:05.767857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25840): Terminating (SIGTERM) 17:13:05.809871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25843): Terminating (SIGTERM) 17:13:05.852091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25846): Terminating (SIGTERM) 17:13:05.894813 --- ParallelTerminationStrategy: PID 25840 died... 17:13:05.914921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25840): Terminated: ok {rc=0} 17:13:05.961562 --- ParallelTerminationStrategy: PID 25843 died... 17:13:05.981144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25843): Terminated: ok {rc=0} 17:13:06.027505 --- ParallelTerminationStrategy: PID 25846 died... 17:13:06.047094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25846): Terminated: ok {rc=0} 17:13:06.135859 bus /sierra_3: Setting Powered False 17:13:07.236588 bus /sierra_3: Setting Powered False 17:13:08.353116 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:13:09.505801 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:09.518173 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:13:09.580695 tst mo_mt_call_osmux.py: using LAC 22491 17:13:09.709205 tst mo_mt_call_osmux.py: using RAC 51 17:13:09.837735 tst mo_mt_call_osmux.py: using CellId 22491 17:13:09.965955 tst mo_mt_call_osmux.py: using BVCI 22492 17:13:10.087436 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:10.099488 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:10.110975 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:10.122438 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:10.133865 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:13:10.145259 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:10.262256 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:13:10.382541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:10.894770 run create_hlr_db(pid=25849): Launched 17:13:11.030357 bus /sierra_2: Setting Powered False 17:13:12.095544 run create_hlr_db(pid=25849): Terminated: ok {rc=0} 17:13:12.539259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25851): Launched 17:13:12.851398 run osmo-hlr_10.42.42.2(pid=25852): Launched 17:13:12.971153 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:13.519115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25854): Launched 17:13:13.830400 run osmo-stp_10.42.42.5(pid=25855): Launched 17:13:13.949481 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:14.507386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25857): Launched 17:13:14.817015 run osmo-msc_10.42.42.6(pid=25858): Launched 17:13:14.989184 run osmo-stp_10.42.42.5(pid=25855): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25855)] 17:13:15.121175 run osmo-stp_10.42.42.5(pid=25855): stdout: | (launched: 2022-12-09_17:13:13.772297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:15.252521 run osmo-stp_10.42.42.5(pid=25855): stderr: | 20221209171313945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171313945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171313945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171313946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171313946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171313946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171313946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:15.382352 run osmo-stp_10.42.42.5(pid=25855): stdout: | (launched: 2022-12-09_17:13:13.772297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:15.504780 run osmo-stp_10.42.42.5(pid=25855): stderr: | 20221209171313945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171313945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171313945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171313946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171313946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171313946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171313946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:15.651975 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25855): Process ended prematurely: osmo-stp_10.42.42.5(pid=25855) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25855)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:13:15.661080 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:13:15.688131 run osmo-hlr_10.42.42.2(pid=25852): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25852)] 17:13:15.736895 run osmo-hlr_10.42.42.2(pid=25852): stdout: | (launched: 2022-12-09_17:13:12.793415) 17:13:15.787252 run osmo-hlr_10.42.42.2(pid=25852): stderr: | 20221209171312974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171312974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171312974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171312974 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171312974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171312974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171312996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171313006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171313006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171313006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:15.871528 run osmo-msc_10.42.42.6(pid=25858): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25858)] 17:13:15.951140 run osmo-msc_10.42.42.6(pid=25858): stdout: | (launched: 2022-12-09_17:13:14.759055) 17:13:16.018077 run osmo-msc_10.42.42.6(pid=25858): stderr: | 20221209171315032 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171315032 DLGLOBAL DEBUG validating counter group 0x7fbd5186ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171315033 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171315033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171315033 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171315033 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171315036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171315037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171315037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171315037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:16.070930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25851): Terminating (SIGTERM) 17:13:16.114269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25854): Terminating (SIGTERM) 17:13:16.157695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25857): Terminating (SIGTERM) 17:13:16.201141 --- ParallelTerminationStrategy: PID 25851 died... 17:13:16.221230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25851): Terminated: ok {rc=0} 17:13:16.269874 --- ParallelTerminationStrategy: PID 25854 died... 17:13:16.290096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25854): Terminated: ok {rc=0} 17:13:16.338839 --- ParallelTerminationStrategy: PID 25857 died... 17:13:16.358827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25857): Terminated: ok {rc=0} 17:13:16.449408 bus /sierra_3: Setting Powered False 17:13:17.549121 bus /sierra_3: Setting Powered False 17:13:18.665668 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:13:19.904480 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:19.910769 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:13:19.931703 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:13:19.958369 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:13:20.011114 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:13:20.031525 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:13:20.057792 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:13:20.612403 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:13:20.661943 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:20.673355 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:13:20.730043 tst mo_mt_call.py: using LAC 22492 17:13:20.861433 tst mo_mt_call.py: using RAC 52 17:13:20.995461 tst mo_mt_call.py: using CellId 22492 17:13:21.125035 tst mo_mt_call.py: using BVCI 22493 17:13:21.245477 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.256930 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.268244 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.279528 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.290865 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:21.302203 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:21.420020 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:21.539715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:22.053396 run create_hlr_db(pid=25863): Launched 17:13:22.188475 bus /sierra_2: Setting Powered False 17:13:23.252475 run create_hlr_db(pid=25863): Terminated: ok {rc=0} 17:13:23.712158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25865): Launched 17:13:24.045018 run osmo-hlr_10.42.42.2(pid=25866): Launched 17:13:24.172804 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:24.744086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25868): Launched 17:13:25.075884 run osmo-stp_10.42.42.5(pid=25869): Launched 17:13:25.203703 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:25.799837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25871): Launched 17:13:26.132872 run osmo-msc_10.42.42.6(pid=25872): Launched 17:13:26.316717 run osmo-stp_10.42.42.5(pid=25869): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25869)] 17:13:26.455260 run osmo-stp_10.42.42.5(pid=25869): stdout: | (launched: 2022-12-09_17:13:25.014602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:26.594293 run osmo-stp_10.42.42.5(pid=25869): stderr: | 20221209171325211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171325211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171325212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171325212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171325212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171325213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171325213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:26.732093 run osmo-stp_10.42.42.5(pid=25869): stdout: | (launched: 2022-12-09_17:13:25.014602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:26.863053 run osmo-stp_10.42.42.5(pid=25869): stderr: | 20221209171325211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171325211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171325212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171325212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171325212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171325213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171325213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:27.019647 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25869): Process ended prematurely: osmo-stp_10.42.42.5(pid=25869) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25869)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:13:27.029286 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:13:27.057230 run osmo-hlr_10.42.42.2(pid=25866): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25866)] 17:13:27.108205 run osmo-hlr_10.42.42.2(pid=25866): stdout: | (launched: 2022-12-09_17:13:23.983510) 17:13:27.160646 run osmo-hlr_10.42.42.2(pid=25866): stderr: | 20221209171324185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171324185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171324185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171324185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171324185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171324185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171324199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171324208 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171324208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171324208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:27.233827 run osmo-msc_10.42.42.6(pid=25872): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25872)] 17:13:27.284027 run osmo-msc_10.42.42.6(pid=25872): stdout: | (launched: 2022-12-09_17:13:26.071113) 17:13:27.336281 run osmo-msc_10.42.42.6(pid=25872): stderr: | 20221209171326398 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171326398 DLGLOBAL DEBUG validating counter group 0x7fdbae76dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171326398 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171326398 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171326398 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171326398 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171326400 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171326401 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171326401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171326401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:27.388761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25865): Terminating (SIGTERM) 17:13:27.430922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25868): Terminating (SIGTERM) 17:13:27.473118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25871): Terminating (SIGTERM) 17:13:27.515697 --- ParallelTerminationStrategy: PID 25865 died... 17:13:27.535711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25865): Terminated: ok {rc=0} 17:13:27.582334 --- ParallelTerminationStrategy: PID 25868 died... 17:13:27.601799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25868): Terminated: ok {rc=0} 17:13:27.648098 --- ParallelTerminationStrategy: PID 25871 died... 17:13:27.667828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25871): Terminated: ok {rc=0} 17:13:27.756098 bus /sierra_3: Setting Powered False 17:13:28.855334 bus /sierra_3: Setting Powered False 17:13:29.972147 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:13:31.121426 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.134470 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:13:31.194134 tst mo_mt_call_osmux.py: using LAC 22493 17:13:31.325264 tst mo_mt_call_osmux.py: using RAC 53 17:13:31.456505 tst mo_mt_call_osmux.py: using CellId 22493 17:13:31.599881 tst mo_mt_call_osmux.py: using BVCI 22494 17:13:31.725065 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.737039 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.748593 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.760514 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.772800 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:13:31.786090 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:31.931237 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:13:32.079787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:32.598027 run create_hlr_db(pid=25874): Launched 17:13:32.733846 bus /sierra_2: Setting Powered False 17:13:33.799263 run create_hlr_db(pid=25874): Terminated: ok {rc=0} 17:13:34.241921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25876): Launched 17:13:34.553469 run osmo-hlr_10.42.42.2(pid=25877): Launched 17:13:34.673124 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:35.219898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25879): Launched 17:13:35.531897 run osmo-stp_10.42.42.5(pid=25880): Launched 17:13:35.651405 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:36.210633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25882): Launched 17:13:36.523483 run osmo-msc_10.42.42.6(pid=25883): Launched 17:13:36.698779 run osmo-stp_10.42.42.5(pid=25880): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25880)] 17:13:36.828923 run osmo-stp_10.42.42.5(pid=25880): stdout: | (launched: 2022-12-09_17:13:35.473655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:36.959360 run osmo-stp_10.42.42.5(pid=25880): stderr: | 20221209171335645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171335645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171335646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171335646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171335648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171335648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171335648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:37.087481 run osmo-stp_10.42.42.5(pid=25880): stdout: | (launched: 2022-12-09_17:13:35.473655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:37.209508 run osmo-stp_10.42.42.5(pid=25880): stderr: | 20221209171335645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171335645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171335646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171335646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171335648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171335648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171335648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:37.355707 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25880): Process ended prematurely: osmo-stp_10.42.42.5(pid=25880) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25880)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:13:37.364678 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:13:37.391749 run osmo-hlr_10.42.42.2(pid=25877): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25877)] 17:13:37.440001 run osmo-hlr_10.42.42.2(pid=25877): stdout: | (launched: 2022-12-09_17:13:34.495312) 17:13:37.490101 run osmo-hlr_10.42.42.2(pid=25877): stderr: | 20221209171334672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171334672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171334672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171334672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171334672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171334672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171334683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171334691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171334691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171334691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:37.559749 run osmo-msc_10.42.42.6(pid=25883): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25883)] 17:13:37.608030 run osmo-msc_10.42.42.6(pid=25883): stdout: | (launched: 2022-12-09_17:13:36.465313) 17:13:37.658223 run osmo-msc_10.42.42.6(pid=25883): stderr: | 20221209171336738 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171336738 DLGLOBAL DEBUG validating counter group 0x7f8298b61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171336738 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171336738 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171336738 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171336739 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171336740 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171336741 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171336741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171336741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:37.708743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25876): Terminating (SIGTERM) 17:13:37.749062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25879): Terminating (SIGTERM) 17:13:37.789391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25882): Terminating (SIGTERM) 17:13:37.829849 --- ParallelTerminationStrategy: PID 25876 died... 17:13:37.848978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25876): Terminated: ok {rc=0} 17:13:37.893511 --- ParallelTerminationStrategy: PID 25879 died... 17:13:37.911980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25879): Terminated: ok {rc=0} 17:13:37.957115 --- ParallelTerminationStrategy: PID 25882 died... 17:13:37.975766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25882): Terminated: ok {rc=0} 17:13:38.063293 bus /sierra_3: Setting Powered False 17:13:39.164005 bus /sierra_3: Setting Powered False 17:13:40.280931 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:13:41.518770 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:13:41.525449 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:13:41.546161 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:13:41.572818 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:13:41.625996 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:13:41.647050 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:13:41.673518 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:13:42.223857 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:13:42.273428 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.284425 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:13:42.340762 tst mo_mt_call.py: using LAC 22494 17:13:42.463555 tst mo_mt_call.py: using RAC 54 17:13:42.585581 tst mo_mt_call.py: using CellId 22494 17:13:42.717688 tst mo_mt_call.py: using BVCI 22495 17:13:42.837829 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.849633 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.860848 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.872256 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.883781 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:42.895161 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:43.009360 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:43.129651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:43.642685 run create_hlr_db(pid=25889): Launched 17:13:43.778329 bus /sierra_2: Setting Powered False 17:13:44.842919 run create_hlr_db(pid=25889): Terminated: ok {rc=0} 17:13:45.284836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25891): Launched 17:13:45.596339 run osmo-hlr_10.42.42.2(pid=25892): Launched 17:13:45.714772 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:46.312074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25894): Launched 17:13:46.667665 run osmo-stp_10.42.42.5(pid=25895): Launched 17:13:46.923703 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:47.552902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25897): Launched 17:13:47.861913 run osmo-msc_10.42.42.6(pid=25898): Launched 17:13:48.035240 run osmo-stp_10.42.42.5(pid=25895): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25895)] 17:13:48.166632 run osmo-stp_10.42.42.5(pid=25895): stdout: | (launched: 2022-12-09_17:13:46.604670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:48.297806 run osmo-stp_10.42.42.5(pid=25895): stderr: | 20221209171346914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171346914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171346914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171346915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171346915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171346915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171346916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:48.426188 run osmo-stp_10.42.42.5(pid=25895): stdout: | (launched: 2022-12-09_17:13:46.604670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:48.548149 run osmo-stp_10.42.42.5(pid=25895): stderr: | 20221209171346914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171346914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171346914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171346915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171346915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171346915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171346916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:48.694350 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25895): Process ended prematurely: osmo-stp_10.42.42.5(pid=25895) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25895)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:13:48.703075 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:13:48.730107 run osmo-hlr_10.42.42.2(pid=25892): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25892)] 17:13:48.778610 run osmo-hlr_10.42.42.2(pid=25892): stdout: | (launched: 2022-12-09_17:13:45.538285) 17:13:48.829040 run osmo-hlr_10.42.42.2(pid=25892): stderr: | 20221209171345720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171345720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171345720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171345720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171345720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171345720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171345732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171345743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171345743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171345743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:48.898783 run osmo-msc_10.42.42.6(pid=25898): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25898)] 17:13:48.947121 run osmo-msc_10.42.42.6(pid=25898): stdout: | (launched: 2022-12-09_17:13:47.803753) 17:13:48.997302 run osmo-msc_10.42.42.6(pid=25898): stderr: | 20221209171348078 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171348078 DLGLOBAL DEBUG validating counter group 0x7f4f32021c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171348078 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171348078 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171348078 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171348078 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171348080 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171348080 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171348081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171348081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:49.047645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25891): Terminating (SIGTERM) 17:13:49.087663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25894): Terminating (SIGTERM) 17:13:49.127953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25897): Terminating (SIGTERM) 17:13:49.168109 --- ParallelTerminationStrategy: PID 25891 died... 17:13:49.187189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25891): Terminated: ok {rc=0} 17:13:49.231687 --- ParallelTerminationStrategy: PID 25894 died... 17:13:49.250239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25894): Terminated: ok {rc=0} 17:13:49.294757 --- ParallelTerminationStrategy: PID 25897 died... 17:13:49.313414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25897): Terminated: ok {rc=0} 17:13:49.400675 bus /sierra_3: Setting Powered False 17:13:50.501310 bus /sierra_3: Setting Powered False 17:13:51.618122 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:13:52.766863 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:52.778619 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:13:52.834743 tst mo_mt_call_osmux.py: using LAC 22495 17:13:52.956618 tst mo_mt_call_osmux.py: using RAC 55 17:13:53.078257 tst mo_mt_call_osmux.py: using CellId 22495 17:13:53.203375 tst mo_mt_call_osmux.py: using BVCI 22496 17:13:53.315488 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.326514 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.337568 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.348601 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.359651 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:13:53.370737 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:53.485869 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:13:53.603811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:13:54.081959 run create_hlr_db(pid=25900): Launched 17:13:54.198561 bus /sierra_2: Setting Powered False 17:13:55.259918 run create_hlr_db(pid=25900): Terminated: ok {rc=0} 17:13:55.713245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25902): Launched 17:13:56.044329 run osmo-hlr_10.42.42.2(pid=25903): Launched 17:13:56.172171 run osmo-stp_10.42.42.5: Starting osmo-stp 17:13:56.744745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25905): Launched 17:13:57.075780 run osmo-stp_10.42.42.5(pid=25906): Launched 17:13:57.202830 run osmo-msc_10.42.42.6: Starting osmo-msc 17:13:57.800223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25908): Launched 17:13:58.133918 run osmo-msc_10.42.42.6(pid=25909): Launched 17:13:58.319337 run osmo-stp_10.42.42.5(pid=25906): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25906)] 17:13:58.459201 run osmo-stp_10.42.42.5(pid=25906): stdout: | (launched: 2022-12-09_17:13:57.014328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:58.599821 run osmo-stp_10.42.42.5(pid=25906): stderr: | 20221209171357210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171357210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171357210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171357211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171357211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171357211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171357211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:58.738073 run osmo-stp_10.42.42.5(pid=25906): stdout: | (launched: 2022-12-09_17:13:57.014328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:13:58.869483 run osmo-stp_10.42.42.5(pid=25906): stderr: | 20221209171357210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171357210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171357210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171357211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171357211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171357211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171357211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:13:59.026353 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25906): Process ended prematurely: osmo-stp_10.42.42.5(pid=25906) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25906)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:13:59.035992 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:13:59.063942 run osmo-hlr_10.42.42.2(pid=25903): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25903)] 17:13:59.114854 run osmo-hlr_10.42.42.2(pid=25903): stdout: | (launched: 2022-12-09_17:13:55.982973) 17:13:59.167952 run osmo-hlr_10.42.42.2(pid=25903): stderr: | 20221209171356185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171356185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171356185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171356185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171356185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171356185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171356197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171356206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171356206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171356206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:13:59.241351 run osmo-msc_10.42.42.6(pid=25909): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25909)] 17:13:59.292293 run osmo-msc_10.42.42.6(pid=25909): stdout: | (launched: 2022-12-09_17:13:58.071416) 17:13:59.345126 run osmo-msc_10.42.42.6(pid=25909): stderr: | 20221209171358399 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171358399 DLGLOBAL DEBUG validating counter group 0x7f2c03f67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171358399 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171358399 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171358399 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171358399 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171358401 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171358401 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171358401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171358402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:13:59.397781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25902): Terminating (SIGTERM) 17:13:59.440228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25905): Terminating (SIGTERM) 17:13:59.482810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25908): Terminating (SIGTERM) 17:13:59.525417 --- ParallelTerminationStrategy: PID 25902 died... 17:13:59.545694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25902): Terminated: ok {rc=0} 17:13:59.592392 --- ParallelTerminationStrategy: PID 25905 died... 17:13:59.612096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25905): Terminated: ok {rc=0} 17:13:59.658825 --- ParallelTerminationStrategy: PID 25908 died... 17:13:59.678596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25908): Terminated: ok {rc=0} 17:13:59.766760 bus /sierra_3: Setting Powered False 17:14:00.883899 bus /sierra_3: Setting Powered False 17:14:02.017809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:14:03.268472 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:03.275240 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:14:03.296262 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:14:03.322785 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:14:03.376011 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:14:03.396722 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:14:03.423187 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:14:03.972452 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:14:04.021985 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.032789 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:14:04.088093 tst mo_mt_call.py: using LAC 22496 17:14:04.210251 tst mo_mt_call.py: using RAC 56 17:14:04.332570 tst mo_mt_call.py: using CellId 22496 17:14:04.454060 tst mo_mt_call.py: using BVCI 22497 17:14:04.565469 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.576423 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.587307 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.598436 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.609491 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:04.620512 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:04.740169 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:04.857349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:05.370998 run create_hlr_db(pid=25914): Launched 17:14:05.506656 bus /sierra_2: Setting Powered False 17:14:06.571500 run create_hlr_db(pid=25914): Terminated: ok {rc=0} 17:14:07.012146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25916): Launched 17:14:07.323120 run osmo-hlr_10.42.42.2(pid=25917): Launched 17:14:07.441806 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:07.983709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25919): Launched 17:14:08.294804 run osmo-stp_10.42.42.5(pid=25920): Launched 17:14:08.414105 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:08.978469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25922): Launched 17:14:09.290217 run osmo-msc_10.42.42.6(pid=25923): Launched 17:14:09.465312 run osmo-stp_10.42.42.5(pid=25920): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25920)] 17:14:09.596886 run osmo-stp_10.42.42.5(pid=25920): stdout: | (launched: 2022-12-09_17:14:08.236700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:09.727688 run osmo-stp_10.42.42.5(pid=25920): stderr: | 20221209171408409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171408410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171408410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171408410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171408411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171408411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171408411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:09.856281 run osmo-stp_10.42.42.5(pid=25920): stdout: | (launched: 2022-12-09_17:14:08.236700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:09.978845 run osmo-stp_10.42.42.5(pid=25920): stderr: | 20221209171408409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171408410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171408410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171408410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171408411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171408411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171408411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:10.125556 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25920): Process ended prematurely: osmo-stp_10.42.42.5(pid=25920) [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25920)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:14:10.134541 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:14:10.161316 run osmo-hlr_10.42.42.2(pid=25917): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25917)] 17:14:10.209720 run osmo-hlr_10.42.42.2(pid=25917): stdout: | (launched: 2022-12-09_17:14:07.265409) 17:14:10.259676 run osmo-hlr_10.42.42.2(pid=25917): stderr: | 20221209171407444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171407444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171407444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171407444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171407444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171407444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171407456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171407465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171407465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171407465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:10.329065 run osmo-msc_10.42.42.6(pid=25923): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25923)] 17:14:10.377269 run osmo-msc_10.42.42.6(pid=25923): stdout: | (launched: 2022-12-09_17:14:09.232100) 17:14:10.427036 run osmo-msc_10.42.42.6(pid=25923): stderr: | 20221209171409506 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171409506 DLGLOBAL DEBUG validating counter group 0x7f0b6188bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171409506 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171409506 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171409507 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171409507 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171409510 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171409511 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171409511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171409511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:10.477335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25916): Terminating (SIGTERM) 17:14:10.517434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25919): Terminating (SIGTERM) 17:14:10.557498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25922): Terminating (SIGTERM) 17:14:10.597801 --- ParallelTerminationStrategy: PID 25916 died... 17:14:10.616876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25916): Terminated: ok {rc=0} 17:14:10.661586 --- ParallelTerminationStrategy: PID 25919 died... 17:14:10.680027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25919): Terminated: ok {rc=0} 17:14:10.725150 --- ParallelTerminationStrategy: PID 25922 died... 17:14:10.743656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25922): Terminated: ok {rc=0} 17:14:10.829992 bus /sierra_3: Setting Powered False 17:14:11.930286 bus /sierra_3: Setting Powered False 17:14:13.047372 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:14:14.194818 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:14.206594 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:14:14.262775 tst mo_mt_call_osmux.py: using LAC 22497 17:14:14.387842 tst mo_mt_call_osmux.py: using RAC 57 17:14:14.511290 tst mo_mt_call_osmux.py: using CellId 22497 17:14:14.641090 tst mo_mt_call_osmux.py: using BVCI 22498 17:14:14.761771 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:14.773448 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:14.784894 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:14.796383 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:14.807897 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:14:14.819244 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:14.934993 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:14:15.056641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:15.537389 run create_hlr_db(pid=25925): Launched 17:14:15.658118 bus /sierra_2: Setting Powered False 17:14:16.723371 run create_hlr_db(pid=25925): Terminated: ok {rc=0} 17:14:17.196344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25927): Launched 17:14:17.534168 run osmo-hlr_10.42.42.2(pid=25928): Launched 17:14:17.660889 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:18.232864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25930): Launched 17:14:18.566187 run osmo-stp_10.42.42.5(pid=25931): Launched 17:14:18.691282 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:19.289282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25933): Launched 17:14:19.622474 run osmo-msc_10.42.42.6(pid=25934): Launched 17:14:19.804915 run osmo-stp_10.42.42.5(pid=25931): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25931)] 17:14:19.943529 run osmo-stp_10.42.42.5(pid=25931): stdout: | (launched: 2022-12-09_17:14:18.504469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:20.082527 run osmo-stp_10.42.42.5(pid=25931): stderr: | 20221209171418699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171418699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171418699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171418700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171418702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171418702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171418702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:20.221892 run osmo-stp_10.42.42.5(pid=25931): stdout: | (launched: 2022-12-09_17:14:18.504469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:20.352935 run osmo-stp_10.42.42.5(pid=25931): stderr: | 20221209171418699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171418699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171418699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171418700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171418702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171418702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171418702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:20.510034 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25931): Process ended prematurely: osmo-stp_10.42.42.5(pid=25931) [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25931)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:14:20.519673 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:14:20.547502 run osmo-hlr_10.42.42.2(pid=25928): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25928)] 17:14:20.598046 run osmo-hlr_10.42.42.2(pid=25928): stdout: | (launched: 2022-12-09_17:14:17.472172) 17:14:20.650220 run osmo-hlr_10.42.42.2(pid=25928): stderr: | 20221209171417672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171417672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171417672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171417672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171417672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171417672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171417684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171417693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171417693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171417693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:20.722751 run osmo-msc_10.42.42.6(pid=25934): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25934)] 17:14:20.773439 run osmo-msc_10.42.42.6(pid=25934): stdout: | (launched: 2022-12-09_17:14:19.560200) 17:14:20.825510 run osmo-msc_10.42.42.6(pid=25934): stderr: | 20221209171419889 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171419890 DLGLOBAL DEBUG validating counter group 0x7fafa01d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171419890 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171419890 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171419890 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171419890 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171419892 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171419892 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171419892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171419892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:20.877852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25927): Terminating (SIGTERM) 17:14:20.919717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25930): Terminating (SIGTERM) 17:14:20.961619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25933): Terminating (SIGTERM) 17:14:21.003706 --- ParallelTerminationStrategy: PID 25927 died... 17:14:21.023795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25927): Terminated: ok {rc=0} 17:14:21.070628 --- ParallelTerminationStrategy: PID 25930 died... 17:14:21.090245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25930): Terminated: ok {rc=0} 17:14:21.136743 --- ParallelTerminationStrategy: PID 25933 died... 17:14:21.156259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25933): Terminated: ok {rc=0} 17:14:21.244827 bus /sierra_3: Setting Powered False 17:14:22.345196 bus /sierra_3: Setting Powered False 17:14:23.462458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:14:24.702192 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:24.709621 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:14:24.731533 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:14:24.758807 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:14:24.812044 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:14:24.833411 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:14:24.860507 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:14:25.412428 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:14:25.464713 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:25.476273 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:14:25.533558 tst mo_mt_call.py: using LAC 22498 17:14:25.662803 tst mo_mt_call.py: using RAC 58 17:14:25.791605 tst mo_mt_call.py: using CellId 22498 17:14:25.927997 tst mo_mt_call.py: using BVCI 22499 17:14:26.049450 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.061045 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.072285 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.083596 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.095032 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:26.106382 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:26.225692 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:26.348704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:26.862187 run create_hlr_db(pid=25939): Launched 17:14:26.996580 bus /sierra_2: Setting Powered False 17:14:28.061937 run create_hlr_db(pid=25939): Terminated: ok {rc=0} 17:14:28.505289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25941): Launched 17:14:28.815972 run osmo-hlr_10.42.42.2(pid=25942): Launched 17:14:28.934885 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:29.481554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25944): Launched 17:14:29.791935 run osmo-stp_10.42.42.5(pid=25945): Launched 17:14:29.910376 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:30.468843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25947): Launched 17:14:30.779286 run osmo-msc_10.42.42.6(pid=25948): Launched 17:14:31.138116 run osmo-stp_10.42.42.5(pid=25945): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25945)] 17:14:31.370491 run osmo-stp_10.42.42.5(pid=25945): stdout: | (launched: 2022-12-09_17:14:29.734102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:31.512805 run osmo-stp_10.42.42.5(pid=25945): stderr: | 20221209171429908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171429908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171429908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171429909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171429909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171429909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171429909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:31.657210 run osmo-stp_10.42.42.5(pid=25945): stdout: | (launched: 2022-12-09_17:14:29.734102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:31.793682 run osmo-stp_10.42.42.5(pid=25945): stderr: | 20221209171429908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171429908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171429908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171429909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171429909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171429909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171429909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:31.956085 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25945): Process ended prematurely: osmo-stp_10.42.42.5(pid=25945) [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25945)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:14:31.966729 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:14:31.996770 run osmo-hlr_10.42.42.2(pid=25942): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25942)] 17:14:32.049179 run osmo-hlr_10.42.42.2(pid=25942): stdout: | (launched: 2022-12-09_17:14:28.757798) 17:14:32.103748 run osmo-hlr_10.42.42.2(pid=25942): stderr: | 20221209171428935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171428935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171428935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171428935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171428935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171428935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171428947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171428958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171428958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171428958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:32.179590 run osmo-msc_10.42.42.6(pid=25948): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25948)] 17:14:32.231702 run osmo-msc_10.42.42.6(pid=25948): stdout: | (launched: 2022-12-09_17:14:30.721319) 17:14:32.286197 run osmo-msc_10.42.42.6(pid=25948): stderr: | 20221209171431087 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171431087 DLGLOBAL DEBUG validating counter group 0x7f9b107ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171431087 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171431087 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171431087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171431088 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171431090 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171431091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171431091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171431091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:32.340325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25941): Terminating (SIGTERM) 17:14:32.382608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25944): Terminating (SIGTERM) 17:14:32.424543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25947): Terminating (SIGTERM) 17:14:32.466948 --- ParallelTerminationStrategy: PID 25941 died... 17:14:32.486978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25941): Terminated: ok {rc=0} 17:14:32.533828 --- ParallelTerminationStrategy: PID 25944 died... 17:14:32.553685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25944): Terminated: ok {rc=0} 17:14:32.600749 --- ParallelTerminationStrategy: PID 25947 died... 17:14:32.620433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25947): Terminated: ok {rc=0} 17:14:32.709598 bus /sierra_3: Setting Powered False 17:14:33.809120 bus /sierra_3: Setting Powered False 17:14:34.926928 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:14:36.078785 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:36.091007 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:14:36.149415 tst mo_mt_call_osmux.py: using LAC 22499 17:14:36.285302 tst mo_mt_call_osmux.py: using RAC 59 17:14:36.426706 tst mo_mt_call_osmux.py: using CellId 22499 17:14:36.561732 tst mo_mt_call_osmux.py: using BVCI 22500 17:14:36.683085 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:36.694808 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:36.706235 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:36.717638 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:36.729017 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:14:36.740409 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:36.859691 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:14:36.981068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:37.459308 run create_hlr_db(pid=25950): Launched 17:14:37.579761 bus /sierra_2: Setting Powered False 17:14:38.640528 run create_hlr_db(pid=25950): Terminated: ok {rc=0} 17:14:39.091550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25952): Launched 17:14:39.422866 run osmo-hlr_10.42.42.2(pid=25953): Launched 17:14:39.549911 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:40.120677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25955): Launched 17:14:40.452724 run osmo-stp_10.42.42.5(pid=25956): Launched 17:14:40.579955 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:41.177537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25958): Launched 17:14:41.510665 run osmo-msc_10.42.42.6(pid=25959): Launched 17:14:41.694989 run osmo-stp_10.42.42.5(pid=25956): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25956)] 17:14:41.833753 run osmo-stp_10.42.42.5(pid=25956): stdout: | (launched: 2022-12-09_17:14:40.391327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:41.972629 run osmo-stp_10.42.42.5(pid=25956): stderr: | 20221209171440587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171440587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171440587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171440587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171440588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171440588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171440588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:42.110978 run osmo-stp_10.42.42.5(pid=25956): stdout: | (launched: 2022-12-09_17:14:40.391327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:42.242107 run osmo-stp_10.42.42.5(pid=25956): stderr: | 20221209171440587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171440587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171440587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171440587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171440588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171440588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171440588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:42.399098 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25956): Process ended prematurely: osmo-stp_10.42.42.5(pid=25956) [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25956)] [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:14:42.408665 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:14:42.436373 run osmo-hlr_10.42.42.2(pid=25953): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25953)] 17:14:42.486196 run osmo-hlr_10.42.42.2(pid=25953): stdout: | (launched: 2022-12-09_17:14:39.361663) 17:14:42.537917 run osmo-hlr_10.42.42.2(pid=25953): stderr: | 20221209171439563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171439563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171439563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171439563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171439563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171439563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171439576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171439584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171439584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171439584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:42.610068 run osmo-msc_10.42.42.6(pid=25959): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25959)] 17:14:42.660113 run osmo-msc_10.42.42.6(pid=25959): stdout: | (launched: 2022-12-09_17:14:41.449102) 17:14:42.711867 run osmo-msc_10.42.42.6(pid=25959): stderr: | 20221209171441777 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171441777 DLGLOBAL DEBUG validating counter group 0x7ff4902d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171441777 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171441777 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171441778 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171441778 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171441779 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171441780 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171441780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171441780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:42.763823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25952): Terminating (SIGTERM) 17:14:42.805344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25955): Terminating (SIGTERM) 17:14:42.847058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25958): Terminating (SIGTERM) 17:14:42.888860 --- ParallelTerminationStrategy: PID 25952 died... 17:14:42.908797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25952): Terminated: ok {rc=0} 17:14:42.955408 --- ParallelTerminationStrategy: PID 25955 died... 17:14:42.974905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25955): Terminated: ok {rc=0} 17:14:43.021020 --- ParallelTerminationStrategy: PID 25958 died... 17:14:43.040452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25958): Terminated: ok {rc=0} 17:14:43.128017 bus /sierra_3: Setting Powered False 17:14:44.226879 bus /sierra_3: Setting Powered False 17:14:45.342827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:14:46.587127 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:14:46.600056 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:14:46.631628 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:14:46.671010 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:14:46.730731 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:14:46.753415 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:14:46.782659 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:14:47.332047 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:14:47.385774 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:47.397463 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:14:47.453850 tst mo_mt_call.py: using LAC 22500 17:14:47.581783 tst mo_mt_call.py: using RAC 60 17:14:47.709068 tst mo_mt_call.py: using CellId 22500 17:14:47.836135 tst mo_mt_call.py: using BVCI 22501 17:14:47.957647 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:47.969162 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:47.980490 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:47.991883 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.003294 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:48.014755 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:48.131103 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:48.254034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:48.735497 run create_hlr_db(pid=25964): Launched 17:14:48.854454 bus /sierra_2: Setting Powered False 17:14:49.916293 run create_hlr_db(pid=25964): Terminated: ok {rc=0} 17:14:50.349922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25966): Launched 17:14:50.662934 run osmo-hlr_10.42.42.2(pid=25967): Launched 17:14:50.782550 run osmo-stp_10.42.42.5: Starting osmo-stp 17:14:51.331705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25969): Launched 17:14:51.644034 run osmo-stp_10.42.42.5(pid=25970): Launched 17:14:51.763846 run osmo-msc_10.42.42.6: Starting osmo-msc 17:14:52.325796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25972): Launched 17:14:52.637623 run osmo-msc_10.42.42.6(pid=25973): Launched 17:14:52.810098 run osmo-stp_10.42.42.5(pid=25970): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25970)] 17:14:52.940603 run osmo-stp_10.42.42.5(pid=25970): stdout: | (launched: 2022-12-09_17:14:51.585767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:53.072070 run osmo-stp_10.42.42.5(pid=25970): stderr: | 20221209171451759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171451759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171451759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171451760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171451760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171451760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171451760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:53.200756 run osmo-stp_10.42.42.5(pid=25970): stdout: | (launched: 2022-12-09_17:14:51.585767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:14:53.323366 run osmo-stp_10.42.42.5(pid=25970): stderr: | 20221209171451759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171451759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171451759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171451760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171451760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171451760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171451760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:14:53.469742 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25970): Process ended prematurely: osmo-stp_10.42.42.5(pid=25970) [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25970)] [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:14:53.478653 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:14:53.505685 run osmo-hlr_10.42.42.2(pid=25967): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25967)] 17:14:53.554315 run osmo-hlr_10.42.42.2(pid=25967): stdout: | (launched: 2022-12-09_17:14:50.605094) 17:14:53.604593 run osmo-hlr_10.42.42.2(pid=25967): stderr: | 20221209171450784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171450785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171450785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171450785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171450785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171450785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171450797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171450806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171450806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171450806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:14:53.675376 run osmo-msc_10.42.42.6(pid=25973): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25973)] 17:14:53.723679 run osmo-msc_10.42.42.6(pid=25973): stdout: | (launched: 2022-12-09_17:14:52.579550) 17:14:53.773933 run osmo-msc_10.42.42.6(pid=25973): stderr: | 20221209171452853 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171452853 DLGLOBAL DEBUG validating counter group 0x7fbd41812c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171452853 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171452853 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171452854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171452854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171452855 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171452856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171452856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171452856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:14:53.824368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25966): Terminating (SIGTERM) 17:14:53.864941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25969): Terminating (SIGTERM) 17:14:53.905732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25972): Terminating (SIGTERM) 17:14:53.946392 --- ParallelTerminationStrategy: PID 25966 died... 17:14:53.965681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25966): Terminated: ok {rc=0} 17:14:54.010684 --- ParallelTerminationStrategy: PID 25969 died... 17:14:54.029433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25969): Terminated: ok {rc=0} 17:14:54.074202 --- ParallelTerminationStrategy: PID 25972 died... 17:14:54.092784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25972): Terminated: ok {rc=0} 17:14:54.179445 bus /sierra_3: Setting Powered False 17:14:55.280222 bus /sierra_3: Setting Powered False 17:14:56.397376 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:14:57.546744 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:57.558542 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:14:57.615249 tst mo_mt_call_osmux.py: using LAC 22501 17:14:57.738600 tst mo_mt_call_osmux.py: using RAC 61 17:14:57.866180 tst mo_mt_call_osmux.py: using CellId 22501 17:14:58.003067 tst mo_mt_call_osmux.py: using BVCI 22502 17:14:58.126046 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.137939 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.149588 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.161825 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.173708 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:14:58.185600 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:58.303118 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:14:58.419247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:14:58.899600 run create_hlr_db(pid=25976): Launched 17:14:59.018816 bus /sierra_2: Setting Powered False 17:15:00.079516 run create_hlr_db(pid=25976): Terminated: ok {rc=0} 17:15:00.532703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25978): Launched 17:15:00.869637 run osmo-hlr_10.42.42.2(pid=25979): Launched 17:15:01.081962 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:01.748351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Launched 17:15:02.118873 run osmo-stp_10.42.42.5(pid=25985): Launched 17:15:02.342601 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:02.995219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25987): Launched 17:15:03.307597 run osmo-msc_10.42.42.6(pid=25988): Launched 17:15:03.481394 run osmo-stp_10.42.42.5(pid=25985): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] 17:15:03.611985 run osmo-stp_10.42.42.5(pid=25985): stdout: | (launched: 2022-12-09_17:15:02.055528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:03.742229 run osmo-stp_10.42.42.5(pid=25985): stderr: | 20221209171502373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171502373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171502375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171502376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171502378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171502378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171502378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:03.871102 run osmo-stp_10.42.42.5(pid=25985): stdout: | (launched: 2022-12-09_17:15:02.055528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:03.993701 run osmo-stp_10.42.42.5(pid=25985): stderr: | 20221209171502373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171502373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171502375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171502376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171502378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171502378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171502378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:04.140229 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25985): Process ended prematurely: osmo-stp_10.42.42.5(pid=25985) [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:15:04.149515 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:15:04.176171 run osmo-hlr_10.42.42.2(pid=25979): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25979)] 17:15:04.225014 run osmo-hlr_10.42.42.2(pid=25979): stdout: | (launched: 2022-12-09_17:15:00.806169) 17:15:04.275077 run osmo-hlr_10.42.42.2(pid=25979): stderr: | 20221209171501162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171501162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171501162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171501165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171501165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171501165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171501188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171501203 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171501203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171501203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:04.345155 run osmo-msc_10.42.42.6(pid=25988): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25988)] 17:15:04.393397 run osmo-msc_10.42.42.6(pid=25988): stdout: | (launched: 2022-12-09_17:15:03.249299) 17:15:04.443388 run osmo-msc_10.42.42.6(pid=25988): stderr: | 20221209171503525 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171503526 DLGLOBAL DEBUG validating counter group 0x7f62ae714c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171503526 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171503526 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171503526 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171503526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171503528 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171503528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171503529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171503529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:04.493915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25978): Terminating (SIGTERM) 17:15:04.534072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Terminating (SIGTERM) 17:15:04.574251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25987): Terminating (SIGTERM) 17:15:04.614848 --- ParallelTerminationStrategy: PID 25978 died... 17:15:04.633779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25978): Terminated: ok {rc=0} 17:15:04.678889 --- ParallelTerminationStrategy: PID 25984 died... 17:15:04.697680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Terminated: ok {rc=0} 17:15:04.742540 --- ParallelTerminationStrategy: PID 25987 died... 17:15:04.761336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25987): Terminated: ok {rc=0} 17:15:04.848366 bus /sierra_3: Setting Powered False 17:15:05.947876 bus /sierra_3: Setting Powered False 17:15:07.065432 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:15:08.302939 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:08.308514 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:15:08.329843 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:15:08.356698 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:15:08.409948 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:15:08.430982 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:15:08.457510 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:15:09.003186 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:15:09.052644 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:09.063448 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:15:09.119266 tst mo_mt_call.py: using LAC 22502 17:15:09.241357 tst mo_mt_call.py: using RAC 62 17:15:09.364043 tst mo_mt_call.py: using CellId 22502 17:15:09.488875 tst mo_mt_call.py: using BVCI 22503 17:15:09.601700 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:09.612593 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:09.623224 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:09.634138 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:09.645011 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:09.655872 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:09.773877 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:09.900016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:10.414931 run create_hlr_db(pid=25993): Launched 17:15:10.551104 bus /sierra_2: Setting Powered False 17:15:11.615575 run create_hlr_db(pid=25993): Terminated: ok {rc=0} 17:15:12.059162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25995): Launched 17:15:12.370770 run osmo-hlr_10.42.42.2(pid=25996): Launched 17:15:12.487417 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:13.035992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25998): Launched 17:15:13.348319 run osmo-stp_10.42.42.5(pid=25999): Launched 17:15:13.467433 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:14.026874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26001): Launched 17:15:14.338853 run osmo-msc_10.42.42.6(pid=26002): Launched 17:15:14.513254 run osmo-stp_10.42.42.5(pid=25999): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25999)] 17:15:14.644250 run osmo-stp_10.42.42.5(pid=25999): stdout: | (launched: 2022-12-09_17:15:13.290224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:14.774825 run osmo-stp_10.42.42.5(pid=25999): stderr: | 20221209171513463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171513463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171513463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171513463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171513464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171513464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171513464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:14.903613 run osmo-stp_10.42.42.5(pid=25999): stdout: | (launched: 2022-12-09_17:15:13.290224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:15.026021 run osmo-stp_10.42.42.5(pid=25999): stderr: | 20221209171513463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171513463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171513463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171513463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171513464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171513464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171513464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:15.172575 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25999): Process ended prematurely: osmo-stp_10.42.42.5(pid=25999) [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25999)] [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:15:15.181742 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:15:15.208474 run osmo-hlr_10.42.42.2(pid=25996): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25996)] 17:15:15.256856 run osmo-hlr_10.42.42.2(pid=25996): stdout: | (launched: 2022-12-09_17:15:12.312852) 17:15:15.306894 run osmo-hlr_10.42.42.2(pid=25996): stderr: | 20221209171512488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171512488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171512489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171512489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171512489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171512489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171512501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171512510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171512510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171512510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:15.377074 run osmo-msc_10.42.42.6(pid=26002): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26002)] 17:15:15.425320 run osmo-msc_10.42.42.6(pid=26002): stdout: | (launched: 2022-12-09_17:15:14.280708) 17:15:15.475236 run osmo-msc_10.42.42.6(pid=26002): stderr: | 20221209171514557 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171514557 DLGLOBAL DEBUG validating counter group 0x7f8e505a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171514558 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171514558 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171514558 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171514558 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171514560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171514560 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171514560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171514560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:15.525801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25995): Terminating (SIGTERM) 17:15:15.566239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25998): Terminating (SIGTERM) 17:15:15.606521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26001): Terminating (SIGTERM) 17:15:15.647295 --- ParallelTerminationStrategy: PID 25995 died... 17:15:15.666551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25995): Terminated: ok {rc=0} 17:15:15.711371 --- ParallelTerminationStrategy: PID 25998 died... 17:15:15.730080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25998): Terminated: ok {rc=0} 17:15:15.774737 --- ParallelTerminationStrategy: PID 26001 died... 17:15:15.793402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26001): Terminated: ok {rc=0} 17:15:15.892680 bus /sierra_3: Setting Powered False 17:15:16.991405 bus /sierra_3: Setting Powered False 17:15:18.112502 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:15:19.264739 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:19.277029 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:15:19.336522 tst mo_mt_call_osmux.py: using LAC 22503 17:15:19.467967 tst mo_mt_call_osmux.py: using RAC 63 17:15:19.597639 tst mo_mt_call_osmux.py: using CellId 22503 17:15:19.721960 tst mo_mt_call_osmux.py: using BVCI 22504 17:15:19.834639 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:19.845756 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:19.856534 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:19.868150 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:19.879761 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:15:19.891466 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:20.013095 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:15:20.134651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:20.650636 run create_hlr_db(pid=26004): Launched 17:15:20.787242 bus /sierra_2: Setting Powered False 17:15:21.849284 run create_hlr_db(pid=26004): Terminated: ok {rc=0} 17:15:22.291677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26006): Launched 17:15:22.603666 run osmo-hlr_10.42.42.2(pid=26007): Launched 17:15:22.720821 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:23.268207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26009): Launched 17:15:23.580138 run osmo-stp_10.42.42.5(pid=26010): Launched 17:15:23.699344 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:24.258535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26012): Launched 17:15:24.568859 run osmo-msc_10.42.42.6(pid=26013): Launched 17:15:24.743480 run osmo-stp_10.42.42.5(pid=26010): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26010)] 17:15:24.874445 run osmo-stp_10.42.42.5(pid=26010): stdout: | (launched: 2022-12-09_17:15:23.522192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:25.005254 run osmo-stp_10.42.42.5(pid=26010): stderr: | 20221209171523695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171523695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171523696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171523696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171523697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171523697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171523697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:25.134190 run osmo-stp_10.42.42.5(pid=26010): stdout: | (launched: 2022-12-09_17:15:23.522192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:25.256506 run osmo-stp_10.42.42.5(pid=26010): stderr: | 20221209171523695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171523695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171523696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171523696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171523697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171523697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171523697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:25.403196 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26010): Process ended prematurely: osmo-stp_10.42.42.5(pid=26010) [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26010)] [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:15:25.412029 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:15:25.438560 run osmo-hlr_10.42.42.2(pid=26007): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26007)] 17:15:25.487109 run osmo-hlr_10.42.42.2(pid=26007): stdout: | (launched: 2022-12-09_17:15:22.545651) 17:15:25.537179 run osmo-hlr_10.42.42.2(pid=26007): stderr: | 20221209171522727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171522727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171522727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171522727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171522727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171522727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171522740 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171522751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171522751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171522751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:25.606732 run osmo-msc_10.42.42.6(pid=26013): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26013)] 17:15:25.654801 run osmo-msc_10.42.42.6(pid=26013): stdout: | (launched: 2022-12-09_17:15:24.510766) 17:15:25.704582 run osmo-msc_10.42.42.6(pid=26013): stderr: | 20221209171524786 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171524786 DLGLOBAL DEBUG validating counter group 0x7f7b768b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171524786 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171524786 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171524786 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171524786 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171524788 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171524789 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171524789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171524789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:25.755008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26006): Terminating (SIGTERM) 17:15:25.795182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26009): Terminating (SIGTERM) 17:15:25.834974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26012): Terminating (SIGTERM) 17:15:25.875393 --- ParallelTerminationStrategy: PID 26006 died... 17:15:25.894411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26006): Terminated: ok {rc=0} 17:15:25.939501 --- ParallelTerminationStrategy: PID 26009 died... 17:15:25.958154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26009): Terminated: ok {rc=0} 17:15:26.003093 --- ParallelTerminationStrategy: PID 26012 died... 17:15:26.021751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26012): Terminated: ok {rc=0} 17:15:26.108100 bus /sierra_3: Setting Powered False 17:15:27.208272 bus /sierra_3: Setting Powered False 17:15:28.320718 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 emergency:sysmo --------------------------------------------------------------------- 17:15:29.555268 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:29.559399 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 17:15:29.580063 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 17:15:29.607236 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 17:15:29.691483 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 17:15:29.712088 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 17:15:29.739145 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 17:15:30.320655 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2362 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 17:15:30.327196 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:30.338850 tst emergency:sysmo: Using 1 x bts (candidates: 1) 17:15:30.376670 tst emergency_mo_mt_call.py: using LAC 22504 17:15:30.505094 tst emergency_mo_mt_call.py: using RAC 64 17:15:30.633039 tst emergency_mo_mt_call.py: using CellId 22504 17:15:30.760930 tst emergency_mo_mt_call.py: using BVCI 22505 17:15:30.885771 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:30.899137 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:30.917625 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:30.929975 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:30.941788 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:30.953623 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:31.081440 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:31.202219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:31.755530 run create_hlr_db(pid=26019): Launched 17:15:31.922507 bus /sierra_2: Setting Powered False 17:15:32.986622 run create_hlr_db(pid=26019): Terminated: ok {rc=0} 17:15:33.444618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26021): Launched 17:15:33.773056 run osmo-hlr_10.42.42.2(pid=26022): Launched 17:15:33.898219 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:34.462947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26024): Launched 17:15:34.789278 run osmo-stp_10.42.42.5(pid=26025): Launched 17:15:34.926996 tst emergency_mo_mt_call.py: using MSISDN 7292 17:15:35.094922 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:35.680161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26027): Launched 17:15:36.007080 run osmo-msc_10.42.42.6(pid=26028): Launched 17:15:36.189627 run osmo-stp_10.42.42.5(pid=26025): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26025)] 17:15:36.327014 run osmo-stp_10.42.42.5(pid=26025): stdout: | (launched: 2022-12-09_17:15:34.728348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:36.464168 run osmo-stp_10.42.42.5(pid=26025): stderr: | 20221209171534925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171534925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171534925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171534926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171534926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171534926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171534926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:36.600154 run osmo-stp_10.42.42.5(pid=26025): stdout: | (launched: 2022-12-09_17:15:34.728348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:36.729452 run osmo-stp_10.42.42.5(pid=26025): stderr: | 20221209171534925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171534925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171534925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171534926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171534926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171534926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171534926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:36.883691 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26025): Process ended prematurely: osmo-stp_10.42.42.5(pid=26025) [trial-2362↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26025)] [trial-2362↪emergency:sysmo↪emergency_mo_mt_call.py:19] 17:15:36.892791 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 17:15:36.920627 run osmo-hlr_10.42.42.2(pid=26022): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26022)] 17:15:36.971306 run osmo-hlr_10.42.42.2(pid=26022): stdout: | (launched: 2022-12-09_17:15:33.712346) 17:15:37.023714 run osmo-hlr_10.42.42.2(pid=26022): stderr: | 20221209171533911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171533911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171533912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171533912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171533912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171533912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171533925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171533934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171533934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171533934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:37.096725 run osmo-msc_10.42.42.6(pid=26028): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26028)] 17:15:37.147414 run osmo-msc_10.42.42.6(pid=26028): stdout: | (launched: 2022-12-09_17:15:35.946222) 17:15:37.200044 run osmo-msc_10.42.42.6(pid=26028): stderr: | 20221209171536269 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171536269 DLGLOBAL DEBUG validating counter group 0x7f5fbfee9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171536270 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171536270 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171536270 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171536270 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171536272 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171536272 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171536272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171536272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:37.252691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26021): Terminating (SIGTERM) 17:15:37.294990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26024): Terminating (SIGTERM) 17:15:37.337473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26027): Terminating (SIGTERM) 17:15:37.380170 --- ParallelTerminationStrategy: PID 26021 died... 17:15:37.400422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26021): Terminated: ok {rc=0} 17:15:37.447693 --- ParallelTerminationStrategy: PID 26024 died... 17:15:37.467576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26024): Terminated: ok {rc=0} 17:15:37.514371 --- ParallelTerminationStrategy: PID 26027 died... 17:15:37.534224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26027): Terminated: ok {rc=0} 17:15:37.622701 bus /sierra_3: Setting Powered False 17:15:38.722924 bus /sierra_3: Setting Powered False 17:15:39.839429 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 17:15:40.926880 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:40.938847 tst emergency:sysmo: Using 1 x bts (candidates: 1) 17:15:40.977768 tst emergency_preemptive_call.py: using LAC 22505 17:15:41.110540 tst emergency_preemptive_call.py: using RAC 65 17:15:41.236224 tst emergency_preemptive_call.py: using CellId 22505 17:15:41.361219 tst emergency_preemptive_call.py: using BVCI 22506 17:15:41.478173 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:41.489332 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:41.500292 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:41.511233 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:41.522225 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:15:41.533054 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:41.647349 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:41.769880 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:41.887934 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:15:42.002275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:15:42.474845 run create_hlr_db(pid=26030): Launched 17:15:42.592061 bus /sierra_2: Setting Powered False 17:15:43.652808 run create_hlr_db(pid=26030): Terminated: ok {rc=0} 17:15:44.077662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26032): Launched 17:15:44.383990 run osmo-hlr_10.42.42.2(pid=26033): Launched 17:15:44.501727 run osmo-stp_10.42.42.5: Starting osmo-stp 17:15:45.028378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26035): Launched 17:15:45.335451 run osmo-stp_10.42.42.5(pid=26036): Launched 17:15:45.460688 tst emergency_preemptive_call.py: using MSISDN 7293 17:15:45.615754 run osmo-msc_10.42.42.6: Starting osmo-msc 17:15:46.242611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26038): Launched 17:15:46.565707 run osmo-msc_10.42.42.6(pid=26039): Launched 17:15:46.853256 run osmo-stp_10.42.42.5(pid=26036): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26036)] 17:15:47.047299 run osmo-stp_10.42.42.5(pid=26036): stdout: | (launched: 2022-12-09_17:15:45.277963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:47.277197 run osmo-stp_10.42.42.5(pid=26036): stderr: | 20221209171545449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171545449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171545449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171545450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171545450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171545450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171545450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:47.583087 run osmo-stp_10.42.42.5(pid=26036): stdout: | (launched: 2022-12-09_17:15:45.277963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:15:47.705253 run osmo-stp_10.42.42.5(pid=26036): stderr: | 20221209171545449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171545449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171545449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171545450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171545450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171545450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171545450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:15:47.850372 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26036): Process ended prematurely: osmo-stp_10.42.42.5(pid=26036) [trial-2362↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26036)] [trial-2362↪emergency:sysmo↪emergency_preemptive_call.py:32] 17:15:47.858834 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 17:15:47.885447 run osmo-hlr_10.42.42.2(pid=26033): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26033)] 17:15:47.933807 run osmo-hlr_10.42.42.2(pid=26033): stdout: | (launched: 2022-12-09_17:15:44.326421) 17:15:47.983895 run osmo-hlr_10.42.42.2(pid=26033): stderr: | 20221209171544502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171544503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171544503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171544503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171544503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171544503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171544516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171544524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171544524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171544524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:15:48.053654 run osmo-msc_10.42.42.6(pid=26039): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26039)] 17:15:48.101933 run osmo-msc_10.42.42.6(pid=26039): stdout: | (launched: 2022-12-09_17:15:46.506603) 17:15:48.151667 run osmo-msc_10.42.42.6(pid=26039): stderr: | 20221209171547085 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209171547085 DLGLOBAL DEBUG validating counter group 0x7f801cfb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209171547085 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209171547085 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209171547085 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209171547086 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209171547087 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209171547088 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209171547088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209171547088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:15:48.201814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26032): Terminating (SIGTERM) 17:15:48.241957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26035): Terminating (SIGTERM) 17:15:48.282236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26038): Terminating (SIGTERM) 17:15:48.322886 --- ParallelTerminationStrategy: PID 26032 died... 17:15:48.342078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26032): Terminated: ok {rc=0} 17:15:48.387060 --- ParallelTerminationStrategy: PID 26035 died... 17:15:48.406062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26035): Terminated: ok {rc=0} 17:15:48.450998 --- ParallelTerminationStrategy: PID 26038 died... 17:15:48.470175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26038): Terminated: ok {rc=0} 17:15:48.554819 bus /sierra_9: Setting Powered False 17:15:49.654260 bus /sierra_9: Setting Powered False 17:15:50.771439 bus /sierra_8: Setting Powered False 17:15:51.870815 bus /sierra_8: Setting Powered False 17:15:52.988412 bus /sierra_3: Setting Powered False 17:15:54.086191 bus /sierra_3: Setting Powered False 17:15:55.202954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:sysmo --------------------------------------------------------------------- 17:15:56.466000 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:15:56.470619 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 17:15:56.492059 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 17:15:56.531402 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 17:15:56.620309 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 17:15:56.641113 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 17:15:56.680772 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 17:15:57.273901 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 17:15:57.329874 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.340734 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:15:57.376407 tst cs_paging_gprs_active.py: using LAC 22506 17:15:57.504913 tst cs_paging_gprs_active.py: using RAC 66 17:15:57.636768 tst cs_paging_gprs_active.py: using CellId 22506 17:15:57.766021 tst cs_paging_gprs_active.py: using BVCI 22507 17:15:57.887557 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.898600 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.909553 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.920270 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.931089 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.942046 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.952854 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.963682 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:15:57.974906 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:15:58.090158 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:15:58.206111 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:15:58.415692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:15:58.730603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26044): Launched 17:15:59.003853 run iperf3-srv_10.42.42.10(pid=26045): Launched 17:15:59.121853 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:15:59.329698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:15:59.641952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26046): Launched 17:15:59.913837 run iperf3-srv_10.42.42.10(pid=26047): Launched 17:16:00.029419 tst cs_paging_gprs_active.py:38: start network... 17:16:00.236666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:00.716225 run create_hlr_db(pid=26048): Launched 17:16:00.835646 bus /sierra_2: Setting Powered False 17:16:01.899199 run create_hlr_db(pid=26048): Terminated: ok {rc=0} 17:16:02.395197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26050): Launched 17:16:02.707912 run osmo-hlr_10.42.42.2(pid=26051): Launched 17:16:02.827372 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:03.358454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26053): Launched 17:16:03.667930 run osmo-stp_10.42.42.5(pid=26054): Launched 17:16:03.785655 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:05.292191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26056): Launched 17:16:05.412465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:05.675953 run patchelf(pid=26057): Launched 17:16:05.851086 run osmo-stp_10.42.42.5(pid=26054): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26054)] 17:16:05.982696 run osmo-stp_10.42.42.5(pid=26054): stdout: | (launched: 2022-12-09_17:16:03.609690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:06.115661 run osmo-stp_10.42.42.5(pid=26054): stderr: | 20221209171603785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171603785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171603785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171603785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171603786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171603786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171603786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:06.248510 run osmo-stp_10.42.42.5(pid=26054): stdout: | (launched: 2022-12-09_17:16:03.609690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:06.376358 run osmo-stp_10.42.42.5(pid=26054): stderr: | 20221209171603785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171603785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171603785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171603785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171603786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171603786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171603786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:06.527281 run patchelf(pid=26057): Terminating (SIGINT) 17:16:06.701415 run patchelf(pid=26057): Terminated: ok {rc=0} 17:16:06.827284 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26054): Process ended prematurely: osmo-stp_10.42.42.5(pid=26054) [trial-2362↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26054)] [trial-2362↪gprs:sysmo↪cs_paging_gprs_active.py:38] 17:16:06.836704 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 17:16:06.864593 run osmo-hlr_10.42.42.2(pid=26051): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26051)] 17:16:06.912763 run osmo-hlr_10.42.42.2(pid=26051): stdout: | (launched: 2022-12-09_17:16:02.649803) 17:16:06.962851 run osmo-hlr_10.42.42.2(pid=26051): stderr: | 20221209171602827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171602827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171602827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171602827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171602827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171602827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171602839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171602847 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171602847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171602847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:07.013154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26044): Terminating (SIGTERM) 17:16:07.053258 run iperf3-srv_10.42.42.10(pid=26045): Terminating (SIGTERM) 17:16:07.093477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26046): Terminating (SIGTERM) 17:16:07.133679 run iperf3-srv_10.42.42.10(pid=26047): Terminating (SIGTERM) 17:16:07.173772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26050): Terminating (SIGTERM) 17:16:07.214042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26053): Terminating (SIGTERM) 17:16:07.254247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26056): Terminating (SIGTERM) 17:16:07.294647 --- ParallelTerminationStrategy: PID 26044 died... 17:16:07.313843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26044): Terminated: ok {rc=0} 17:16:07.358974 --- ParallelTerminationStrategy: PID 26045 died... 17:16:07.377744 run iperf3-srv_10.42.42.10(pid=26045): Terminated {rc=256} 17:16:07.422981 --- ParallelTerminationStrategy: PID 26046 died... 17:16:07.441854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26046): Terminated: ok {rc=0} 17:16:07.486538 --- ParallelTerminationStrategy: PID 26047 died... 17:16:07.505240 run iperf3-srv_10.42.42.10(pid=26047): Terminated {rc=256} 17:16:07.549911 --- ParallelTerminationStrategy: PID 26050 died... 17:16:07.568762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26050): Terminated: ok {rc=0} 17:16:07.614286 --- ParallelTerminationStrategy: PID 26053 died... 17:16:07.633195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26053): Terminated: ok {rc=0} 17:16:07.678584 --- ParallelTerminationStrategy: PID 26056 died... 17:16:07.697462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26056): Terminated: ok {rc=0} 17:16:07.784418 bus /gobi_0: Setting Powered False 17:16:08.885680 bus /gobi_0: Setting Powered False 17:16:10.003679 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo iperf3.py ---------------------------------------------- 17:16:11.154068 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.165579 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:11.201699 tst iperf3.py: using LAC 22507 17:16:11.331638 tst iperf3.py: using RAC 67 17:16:11.461102 tst iperf3.py: using CellId 22507 17:16:11.591518 tst iperf3.py: using BVCI 22508 17:16:11.713810 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.724750 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.735660 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.746580 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.757355 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.768140 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.779107 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.790006 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:11.800880 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:11.915615 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:16:12.123622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:12.435193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26058): Launched 17:16:12.708141 run iperf3-srv_10.42.42.10(pid=26059): Launched 17:16:12.825920 tst iperf3.py:8: start network... 17:16:13.032810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:13.513874 run create_hlr_db(pid=26060): Launched 17:16:13.632939 bus /gobi_6: Setting Powered False 17:16:14.694575 run create_hlr_db(pid=26060): Terminated: ok {rc=0} 17:16:15.147450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26062): Launched 17:16:15.481506 run osmo-hlr_10.42.42.2(pid=26063): Launched 17:16:15.610159 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:16.249672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26065): Launched 17:16:16.593807 run osmo-stp_10.42.42.5(pid=26066): Launched 17:16:16.873225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:17.550484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26068): Launched 17:16:17.679092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:17.959196 run patchelf(pid=26069): Launched 17:16:18.143387 run osmo-stp_10.42.42.5(pid=26066): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26066)] 17:16:18.283852 run osmo-stp_10.42.42.5(pid=26066): stdout: | (launched: 2022-12-09_17:16:16.531508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:18.424907 run osmo-stp_10.42.42.5(pid=26066): stderr: | 20221209171616809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171616809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171616809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171616810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171616810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171616810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171616810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:18.566513 run osmo-stp_10.42.42.5(pid=26066): stdout: | (launched: 2022-12-09_17:16:16.531508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:18.701394 run osmo-stp_10.42.42.5(pid=26066): stderr: | 20221209171616809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171616809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171616809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171616810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171616810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171616810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171616810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:18.861221 run patchelf(pid=26069): Terminating (SIGINT) 17:16:19.046051 run patchelf(pid=26069): Terminated: ok {rc=0} 17:16:19.179350 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26066): Process ended prematurely: osmo-stp_10.42.42.5(pid=26066) [trial-2362↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26066)] [trial-2362↪gprs:sysmo↪iperf3.py:8] 17:16:19.189586 tst iperf3.py:8: Test FAILED (8.1 sec) 17:16:19.218466 run osmo-hlr_10.42.42.2(pid=26063): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26063)] 17:16:19.268871 run osmo-hlr_10.42.42.2(pid=26063): stdout: | (launched: 2022-12-09_17:16:15.419690) 17:16:19.320770 run osmo-hlr_10.42.42.2(pid=26063): stderr: | 20221209171615623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171615623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171615623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171615623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171615623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171615624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171615636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171615644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171615644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171615644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:19.373372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26058): Terminating (SIGTERM) 17:16:19.415448 run iperf3-srv_10.42.42.10(pid=26059): Terminating (SIGTERM) 17:16:19.457526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26062): Terminating (SIGTERM) 17:16:19.499842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26065): Terminating (SIGTERM) 17:16:19.542129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26068): Terminating (SIGTERM) 17:16:19.584533 --- ParallelTerminationStrategy: PID 26058 died... 17:16:19.604707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26058): Terminated: ok {rc=0} 17:16:19.651561 --- ParallelTerminationStrategy: PID 26059 died... 17:16:19.671300 run iperf3-srv_10.42.42.10(pid=26059): Terminated {rc=256} 17:16:19.717735 --- ParallelTerminationStrategy: PID 26062 died... 17:16:19.737424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26062): Terminated: ok {rc=0} 17:16:19.783968 --- ParallelTerminationStrategy: PID 26065 died... 17:16:19.803667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26065): Terminated: ok {rc=0} 17:16:19.850283 --- ParallelTerminationStrategy: PID 26068 died... 17:16:19.869995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26068): Terminated: ok {rc=0} 17:16:19.958766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo iperf3m4.py ---------------------------------------------- 17:16:21.112834 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.125206 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:21.161978 tst iperf3m4.py: using LAC 22508 17:16:21.291855 tst iperf3m4.py: using RAC 68 17:16:21.414427 tst iperf3m4.py: using CellId 22508 17:16:21.537064 tst iperf3m4.py: using BVCI 22509 17:16:21.649379 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.660061 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.670803 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.681910 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.692273 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.702836 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.713790 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.724275 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:21.735269 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:21.856442 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:21.975119 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:22.095085 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:22.217376 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:16:22.441100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:22.776517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26070): Launched 17:16:23.066727 run iperf3-srv_10.42.42.10(pid=26071): Launched 17:16:23.191204 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:16:23.415044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:23.749650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26072): Launched 17:16:24.040669 run iperf3-srv_10.42.42.10(pid=26073): Launched 17:16:24.166094 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:16:24.390270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:24.725394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26074): Launched 17:16:25.016651 run iperf3-srv_10.42.42.10(pid=26075): Launched 17:16:25.140301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:16:25.363424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:16:25.697462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26076): Launched 17:16:26.003334 run iperf3-srv_10.42.42.10(pid=26077): Launched 17:16:26.127680 tst iperf3m4.py:8: start network... 17:16:26.351368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:26.868179 run create_hlr_db(pid=26078): Launched 17:16:27.001844 bus /gobi_6: Setting Powered False 17:16:28.066114 run create_hlr_db(pid=26078): Terminated: ok {rc=0} 17:16:28.530432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26080): Launched 17:16:28.865615 run osmo-hlr_10.42.42.2(pid=26081): Launched 17:16:28.990602 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:29.558779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26083): Launched 17:16:29.890566 run osmo-stp_10.42.42.5(pid=26084): Launched 17:16:30.015975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:30.588090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26086): Launched 17:16:30.715728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:31.007168 run patchelf(pid=26087): Launched 17:16:31.201245 run osmo-stp_10.42.42.5(pid=26084): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26084)] 17:16:31.339756 run osmo-stp_10.42.42.5(pid=26084): stdout: | (launched: 2022-12-09_17:16:29.828155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:31.480647 run osmo-stp_10.42.42.5(pid=26084): stderr: | 20221209171630026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171630026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171630026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171630027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171630027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171630027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171630027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:31.656663 run osmo-stp_10.42.42.5(pid=26084): stdout: | (launched: 2022-12-09_17:16:29.828155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:31.795178 run osmo-stp_10.42.42.5(pid=26084): stderr: | 20221209171630026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171630026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171630026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171630027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171630027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171630027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171630027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:31.950844 run patchelf(pid=26087): Terminating (SIGINT) 17:16:32.130135 run patchelf(pid=26087): Terminated: ok {rc=0} 17:16:32.258536 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26084): Process ended prematurely: osmo-stp_10.42.42.5(pid=26084) [trial-2362↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26084)] [trial-2362↪gprs:sysmo↪iperf3m4.py:8] 17:16:32.269278 tst iperf3m4.py:8: Test FAILED (11.2 sec) 17:16:32.300858 run osmo-hlr_10.42.42.2(pid=26081): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26081)] 17:16:32.353085 run osmo-hlr_10.42.42.2(pid=26081): stdout: | (launched: 2022-12-09_17:16:28.803254) 17:16:32.404243 run osmo-hlr_10.42.42.2(pid=26081): stderr: | 20221209171629005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171629005 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171629005 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171629005 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171629006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171629006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171629018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171629026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171629026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171629027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:32.456009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26070): Terminating (SIGTERM) 17:16:32.497189 run iperf3-srv_10.42.42.10(pid=26071): Terminating (SIGTERM) 17:16:32.538521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26072): Terminating (SIGTERM) 17:16:32.579800 run iperf3-srv_10.42.42.10(pid=26073): Terminating (SIGTERM) 17:16:32.621071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26074): Terminating (SIGTERM) 17:16:32.662546 run iperf3-srv_10.42.42.10(pid=26075): Terminating (SIGTERM) 17:16:32.703771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26076): Terminating (SIGTERM) 17:16:32.745655 run iperf3-srv_10.42.42.10(pid=26077): Terminating (SIGTERM) 17:16:32.786881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26080): Terminating (SIGTERM) 17:16:32.828076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26083): Terminating (SIGTERM) 17:16:32.869280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26086): Terminating (SIGTERM) 17:16:32.910807 --- ParallelTerminationStrategy: PID 26070 died... 17:16:32.929893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26070): Terminated: ok {rc=0} 17:16:32.976400 --- ParallelTerminationStrategy: PID 26071 died... 17:16:32.995499 run iperf3-srv_10.42.42.10(pid=26071): Terminated {rc=256} 17:16:33.041674 --- ParallelTerminationStrategy: PID 26072 died... 17:16:33.060718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26072): Terminated: ok {rc=0} 17:16:33.107112 --- ParallelTerminationStrategy: PID 26073 died... 17:16:33.126203 run iperf3-srv_10.42.42.10(pid=26073): Terminated {rc=256} 17:16:33.172558 --- ParallelTerminationStrategy: PID 26074 died... 17:16:33.191674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26074): Terminated: ok {rc=0} 17:16:33.238050 --- ParallelTerminationStrategy: PID 26075 died... 17:16:33.257036 run iperf3-srv_10.42.42.10(pid=26075): Terminated {rc=256} 17:16:33.303136 --- ParallelTerminationStrategy: PID 26076 died... 17:16:33.322235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26076): Terminated: ok {rc=0} 17:16:33.368276 --- ParallelTerminationStrategy: PID 26077 died... 17:16:33.387117 run iperf3-srv_10.42.42.10(pid=26077): Terminated {rc=256} 17:16:33.433691 --- ParallelTerminationStrategy: PID 26080 died... 17:16:33.452789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26080): Terminated: ok {rc=0} 17:16:33.499201 --- ParallelTerminationStrategy: PID 26083 died... 17:16:33.518368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26083): Terminated: ok {rc=0} 17:16:33.565045 --- ParallelTerminationStrategy: PID 26086 died... 17:16:33.584086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26086): Terminated: ok {rc=0} 17:16:33.672658 bus /gobi_4: Setting Powered False 17:16:34.772803 bus /gobi_4: Setting Powered False 17:16:35.890836 bus /gobi_1: Setting Powered False 17:16:36.990762 bus /gobi_1: Setting Powered False 17:16:38.120389 bus /gobi_0: Setting Powered False 17:16:39.221036 bus /gobi_0: Setting Powered False 17:16:40.339843 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo ping.py ---------------------------------------------- 17:16:41.440616 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:41.452000 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:41.491673 tst ping.py: using LAC 22509 17:16:41.612333 tst ping.py: using RAC 69 17:16:41.731085 tst ping.py: using CellId 22509 17:16:41.850645 tst ping.py: using BVCI 22510 17:16:41.962271 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:41.972855 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:41.983453 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:41.994225 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.004692 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.015286 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.026105 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:42.036735 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:42.155802 tst ping.py:19: start network... 17:16:42.376351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:42.883091 run create_hlr_db(pid=26088): Launched 17:16:43.015923 bus /gobi_6: Setting Powered False 17:16:44.079914 run create_hlr_db(pid=26088): Terminated: ok {rc=0} 17:16:44.519000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26090): Launched 17:16:44.825446 run osmo-hlr_10.42.42.2(pid=26091): Launched 17:16:44.940592 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:45.477428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26093): Launched 17:16:45.780861 run osmo-stp_10.42.42.5(pid=26094): Launched 17:16:45.898712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:46.623504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26096): Launched 17:16:46.752838 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:47.071284 run patchelf(pid=26097): Launched 17:16:47.295675 run osmo-stp_10.42.42.5(pid=26094): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26094)] 17:16:47.436600 run osmo-stp_10.42.42.5(pid=26094): stdout: | (launched: 2022-12-09_17:16:45.723301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:47.568049 run osmo-stp_10.42.42.5(pid=26094): stderr: | 20221209171645995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171645995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171645995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171645995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171645996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171645996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171645996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:47.699916 run osmo-stp_10.42.42.5(pid=26094): stdout: | (launched: 2022-12-09_17:16:45.723301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:47.824453 run osmo-stp_10.42.42.5(pid=26094): stderr: | 20221209171645995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171645995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171645995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171645995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171645996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171645996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171645996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:47.971973 run patchelf(pid=26097): Terminating (SIGINT) 17:16:48.142800 run patchelf(pid=26097): Terminated: ok {rc=0} 17:16:48.266363 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26094): Process ended prematurely: osmo-stp_10.42.42.5(pid=26094) [trial-2362↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26094)] [trial-2362↪gprs:sysmo↪ping.py:22] 17:16:48.275462 tst ping.py:22: Test FAILED (6.8 sec) 17:16:48.303110 run osmo-hlr_10.42.42.2(pid=26091): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26091)] 17:16:48.352125 run osmo-hlr_10.42.42.2(pid=26091): stdout: | (launched: 2022-12-09_17:16:44.767363) 17:16:48.402557 run osmo-hlr_10.42.42.2(pid=26091): stderr: | 20221209171644945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171644945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171644946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171644946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171644946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171644946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171644958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171644969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171644970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171644970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:48.453453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26090): Terminating (SIGTERM) 17:16:48.494537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26093): Terminating (SIGTERM) 17:16:48.535413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26096): Terminating (SIGTERM) 17:16:48.576397 --- ParallelTerminationStrategy: PID 26090 died... 17:16:48.595915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26090): Terminated: ok {rc=0} 17:16:48.641553 --- ParallelTerminationStrategy: PID 26093 died... 17:16:48.660545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26093): Terminated: ok {rc=0} 17:16:48.705856 --- ParallelTerminationStrategy: PID 26096 died... 17:16:48.724886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26096): Terminated: ok {rc=0} 17:16:48.812799 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 17:16:49.902541 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:49.914325 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:16:49.951965 tst ping_idle_ping.py: using LAC 22510 17:16:50.073359 tst ping_idle_ping.py: using RAC 70 17:16:50.194722 tst ping_idle_ping.py: using CellId 22510 17:16:50.315282 tst ping_idle_ping.py: using BVCI 22511 17:16:50.427331 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.438126 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.448598 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.459479 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.470315 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.481151 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.491924 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:16:50.502869 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:16:50.624434 tst ping_idle_ping.py:24: start network... 17:16:50.829510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:16:51.300518 run create_hlr_db(pid=26098): Launched 17:16:51.416451 bus /gobi_6: Setting Powered False 17:16:52.476926 run create_hlr_db(pid=26098): Terminated: ok {rc=0} 17:16:52.924941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26100): Launched 17:16:53.251450 run osmo-hlr_10.42.42.2(pid=26101): Launched 17:16:53.375385 run osmo-stp_10.42.42.5: Starting osmo-stp 17:16:53.938320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26103): Launched 17:16:54.264213 run osmo-stp_10.42.42.5(pid=26104): Launched 17:16:54.387515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:16:54.949323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26106): Launched 17:16:55.074044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:16:55.351346 run patchelf(pid=26107): Launched 17:16:55.531319 run osmo-stp_10.42.42.5(pid=26104): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26104)] 17:16:55.669163 run osmo-stp_10.42.42.5(pid=26104): stdout: | (launched: 2022-12-09_17:16:54.202604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:55.808648 run osmo-stp_10.42.42.5(pid=26104): stderr: | 20221209171654399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171654399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171654399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171654399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171654400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171654400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171654400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:55.948151 run osmo-stp_10.42.42.5(pid=26104): stdout: | (launched: 2022-12-09_17:16:54.202604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:16:56.081372 run osmo-stp_10.42.42.5(pid=26104): stderr: | 20221209171654399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171654399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171654399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171654399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171654400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171654400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171654400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:16:56.239398 run patchelf(pid=26107): Terminating (SIGINT) 17:16:56.421134 run patchelf(pid=26107): Terminated: ok {rc=0} 17:16:56.552375 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26104): Process ended prematurely: osmo-stp_10.42.42.5(pid=26104) [trial-2362↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26104)] [trial-2362↪gprs:sysmo↪ping_idle_ping.py:27] 17:16:56.561974 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:16:56.589903 run osmo-hlr_10.42.42.2(pid=26101): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26101)] 17:16:56.639880 run osmo-hlr_10.42.42.2(pid=26101): stdout: | (launched: 2022-12-09_17:16:53.189812) 17:16:56.691479 run osmo-hlr_10.42.42.2(pid=26101): stderr: | 20221209171653392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171653392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171653392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171653392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171653393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171653393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171653406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171653414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171653414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171653414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:16:56.743377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26100): Terminating (SIGTERM) 17:16:56.784831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26103): Terminating (SIGTERM) 17:16:56.826919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26106): Terminating (SIGTERM) 17:16:56.869582 --- ParallelTerminationStrategy: PID 26100 died... 17:16:56.889682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26100): Terminated: ok {rc=0} 17:16:56.936215 --- ParallelTerminationStrategy: PID 26103 died... 17:16:56.955959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26103): Terminated: ok {rc=0} 17:16:57.002450 --- ParallelTerminationStrategy: PID 26106 died... 17:16:57.022068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26106): Terminated: ok {rc=0} 17:16:57.110271 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 17:16:58.402390 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:16:58.408299 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:16:58.430263 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:16:58.470096 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:16:58.558726 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:16:58.580125 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:16:58.619447 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:16:59.214859 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:16:59.268917 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.280313 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:16:59.317715 tst cs_paging_gprs_active.py: using LAC 22511 17:16:59.447297 tst cs_paging_gprs_active.py: using RAC 71 17:16:59.577347 tst cs_paging_gprs_active.py: using CellId 22511 17:16:59.707060 tst cs_paging_gprs_active.py: using BVCI 22512 17:16:59.829557 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.840815 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.851821 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.863062 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.874195 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.885371 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.896569 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.907651 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:16:59.919098 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:00.035321 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:00.151955 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:17:00.378919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:00.714779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26111): Launched 17:17:01.029102 run iperf3-srv_10.42.42.10(pid=26112): Launched 17:17:01.168061 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:17:01.396145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:01.745460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26116): Launched 17:17:02.088796 run iperf3-srv_10.42.42.10(pid=26117): Launched 17:17:02.232712 tst cs_paging_gprs_active.py:38: start network... 17:17:02.458342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:02.977550 run create_hlr_db(pid=26118): Launched 17:17:03.112400 bus /gobi_6: Setting Powered False 17:17:04.177664 run create_hlr_db(pid=26118): Terminated: ok {rc=0} 17:17:04.621474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26120): Launched 17:17:04.933428 run osmo-hlr_10.42.42.2(pid=26121): Launched 17:17:05.052006 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:05.586094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26123): Launched 17:17:05.897512 run osmo-stp_10.42.42.5(pid=26124): Launched 17:17:06.016074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:06.550561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26126): Launched 17:17:06.669220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:06.932586 run patchelf(pid=26127): Launched 17:17:07.104391 run osmo-stp_10.42.42.5(pid=26124): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26124)] 17:17:07.235355 run osmo-stp_10.42.42.5(pid=26124): stdout: | (launched: 2022-12-09_17:17:05.838287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:07.367389 run osmo-stp_10.42.42.5(pid=26124): stderr: | 20221209171706012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171706012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171706013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171706013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171706013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171706014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171706014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:07.499770 run osmo-stp_10.42.42.5(pid=26124): stdout: | (launched: 2022-12-09_17:17:05.838287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:07.626093 run osmo-stp_10.42.42.5(pid=26124): stderr: | 20221209171706012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171706012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171706013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171706013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171706013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171706014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171706014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:07.776415 run patchelf(pid=26127): Terminating (SIGINT) 17:17:07.950090 run patchelf(pid=26127): Terminated: ok {rc=0} 17:17:08.075616 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26124): Process ended prematurely: osmo-stp_10.42.42.5(pid=26124) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26124)] [trial-2362↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:17:08.085299 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:17:08.113049 run osmo-hlr_10.42.42.2(pid=26121): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26121)] 17:17:08.161282 run osmo-hlr_10.42.42.2(pid=26121): stdout: | (launched: 2022-12-09_17:17:04.873878) 17:17:08.211202 run osmo-hlr_10.42.42.2(pid=26121): stderr: | 20221209171705054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171705054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171705054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171705054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171705054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171705054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171705105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171705115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171705116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171705116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:08.261950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26111): Terminating (SIGTERM) 17:17:08.302482 run iperf3-srv_10.42.42.10(pid=26112): Terminating (SIGTERM) 17:17:08.342359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26116): Terminating (SIGTERM) 17:17:08.382385 run iperf3-srv_10.42.42.10(pid=26117): Terminating (SIGTERM) 17:17:08.422278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26120): Terminating (SIGTERM) 17:17:08.462374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26123): Terminating (SIGTERM) 17:17:08.502390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26126): Terminating (SIGTERM) 17:17:08.542563 --- ParallelTerminationStrategy: PID 26111 died... 17:17:08.561708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26111): Terminated: ok {rc=0} 17:17:08.606743 --- ParallelTerminationStrategy: PID 26112 died... 17:17:08.625199 run iperf3-srv_10.42.42.10(pid=26112): Terminated {rc=256} 17:17:08.669784 --- ParallelTerminationStrategy: PID 26116 died... 17:17:08.688413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26116): Terminated: ok {rc=0} 17:17:08.732521 --- ParallelTerminationStrategy: PID 26117 died... 17:17:08.750967 run iperf3-srv_10.42.42.10(pid=26117): Terminated {rc=256} 17:17:08.795101 --- ParallelTerminationStrategy: PID 26120 died... 17:17:08.813627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26120): Terminated: ok {rc=0} 17:17:08.858284 --- ParallelTerminationStrategy: PID 26123 died... 17:17:08.876718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26123): Terminated: ok {rc=0} 17:17:08.921072 --- ParallelTerminationStrategy: PID 26126 died... 17:17:08.939844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26126): Terminated: ok {rc=0} 17:17:09.024143 bus /gobi_0: Setting Powered False 17:17:10.123078 bus /gobi_0: Setting Powered False 17:17:11.241174 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:17:12.389522 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:12.401186 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:12.439655 tst iperf3.py: using LAC 22512 17:17:12.562899 tst iperf3.py: using RAC 72 17:17:12.686117 tst iperf3.py: using CellId 22512 17:17:12.806850 tst iperf3.py: using BVCI 22513 17:17:12.920736 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:12.931606 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:12.942348 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:12.953331 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:12.964237 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:12.975396 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:12.986819 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:12.998079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:13.009490 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:13.128787 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:17:13.336778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:13.648112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26128): Launched 17:17:13.920202 run iperf3-srv_10.42.42.10(pid=26129): Launched 17:17:14.046051 tst iperf3.py:8: start network... 17:17:14.270265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:14.784801 run create_hlr_db(pid=26130): Launched 17:17:14.919680 bus /gobi_6: Setting Powered False 17:17:15.986755 run create_hlr_db(pid=26130): Terminated: ok {rc=0} 17:17:16.438209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26132): Launched 17:17:16.777884 run osmo-hlr_10.42.42.2(pid=26133): Launched 17:17:16.961215 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:17.653853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26135): Launched 17:17:17.964308 run osmo-stp_10.42.42.5(pid=26136): Launched 17:17:18.081377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:18.618761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26138): Launched 17:17:18.737655 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:19.000757 run patchelf(pid=26139): Launched 17:17:19.173166 run osmo-stp_10.42.42.5(pid=26136): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26136)] 17:17:19.304266 run osmo-stp_10.42.42.5(pid=26136): stdout: | (launched: 2022-12-09_17:17:17.905992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:19.437311 run osmo-stp_10.42.42.5(pid=26136): stderr: | 20221209171718077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171718078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171718078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171718078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171718080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171718081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171718081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:19.569985 run osmo-stp_10.42.42.5(pid=26136): stdout: | (launched: 2022-12-09_17:17:17.905992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:19.696491 run osmo-stp_10.42.42.5(pid=26136): stderr: | 20221209171718077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171718078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171718078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171718078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171718080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171718081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171718081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:19.846518 run patchelf(pid=26139): Terminating (SIGINT) 17:17:20.020446 run patchelf(pid=26139): Terminated: ok {rc=0} 17:17:20.146044 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26136): Process ended prematurely: osmo-stp_10.42.42.5(pid=26136) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26136)] [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 17:17:20.155534 tst iperf3.py:8: Test FAILED (7.8 sec) 17:17:20.183036 run osmo-hlr_10.42.42.2(pid=26133): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26133)] 17:17:20.231701 run osmo-hlr_10.42.42.2(pid=26133): stdout: | (launched: 2022-12-09_17:17:16.713582) 17:17:20.281885 run osmo-hlr_10.42.42.2(pid=26133): stderr: | 20221209171717084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171717084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171717084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171717084 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171717084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171717084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171717106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171717127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171717127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171717127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:20.332435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26128): Terminating (SIGTERM) 17:17:20.372691 run iperf3-srv_10.42.42.10(pid=26129): Terminating (SIGTERM) 17:17:20.412850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26132): Terminating (SIGTERM) 17:17:20.453365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26135): Terminating (SIGTERM) 17:17:20.493732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26138): Terminating (SIGTERM) 17:17:20.534607 --- ParallelTerminationStrategy: PID 26128 died... 17:17:20.554093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26128): Terminated: ok {rc=0} 17:17:20.599325 --- ParallelTerminationStrategy: PID 26129 died... 17:17:20.618154 run iperf3-srv_10.42.42.10(pid=26129): Terminated {rc=256} 17:17:20.662770 --- ParallelTerminationStrategy: PID 26132 died... 17:17:20.682110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26132): Terminated: ok {rc=0} 17:17:20.726876 --- ParallelTerminationStrategy: PID 26135 died... 17:17:20.745876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26135): Terminated: ok {rc=0} 17:17:20.790961 --- ParallelTerminationStrategy: PID 26138 died... 17:17:20.809980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26138): Terminated: ok {rc=0} 17:17:20.896648 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:17:22.046003 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.057687 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:22.096538 tst iperf3m4.py: using LAC 22513 17:17:22.227043 tst iperf3m4.py: using RAC 73 17:17:22.362703 tst iperf3m4.py: using CellId 22513 17:17:22.491646 tst iperf3m4.py: using BVCI 22514 17:17:22.613922 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.625381 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.636560 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.647810 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.659027 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.670274 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.681741 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.692615 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:22.703757 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:22.826098 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:22.944457 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.064048 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:23.185205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:17:23.409777 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:23.746509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26140): Launched 17:17:24.037290 run iperf3-srv_10.42.42.10(pid=26141): Launched 17:17:24.161553 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:17:24.384837 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:24.719714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26142): Launched 17:17:25.009908 run iperf3-srv_10.42.42.10(pid=26143): Launched 17:17:25.136098 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:17:25.359294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:25.694219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26144): Launched 17:17:25.986032 run iperf3-srv_10.42.42.10(pid=26145): Launched 17:17:26.112153 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:17:26.336443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:17:26.671889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26146): Launched 17:17:26.961378 run iperf3-srv_10.42.42.10(pid=26147): Launched 17:17:27.085276 tst iperf3m4.py:8: start network... 17:17:27.308845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:27.823244 run create_hlr_db(pid=26148): Launched 17:17:27.957141 bus /gobi_6: Setting Powered False 17:17:29.021897 run create_hlr_db(pid=26148): Terminated: ok {rc=0} 17:17:29.486818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26150): Launched 17:17:29.819517 run osmo-hlr_10.42.42.2(pid=26151): Launched 17:17:29.944220 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:30.513038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26153): Launched 17:17:30.854989 run osmo-stp_10.42.42.5(pid=26154): Launched 17:17:31.058434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:31.813825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26156): Launched 17:17:31.952638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:32.239671 run patchelf(pid=26157): Launched 17:17:32.436247 run osmo-stp_10.42.42.5(pid=26154): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26154)] 17:17:32.576404 run osmo-stp_10.42.42.5(pid=26154): stdout: | (launched: 2022-12-09_17:17:30.782735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:32.717721 run osmo-stp_10.42.42.5(pid=26154): stderr: | 20221209171731069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171731069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171731070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171731070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171731071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171731071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171731071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:32.859207 run osmo-stp_10.42.42.5(pid=26154): stdout: | (launched: 2022-12-09_17:17:30.782735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:32.994602 run osmo-stp_10.42.42.5(pid=26154): stderr: | 20221209171731069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171731069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171731070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171731070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171731071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171731071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171731071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:33.155530 run patchelf(pid=26157): Terminating (SIGINT) 17:17:33.341992 run patchelf(pid=26157): Terminated: ok {rc=0} 17:17:33.475895 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26154): Process ended prematurely: osmo-stp_10.42.42.5(pid=26154) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26154)] [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 17:17:33.486520 tst iperf3m4.py:8: Test FAILED (11.5 sec) 17:17:33.515486 run osmo-hlr_10.42.42.2(pid=26151): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26151)] 17:17:33.565894 run osmo-hlr_10.42.42.2(pid=26151): stdout: | (launched: 2022-12-09_17:17:29.757332) 17:17:33.618025 run osmo-hlr_10.42.42.2(pid=26151): stderr: | 20221209171729959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171729959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171729959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171729959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171729959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171729960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171729973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171729981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171729981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171729981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:33.670745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26140): Terminating (SIGTERM) 17:17:33.712701 run iperf3-srv_10.42.42.10(pid=26141): Terminating (SIGTERM) 17:17:33.754731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26142): Terminating (SIGTERM) 17:17:33.796769 run iperf3-srv_10.42.42.10(pid=26143): Terminating (SIGTERM) 17:17:33.838849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26144): Terminating (SIGTERM) 17:17:33.881023 run iperf3-srv_10.42.42.10(pid=26145): Terminating (SIGTERM) 17:17:33.922897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26146): Terminating (SIGTERM) 17:17:33.965073 run iperf3-srv_10.42.42.10(pid=26147): Terminating (SIGTERM) 17:17:34.007067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26150): Terminating (SIGTERM) 17:17:34.049396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26153): Terminating (SIGTERM) 17:17:34.091562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26156): Terminating (SIGTERM) 17:17:34.134354 --- ParallelTerminationStrategy: PID 26140 died... 17:17:34.154614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26140): Terminated: ok {rc=0} 17:17:34.201793 --- ParallelTerminationStrategy: PID 26141 died... 17:17:34.221624 run iperf3-srv_10.42.42.10(pid=26141): Terminated {rc=256} 17:17:34.268507 --- ParallelTerminationStrategy: PID 26142 died... 17:17:34.288502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26142): Terminated: ok {rc=0} 17:17:34.335499 --- ParallelTerminationStrategy: PID 26143 died... 17:17:34.355582 run iperf3-srv_10.42.42.10(pid=26143): Terminated {rc=256} 17:17:34.402172 --- ParallelTerminationStrategy: PID 26144 died... 17:17:34.421807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26144): Terminated: ok {rc=0} 17:17:34.468917 --- ParallelTerminationStrategy: PID 26145 died... 17:17:34.488502 run iperf3-srv_10.42.42.10(pid=26145): Terminated {rc=256} 17:17:34.534618 --- ParallelTerminationStrategy: PID 26146 died... 17:17:34.554178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26146): Terminated: ok {rc=0} 17:17:34.600573 --- ParallelTerminationStrategy: PID 26147 died... 17:17:34.620290 run iperf3-srv_10.42.42.10(pid=26147): Terminated {rc=256} 17:17:34.666641 --- ParallelTerminationStrategy: PID 26150 died... 17:17:34.686298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26150): Terminated: ok {rc=0} 17:17:34.732510 --- ParallelTerminationStrategy: PID 26153 died... 17:17:34.752224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26153): Terminated: ok {rc=0} 17:17:34.798704 --- ParallelTerminationStrategy: PID 26156 died... 17:17:34.818422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26156): Terminated: ok {rc=0} 17:17:34.907375 bus /gobi_4: Setting Powered False 17:17:36.008002 bus /gobi_4: Setting Powered False 17:17:37.124831 bus /gobi_1: Setting Powered False 17:17:38.225472 bus /gobi_1: Setting Powered False 17:17:39.342658 bus /gobi_0: Setting Powered False 17:17:40.442735 bus /gobi_0: Setting Powered False 17:17:41.560759 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 17:17:42.665771 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:42.677792 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:42.715851 tst ping.py: using LAC 22514 17:17:42.846957 tst ping.py: using RAC 74 17:17:42.973632 tst ping.py: using CellId 22514 17:17:43.093830 tst ping.py: using BVCI 22515 17:17:43.206543 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.217823 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.228682 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.240031 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.251294 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.262316 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.273588 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:43.284476 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:43.405581 tst ping.py:19: start network... 17:17:43.627250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:44.134335 run create_hlr_db(pid=26158): Launched 17:17:44.265927 bus /gobi_6: Setting Powered False 17:17:45.330898 run create_hlr_db(pid=26158): Terminated: ok {rc=0} 17:17:45.769306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26160): Launched 17:17:46.117174 run osmo-hlr_10.42.42.2(pid=26161): Launched 17:17:46.345995 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:47.036442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26163): Launched 17:17:47.358139 run osmo-stp_10.42.42.5(pid=26164): Launched 17:17:47.473767 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:47.999934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26166): Launched 17:17:48.115639 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:48.373349 run patchelf(pid=26167): Launched 17:17:48.542342 run osmo-stp_10.42.42.5(pid=26164): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26164)] 17:17:48.670851 run osmo-stp_10.42.42.5(pid=26164): stdout: | (launched: 2022-12-09_17:17:47.300494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:48.800767 run osmo-stp_10.42.42.5(pid=26164): stderr: | 20221209171747472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171747472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171747472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171747472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171747473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171747473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171747473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:48.931471 run osmo-stp_10.42.42.5(pid=26164): stdout: | (launched: 2022-12-09_17:17:47.300494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:49.055581 run osmo-stp_10.42.42.5(pid=26164): stderr: | 20221209171747472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171747472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171747472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171747472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171747473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171747473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171747473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:49.202884 run patchelf(pid=26167): Terminating (SIGINT) 17:17:49.372840 run patchelf(pid=26167): Terminated: ok {rc=0} 17:17:49.495221 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26164): Process ended prematurely: osmo-stp_10.42.42.5(pid=26164) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26164)] [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 17:17:49.504251 tst ping.py:22: Test FAILED (6.8 sec) 17:17:49.531685 run osmo-hlr_10.42.42.2(pid=26161): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26161)] 17:17:49.579777 run osmo-hlr_10.42.42.2(pid=26161): stdout: | (launched: 2022-12-09_17:17:46.056630) 17:17:49.629797 run osmo-hlr_10.42.42.2(pid=26161): stderr: | 20221209171746360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171746360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171746360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171746360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171746360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171746360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171746372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171746380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171746380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171746380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:49.680382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26160): Terminating (SIGTERM) 17:17:49.720360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26163): Terminating (SIGTERM) 17:17:49.760578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26166): Terminating (SIGTERM) 17:17:49.801194 --- ParallelTerminationStrategy: PID 26160 died... 17:17:49.820386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26160): Terminated: ok {rc=0} 17:17:49.865455 --- ParallelTerminationStrategy: PID 26163 died... 17:17:49.884016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26163): Terminated: ok {rc=0} 17:17:49.928887 --- ParallelTerminationStrategy: PID 26166 died... 17:17:49.948194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26166): Terminated: ok {rc=0} 17:17:50.035471 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:17:51.124342 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.136029 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:17:51.175669 tst ping_idle_ping.py: using LAC 22515 17:17:51.297360 tst ping_idle_ping.py: using RAC 75 17:17:51.418785 tst ping_idle_ping.py: using CellId 22515 17:17:51.539770 tst ping_idle_ping.py: using BVCI 22516 17:17:51.650750 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.661605 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.672239 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.683648 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.694974 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.706387 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.717848 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:17:51.729210 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:17:51.852408 tst ping_idle_ping.py:24: start network... 17:17:52.057840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:17:52.530323 run create_hlr_db(pid=26168): Launched 17:17:52.646492 bus /gobi_6: Setting Powered False 17:17:53.707506 run create_hlr_db(pid=26168): Terminated: ok {rc=0} 17:17:54.156931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26170): Launched 17:17:54.486654 run osmo-hlr_10.42.42.2(pid=26171): Launched 17:17:54.612377 run osmo-stp_10.42.42.5: Starting osmo-stp 17:17:55.175037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26173): Launched 17:17:55.503277 run osmo-stp_10.42.42.5(pid=26174): Launched 17:17:55.628215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:17:56.193660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26176): Launched 17:17:56.318747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:17:56.596350 run patchelf(pid=26177): Launched 17:17:56.776438 run osmo-stp_10.42.42.5(pid=26174): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26174)] 17:17:56.914232 run osmo-stp_10.42.42.5(pid=26174): stdout: | (launched: 2022-12-09_17:17:55.441958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:57.054119 run osmo-stp_10.42.42.5(pid=26174): stderr: | 20221209171755637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171755637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171755637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171755638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171755638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171755638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171755638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:57.193983 run osmo-stp_10.42.42.5(pid=26174): stdout: | (launched: 2022-12-09_17:17:55.441958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:17:57.328078 run osmo-stp_10.42.42.5(pid=26174): stderr: | 20221209171755637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171755637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171755637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171755638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171755638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171755638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171755638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:17:57.486784 run patchelf(pid=26177): Terminating (SIGINT) 17:17:57.668843 run patchelf(pid=26177): Terminated: ok {rc=0} 17:17:57.800716 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26174): Process ended prematurely: osmo-stp_10.42.42.5(pid=26174) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26174)] [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 17:17:57.810587 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:17:57.838616 run osmo-hlr_10.42.42.2(pid=26171): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26171)] 17:17:57.888823 run osmo-hlr_10.42.42.2(pid=26171): stdout: | (launched: 2022-12-09_17:17:54.424356) 17:17:57.941162 run osmo-hlr_10.42.42.2(pid=26171): stderr: | 20221209171754628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171754628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171754628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171754628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171754628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171754628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171754644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171754654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171754654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171754654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:17:57.993778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26170): Terminating (SIGTERM) 17:17:58.036181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26173): Terminating (SIGTERM) 17:17:58.078476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26176): Terminating (SIGTERM) 17:17:58.121248 --- ParallelTerminationStrategy: PID 26170 died... 17:17:58.141556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26170): Terminated: ok {rc=0} 17:17:58.188753 --- ParallelTerminationStrategy: PID 26173 died... 17:17:58.208743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26173): Terminated: ok {rc=0} 17:17:58.256042 --- ParallelTerminationStrategy: PID 26176 died... 17:17:58.275953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26176): Terminated: ok {rc=0} 17:17:58.364510 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:17:59.652547 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:17:59.659149 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:17:59.681064 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:17:59.719983 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:17:59.806814 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:17:59.827678 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:17:59.866553 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:18:00.457633 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:18:00.507966 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:00.519039 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:00.575105 tst cs_paging_gprs_active.py: using LAC 22516 17:18:00.697408 tst cs_paging_gprs_active.py: using RAC 76 17:18:00.828116 tst cs_paging_gprs_active.py: using CellId 22516 17:18:00.966890 tst cs_paging_gprs_active.py: using BVCI 22517 17:18:01.117090 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.129221 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.140902 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.152832 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.166346 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.178273 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.190637 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.202848 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:01.214937 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:01.340406 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:01.469912 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:18:01.720674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:02.046314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26181): Launched 17:18:02.332288 run iperf3-srv_10.42.42.10(pid=26182): Launched 17:18:02.448320 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:18:02.655835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:02.968561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26183): Launched 17:18:03.240261 run iperf3-srv_10.42.42.10(pid=26184): Launched 17:18:03.356388 tst cs_paging_gprs_active.py:38: start network... 17:18:03.563821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:04.044921 run create_hlr_db(pid=26185): Launched 17:18:04.163514 bus /gobi_6: Setting Powered False 17:18:05.225160 run create_hlr_db(pid=26185): Terminated: ok {rc=0} 17:18:05.681168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26187): Launched 17:18:06.016020 run osmo-hlr_10.42.42.2(pid=26188): Launched 17:18:06.143378 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:06.722413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26190): Launched 17:18:07.057926 run osmo-stp_10.42.42.5(pid=26191): Launched 17:18:07.184460 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:07.761658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26193): Launched 17:18:07.888515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:08.171658 run patchelf(pid=26194): Launched 17:18:08.356739 run osmo-stp_10.42.42.5(pid=26191): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26191)] 17:18:08.497391 run osmo-stp_10.42.42.5(pid=26191): stdout: | (launched: 2022-12-09_17:18:06.995228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:08.639804 run osmo-stp_10.42.42.5(pid=26191): stderr: | 20221209171807190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171807190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171807190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171807191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171807191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171807191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171807191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:08.781692 run osmo-stp_10.42.42.5(pid=26191): stdout: | (launched: 2022-12-09_17:18:06.995228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:08.917637 run osmo-stp_10.42.42.5(pid=26191): stderr: | 20221209171807190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171807190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171807190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171807191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171807191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171807191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171807191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:09.078695 run patchelf(pid=26194): Terminating (SIGINT) 17:18:09.265569 run patchelf(pid=26194): Terminated: ok {rc=0} 17:18:09.400699 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26191): Process ended prematurely: osmo-stp_10.42.42.5(pid=26191) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26191)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:18:09.411093 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:18:09.440518 run osmo-hlr_10.42.42.2(pid=26188): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26188)] 17:18:09.491407 run osmo-hlr_10.42.42.2(pid=26188): stdout: | (launched: 2022-12-09_17:18:05.953311) 17:18:09.544056 run osmo-hlr_10.42.42.2(pid=26188): stderr: | 20221209171806155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171806155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171806155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171806155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171806155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171806155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171806167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171806176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171806176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171806176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:09.597284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26181): Terminating (SIGTERM) 17:18:09.639842 run iperf3-srv_10.42.42.10(pid=26182): Terminating (SIGTERM) 17:18:09.682418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26183): Terminating (SIGTERM) 17:18:09.725189 run iperf3-srv_10.42.42.10(pid=26184): Terminating (SIGTERM) 17:18:09.767887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26187): Terminating (SIGTERM) 17:18:09.810614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26190): Terminating (SIGTERM) 17:18:09.853186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26193): Terminating (SIGTERM) 17:18:09.895926 --- ParallelTerminationStrategy: PID 26181 died... 17:18:09.916211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26181): Terminated: ok {rc=0} 17:18:09.963415 --- ParallelTerminationStrategy: PID 26182 died... 17:18:09.983323 run iperf3-srv_10.42.42.10(pid=26182): Terminated {rc=256} 17:18:10.030094 --- ParallelTerminationStrategy: PID 26183 died... 17:18:10.049960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26183): Terminated: ok {rc=0} 17:18:10.096498 --- ParallelTerminationStrategy: PID 26184 died... 17:18:10.116128 run iperf3-srv_10.42.42.10(pid=26184): Terminated {rc=256} 17:18:10.162752 --- ParallelTerminationStrategy: PID 26187 died... 17:18:10.182682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26187): Terminated: ok {rc=0} 17:18:10.229461 --- ParallelTerminationStrategy: PID 26190 died... 17:18:10.249353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26190): Terminated: ok {rc=0} 17:18:10.296355 --- ParallelTerminationStrategy: PID 26193 died... 17:18:10.316445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26193): Terminated: ok {rc=0} 17:18:10.404695 bus /gobi_0: Setting Powered False 17:18:11.504659 bus /gobi_0: Setting Powered False 17:18:12.623123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:18:13.771471 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:13.783212 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:13.845958 tst iperf3.py: using LAC 22517 17:18:13.966423 tst iperf3.py: using RAC 77 17:18:14.087374 tst iperf3.py: using CellId 22517 17:18:14.206501 tst iperf3.py: using BVCI 22518 17:18:14.320584 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.331577 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.342365 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.353718 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.364469 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.375416 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.386498 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.397387 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:14.408360 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:14.524735 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:18:14.734187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:15.048477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26195): Launched 17:18:15.322413 run iperf3-srv_10.42.42.10(pid=26196): Launched 17:18:15.438898 tst iperf3.py:8: start network... 17:18:15.647906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:16.137417 run create_hlr_db(pid=26197): Launched 17:18:16.292391 bus /gobi_6: Setting Powered False 17:18:17.353282 run create_hlr_db(pid=26197): Terminated: ok {rc=0} 17:18:17.809506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26199): Launched 17:18:18.143741 run osmo-hlr_10.42.42.2(pid=26200): Launched 17:18:18.270826 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:18.842263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26202): Launched 17:18:19.174604 run osmo-stp_10.42.42.5(pid=26203): Launched 17:18:19.300628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:19.872882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26205): Launched 17:18:19.999288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:20.280718 run patchelf(pid=26206): Launched 17:18:20.464833 run osmo-stp_10.42.42.5(pid=26203): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26203)] 17:18:20.604181 run osmo-stp_10.42.42.5(pid=26203): stdout: | (launched: 2022-12-09_17:18:19.112163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:20.745440 run osmo-stp_10.42.42.5(pid=26203): stderr: | 20221209171819309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171819309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171819309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171819309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171819310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171819310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171819310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:20.886813 run osmo-stp_10.42.42.5(pid=26203): stdout: | (launched: 2022-12-09_17:18:19.112163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:21.021756 run osmo-stp_10.42.42.5(pid=26203): stderr: | 20221209171819309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171819309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171819309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171819309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171819310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171819310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171819310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:21.182434 run patchelf(pid=26206): Terminating (SIGINT) 17:18:21.367913 run patchelf(pid=26206): Terminated: ok {rc=0} 17:18:21.501275 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26203): Process ended prematurely: osmo-stp_10.42.42.5(pid=26203) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26203)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 17:18:21.511511 tst iperf3.py:8: Test FAILED (7.8 sec) 17:18:21.540708 run osmo-hlr_10.42.42.2(pid=26200): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26200)] 17:18:21.591186 run osmo-hlr_10.42.42.2(pid=26200): stdout: | (launched: 2022-12-09_17:18:18.080938) 17:18:21.643535 run osmo-hlr_10.42.42.2(pid=26200): stderr: | 20221209171818283 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171818283 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171818283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171818283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171818283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171818283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171818295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171818304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171818304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171818304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:21.696272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26195): Terminating (SIGTERM) 17:18:21.738483 run iperf3-srv_10.42.42.10(pid=26196): Terminating (SIGTERM) 17:18:21.780748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26199): Terminating (SIGTERM) 17:18:21.823035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26202): Terminating (SIGTERM) 17:18:21.865275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26205): Terminating (SIGTERM) 17:18:21.908015 --- ParallelTerminationStrategy: PID 26195 died... 17:18:21.928453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26195): Terminated: ok {rc=0} 17:18:21.975613 --- ParallelTerminationStrategy: PID 26196 died... 17:18:21.995557 run iperf3-srv_10.42.42.10(pid=26196): Terminated {rc=256} 17:18:22.042543 --- ParallelTerminationStrategy: PID 26199 died... 17:18:22.062417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26199): Terminated: ok {rc=0} 17:18:22.109328 --- ParallelTerminationStrategy: PID 26202 died... 17:18:22.129459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26202): Terminated: ok {rc=0} 17:18:22.176179 --- ParallelTerminationStrategy: PID 26205 died... 17:18:22.196027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26205): Terminated: ok {rc=0} 17:18:22.283830 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:18:23.436179 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:23.448615 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:23.507595 tst iperf3m4.py: using LAC 22518 17:18:23.638813 tst iperf3m4.py: using RAC 78 17:18:23.769628 tst iperf3m4.py: using CellId 22518 17:18:23.903303 tst iperf3m4.py: using BVCI 22519 17:18:24.023586 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.035166 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.046272 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.057645 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.068803 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.079980 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.091472 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.102649 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:24.114143 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:24.234418 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:24.355005 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:24.476107 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:24.593876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:18:24.803173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:25.117563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26207): Launched 17:18:25.389507 run iperf3-srv_10.42.42.10(pid=26208): Launched 17:18:25.506255 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:18:25.714362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:26.028198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26209): Launched 17:18:26.301359 run iperf3-srv_10.42.42.10(pid=26210): Launched 17:18:26.417196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:18:26.623519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:26.936515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26211): Launched 17:18:27.209210 run iperf3-srv_10.42.42.10(pid=26212): Launched 17:18:27.325376 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:18:27.532632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:18:27.846802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26213): Launched 17:18:28.118718 run iperf3-srv_10.42.42.10(pid=26214): Launched 17:18:28.234823 tst iperf3m4.py:8: start network... 17:18:28.442845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:28.924016 run create_hlr_db(pid=26215): Launched 17:18:29.043381 bus /gobi_6: Setting Powered False 17:18:30.104400 run create_hlr_db(pid=26215): Terminated: ok {rc=0} 17:18:30.536647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26217): Launched 17:18:30.855704 run osmo-hlr_10.42.42.2(pid=26218): Launched 17:18:31.105077 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:31.931572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26220): Launched 17:18:32.281807 run osmo-stp_10.42.42.5(pid=26221): Launched 17:18:32.419126 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:32.995821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26223): Launched 17:18:33.123088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:33.404896 run patchelf(pid=26224): Launched 17:18:33.588626 run osmo-stp_10.42.42.5(pid=26221): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26221)] 17:18:33.728414 run osmo-stp_10.42.42.5(pid=26221): stdout: | (launched: 2022-12-09_17:18:32.218409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:33.869440 run osmo-stp_10.42.42.5(pid=26221): stderr: | 20221209171832439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171832440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171832440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171832440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171832441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171832441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171832441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:34.010273 run osmo-stp_10.42.42.5(pid=26221): stdout: | (launched: 2022-12-09_17:18:32.218409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:34.145488 run osmo-stp_10.42.42.5(pid=26221): stderr: | 20221209171832439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171832440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171832440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171832440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171832441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171832441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171832441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:34.305999 run patchelf(pid=26224): Terminating (SIGINT) 17:18:34.490922 run patchelf(pid=26224): Terminated: ok {rc=0} 17:18:34.623988 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26221): Process ended prematurely: osmo-stp_10.42.42.5(pid=26221) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26221)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:18:34.634326 tst iperf3m4.py:8: Test FAILED (11.2 sec) 17:18:34.663218 run osmo-hlr_10.42.42.2(pid=26218): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26218)] 17:18:34.713480 run osmo-hlr_10.42.42.2(pid=26218): stdout: | (launched: 2022-12-09_17:18:30.788738) 17:18:34.765697 run osmo-hlr_10.42.42.2(pid=26218): stderr: | 20221209171831094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171831094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171831094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171831094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171831094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171831094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171831114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171831132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171831133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171831134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:34.818090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26207): Terminating (SIGTERM) 17:18:34.860399 run iperf3-srv_10.42.42.10(pid=26208): Terminating (SIGTERM) 17:18:34.902549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26209): Terminating (SIGTERM) 17:18:34.944858 run iperf3-srv_10.42.42.10(pid=26210): Terminating (SIGTERM) 17:18:34.987177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26211): Terminating (SIGTERM) 17:18:35.029481 run iperf3-srv_10.42.42.10(pid=26212): Terminating (SIGTERM) 17:18:35.071584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26213): Terminating (SIGTERM) 17:18:35.113933 run iperf3-srv_10.42.42.10(pid=26214): Terminating (SIGTERM) 17:18:35.155767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26217): Terminating (SIGTERM) 17:18:35.198001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26220): Terminating (SIGTERM) 17:18:35.240034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26223): Terminating (SIGTERM) 17:18:35.282894 --- ParallelTerminationStrategy: PID 26207 died... 17:18:35.303082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26207): Terminated: ok {rc=0} 17:18:35.349988 --- ParallelTerminationStrategy: PID 26208 died... 17:18:35.369708 run iperf3-srv_10.42.42.10(pid=26208): Terminated {rc=256} 17:18:35.415840 --- ParallelTerminationStrategy: PID 26209 died... 17:18:35.435593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26209): Terminated: ok {rc=0} 17:18:35.482071 --- ParallelTerminationStrategy: PID 26210 died... 17:18:35.501794 run iperf3-srv_10.42.42.10(pid=26210): Terminated {rc=256} 17:18:35.548049 --- ParallelTerminationStrategy: PID 26211 died... 17:18:35.567878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26211): Terminated: ok {rc=0} 17:18:35.614265 --- ParallelTerminationStrategy: PID 26212 died... 17:18:35.634207 run iperf3-srv_10.42.42.10(pid=26212): Terminated {rc=256} 17:18:35.681032 --- ParallelTerminationStrategy: PID 26213 died... 17:18:35.700596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26213): Terminated: ok {rc=0} 17:18:35.747178 --- ParallelTerminationStrategy: PID 26214 died... 17:18:35.767032 run iperf3-srv_10.42.42.10(pid=26214): Terminated {rc=256} 17:18:35.813412 --- ParallelTerminationStrategy: PID 26217 died... 17:18:35.833593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26217): Terminated: ok {rc=0} 17:18:35.880170 --- ParallelTerminationStrategy: PID 26220 died... 17:18:35.900056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26220): Terminated: ok {rc=0} 17:18:35.946492 --- ParallelTerminationStrategy: PID 26223 died... 17:18:35.966293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26223): Terminated: ok {rc=0} 17:18:36.054050 bus /gobi_4: Setting Powered False 17:18:37.155145 bus /gobi_4: Setting Powered False 17:18:38.272699 bus /gobi_1: Setting Powered False 17:18:39.373235 bus /gobi_1: Setting Powered False 17:18:40.491481 bus /gobi_0: Setting Powered False 17:18:41.591210 bus /gobi_0: Setting Powered False 17:18:42.709818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:18:43.813308 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:43.824936 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:43.883000 tst ping.py: using LAC 22519 17:18:44.003157 tst ping.py: using RAC 79 17:18:44.122699 tst ping.py: using CellId 22519 17:18:44.243819 tst ping.py: using BVCI 22520 17:18:44.355799 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.366990 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.377748 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.388850 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.399941 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.410978 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.422460 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:44.433685 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:44.549585 tst ping.py:19: start network... 17:18:44.753837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:45.226465 run create_hlr_db(pid=26225): Launched 17:18:45.342277 bus /gobi_6: Setting Powered False 17:18:46.400566 run create_hlr_db(pid=26225): Terminated: ok {rc=0} 17:18:46.838811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26227): Launched 17:18:47.161209 run osmo-hlr_10.42.42.2(pid=26228): Launched 17:18:47.294570 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:47.869235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26230): Launched 17:18:48.196590 run osmo-stp_10.42.42.5(pid=26231): Launched 17:18:48.320304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:48.881690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26233): Launched 17:18:49.006348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:49.282975 run patchelf(pid=26234): Launched 17:18:49.463656 run osmo-stp_10.42.42.5(pid=26231): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26231)] 17:18:49.601183 run osmo-stp_10.42.42.5(pid=26231): stdout: | (launched: 2022-12-09_17:18:48.135401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:49.741268 run osmo-stp_10.42.42.5(pid=26231): stderr: | 20221209171848330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171848330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171848330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171848330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171848331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171848331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171848331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:49.881624 run osmo-stp_10.42.42.5(pid=26231): stdout: | (launched: 2022-12-09_17:18:48.135401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:50.014870 run osmo-stp_10.42.42.5(pid=26231): stderr: | 20221209171848330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171848330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171848330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171848330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171848331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171848331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171848331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:50.171982 run patchelf(pid=26234): Terminating (SIGINT) 17:18:50.353678 run patchelf(pid=26234): Terminated: ok {rc=0} 17:18:50.484725 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26231): Process ended prematurely: osmo-stp_10.42.42.5(pid=26231) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26231)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 17:18:50.494343 tst ping.py:22: Test FAILED (6.7 sec) 17:18:50.522684 run osmo-hlr_10.42.42.2(pid=26228): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26228)] 17:18:50.573261 run osmo-hlr_10.42.42.2(pid=26228): stdout: | (launched: 2022-12-09_17:18:47.100095) 17:18:50.625714 run osmo-hlr_10.42.42.2(pid=26228): stderr: | 20221209171847308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171847308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171847308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171847308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171847308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171847308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171847321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171847329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171847329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171847329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:50.678358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26227): Terminating (SIGTERM) 17:18:50.720811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26230): Terminating (SIGTERM) 17:18:50.763199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26233): Terminating (SIGTERM) 17:18:50.805842 --- ParallelTerminationStrategy: PID 26227 died... 17:18:50.825652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26227): Terminated: ok {rc=0} 17:18:50.872207 --- ParallelTerminationStrategy: PID 26230 died... 17:18:50.892009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26230): Terminated: ok {rc=0} 17:18:50.938480 --- ParallelTerminationStrategy: PID 26233 died... 17:18:50.958129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26233): Terminated: ok {rc=0} 17:18:51.046444 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:18:52.135438 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:52.147381 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:18:52.209439 tst ping_idle_ping.py: using LAC 22520 17:18:52.336396 tst ping_idle_ping.py: using RAC 80 17:18:52.463467 tst ping_idle_ping.py: using CellId 22520 17:18:52.588762 tst ping_idle_ping.py: using BVCI 22521 17:18:52.699237 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:52.710446 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:52.721445 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:52.732745 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:52.744088 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:52.755295 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:52.766773 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:18:52.778079 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:18:52.897615 tst ping_idle_ping.py:24: start network... 17:18:53.118563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:18:53.628927 run create_hlr_db(pid=26235): Launched 17:18:53.761981 bus /gobi_6: Setting Powered False 17:18:54.826892 run create_hlr_db(pid=26235): Terminated: ok {rc=0} 17:18:55.267543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26237): Launched 17:18:55.576358 run osmo-hlr_10.42.42.2(pid=26238): Launched 17:18:55.693779 run osmo-stp_10.42.42.5: Starting osmo-stp 17:18:56.235034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26240): Launched 17:18:56.542774 run osmo-stp_10.42.42.5(pid=26241): Launched 17:18:56.659262 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:18:57.186374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26243): Launched 17:18:57.303429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:18:57.563744 run patchelf(pid=26244): Launched 17:18:57.733807 run osmo-stp_10.42.42.5(pid=26241): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26241)] 17:18:57.864227 run osmo-stp_10.42.42.5(pid=26241): stdout: | (launched: 2022-12-09_17:18:56.484582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:57.996328 run osmo-stp_10.42.42.5(pid=26241): stderr: | 20221209171856656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171856657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171856657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171856657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171856659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171856660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171856660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:58.128256 run osmo-stp_10.42.42.5(pid=26241): stdout: | (launched: 2022-12-09_17:18:56.484582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:18:58.253454 run osmo-stp_10.42.42.5(pid=26241): stderr: | 20221209171856656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171856657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171856657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171856657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171856659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171856660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171856660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:18:58.402103 run patchelf(pid=26244): Terminating (SIGINT) 17:18:58.573209 run patchelf(pid=26244): Terminated: ok {rc=0} 17:18:58.697073 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26241): Process ended prematurely: osmo-stp_10.42.42.5(pid=26241) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26241)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:18:58.706385 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:18:58.734039 run osmo-hlr_10.42.42.2(pid=26238): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26238)] 17:18:58.783144 run osmo-hlr_10.42.42.2(pid=26238): stdout: | (launched: 2022-12-09_17:18:55.518018) 17:18:58.833604 run osmo-hlr_10.42.42.2(pid=26238): stderr: | 20221209171855695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171855695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171855695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171855695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171855695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171855695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171855712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171855722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171855722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171855722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:18:58.884322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26237): Terminating (SIGTERM) 17:18:58.925372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26240): Terminating (SIGTERM) 17:18:58.966324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26243): Terminating (SIGTERM) 17:18:59.007730 --- ParallelTerminationStrategy: PID 26237 died... 17:18:59.027017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26237): Terminated: ok {rc=0} 17:18:59.072161 --- ParallelTerminationStrategy: PID 26240 died... 17:18:59.090994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26240): Terminated: ok {rc=0} 17:18:59.136196 --- ParallelTerminationStrategy: PID 26243 died... 17:18:59.155012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26243): Terminated: ok {rc=0} 17:18:59.240159 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:19:00.536662 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:19:00.543432 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:19:00.565156 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:19:00.605236 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:19:00.692731 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:19:00.714234 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:19:00.753896 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:19:01.374238 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:19:01.446347 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:01.461254 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:01.529800 tst cs_paging_gprs_active.py: using LAC 22521 17:19:01.679361 tst cs_paging_gprs_active.py: using RAC 81 17:19:01.806195 tst cs_paging_gprs_active.py: using CellId 22521 17:19:01.966977 tst cs_paging_gprs_active.py: using BVCI 22522 17:19:02.120395 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.136024 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.151123 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.165896 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.180492 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.194359 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.206017 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.217977 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:02.230331 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:02.352837 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:02.473806 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:19:02.699284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:03.034670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26248): Launched 17:19:03.325715 run iperf3-srv_10.42.42.10(pid=26249): Launched 17:19:03.450274 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:19:03.675014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:04.011425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26250): Launched 17:19:04.302752 run iperf3-srv_10.42.42.10(pid=26251): Launched 17:19:04.427676 tst cs_paging_gprs_active.py:38: start network... 17:19:04.652269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:05.168090 run create_hlr_db(pid=26252): Launched 17:19:05.302687 bus /gobi_6: Setting Powered False 17:19:06.368562 run create_hlr_db(pid=26252): Terminated: ok {rc=0} 17:19:06.811646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26254): Launched 17:19:07.124644 run osmo-hlr_10.42.42.2(pid=26255): Launched 17:19:07.242787 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:07.792463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26257): Launched 17:19:08.104680 run osmo-stp_10.42.42.5(pid=26258): Launched 17:19:08.223296 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:08.773469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26260): Launched 17:19:08.892265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:09.155846 run patchelf(pid=26261): Launched 17:19:09.328417 run osmo-stp_10.42.42.5(pid=26258): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26258)] 17:19:09.460324 run osmo-stp_10.42.42.5(pid=26258): stdout: | (launched: 2022-12-09_17:19:08.045775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:09.593432 run osmo-stp_10.42.42.5(pid=26258): stderr: | 20221209171908217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171908217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171908218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171908218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171908220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171908220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171908220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:09.726852 run osmo-stp_10.42.42.5(pid=26258): stdout: | (launched: 2022-12-09_17:19:08.045775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:09.854174 run osmo-stp_10.42.42.5(pid=26258): stderr: | 20221209171908217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171908217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171908218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171908218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171908220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171908220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171908220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:10.005650 run patchelf(pid=26261): Terminating (SIGINT) 17:19:10.180615 run patchelf(pid=26261): Terminated: ok {rc=0} 17:19:10.307576 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26258): Process ended prematurely: osmo-stp_10.42.42.5(pid=26258) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26258)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:19:10.317375 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:19:10.345472 run osmo-hlr_10.42.42.2(pid=26255): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26255)] 17:19:10.394169 run osmo-hlr_10.42.42.2(pid=26255): stdout: | (launched: 2022-12-09_17:19:07.064886) 17:19:10.444676 run osmo-hlr_10.42.42.2(pid=26255): stderr: | 20221209171907245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171907245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171907245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171907245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171907245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171907245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171907258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171907266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171907266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171907266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:10.495707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26248): Terminating (SIGTERM) 17:19:10.536714 run iperf3-srv_10.42.42.10(pid=26249): Terminating (SIGTERM) 17:19:10.577918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26250): Terminating (SIGTERM) 17:19:10.618969 run iperf3-srv_10.42.42.10(pid=26251): Terminating (SIGTERM) 17:19:10.659928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26254): Terminating (SIGTERM) 17:19:10.700729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26257): Terminating (SIGTERM) 17:19:10.741602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26260): Terminating (SIGTERM) 17:19:10.782674 --- ParallelTerminationStrategy: PID 26248 died... 17:19:10.802105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26248): Terminated: ok {rc=0} 17:19:10.847682 --- ParallelTerminationStrategy: PID 26249 died... 17:19:10.866627 run iperf3-srv_10.42.42.10(pid=26249): Terminated {rc=256} 17:19:10.911496 --- ParallelTerminationStrategy: PID 26250 died... 17:19:10.930533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26250): Terminated: ok {rc=0} 17:19:10.975486 --- ParallelTerminationStrategy: PID 26251 died... 17:19:10.994466 run iperf3-srv_10.42.42.10(pid=26251): Terminated {rc=256} 17:19:11.039468 --- ParallelTerminationStrategy: PID 26254 died... 17:19:11.058523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26254): Terminated: ok {rc=0} 17:19:11.103456 --- ParallelTerminationStrategy: PID 26257 died... 17:19:11.122564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26257): Terminated: ok {rc=0} 17:19:11.167513 --- ParallelTerminationStrategy: PID 26260 died... 17:19:11.186466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26260): Terminated: ok {rc=0} 17:19:11.271092 bus /gobi_0: Setting Powered False 17:19:12.367191 bus /gobi_0: Setting Powered False 17:19:13.480903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:19:14.625673 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:14.637344 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:14.697343 tst iperf3.py: using LAC 22522 17:19:14.823230 tst iperf3.py: using RAC 82 17:19:14.944185 tst iperf3.py: using CellId 22522 17:19:15.064114 tst iperf3.py: using BVCI 22523 17:19:15.176559 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.187718 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.198626 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.209923 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.220938 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.232073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.243315 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.254391 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:15.265605 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:15.380933 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:19:15.590531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:15.929702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26262): Launched 17:19:16.238522 run iperf3-srv_10.42.42.10(pid=26263): Launched 17:19:16.381776 tst iperf3.py:8: start network... 17:19:16.614978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:17.147558 run create_hlr_db(pid=26264): Launched 17:19:17.274291 bus /gobi_6: Setting Powered False 17:19:18.336313 run create_hlr_db(pid=26264): Terminated: ok {rc=0} 17:19:18.792371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26266): Launched 17:19:19.126549 run osmo-hlr_10.42.42.2(pid=26267): Launched 17:19:19.253714 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:19.830410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26269): Launched 17:19:20.164001 run osmo-stp_10.42.42.5(pid=26270): Launched 17:19:20.289961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:20.864056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26272): Launched 17:19:20.990739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:21.272050 run patchelf(pid=26273): Launched 17:19:21.458924 run osmo-stp_10.42.42.5(pid=26270): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26270)] 17:19:21.599687 run osmo-stp_10.42.42.5(pid=26270): stdout: | (launched: 2022-12-09_17:19:20.101363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:21.741676 run osmo-stp_10.42.42.5(pid=26270): stderr: | 20221209171920296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171920297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171920297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171920297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171920298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171920298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171920298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:21.883823 run osmo-stp_10.42.42.5(pid=26270): stdout: | (launched: 2022-12-09_17:19:20.101363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:22.020017 run osmo-stp_10.42.42.5(pid=26270): stderr: | 20221209171920296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171920297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171920297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171920297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171920298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171920298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171920298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:22.180771 run patchelf(pid=26273): Terminating (SIGINT) 17:19:22.366718 run patchelf(pid=26273): Terminated: ok {rc=0} 17:19:22.500698 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26270): Process ended prematurely: osmo-stp_10.42.42.5(pid=26270) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26270)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 17:19:22.511195 tst iperf3.py:8: Test FAILED (7.9 sec) 17:19:22.539840 run osmo-hlr_10.42.42.2(pid=26267): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26267)] 17:19:22.590289 run osmo-hlr_10.42.42.2(pid=26267): stdout: | (launched: 2022-12-09_17:19:19.063649) 17:19:22.642627 run osmo-hlr_10.42.42.2(pid=26267): stderr: | 20221209171919265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171919265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171919265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171919265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171919265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171919265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171919278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171919287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171919287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171919287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:22.695537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26262): Terminating (SIGTERM) 17:19:22.738111 run iperf3-srv_10.42.42.10(pid=26263): Terminating (SIGTERM) 17:19:22.780408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26266): Terminating (SIGTERM) 17:19:22.823336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26269): Terminating (SIGTERM) 17:19:22.866001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26272): Terminating (SIGTERM) 17:19:22.908524 --- ParallelTerminationStrategy: PID 26262 died... 17:19:22.928750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26262): Terminated: ok {rc=0} 17:19:22.975998 --- ParallelTerminationStrategy: PID 26263 died... 17:19:22.995903 run iperf3-srv_10.42.42.10(pid=26263): Terminated {rc=256} 17:19:23.042627 --- ParallelTerminationStrategy: PID 26266 died... 17:19:23.062571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26266): Terminated: ok {rc=0} 17:19:23.109351 --- ParallelTerminationStrategy: PID 26269 died... 17:19:23.129418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26269): Terminated: ok {rc=0} 17:19:23.176226 --- ParallelTerminationStrategy: PID 26272 died... 17:19:23.196255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26272): Terminated: ok {rc=0} 17:19:23.285554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:19:24.432176 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:24.443974 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:24.501885 tst iperf3m4.py: using LAC 22523 17:19:24.625303 tst iperf3m4.py: using RAC 83 17:19:24.748025 tst iperf3m4.py: using CellId 22523 17:19:24.870636 tst iperf3m4.py: using BVCI 22524 17:19:24.983358 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:24.994365 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.005136 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.016200 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.027304 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.038685 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.050021 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.061162 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:25.072463 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:25.193944 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:25.315874 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:25.438504 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:25.557175 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:19:25.765549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:26.078591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26274): Launched 17:19:26.349494 run iperf3-srv_10.42.42.10(pid=26275): Launched 17:19:26.465150 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:19:26.671801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:26.983796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26276): Launched 17:19:27.254298 run iperf3-srv_10.42.42.10(pid=26277): Launched 17:19:27.369715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:19:27.575815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:27.886834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26278): Launched 17:19:28.159252 run iperf3-srv_10.42.42.10(pid=26279): Launched 17:19:28.275247 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:19:28.481961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:19:28.793982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26280): Launched 17:19:29.064566 run iperf3-srv_10.42.42.10(pid=26281): Launched 17:19:29.180333 tst iperf3m4.py:8: start network... 17:19:29.386190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:29.864577 run create_hlr_db(pid=26282): Launched 17:19:29.981573 bus /gobi_6: Setting Powered False 17:19:31.040762 run create_hlr_db(pid=26282): Terminated: ok {rc=0} 17:19:31.488279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26284): Launched 17:19:31.854369 run osmo-hlr_10.42.42.2(pid=26285): Launched 17:19:32.109668 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:32.679213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26287): Launched 17:19:32.991639 run osmo-stp_10.42.42.5(pid=26288): Launched 17:19:33.109811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:33.644388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26290): Launched 17:19:33.763297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:34.027254 run patchelf(pid=26291): Launched 17:19:34.200080 run osmo-stp_10.42.42.5(pid=26288): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26288)] 17:19:34.331477 run osmo-stp_10.42.42.5(pid=26288): stdout: | (launched: 2022-12-09_17:19:32.932256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:34.464256 run osmo-stp_10.42.42.5(pid=26288): stderr: | 20221209171933106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171933106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171933106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171933107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171933107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171933107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171933107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:34.597368 run osmo-stp_10.42.42.5(pid=26288): stdout: | (launched: 2022-12-09_17:19:32.932256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:34.724429 run osmo-stp_10.42.42.5(pid=26288): stderr: | 20221209171933106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171933106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171933106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171933107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171933107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171933107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171933107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:34.875014 run patchelf(pid=26291): Terminating (SIGINT) 17:19:35.048681 run patchelf(pid=26291): Terminated: ok {rc=0} 17:19:35.174920 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26288): Process ended prematurely: osmo-stp_10.42.42.5(pid=26288) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26288)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:19:35.184528 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:19:35.212868 run osmo-hlr_10.42.42.2(pid=26285): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26285)] 17:19:35.261670 run osmo-hlr_10.42.42.2(pid=26285): stdout: | (launched: 2022-12-09_17:19:31.789848) 17:19:35.312064 run osmo-hlr_10.42.42.2(pid=26285): stderr: | 20221209171932103 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171932103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171932103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171932103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171932104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171932104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171932123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171932143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171932143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171932143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:35.362970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26274): Terminating (SIGTERM) 17:19:35.403374 run iperf3-srv_10.42.42.10(pid=26275): Terminating (SIGTERM) 17:19:35.443788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26276): Terminating (SIGTERM) 17:19:35.483830 run iperf3-srv_10.42.42.10(pid=26277): Terminating (SIGTERM) 17:19:35.524611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26278): Terminating (SIGTERM) 17:19:35.564854 run iperf3-srv_10.42.42.10(pid=26279): Terminating (SIGTERM) 17:19:35.605058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26280): Terminating (SIGTERM) 17:19:35.645239 run iperf3-srv_10.42.42.10(pid=26281): Terminating (SIGTERM) 17:19:35.685852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26284): Terminating (SIGTERM) 17:19:35.726244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26287): Terminating (SIGTERM) 17:19:35.767113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26290): Terminating (SIGTERM) 17:19:35.807860 --- ParallelTerminationStrategy: PID 26274 died... 17:19:35.827218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26274): Terminated: ok {rc=0} 17:19:35.872528 --- ParallelTerminationStrategy: PID 26275 died... 17:19:35.891354 run iperf3-srv_10.42.42.10(pid=26275): Terminated {rc=256} 17:19:35.936184 --- ParallelTerminationStrategy: PID 26276 died... 17:19:35.955096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26276): Terminated: ok {rc=0} 17:19:36.000129 --- ParallelTerminationStrategy: PID 26277 died... 17:19:36.018918 run iperf3-srv_10.42.42.10(pid=26277): Terminated {rc=256} 17:19:36.063891 --- ParallelTerminationStrategy: PID 26278 died... 17:19:36.082695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26278): Terminated: ok {rc=0} 17:19:36.128189 --- ParallelTerminationStrategy: PID 26279 died... 17:19:36.147080 run iperf3-srv_10.42.42.10(pid=26279): Terminated {rc=256} 17:19:36.191652 --- ParallelTerminationStrategy: PID 26280 died... 17:19:36.210407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26280): Terminated: ok {rc=0} 17:19:36.255422 --- ParallelTerminationStrategy: PID 26281 died... 17:19:36.274366 run iperf3-srv_10.42.42.10(pid=26281): Terminated {rc=256} 17:19:36.319514 --- ParallelTerminationStrategy: PID 26284 died... 17:19:36.338593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26284): Terminated: ok {rc=0} 17:19:36.383850 --- ParallelTerminationStrategy: PID 26287 died... 17:19:36.402726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26287): Terminated: ok {rc=0} 17:19:36.447911 --- ParallelTerminationStrategy: PID 26290 died... 17:19:36.466871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26290): Terminated: ok {rc=0} 17:19:36.553691 bus /gobi_4: Setting Powered False 17:19:37.654289 bus /gobi_4: Setting Powered False 17:19:38.771030 bus /gobi_1: Setting Powered False 17:19:39.869747 bus /gobi_1: Setting Powered False 17:19:40.986183 bus /gobi_0: Setting Powered False 17:19:42.084689 bus /gobi_0: Setting Powered False 17:19:43.201613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:19:44.305160 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:44.316837 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:44.376264 tst ping.py: using LAC 22524 17:19:44.497364 tst ping.py: using RAC 84 17:19:44.617745 tst ping.py: using CellId 22524 17:19:44.738591 tst ping.py: using BVCI 22525 17:19:44.850154 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:44.861438 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:44.872064 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:44.883202 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:44.894384 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:44.905534 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:44.916564 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:44.927481 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:45.043315 tst ping.py:19: start network... 17:19:45.247717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:45.720641 run create_hlr_db(pid=26292): Launched 17:19:45.842094 bus /gobi_6: Setting Powered False 17:19:46.902788 run create_hlr_db(pid=26292): Terminated: ok {rc=0} 17:19:47.381675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26294): Launched 17:19:47.710751 run osmo-hlr_10.42.42.2(pid=26295): Launched 17:19:47.834667 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:48.401764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26297): Launched 17:19:48.728661 run osmo-stp_10.42.42.5(pid=26298): Launched 17:19:48.851754 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:49.418677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26300): Launched 17:19:49.542824 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:49.819003 run patchelf(pid=26301): Launched 17:19:49.999474 run osmo-stp_10.42.42.5(pid=26298): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26298)] 17:19:50.137826 run osmo-stp_10.42.42.5(pid=26298): stdout: | (launched: 2022-12-09_17:19:48.667342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:50.278325 run osmo-stp_10.42.42.5(pid=26298): stderr: | 20221209171948882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171948882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171948882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171948883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171948883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171948883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171948883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:50.419070 run osmo-stp_10.42.42.5(pid=26298): stdout: | (launched: 2022-12-09_17:19:48.667342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:50.552523 run osmo-stp_10.42.42.5(pid=26298): stderr: | 20221209171948882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171948882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171948882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171948883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171948883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171948883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171948883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:50.710529 run patchelf(pid=26301): Terminating (SIGINT) 17:19:50.892636 run patchelf(pid=26301): Terminated: ok {rc=0} 17:19:51.024306 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26298): Process ended prematurely: osmo-stp_10.42.42.5(pid=26298) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26298)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 17:19:51.034310 tst ping.py:22: Test FAILED (6.7 sec) 17:19:51.063071 run osmo-hlr_10.42.42.2(pid=26295): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26295)] 17:19:51.113975 run osmo-hlr_10.42.42.2(pid=26295): stdout: | (launched: 2022-12-09_17:19:47.649001) 17:19:51.166543 run osmo-hlr_10.42.42.2(pid=26295): stderr: | 20221209171947851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171947851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171947852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171947852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171947852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171947852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171947864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171947872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171947872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171947872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:51.219462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26294): Terminating (SIGTERM) 17:19:51.262243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26297): Terminating (SIGTERM) 17:19:51.305430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26300): Terminating (SIGTERM) 17:19:51.348437 --- ParallelTerminationStrategy: PID 26294 died... 17:19:51.368805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26294): Terminated: ok {rc=0} 17:19:51.416205 --- ParallelTerminationStrategy: PID 26297 died... 17:19:51.436238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26297): Terminated: ok {rc=0} 17:19:51.483514 --- ParallelTerminationStrategy: PID 26300 died... 17:19:51.503504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26300): Terminated: ok {rc=0} 17:19:51.592713 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:19:52.680711 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:52.693217 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:19:52.754179 tst ping_idle_ping.py: using LAC 22525 17:19:52.887378 tst ping_idle_ping.py: using RAC 85 17:19:53.014435 tst ping_idle_ping.py: using CellId 22525 17:19:53.140531 tst ping_idle_ping.py: using BVCI 22526 17:19:53.258778 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:53.270423 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:53.281721 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:53.293224 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:53.304860 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:53.316728 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:53.328669 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:19:53.340246 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:19:53.455556 tst ping_idle_ping.py:24: start network... 17:19:53.660681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:19:54.137456 run create_hlr_db(pid=26302): Launched 17:19:54.254928 bus /gobi_6: Setting Powered False 17:19:55.315819 run create_hlr_db(pid=26302): Terminated: ok {rc=0} 17:19:55.767065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26304): Launched 17:19:56.096158 run osmo-hlr_10.42.42.2(pid=26305): Launched 17:19:56.220858 run osmo-stp_10.42.42.5: Starting osmo-stp 17:19:56.790411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26307): Launched 17:19:57.117904 run osmo-stp_10.42.42.5(pid=26308): Launched 17:19:57.241825 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:19:57.808381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26310): Launched 17:19:57.932834 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:19:58.209764 run patchelf(pid=26311): Launched 17:19:58.392021 run osmo-stp_10.42.42.5(pid=26308): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26308)] 17:19:58.529980 run osmo-stp_10.42.42.5(pid=26308): stdout: | (launched: 2022-12-09_17:19:57.055787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:58.669731 run osmo-stp_10.42.42.5(pid=26308): stderr: | 20221209171957252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171957252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171957252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171957253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171957253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171957253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171957253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:58.810279 run osmo-stp_10.42.42.5(pid=26308): stdout: | (launched: 2022-12-09_17:19:57.055787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:19:58.943500 run osmo-stp_10.42.42.5(pid=26308): stderr: | 20221209171957252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209171957252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209171957252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209171957253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209171957253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209171957253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209171957253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:19:59.101979 run patchelf(pid=26311): Terminating (SIGINT) 17:19:59.284533 run patchelf(pid=26311): Terminated: ok {rc=0} 17:19:59.417233 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26308): Process ended prematurely: osmo-stp_10.42.42.5(pid=26308) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26308)] [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:19:59.427153 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:19:59.455548 run osmo-hlr_10.42.42.2(pid=26305): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26305)] 17:19:59.506331 run osmo-hlr_10.42.42.2(pid=26305): stdout: | (launched: 2022-12-09_17:19:56.034238) 17:19:59.559314 run osmo-hlr_10.42.42.2(pid=26305): stderr: | 20221209171956237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209171956237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209171956237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209171956237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209171956237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209171956237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209171956249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209171956258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209171956258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209171956258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:19:59.612767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26304): Terminating (SIGTERM) 17:19:59.655528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26307): Terminating (SIGTERM) 17:19:59.698305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26310): Terminating (SIGTERM) 17:19:59.741419 --- ParallelTerminationStrategy: PID 26304 died... 17:19:59.761708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26304): Terminated: ok {rc=0} 17:19:59.809351 --- ParallelTerminationStrategy: PID 26307 died... 17:19:59.829424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26307): Terminated: ok {rc=0} 17:19:59.876762 --- ParallelTerminationStrategy: PID 26310 died... 17:19:59.896896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26310): Terminated: ok {rc=0} 17:19:59.986785 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:20:01.317059 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:01.327278 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:20:01.356494 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:20:01.398714 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:20:01.462119 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:20:01.484857 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:20:01.523419 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:20:02.093458 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:20:02.100670 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:02.113247 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:20:02.175030 tst switch_tch_pdch.py: using LAC 22526 17:20:02.305268 tst switch_tch_pdch.py: using RAC 86 17:20:02.435022 tst switch_tch_pdch.py: using CellId 22526 17:20:02.563522 tst switch_tch_pdch.py: using BVCI 22527 17:20:02.683651 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:02.695592 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:02.707362 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:02.719212 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:02.730945 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:02.742765 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:02.754565 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:20:02.766277 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:20:02.887039 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:20:03.004347 tst switch_tch_pdch.py:51: start network... 17:20:03.209103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:03.681403 run create_hlr_db(pid=26318): Launched 17:20:03.797287 bus /gobi_6: Setting Powered False 17:20:04.858316 run create_hlr_db(pid=26318): Terminated: ok {rc=0} 17:20:05.305916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26320): Launched 17:20:05.635939 run osmo-hlr_10.42.42.2(pid=26321): Launched 17:20:05.760215 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:06.321115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26323): Launched 17:20:06.648635 run osmo-stp_10.42.42.5(pid=26325): Launched 17:20:06.772213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:20:07.333818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26327): Launched 17:20:07.457784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:20:07.733648 run patchelf(pid=26328): Launched 17:20:07.913638 run osmo-stp_10.42.42.5(pid=26325): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26325)] 17:20:08.052080 run osmo-stp_10.42.42.5(pid=26325): stdout: | (launched: 2022-12-09_17:20:06.587348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:08.191795 run osmo-stp_10.42.42.5(pid=26325): stderr: | 20221209172006781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172006781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172006782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172006782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172006784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172006784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172006784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:08.332119 run osmo-stp_10.42.42.5(pid=26325): stdout: | (launched: 2022-12-09_17:20:06.587348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:08.465334 run osmo-stp_10.42.42.5(pid=26325): stderr: | 20221209172006781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172006781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172006782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172006782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172006784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172006784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172006784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:08.622673 run patchelf(pid=26328): Terminating (SIGINT) 17:20:08.804791 run patchelf(pid=26328): Terminated: ok {rc=0} 17:20:08.936239 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26325): Process ended prematurely: osmo-stp_10.42.42.5(pid=26325) [trial-2362↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26325)] [trial-2362↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:20:08.945863 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 17:20:08.974116 run osmo-hlr_10.42.42.2(pid=26321): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26321)] 17:20:09.025148 run osmo-hlr_10.42.42.2(pid=26321): stdout: | (launched: 2022-12-09_17:20:05.574439) 17:20:09.077345 run osmo-hlr_10.42.42.2(pid=26321): stderr: | 20221209172005777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172005777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172005777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172005777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172005777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172005777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172005789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172005797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172005797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172005797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:09.129808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26320): Terminating (SIGTERM) 17:20:09.172100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26323): Terminating (SIGTERM) 17:20:09.214698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26327): Terminating (SIGTERM) 17:20:09.257410 --- ParallelTerminationStrategy: PID 26320 died... 17:20:09.277788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26320): Terminated: ok {rc=0} 17:20:09.325211 --- ParallelTerminationStrategy: PID 26323 died... 17:20:09.344834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26323): Terminated: ok {rc=0} 17:20:09.391795 --- ParallelTerminationStrategy: PID 26327 died... 17:20:09.411505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26327): Terminated: ok {rc=0} 17:20:09.500294 bus /gobi_0: Setting Powered False 17:20:10.599388 bus /gobi_0: Setting Powered False 17:20:11.715830 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:20:12.957382 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:12.963875 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:20:12.985741 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:20:13.021557 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:20:13.076193 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:20:13.097913 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:20:13.133407 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:20:13.689193 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:20:13.694735 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:13.706377 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:20:13.764884 tst switch_tch_pdch.py: using LAC 22527 17:20:13.893463 tst switch_tch_pdch.py: using RAC 87 17:20:14.020461 tst switch_tch_pdch.py: using CellId 22527 17:20:14.146990 tst switch_tch_pdch.py: using BVCI 22528 17:20:14.264810 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:14.276245 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:14.287473 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:14.298837 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:14.310180 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:14.321827 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:14.333433 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:20:14.344758 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:20:14.461664 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:20:14.581832 tst switch_tch_pdch.py:51: start network... 17:20:14.802277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:15.279295 run create_hlr_db(pid=26333): Launched 17:20:15.411411 bus /gobi_6: Setting Powered False 17:20:16.475590 run create_hlr_db(pid=26333): Terminated: ok {rc=0} 17:20:16.910991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26335): Launched 17:20:17.252217 run osmo-hlr_10.42.42.2(pid=26336): Launched 17:20:17.377063 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:17.908154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26338): Launched 17:20:18.236358 run osmo-stp_10.42.42.5(pid=26339): Launched 17:20:18.359919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:20:18.892808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26341): Launched 17:20:19.017027 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:20:19.292207 run patchelf(pid=26342): Launched 17:20:19.474748 run osmo-stp_10.42.42.5(pid=26339): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26339)] 17:20:19.611922 run osmo-stp_10.42.42.5(pid=26339): stdout: | (launched: 2022-12-09_17:20:18.175055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:19.751615 run osmo-stp_10.42.42.5(pid=26339): stderr: | 20221209172018369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172018369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172018369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172018370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172018370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172018370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172018370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:19.891604 run osmo-stp_10.42.42.5(pid=26339): stdout: | (launched: 2022-12-09_17:20:18.175055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:20.024560 run osmo-stp_10.42.42.5(pid=26339): stderr: | 20221209172018369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172018369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172018369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172018370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172018370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172018370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172018370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:20.182537 run patchelf(pid=26342): Terminating (SIGINT) 17:20:20.364569 run patchelf(pid=26342): Terminated: ok {rc=0} 17:20:20.496439 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26339): Process ended prematurely: osmo-stp_10.42.42.5(pid=26339) [trial-2362↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26339)] [trial-2362↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:20:20.506456 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 17:20:20.534614 run osmo-hlr_10.42.42.2(pid=26336): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26336)] 17:20:20.585605 run osmo-hlr_10.42.42.2(pid=26336): stdout: | (launched: 2022-12-09_17:20:17.190634) 17:20:20.638285 run osmo-hlr_10.42.42.2(pid=26336): stderr: | 20221209172017393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172017393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172017393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172017393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172017393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172017393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172017407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172017415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172017415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172017416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:20.691173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26335): Terminating (SIGTERM) 17:20:20.733842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26338): Terminating (SIGTERM) 17:20:20.776700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26341): Terminating (SIGTERM) 17:20:20.819812 --- ParallelTerminationStrategy: PID 26335 died... 17:20:20.840026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26335): Terminated: ok {rc=0} 17:20:20.887073 --- ParallelTerminationStrategy: PID 26338 died... 17:20:20.907079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26338): Terminated: ok {rc=0} 17:20:20.953927 --- ParallelTerminationStrategy: PID 26341 died... 17:20:20.973876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26341): Terminated: ok {rc=0} 17:20:21.062888 bus /gobi_0: Setting Powered False 17:20:22.163666 bus /gobi_0: Setting Powered False 17:20:23.283331 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_sms:oc2g --------------------------------------------------------------------- 17:20:24.525109 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:24.528868 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 17:20:24.549460 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 17:20:24.557889 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 17:20:24.611912 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 17:20:24.633306 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 17:20:24.640490 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 17:20:25.175965 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 17:20:25.181950 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 17:20:25.193120 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 17:20:25.229502 tst mo_mt_sms.py: using LAC 22528 17:20:25.358746 tst mo_mt_sms.py: using RAC 88 17:20:25.487494 tst mo_mt_sms.py: using CellId 22528 17:20:25.615945 tst mo_mt_sms.py: using BVCI 22529 17:20:25.733664 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 17:20:25.849924 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 17:20:25.969624 tst mo_mt_sms.py:9: start nitb and bts... 17:20:26.189292 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:26.854641 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26346): Launched 17:20:27.183420 run osmo-nitb_10.42.42.2(pid=26347): Launched 17:20:27.366283 run osmo-nitb_10.42.42.2(pid=26347): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26347)] 17:20:27.512580 run osmo-nitb_10.42.42.2(pid=26347): stdout: | (launched: 2022-12-09_17:20:27.122144) 17:20:27.660225 run osmo-nitb_10.42.42.2(pid=26347): stderr: | (launched: 2022-12-09_17:20:27.170365) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:27.807644 run osmo-nitb_10.42.42.2(pid=26347): stdout: | (launched: 2022-12-09_17:20:27.122144) 17:20:27.948843 run osmo-nitb_10.42.42.2(pid=26347): stderr: | (launched: 2022-12-09_17:20:27.170365) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26347): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26347) [trial-2362↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26347)] 17:20:28.309117 tst osmo-nitb_10.42.42.2(pid=26347): stdout: | (launched: 2022-12-09_17:20:27.122144) 17:20:28.440839 tst osmo-nitb_10.42.42.2(pid=26347): stderr: | (launched: 2022-12-09_17:20:27.170365) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:28.596799 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26347): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26347) [trial-2362↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26347)] [trial-2362↪nitb_sms:oc2g↪mo_mt_sms.py:11] 17:20:28.605952 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 17:20:28.612790 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26346): Terminating (SIGTERM) 17:20:28.825357 --- ParallelTerminationStrategy: PID 26346 died... 17:20:28.846636 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26346): Terminated: ok {rc=0} 17:20:28.936010 bus /sierra_3: Setting Powered False 17:20:30.037405 bus /sierra_3: Setting Powered False 17:20:31.158215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 sms:oc2g --------------------------------------------------------------------- 17:20:32.342778 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:32.347175 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 17:20:32.368362 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 17:20:32.395785 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 17:20:32.450420 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 17:20:32.472097 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 17:20:32.499519 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 17:20:33.044136 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 sms:oc2g mo_mt_sms.py ---------------------------------------------- 17:20:33.049337 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:33.060173 tst sms:oc2g: Using 1 x bts (candidates: 1) 17:20:33.095115 tst mo_mt_sms.py: using LAC 22529 17:20:33.221969 tst mo_mt_sms.py: using RAC 89 17:20:33.350711 tst mo_mt_sms.py: using CellId 22529 17:20:33.478768 tst mo_mt_sms.py: using BVCI 22530 17:20:33.596379 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:33.607389 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:33.619026 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:33.629888 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:33.640630 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:20:33.651392 tst sms:oc2g: Using 1 x modem (candidates: 2) 17:20:33.767675 tst sms:oc2g: Using 1 x modem (candidates: 2) 17:20:33.882871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:34.356917 run create_hlr_db(pid=26353): Launched 17:20:34.473420 bus /sierra_2: Setting Powered False 17:20:35.534145 run create_hlr_db(pid=26353): Terminated: ok {rc=0} 17:20:35.961162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26355): Launched 17:20:36.266283 run osmo-hlr_10.42.42.2(pid=26356): Launched 17:20:36.381158 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:36.920200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26358): Launched 17:20:37.227376 run osmo-stp_10.42.42.5(pid=26359): Launched 17:20:37.343082 run osmo-msc_10.42.42.6: Starting osmo-msc 17:20:37.894461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26361): Launched 17:20:38.200011 run osmo-msc_10.42.42.6(pid=26362): Launched 17:20:38.369985 run osmo-stp_10.42.42.5(pid=26359): ERR: Terminated: ERROR {rc=1} [trial-2362↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26359)] 17:20:38.499429 run osmo-stp_10.42.42.5(pid=26359): stdout: | (launched: 2022-12-09_17:20:37.169110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:38.629216 run osmo-stp_10.42.42.5(pid=26359): stderr: | 20221209172037342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172037342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172037342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172037343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172037345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172037345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172037345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:38.756088 run osmo-stp_10.42.42.5(pid=26359): stdout: | (launched: 2022-12-09_17:20:37.169110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:38.877612 run osmo-stp_10.42.42.5(pid=26359): stderr: | 20221209172037342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172037342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172037342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172037343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172037345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172037345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172037345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:39.022366 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26359): Process ended prematurely: osmo-stp_10.42.42.5(pid=26359) [trial-2362↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26359)] [trial-2362↪sms:oc2g↪mo_mt_sms.py:16] 17:20:39.030855 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 17:20:39.057454 run osmo-hlr_10.42.42.2(pid=26356): ERR: Terminated: ERROR {rc=237} [trial-2362↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26356)] 17:20:39.106436 run osmo-hlr_10.42.42.2(pid=26356): stdout: | (launched: 2022-12-09_17:20:36.208342) 17:20:39.157204 run osmo-hlr_10.42.42.2(pid=26356): stderr: | 20221209172036389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172036389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172036389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172036389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172036389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172036389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172036404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172036413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172036413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172036413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:39.227265 run osmo-msc_10.42.42.6(pid=26362): ERR: Terminated: ERROR {rc=2} [trial-2362↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26362)] 17:20:39.275679 run osmo-msc_10.42.42.6(pid=26362): stdout: | (launched: 2022-12-09_17:20:38.141940) 17:20:39.325832 run osmo-msc_10.42.42.6(pid=26362): stderr: | 20221209172038416 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172038416 DLGLOBAL DEBUG validating counter group 0x7f1902a3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172038416 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172038416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172038416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172038417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172038418 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172038419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172038419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172038419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:20:39.376365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26355): Terminating (SIGTERM) 17:20:39.416664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26358): Terminating (SIGTERM) 17:20:39.457618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26361): Terminating (SIGTERM) 17:20:39.498638 --- ParallelTerminationStrategy: PID 26355 died... 17:20:39.518045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26355): Terminated: ok {rc=0} 17:20:39.563137 --- ParallelTerminationStrategy: PID 26358 died... 17:20:39.582152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26358): Terminated: ok {rc=0} 17:20:39.627328 --- ParallelTerminationStrategy: PID 26361 died... 17:20:39.646146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26361): Terminated: ok {rc=0} 17:20:39.731860 bus /sierra_3: Setting Powered False 17:20:40.831241 bus /sierra_3: Setting Powered False 17:20:41.948073 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_ussd:oc2g --------------------------------------------------------------------- 17:20:43.166616 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:43.171264 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 17:20:43.192868 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 17:20:43.200565 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 17:20:43.239812 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 17:20:43.262071 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 17:20:43.269213 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 17:20:43.784024 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 17:20:43.789162 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 17:20:43.799820 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 17:20:43.835579 tst assert_extension.py: using LAC 22530 17:20:43.964236 tst assert_extension.py: using RAC 90 17:20:44.091457 tst assert_extension.py: using CellId 22530 17:20:44.218802 tst assert_extension.py: using BVCI 22531 17:20:44.338727 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 17:20:44.456069 tst assert_extension.py:10: start nitb and bts... 17:20:44.661558 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:20:45.284771 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26367): Launched 17:20:45.590462 run osmo-nitb_10.42.42.2(pid=26368): Launched 17:20:45.758959 run osmo-nitb_10.42.42.2(pid=26368): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26368)] 17:20:45.898870 run osmo-nitb_10.42.42.2(pid=26368): stdout: | (launched: 2022-12-09_17:20:45.532351) 17:20:46.039827 run osmo-nitb_10.42.42.2(pid=26368): stderr: | (launched: 2022-12-09_17:20:45.577266) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:46.181629 run osmo-nitb_10.42.42.2(pid=26368): stdout: | (launched: 2022-12-09_17:20:45.532351) 17:20:46.317658 run osmo-nitb_10.42.42.2(pid=26368): stderr: | (launched: 2022-12-09_17:20:45.577266) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26368): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26368) [trial-2362↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26368)] 17:20:46.705087 tst osmo-nitb_10.42.42.2(pid=26368): stdout: | (launched: 2022-12-09_17:20:45.532351) 17:20:46.873946 tst osmo-nitb_10.42.42.2(pid=26368): stderr: | (launched: 2022-12-09_17:20:45.577266) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:20:47.056781 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26368): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26368) [trial-2362↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26368)] [trial-2362↪nitb_ussd:oc2g↪assert_extension.py:12] 17:20:47.066141 tst assert_extension.py:12: Test FAILED (3.3 sec) 17:20:47.073571 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26367): Terminating (SIGTERM) 17:20:47.288217 --- ParallelTerminationStrategy: PID 26367 died... 17:20:47.307451 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26367): Terminated: ok {rc=0} 17:20:47.395768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 ussd:oc2g --------------------------------------------------------------------- 17:20:48.565576 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:48.569898 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 17:20:48.591183 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 17:20:48.619499 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 17:20:48.655257 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 17:20:48.675795 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 17:20:48.703011 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 17:20:49.233531 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 ussd:oc2g assert_extension.py ---------------------------------------------- 17:20:49.239100 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:49.251624 tst ussd:oc2g: Using 1 x bts (candidates: 1) 17:20:49.286452 tst assert_extension.py: using LAC 22531 17:20:49.403892 tst assert_extension.py: using RAC 91 17:20:49.521408 tst assert_extension.py: using CellId 22531 17:20:49.643515 tst assert_extension.py: using BVCI 22532 17:20:49.754157 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:49.764594 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:49.775211 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:49.785788 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:49.796459 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:20:49.807311 tst ussd:oc2g: Using 1 x modem (candidates: 1) 17:20:49.925229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:50.433469 run create_hlr_db(pid=26374): Launched 17:20:50.566139 bus /sierra_2: Setting Powered False 17:20:51.630721 run create_hlr_db(pid=26374): Terminated: ok {rc=0} 17:20:52.087477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26376): Launched 17:20:52.416420 run osmo-hlr_10.42.42.2(pid=26377): Launched 17:20:52.540480 run osmo-stp_10.42.42.5: Starting osmo-stp 17:20:53.109311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26379): Launched 17:20:53.438614 run osmo-stp_10.42.42.5(pid=26380): Launched 17:20:53.562516 run osmo-msc_10.42.42.6: Starting osmo-msc 17:20:54.154127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26382): Launched 17:20:54.482270 run osmo-msc_10.42.42.6(pid=26383): Launched 17:20:54.665502 run osmo-stp_10.42.42.5(pid=26380): ERR: Terminated: ERROR {rc=1} [trial-2362↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26380)] 17:20:54.802602 run osmo-stp_10.42.42.5(pid=26380): stdout: | (launched: 2022-12-09_17:20:53.376525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:54.939968 run osmo-stp_10.42.42.5(pid=26380): stderr: | 20221209172053572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172053572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172053572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172053572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172053575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172053575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172053575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:55.076072 run osmo-stp_10.42.42.5(pid=26380): stdout: | (launched: 2022-12-09_17:20:53.376525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:20:55.206051 run osmo-stp_10.42.42.5(pid=26380): stderr: | 20221209172053572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172053572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172053572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172053572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172053575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172053575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172053575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:20:55.361491 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26380): Process ended prematurely: osmo-stp_10.42.42.5(pid=26380) [trial-2362↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26380)] [trial-2362↪ussd:oc2g↪assert_extension.py:17] 17:20:55.370576 tst assert_extension.py:17: Test FAILED (6.1 sec) 17:20:55.398421 run osmo-hlr_10.42.42.2(pid=26377): ERR: Terminated: ERROR {rc=237} [trial-2362↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26377)] 17:20:55.448763 run osmo-hlr_10.42.42.2(pid=26377): stdout: | (launched: 2022-12-09_17:20:52.354626) 17:20:55.500817 run osmo-hlr_10.42.42.2(pid=26377): stderr: | 20221209172052555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172052555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172052556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172052556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172052556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172052556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172052568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172052577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172052577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172052577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:20:55.573408 run osmo-msc_10.42.42.6(pid=26383): ERR: Terminated: ERROR {rc=2} [trial-2362↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26383)] 17:20:55.623782 run osmo-msc_10.42.42.6(pid=26383): stdout: | (launched: 2022-12-09_17:20:54.420586) 17:20:55.675756 run osmo-msc_10.42.42.6(pid=26383): stderr: | 20221209172054746 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172054746 DLGLOBAL DEBUG validating counter group 0x7f4ddea1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172054746 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172054747 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172054747 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172054747 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172054749 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172054749 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172054749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172054749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:20:55.728172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26376): Terminating (SIGTERM) 17:20:55.770208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26379): Terminating (SIGTERM) 17:20:55.812127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26382): Terminating (SIGTERM) 17:20:55.854569 --- ParallelTerminationStrategy: PID 26376 died... 17:20:55.874762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26376): Terminated: ok {rc=0} 17:20:55.921226 --- ParallelTerminationStrategy: PID 26379 died... 17:20:55.940637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26379): Terminated: ok {rc=0} 17:20:55.987012 --- ParallelTerminationStrategy: PID 26382 died... 17:20:56.006594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26382): Terminated: ok {rc=0} 17:20:56.094915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:20:57.294729 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:20:57.301983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:20:57.324092 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:20:57.352248 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:20:57.406875 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:20:57.427928 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:20:57.455536 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:20:58.006297 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:20:58.060934 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:58.072457 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:20:58.130966 tst mo_mt_call.py: using LAC 22532 17:20:58.262425 tst mo_mt_call.py: using RAC 92 17:20:58.395465 tst mo_mt_call.py: using CellId 22532 17:20:58.526495 tst mo_mt_call.py: using BVCI 22533 17:20:58.648424 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:58.659991 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:58.671202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:58.682918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:58.694778 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:20:58.706828 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:20:58.824933 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:20:58.946857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:20:59.464297 run create_hlr_db(pid=26388): Launched 17:20:59.598891 bus /sierra_2: Setting Powered False 17:21:00.664043 run create_hlr_db(pid=26388): Terminated: ok {rc=0} 17:21:01.145676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26390): Launched 17:21:01.494484 run osmo-hlr_10.42.42.2(pid=26391): Launched 17:21:01.688869 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:02.430620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26393): Launched 17:21:02.765166 run osmo-stp_10.42.42.5(pid=26394): Launched 17:21:02.891361 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:03.494256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26396): Launched 17:21:03.828154 run osmo-msc_10.42.42.6(pid=26397): Launched 17:21:04.012313 run osmo-stp_10.42.42.5(pid=26394): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26394)] 17:21:04.151365 run osmo-stp_10.42.42.5(pid=26394): stdout: | (launched: 2022-12-09_17:21:02.702641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:04.291638 run osmo-stp_10.42.42.5(pid=26394): stderr: | 20221209172102897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172102897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172102897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172102898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172102898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172102898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172102898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:04.431448 run osmo-stp_10.42.42.5(pid=26394): stdout: | (launched: 2022-12-09_17:21:02.702641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:04.563160 run osmo-stp_10.42.42.5(pid=26394): stderr: | 20221209172102897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172102897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172102897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172102898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172102898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172102898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172102898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:04.721069 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26394): Process ended prematurely: osmo-stp_10.42.42.5(pid=26394) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26394)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:21:04.731216 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:21:04.759519 run osmo-hlr_10.42.42.2(pid=26391): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26391)] 17:21:04.810846 run osmo-hlr_10.42.42.2(pid=26391): stdout: | (launched: 2022-12-09_17:21:01.430398) 17:21:04.863859 run osmo-hlr_10.42.42.2(pid=26391): stderr: | 20221209172101781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172101781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172101781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172101781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172101781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172101781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172101807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172101831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172101832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172101832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:04.937340 run osmo-msc_10.42.42.6(pid=26397): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26397)] 17:21:04.987911 run osmo-msc_10.42.42.6(pid=26397): stdout: | (launched: 2022-12-09_17:21:03.765580) 17:21:05.040351 run osmo-msc_10.42.42.6(pid=26397): stderr: | 20221209172104090 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172104090 DLGLOBAL DEBUG validating counter group 0x7fb457a17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172104090 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172104091 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172104091 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172104091 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172104093 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172104093 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172104093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172104093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:05.093422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26390): Terminating (SIGTERM) 17:21:05.135805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26393): Terminating (SIGTERM) 17:21:05.178433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26396): Terminating (SIGTERM) 17:21:05.221215 --- ParallelTerminationStrategy: PID 26390 died... 17:21:05.241755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26390): Terminated: ok {rc=0} 17:21:05.288915 --- ParallelTerminationStrategy: PID 26393 died... 17:21:05.308675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26393): Terminated: ok {rc=0} 17:21:05.356107 --- ParallelTerminationStrategy: PID 26396 died... 17:21:05.376074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26396): Terminated: ok {rc=0} 17:21:05.464715 bus /sierra_3: Setting Powered False 17:21:06.563651 bus /sierra_3: Setting Powered False 17:21:07.680521 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:21:08.829661 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:08.841791 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:21:08.899416 tst mo_mt_call_osmux.py: using LAC 22533 17:21:09.021551 tst mo_mt_call_osmux.py: using RAC 93 17:21:09.143130 tst mo_mt_call_osmux.py: using CellId 22533 17:21:09.264840 tst mo_mt_call_osmux.py: using BVCI 22534 17:21:09.379944 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:09.391176 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:09.402233 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:09.413543 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:09.427653 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:21:09.439463 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:21:09.560403 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:21:09.677931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:10.160748 run create_hlr_db(pid=26399): Launched 17:21:10.278582 bus /sierra_2: Setting Powered False 17:21:11.340279 run create_hlr_db(pid=26399): Terminated: ok {rc=0} 17:21:11.774760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26401): Launched 17:21:12.086742 run osmo-hlr_10.42.42.2(pid=26402): Launched 17:21:12.204170 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:12.751970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26404): Launched 17:21:13.065392 run osmo-stp_10.42.42.5(pid=26405): Launched 17:21:13.183910 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:13.756050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26407): Launched 17:21:14.090821 run osmo-msc_10.42.42.6(pid=26408): Launched 17:21:14.274931 run osmo-stp_10.42.42.5(pid=26405): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26405)] 17:21:14.415589 run osmo-stp_10.42.42.5(pid=26405): stdout: | (launched: 2022-12-09_17:21:13.006504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:14.556662 run osmo-stp_10.42.42.5(pid=26405): stderr: | 20221209172113182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172113182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172113183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172113183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172113183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172113183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172113184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:14.695947 run osmo-stp_10.42.42.5(pid=26405): stdout: | (launched: 2022-12-09_17:21:13.006504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:14.827537 run osmo-stp_10.42.42.5(pid=26405): stderr: | 20221209172113182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172113182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172113183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172113183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172113183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172113183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172113184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:14.986158 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26405): Process ended prematurely: osmo-stp_10.42.42.5(pid=26405) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26405)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:21:14.995721 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:21:15.023823 run osmo-hlr_10.42.42.2(pid=26402): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26402)] 17:21:15.074505 run osmo-hlr_10.42.42.2(pid=26402): stdout: | (launched: 2022-12-09_17:21:12.027976) 17:21:15.127040 run osmo-hlr_10.42.42.2(pid=26402): stderr: | 20221209172112207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172112207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172112207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172112208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172112208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172112208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172112220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172112228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172112228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172112228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:15.200009 run osmo-msc_10.42.42.6(pid=26408): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26408)] 17:21:15.250749 run osmo-msc_10.42.42.6(pid=26408): stdout: | (launched: 2022-12-09_17:21:14.028034) 17:21:15.303022 run osmo-msc_10.42.42.6(pid=26408): stderr: | 20221209172114356 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172114356 DLGLOBAL DEBUG validating counter group 0x7fd0a6f87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172114356 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172114356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172114356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172114356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172114358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172114358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172114359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172114359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:15.356198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26401): Terminating (SIGTERM) 17:21:15.398346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26404): Terminating (SIGTERM) 17:21:15.440143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26407): Terminating (SIGTERM) 17:21:15.482259 --- ParallelTerminationStrategy: PID 26401 died... 17:21:15.502525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26401): Terminated: ok {rc=0} 17:21:15.549337 --- ParallelTerminationStrategy: PID 26404 died... 17:21:15.569315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26404): Terminated: ok {rc=0} 17:21:15.616314 --- ParallelTerminationStrategy: PID 26407 died... 17:21:15.636021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26407): Terminated: ok {rc=0} 17:21:15.725251 bus /sierra_3: Setting Powered False 17:21:16.831377 bus /sierra_3: Setting Powered False 17:21:17.959364 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:21:19.198512 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:21:19.205934 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:21:19.227154 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:21:19.254474 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:21:19.307644 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:21:19.328722 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:21:19.356228 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:21:19.904317 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:21:19.955160 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:19.966553 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:21:20.022587 tst mo_mt_call.py: using LAC 22534 17:21:20.146321 tst mo_mt_call.py: using RAC 94 17:21:20.267690 tst mo_mt_call.py: using CellId 22534 17:21:20.391101 tst mo_mt_call.py: using BVCI 22535 17:21:20.505503 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:20.516583 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:20.527595 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:20.538954 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:20.550228 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:20.561610 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:20.681785 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:20.797845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:21.281139 run create_hlr_db(pid=26413): Launched 17:21:21.399344 bus /sierra_2: Setting Powered False 17:21:22.460440 run create_hlr_db(pid=26413): Terminated: ok {rc=0} 17:21:22.916566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26415): Launched 17:21:23.251090 run osmo-hlr_10.42.42.2(pid=26416): Launched 17:21:23.377844 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:23.953389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26418): Launched 17:21:24.286996 run osmo-stp_10.42.42.5(pid=26419): Launched 17:21:24.412560 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:25.013655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26421): Launched 17:21:25.347436 run osmo-msc_10.42.42.6(pid=26422): Launched 17:21:25.532609 run osmo-stp_10.42.42.5(pid=26419): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26419)] 17:21:25.672089 run osmo-stp_10.42.42.5(pid=26419): stdout: | (launched: 2022-12-09_17:21:24.224119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:25.812388 run osmo-stp_10.42.42.5(pid=26419): stderr: | 20221209172124421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172124421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172124421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172124422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172124424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172124424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172124424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:25.951718 run osmo-stp_10.42.42.5(pid=26419): stdout: | (launched: 2022-12-09_17:21:24.224119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:26.083366 run osmo-stp_10.42.42.5(pid=26419): stderr: | 20221209172124421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172124421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172124421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172124422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172124424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172124424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172124424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:26.241122 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26419): Process ended prematurely: osmo-stp_10.42.42.5(pid=26419) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26419)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:21:26.250670 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:21:26.278628 run osmo-hlr_10.42.42.2(pid=26416): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26416)] 17:21:26.328861 run osmo-hlr_10.42.42.2(pid=26416): stdout: | (launched: 2022-12-09_17:21:23.188515) 17:21:26.381299 run osmo-hlr_10.42.42.2(pid=26416): stderr: | 20221209172123392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172123392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172123392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172123392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172123392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172123392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172123404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172123414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172123414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172123414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:26.453818 run osmo-msc_10.42.42.6(pid=26422): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26422)] 17:21:26.503942 run osmo-msc_10.42.42.6(pid=26422): stdout: | (launched: 2022-12-09_17:21:25.284501) 17:21:26.555748 run osmo-msc_10.42.42.6(pid=26422): stderr: | 20221209172125609 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172125609 DLGLOBAL DEBUG validating counter group 0x7f47165fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172125609 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172125610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172125610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172125610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172125612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172125612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172125612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172125612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:26.607960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26415): Terminating (SIGTERM) 17:21:26.649723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26418): Terminating (SIGTERM) 17:21:26.691545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26421): Terminating (SIGTERM) 17:21:26.733580 --- ParallelTerminationStrategy: PID 26415 died... 17:21:26.753647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26415): Terminated: ok {rc=0} 17:21:26.799805 --- ParallelTerminationStrategy: PID 26418 died... 17:21:26.819410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26418): Terminated: ok {rc=0} 17:21:26.865470 --- ParallelTerminationStrategy: PID 26421 died... 17:21:26.885009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26421): Terminated: ok {rc=0} 17:21:26.973501 bus /sierra_3: Setting Powered False 17:21:28.074504 bus /sierra_3: Setting Powered False 17:21:29.192654 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:21:30.339629 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:30.351691 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:21:30.414719 tst mo_mt_call_osmux.py: using LAC 22535 17:21:30.536686 tst mo_mt_call_osmux.py: using RAC 95 17:21:30.656693 tst mo_mt_call_osmux.py: using CellId 22535 17:21:30.776746 tst mo_mt_call_osmux.py: using BVCI 22536 17:21:30.904693 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:30.917140 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:30.929099 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:30.941963 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:30.955951 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:21:30.969194 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:31.092248 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:21:31.228113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:31.788630 run create_hlr_db(pid=26424): Launched 17:21:31.946518 bus /sierra_2: Setting Powered False 17:21:33.012406 run create_hlr_db(pid=26424): Terminated: ok {rc=0} 17:21:33.458789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26426): Launched 17:21:33.771541 run osmo-hlr_10.42.42.2(pid=26427): Launched 17:21:33.889263 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:34.439850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26429): Launched 17:21:34.753998 run osmo-stp_10.42.42.5(pid=26430): Launched 17:21:34.871770 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:35.435718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26432): Launched 17:21:35.749368 run osmo-msc_10.42.42.6(pid=26433): Launched 17:21:35.922528 run osmo-stp_10.42.42.5(pid=26430): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26430)] 17:21:36.055047 run osmo-stp_10.42.42.5(pid=26430): stdout: | (launched: 2022-12-09_17:21:34.694537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:36.186938 run osmo-stp_10.42.42.5(pid=26430): stderr: | 20221209172134868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172134868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172134868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172134869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172134869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172134869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172134869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:36.316785 run osmo-stp_10.42.42.5(pid=26430): stdout: | (launched: 2022-12-09_17:21:34.694537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:36.440560 run osmo-stp_10.42.42.5(pid=26430): stderr: | 20221209172134868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172134868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172134868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172134869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172134869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172134869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172134869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:36.588361 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26430): Process ended prematurely: osmo-stp_10.42.42.5(pid=26430) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26430)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:21:36.597634 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:21:36.625410 run osmo-hlr_10.42.42.2(pid=26427): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26427)] 17:21:36.674598 run osmo-hlr_10.42.42.2(pid=26427): stdout: | (launched: 2022-12-09_17:21:33.712748) 17:21:36.725377 run osmo-hlr_10.42.42.2(pid=26427): stderr: | 20221209172133891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172133891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172133891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172133891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172133892 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172133892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172133904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172133913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172133913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172133913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:36.795879 run osmo-msc_10.42.42.6(pid=26433): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26433)] 17:21:36.844825 run osmo-msc_10.42.42.6(pid=26433): stdout: | (launched: 2022-12-09_17:21:35.690089) 17:21:36.895442 run osmo-msc_10.42.42.6(pid=26433): stderr: | 20221209172135966 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172135966 DLGLOBAL DEBUG validating counter group 0x7fc8e867dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172135966 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172135966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172135966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172135966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172135968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172135969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172135969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172135969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:36.946216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26426): Terminating (SIGTERM) 17:21:36.987111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26429): Terminating (SIGTERM) 17:21:37.027963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26432): Terminating (SIGTERM) 17:21:37.069382 --- ParallelTerminationStrategy: PID 26426 died... 17:21:37.088685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26426): Terminated: ok {rc=0} 17:21:37.134476 --- ParallelTerminationStrategy: PID 26429 died... 17:21:37.153502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26429): Terminated: ok {rc=0} 17:21:37.199122 --- ParallelTerminationStrategy: PID 26432 died... 17:21:37.218193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26432): Terminated: ok {rc=0} 17:21:37.307010 bus /sierra_3: Setting Powered False 17:21:38.407836 bus /sierra_3: Setting Powered False 17:21:39.525840 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:21:40.767376 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:21:40.774266 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:21:40.795751 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:21:40.823201 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:21:40.876228 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:21:40.897383 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:21:40.924810 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:21:41.476050 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:21:41.529190 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:41.540646 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:21:41.598292 tst mo_mt_call.py: using LAC 22536 17:21:41.727798 tst mo_mt_call.py: using RAC 96 17:21:41.850857 tst mo_mt_call.py: using CellId 22536 17:21:41.979541 tst mo_mt_call.py: using BVCI 22537 17:21:42.093468 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.104624 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.115649 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.127398 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.139302 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:42.151317 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:42.271707 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:42.388269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:42.870299 run create_hlr_db(pid=26438): Launched 17:21:42.988461 bus /sierra_2: Setting Powered False 17:21:44.050304 run create_hlr_db(pid=26438): Terminated: ok {rc=0} 17:21:44.507209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26440): Launched 17:21:44.841821 run osmo-hlr_10.42.42.2(pid=26441): Launched 17:21:44.968065 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:45.545636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26443): Launched 17:21:45.891838 run osmo-stp_10.42.42.5(pid=26444): Launched 17:21:46.248027 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:46.836543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26446): Launched 17:21:47.167138 run osmo-msc_10.42.42.6(pid=26447): Launched 17:21:47.393219 run osmo-stp_10.42.42.5(pid=26444): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26444)] 17:21:47.534234 run osmo-stp_10.42.42.5(pid=26444): stdout: | (launched: 2022-12-09_17:21:45.816371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:47.677263 run osmo-stp_10.42.42.5(pid=26444): stderr: | 20221209172146084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172146084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172146085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172146085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172146085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172146086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172146086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:47.816704 run osmo-stp_10.42.42.5(pid=26444): stdout: | (launched: 2022-12-09_17:21:45.816371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:47.949276 run osmo-stp_10.42.42.5(pid=26444): stderr: | 20221209172146084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172146084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172146085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172146085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172146085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172146086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172146086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:48.108319 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26444): Process ended prematurely: osmo-stp_10.42.42.5(pid=26444) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26444)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:21:48.118247 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 17:21:48.146779 run osmo-hlr_10.42.42.2(pid=26441): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26441)] 17:21:48.198257 run osmo-hlr_10.42.42.2(pid=26441): stdout: | (launched: 2022-12-09_17:21:44.779220) 17:21:48.251303 run osmo-hlr_10.42.42.2(pid=26441): stderr: | 20221209172144982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172144982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172144982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172144982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172144982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172144982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172144995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172145005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172145005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172145005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:48.325402 run osmo-msc_10.42.42.6(pid=26447): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26447)] 17:21:48.376722 run osmo-msc_10.42.42.6(pid=26447): stdout: | (launched: 2022-12-09_17:21:47.103651) 17:21:48.429370 run osmo-msc_10.42.42.6(pid=26447): stderr: | 20221209172147473 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172147474 DLGLOBAL DEBUG validating counter group 0x7fbdbc02dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172147474 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172147474 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172147474 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172147474 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172147476 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172147476 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172147476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172147476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:48.482643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26440): Terminating (SIGTERM) 17:21:48.525324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26443): Terminating (SIGTERM) 17:21:48.568102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26446): Terminating (SIGTERM) 17:21:48.611145 --- ParallelTerminationStrategy: PID 26440 died... 17:21:48.631577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26440): Terminated: ok {rc=0} 17:21:48.679427 --- ParallelTerminationStrategy: PID 26443 died... 17:21:48.699526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26443): Terminated: ok {rc=0} 17:21:48.746690 --- ParallelTerminationStrategy: PID 26446 died... 17:21:48.766732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26446): Terminated: ok {rc=0} 17:21:48.855750 bus /sierra_3: Setting Powered False 17:21:49.956040 bus /sierra_3: Setting Powered False 17:21:51.076165 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:21:52.230449 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.242866 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:21:52.302779 tst mo_mt_call_osmux.py: using LAC 22537 17:21:52.434485 tst mo_mt_call_osmux.py: using RAC 97 17:21:52.564760 tst mo_mt_call_osmux.py: using CellId 22537 17:21:52.694213 tst mo_mt_call_osmux.py: using BVCI 22538 17:21:52.815981 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.827566 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.838882 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.850190 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.861504 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:21:52.872812 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:52.994137 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:21:53.112558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:21:53.595611 run create_hlr_db(pid=26449): Launched 17:21:53.714800 bus /sierra_2: Setting Powered False 17:21:54.776513 run create_hlr_db(pid=26449): Terminated: ok {rc=0} 17:21:55.211466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26451): Launched 17:21:55.525814 run osmo-hlr_10.42.42.2(pid=26452): Launched 17:21:55.643767 run osmo-stp_10.42.42.5: Starting osmo-stp 17:21:56.194389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26454): Launched 17:21:56.507364 run osmo-stp_10.42.42.5(pid=26455): Launched 17:21:56.625487 run osmo-msc_10.42.42.6: Starting osmo-msc 17:21:57.187263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26457): Launched 17:21:57.501305 run osmo-msc_10.42.42.6(pid=26458): Launched 17:21:57.674969 run osmo-stp_10.42.42.5(pid=26455): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26455)] 17:21:57.806605 run osmo-stp_10.42.42.5(pid=26455): stdout: | (launched: 2022-12-09_17:21:56.447873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:57.938463 run osmo-stp_10.42.42.5(pid=26455): stderr: | 20221209172156622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172156623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172156623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172156623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172156624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172156624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172156624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:58.067694 run osmo-stp_10.42.42.5(pid=26455): stdout: | (launched: 2022-12-09_17:21:56.447873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:21:58.190750 run osmo-stp_10.42.42.5(pid=26455): stderr: | 20221209172156622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172156623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172156623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172156623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172156624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172156624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172156624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:21:58.338775 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26455): Process ended prematurely: osmo-stp_10.42.42.5(pid=26455) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26455)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:21:58.347719 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:21:58.375173 run osmo-hlr_10.42.42.2(pid=26452): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26452)] 17:21:58.424096 run osmo-hlr_10.42.42.2(pid=26452): stdout: | (launched: 2022-12-09_17:21:55.464582) 17:21:58.474700 run osmo-hlr_10.42.42.2(pid=26452): stderr: | 20221209172155648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172155648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172155648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172155648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172155648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172155648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172155659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172155668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172155668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172155668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:21:58.544896 run osmo-msc_10.42.42.6(pid=26458): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26458)] 17:21:58.593827 run osmo-msc_10.42.42.6(pid=26458): stdout: | (launched: 2022-12-09_17:21:57.441742) 17:21:58.644270 run osmo-msc_10.42.42.6(pid=26458): stderr: | 20221209172157717 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172157717 DLGLOBAL DEBUG validating counter group 0x7f5be4d9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172157717 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172157717 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172157717 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172157717 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172157719 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172157720 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172157720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172157720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:21:58.695329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26451): Terminating (SIGTERM) 17:21:58.735835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26454): Terminating (SIGTERM) 17:21:58.776399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26457): Terminating (SIGTERM) 17:21:58.817373 --- ParallelTerminationStrategy: PID 26451 died... 17:21:58.836653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26451): Terminated: ok {rc=0} 17:21:58.882180 --- ParallelTerminationStrategy: PID 26454 died... 17:21:58.900873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26454): Terminated: ok {rc=0} 17:21:58.946304 --- ParallelTerminationStrategy: PID 26457 died... 17:21:58.965247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26457): Terminated: ok {rc=0} 17:21:59.052199 bus /sierra_3: Setting Powered False 17:22:00.151712 bus /sierra_3: Setting Powered False 17:22:01.271506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:22:02.514224 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:22:02.521897 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:22:02.543498 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:22:02.571845 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:22:02.625352 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:22:02.646512 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:22:02.674012 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:22:03.225749 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:22:03.279183 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.291039 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:22:03.348668 tst mo_mt_call.py: using LAC 22538 17:22:03.481179 tst mo_mt_call.py: using RAC 98 17:22:03.611394 tst mo_mt_call.py: using CellId 22538 17:22:03.743418 tst mo_mt_call.py: using BVCI 22539 17:22:03.865424 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.876925 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.888231 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.899711 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.911197 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:03.922702 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:04.040132 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:04.158679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:04.642177 run create_hlr_db(pid=26463): Launched 17:22:04.763315 bus /sierra_2: Setting Powered False 17:22:05.825258 run create_hlr_db(pid=26463): Terminated: ok {rc=0} 17:22:06.260343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26465): Launched 17:22:06.572487 run osmo-hlr_10.42.42.2(pid=26466): Launched 17:22:06.691193 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:07.241139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26468): Launched 17:22:07.552633 run osmo-stp_10.42.42.5(pid=26469): Launched 17:22:07.671068 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:08.233182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26471): Launched 17:22:08.545690 run osmo-msc_10.42.42.6(pid=26472): Launched 17:22:08.718896 run osmo-stp_10.42.42.5(pid=26469): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26469)] 17:22:08.849994 run osmo-stp_10.42.42.5(pid=26469): stdout: | (launched: 2022-12-09_17:22:07.494063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:08.981548 run osmo-stp_10.42.42.5(pid=26469): stderr: | 20221209172207667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172207667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172207668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172207668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172207669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172207669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172207669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:09.110671 run osmo-stp_10.42.42.5(pid=26469): stdout: | (launched: 2022-12-09_17:22:07.494063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:09.233504 run osmo-stp_10.42.42.5(pid=26469): stderr: | 20221209172207667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172207667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172207668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172207668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172207669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172207669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172207669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:09.380878 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26469): Process ended prematurely: osmo-stp_10.42.42.5(pid=26469) [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26469)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:22:09.389928 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:22:09.417052 run osmo-hlr_10.42.42.2(pid=26466): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26466)] 17:22:09.465692 run osmo-hlr_10.42.42.2(pid=26466): stdout: | (launched: 2022-12-09_17:22:06.513643) 17:22:09.515907 run osmo-hlr_10.42.42.2(pid=26466): stderr: | 20221209172206695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172206695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172206695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172206695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172206695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172206695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172206707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172206715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172206716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172206716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:09.585780 run osmo-msc_10.42.42.6(pid=26472): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26472)] 17:22:09.634551 run osmo-msc_10.42.42.6(pid=26472): stdout: | (launched: 2022-12-09_17:22:08.486706) 17:22:09.684641 run osmo-msc_10.42.42.6(pid=26472): stderr: | 20221209172208764 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172208764 DLGLOBAL DEBUG validating counter group 0x7fc7e1e31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172208764 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172208764 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172208764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172208764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172208766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172208767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172208767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172208767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:09.735368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26465): Terminating (SIGTERM) 17:22:09.775795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26468): Terminating (SIGTERM) 17:22:09.816233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26471): Terminating (SIGTERM) 17:22:09.857060 --- ParallelTerminationStrategy: PID 26465 died... 17:22:09.876406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26465): Terminated: ok {rc=0} 17:22:09.921503 --- ParallelTerminationStrategy: PID 26468 died... 17:22:09.940351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26468): Terminated: ok {rc=0} 17:22:09.985590 --- ParallelTerminationStrategy: PID 26471 died... 17:22:10.004330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26471): Terminated: ok {rc=0} 17:22:10.090853 bus /sierra_3: Setting Powered False 17:22:11.193333 bus /sierra_3: Setting Powered False 17:22:12.309744 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:22:13.462968 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:13.475311 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:22:13.533431 tst mo_mt_call_osmux.py: using LAC 22539 17:22:13.665409 tst mo_mt_call_osmux.py: using RAC 99 17:22:13.799364 tst mo_mt_call_osmux.py: using CellId 22539 17:22:13.920720 tst mo_mt_call_osmux.py: using BVCI 22540 17:22:14.033398 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:14.044475 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:14.055490 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:14.066961 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:14.078299 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:22:14.089586 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:14.208673 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:22:14.327170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:14.809995 run create_hlr_db(pid=26474): Launched 17:22:14.927999 bus /sierra_2: Setting Powered False 17:22:15.994728 run create_hlr_db(pid=26474): Terminated: ok {rc=0} 17:22:16.425023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26476): Launched 17:22:16.753681 run osmo-hlr_10.42.42.2(pid=26477): Launched 17:22:17.002624 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:17.626873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26479): Launched 17:22:17.948379 run osmo-stp_10.42.42.5(pid=26480): Launched 17:22:18.070129 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:18.649256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26482): Launched 17:22:18.969606 run osmo-msc_10.42.42.6(pid=26483): Launched 17:22:19.148253 run osmo-stp_10.42.42.5(pid=26480): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26480)] 17:22:19.282167 run osmo-stp_10.42.42.5(pid=26480): stdout: | (launched: 2022-12-09_17:22:17.888552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:19.417825 run osmo-stp_10.42.42.5(pid=26480): stderr: | 20221209172218080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172218080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172218080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172218081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172218081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172218081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172218081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:19.552076 run osmo-stp_10.42.42.5(pid=26480): stdout: | (launched: 2022-12-09_17:22:17.888552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:19.678962 run osmo-stp_10.42.42.5(pid=26480): stderr: | 20221209172218080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172218080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172218080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172218081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172218081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172218081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172218081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:19.830783 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26480): Process ended prematurely: osmo-stp_10.42.42.5(pid=26480) [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26480)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:22:19.840388 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:22:19.868551 run osmo-hlr_10.42.42.2(pid=26477): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26477)] 17:22:19.918495 run osmo-hlr_10.42.42.2(pid=26477): stdout: | (launched: 2022-12-09_17:22:16.684464) 17:22:19.970117 run osmo-hlr_10.42.42.2(pid=26477): stderr: | 20221209172216911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172216911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172216911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172216911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172216912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172216912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172216926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172216948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172216948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172216948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:20.042192 run osmo-msc_10.42.42.6(pid=26483): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26483)] 17:22:20.092103 run osmo-msc_10.42.42.6(pid=26483): stdout: | (launched: 2022-12-09_17:22:18.909752) 17:22:20.143304 run osmo-msc_10.42.42.6(pid=26483): stderr: | 20221209172219235 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172219235 DLGLOBAL DEBUG validating counter group 0x7f06ce31bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172219235 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172219235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172219235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172219235 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172219237 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172219237 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172219238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172219238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:20.194851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26476): Terminating (SIGTERM) 17:22:20.236417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26479): Terminating (SIGTERM) 17:22:20.278454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26482): Terminating (SIGTERM) 17:22:20.320693 --- ParallelTerminationStrategy: PID 26476 died... 17:22:20.340751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26476): Terminated: ok {rc=0} 17:22:20.387401 --- ParallelTerminationStrategy: PID 26479 died... 17:22:20.406958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26479): Terminated: ok {rc=0} 17:22:20.453535 --- ParallelTerminationStrategy: PID 26482 died... 17:22:20.473120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26482): Terminated: ok {rc=0} 17:22:20.560252 bus /sierra_3: Setting Powered False 17:22:21.658378 bus /sierra_3: Setting Powered False 17:22:22.773311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:22:23.999536 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:22:24.005811 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:22:24.026634 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:22:24.053151 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:22:24.105995 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:22:24.126649 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:22:24.152744 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:22:24.699612 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:22:24.747804 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:24.758614 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:22:24.813219 tst mo_mt_call.py: using LAC 22540 17:22:24.930823 tst mo_mt_call.py: using RAC 100 17:22:25.048036 tst mo_mt_call.py: using CellId 22540 17:22:25.164398 tst mo_mt_call.py: using BVCI 22541 17:22:25.272316 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.283312 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.294007 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.304932 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.315875 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:25.326832 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:25.445412 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:25.563660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:26.061444 run create_hlr_db(pid=26488): Launched 17:22:26.191955 bus /sierra_2: Setting Powered False 17:22:27.255635 run create_hlr_db(pid=26488): Terminated: ok {rc=0} 17:22:27.684528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26490): Launched 17:22:27.983303 run osmo-hlr_10.42.42.2(pid=26491): Launched 17:22:28.096591 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:28.609910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26493): Launched 17:22:28.909437 run osmo-stp_10.42.42.5(pid=26494): Launched 17:22:29.022916 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:29.564049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26496): Launched 17:22:29.863506 run osmo-msc_10.42.42.6(pid=26497): Launched 17:22:30.029321 run osmo-stp_10.42.42.5(pid=26494): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26494)] 17:22:30.155230 run osmo-stp_10.42.42.5(pid=26494): stdout: | (launched: 2022-12-09_17:22:28.853020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:30.281653 run osmo-stp_10.42.42.5(pid=26494): stderr: | 20221209172229026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172229026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172229026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172229027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172229027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172229027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172229027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:30.405678 run osmo-stp_10.42.42.5(pid=26494): stdout: | (launched: 2022-12-09_17:22:28.853020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:30.523371 run osmo-stp_10.42.42.5(pid=26494): stderr: | 20221209172229026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172229026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172229026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172229027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172229027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172229027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172229027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:30.664906 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26494): Process ended prematurely: osmo-stp_10.42.42.5(pid=26494) [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26494)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:22:30.673779 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:22:30.699891 run osmo-hlr_10.42.42.2(pid=26491): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26491)] 17:22:30.747815 run osmo-hlr_10.42.42.2(pid=26491): stdout: | (launched: 2022-12-09_17:22:27.927350) 17:22:30.796795 run osmo-hlr_10.42.42.2(pid=26491): stderr: | 20221209172228103 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172228104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172228104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172228104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172228104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172228104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172228120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172228129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172228130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172228130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:30.871049 run osmo-msc_10.42.42.6(pid=26497): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26497)] 17:22:30.922067 run osmo-msc_10.42.42.6(pid=26497): stdout: | (launched: 2022-12-09_17:22:29.806944) 17:22:30.975213 run osmo-msc_10.42.42.6(pid=26497): stderr: | 20221209172230078 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172230079 DLGLOBAL DEBUG validating counter group 0x7ff20c617c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172230079 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172230079 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172230079 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172230079 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172230081 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172230082 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172230082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172230082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:31.027825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26490): Terminating (SIGTERM) 17:22:31.071447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26493): Terminating (SIGTERM) 17:22:31.116191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26496): Terminating (SIGTERM) 17:22:31.162681 --- ParallelTerminationStrategy: PID 26490 died... 17:22:31.183230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26490): Terminated: ok {rc=0} 17:22:31.231245 --- ParallelTerminationStrategy: PID 26493 died... 17:22:31.251731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26493): Terminated: ok {rc=0} 17:22:31.298986 --- ParallelTerminationStrategy: PID 26496 died... 17:22:31.319025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26496): Terminated: ok {rc=0} 17:22:31.410221 bus /sierra_3: Setting Powered False 17:22:32.508069 bus /sierra_3: Setting Powered False 17:22:33.621926 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:22:34.769089 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:34.781187 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:22:34.838962 tst mo_mt_call_osmux.py: using LAC 22541 17:22:34.968692 tst mo_mt_call_osmux.py: using RAC 101 17:22:35.094435 tst mo_mt_call_osmux.py: using CellId 22541 17:22:35.210720 tst mo_mt_call_osmux.py: using BVCI 22542 17:22:35.320727 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.331703 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.342610 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.353722 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.364662 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:22:35.375677 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:35.489245 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:22:35.604243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:36.070363 run create_hlr_db(pid=26504): Launched 17:22:36.183423 bus /sierra_2: Setting Powered False 17:22:37.242946 run create_hlr_db(pid=26504): Terminated: ok {rc=0} 17:22:37.683533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26506): Launched 17:22:38.006098 run osmo-hlr_10.42.42.2(pid=26507): Launched 17:22:38.127650 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:38.682159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26509): Launched 17:22:39.005015 run osmo-stp_10.42.42.5(pid=26510): Launched 17:22:39.126738 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:39.709584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26512): Launched 17:22:40.031939 run osmo-msc_10.42.42.6(pid=26513): Launched 17:22:40.209843 run osmo-stp_10.42.42.5(pid=26510): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26510)] 17:22:40.344524 run osmo-stp_10.42.42.5(pid=26510): stdout: | (launched: 2022-12-09_17:22:38.944906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:40.480436 run osmo-stp_10.42.42.5(pid=26510): stderr: | 20221209172239138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172239138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172239138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172239139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172239139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172239139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172239139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:40.615539 run osmo-stp_10.42.42.5(pid=26510): stdout: | (launched: 2022-12-09_17:22:38.944906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:40.742792 run osmo-stp_10.42.42.5(pid=26510): stderr: | 20221209172239138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172239138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172239138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172239139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172239139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172239139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172239139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:40.894912 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26510): Process ended prematurely: osmo-stp_10.42.42.5(pid=26510) [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26510)] [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:22:40.904220 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:22:40.932157 run osmo-hlr_10.42.42.2(pid=26507): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26507)] 17:22:40.982144 run osmo-hlr_10.42.42.2(pid=26507): stdout: | (launched: 2022-12-09_17:22:37.945813) 17:22:41.033855 run osmo-hlr_10.42.42.2(pid=26507): stderr: | 20221209172238147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172238147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172238147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172238147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172238147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172238147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172238160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172238170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172238171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172238171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:41.106116 run osmo-msc_10.42.42.6(pid=26513): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26513)] 17:22:41.156069 run osmo-msc_10.42.42.6(pid=26513): stdout: | (launched: 2022-12-09_17:22:39.971852) 17:22:41.207987 run osmo-msc_10.42.42.6(pid=26513): stderr: | 20221209172240294 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172240294 DLGLOBAL DEBUG validating counter group 0x7f08c0209c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172240294 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172240294 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172240295 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172240295 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172240297 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172240297 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172240297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172240297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:41.260210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26506): Terminating (SIGTERM) 17:22:41.301787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26509): Terminating (SIGTERM) 17:22:41.343623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26512): Terminating (SIGTERM) 17:22:41.385878 --- ParallelTerminationStrategy: PID 26506 died... 17:22:41.405876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26506): Terminated: ok {rc=0} 17:22:41.452178 --- ParallelTerminationStrategy: PID 26509 died... 17:22:41.471747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26509): Terminated: ok {rc=0} 17:22:41.518225 --- ParallelTerminationStrategy: PID 26512 died... 17:22:41.537720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26512): Terminated: ok {rc=0} 17:22:41.625108 bus /sierra_3: Setting Powered False 17:22:42.722410 bus /sierra_3: Setting Powered False 17:22:43.839033 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:22:45.076448 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:22:45.082839 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:22:45.103423 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:22:45.130116 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:22:45.179381 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:22:45.199420 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:22:45.226164 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:22:45.789487 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:22:45.841055 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:45.853079 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:22:45.920660 tst mo_mt_call.py: using LAC 22542 17:22:46.038714 tst mo_mt_call.py: using RAC 102 17:22:46.155557 tst mo_mt_call.py: using CellId 22542 17:22:46.281895 tst mo_mt_call.py: using BVCI 22543 17:22:46.403570 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.416386 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.429587 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.442974 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.455155 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:46.469117 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:46.606893 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:46.749955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:47.301661 run create_hlr_db(pid=26518): Launched 17:22:47.451766 bus /sierra_2: Setting Powered False 17:22:48.509662 run create_hlr_db(pid=26518): Terminated: ok {rc=0} 17:22:48.941394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26520): Launched 17:22:49.256423 run osmo-hlr_10.42.42.2(pid=26521): Launched 17:22:49.376786 run osmo-stp_10.42.42.5: Starting osmo-stp 17:22:49.919378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26523): Launched 17:22:50.233593 run osmo-stp_10.42.42.5(pid=26524): Launched 17:22:50.353318 run osmo-msc_10.42.42.6: Starting osmo-msc 17:22:50.922934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26526): Launched 17:22:51.238965 run osmo-msc_10.42.42.6(pid=26527): Launched 17:22:51.414871 run osmo-stp_10.42.42.5(pid=26524): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26524)] 17:22:51.548362 run osmo-stp_10.42.42.5(pid=26524): stdout: | (launched: 2022-12-09_17:22:50.176204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:51.683471 run osmo-stp_10.42.42.5(pid=26524): stderr: | 20221209172250369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172250369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172250370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172250370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172250370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172250370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172250371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:51.817224 run osmo-stp_10.42.42.5(pid=26524): stdout: | (launched: 2022-12-09_17:22:50.176204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:22:51.943288 run osmo-stp_10.42.42.5(pid=26524): stderr: | 20221209172250369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172250369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172250370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172250370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172250370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172250370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172250371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:22:52.093408 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26524): Process ended prematurely: osmo-stp_10.42.42.5(pid=26524) [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26524)] [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:22:52.102821 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:22:52.130392 run osmo-hlr_10.42.42.2(pid=26521): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26521)] 17:22:52.180137 run osmo-hlr_10.42.42.2(pid=26521): stdout: | (launched: 2022-12-09_17:22:49.199134) 17:22:52.231858 run osmo-hlr_10.42.42.2(pid=26521): stderr: | 20221209172249398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172249398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172249398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172249398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172249398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172249398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172249413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172249421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172249422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172249422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:22:52.303863 run osmo-msc_10.42.42.6(pid=26527): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26527)] 17:22:52.353630 run osmo-msc_10.42.42.6(pid=26527): stdout: | (launched: 2022-12-09_17:22:51.181666) 17:22:52.405357 run osmo-msc_10.42.42.6(pid=26527): stderr: | 20221209172251501 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172251502 DLGLOBAL DEBUG validating counter group 0x7f1e44e98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172251502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172251502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172251502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172251502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172251506 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172251506 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172251506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172251506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:22:52.457226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26520): Terminating (SIGTERM) 17:22:52.498413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26523): Terminating (SIGTERM) 17:22:52.539601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26526): Terminating (SIGTERM) 17:22:52.581166 --- ParallelTerminationStrategy: PID 26520 died... 17:22:52.600890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26520): Terminated: ok {rc=0} 17:22:52.646855 --- ParallelTerminationStrategy: PID 26523 died... 17:22:52.666280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26523): Terminated: ok {rc=0} 17:22:52.712045 --- ParallelTerminationStrategy: PID 26526 died... 17:22:52.731487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26526): Terminated: ok {rc=0} 17:22:52.817883 bus /sierra_3: Setting Powered False 17:22:53.915538 bus /sierra_3: Setting Powered False 17:22:55.030932 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:22:56.177660 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.189627 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:22:56.247091 tst mo_mt_call_osmux.py: using LAC 22543 17:22:56.373963 tst mo_mt_call_osmux.py: using RAC 103 17:22:56.490442 tst mo_mt_call_osmux.py: using CellId 22543 17:22:56.604612 tst mo_mt_call_osmux.py: using BVCI 22544 17:22:56.710845 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.721979 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.732779 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.743893 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.755009 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:22:56.766092 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:56.882723 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:22:56.995650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:22:57.447115 run create_hlr_db(pid=26529): Launched 17:22:57.558318 bus /sierra_2: Setting Powered False 17:22:58.617999 run create_hlr_db(pid=26529): Terminated: ok {rc=0} 17:22:59.046117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26531): Launched 17:22:59.359230 run osmo-hlr_10.42.42.2(pid=26532): Launched 17:22:59.478681 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:00.019791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26534): Launched 17:23:00.334519 run osmo-stp_10.42.42.5(pid=26535): Launched 17:23:00.454101 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:01.047420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26537): Launched 17:23:01.368873 run osmo-msc_10.42.42.6(pid=26538): Launched 17:23:01.729786 run osmo-stp_10.42.42.5(pid=26535): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26535)] 17:23:01.933497 run osmo-stp_10.42.42.5(pid=26535): stdout: | (launched: 2022-12-09_17:23:00.276902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:02.133379 run osmo-stp_10.42.42.5(pid=26535): stderr: | 20221209172300466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172300466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172300467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172300467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172300467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172300468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172300468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:02.309909 run osmo-stp_10.42.42.5(pid=26535): stdout: | (launched: 2022-12-09_17:23:00.276902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:02.457524 run osmo-stp_10.42.42.5(pid=26535): stderr: | 20221209172300466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172300466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172300467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172300467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172300467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172300468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172300468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:02.601679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26535): Process ended prematurely: osmo-stp_10.42.42.5(pid=26535) [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26535)] [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:23:02.611493 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:23:02.649699 run osmo-hlr_10.42.42.2(pid=26532): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26532)] 17:23:02.701314 run osmo-hlr_10.42.42.2(pid=26532): stdout: | (launched: 2022-12-09_17:22:59.302809) 17:23:02.766550 run osmo-hlr_10.42.42.2(pid=26532): stderr: | 20221209172259498 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172259498 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172259498 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172259498 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172259498 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172259498 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172259516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172259526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172259526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172259527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:02.851370 run osmo-msc_10.42.42.6(pid=26538): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26538)] 17:23:02.908812 run osmo-msc_10.42.42.6(pid=26538): stdout: | (launched: 2022-12-09_17:23:01.299941) 17:23:02.963848 run osmo-msc_10.42.42.6(pid=26538): stderr: | 20221209172301873 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172301873 DLGLOBAL DEBUG validating counter group 0x7fa511fcec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172301873 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172301874 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172301875 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172301875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172301882 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172301882 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172301882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172301882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:03.016201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26531): Terminating (SIGTERM) 17:23:03.061282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26534): Terminating (SIGTERM) 17:23:03.106136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26537): Terminating (SIGTERM) 17:23:03.157890 --- ParallelTerminationStrategy: PID 26531 died... 17:23:03.178313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26531): Terminated: ok {rc=0} 17:23:03.232299 --- ParallelTerminationStrategy: PID 26534 died... 17:23:03.256598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26534): Terminated: ok {rc=0} 17:23:03.304358 --- ParallelTerminationStrategy: PID 26537 died... 17:23:03.327727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26537): Terminated: ok {rc=0} 17:23:03.443784 bus /sierra_3: Setting Powered False 17:23:04.574678 bus /sierra_3: Setting Powered False 17:23:05.689595 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:23:06.929299 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:23:06.936576 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:23:06.959810 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:23:06.988848 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:23:07.040153 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:23:07.061410 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:23:07.090504 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:23:07.637622 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:23:07.690529 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:07.702298 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:23:07.767030 tst mo_mt_call.py: using LAC 22544 17:23:07.886188 tst mo_mt_call.py: using RAC 104 17:23:08.003293 tst mo_mt_call.py: using CellId 22544 17:23:08.120274 tst mo_mt_call.py: using BVCI 22545 17:23:08.230541 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.242288 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.253721 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.267608 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.280475 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:08.291935 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:08.412219 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:08.528584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:09.009019 run create_hlr_db(pid=26814): Launched 17:23:09.166943 bus /sierra_2: Setting Powered False 17:23:10.229490 run create_hlr_db(pid=26814): Terminated: ok {rc=0} 17:23:10.673690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26816): Launched 17:23:11.006323 run osmo-hlr_10.42.42.2(pid=26817): Launched 17:23:11.245150 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:11.970966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26819): Launched 17:23:12.302084 run osmo-stp_10.42.42.5(pid=26820): Launched 17:23:12.539347 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:13.261745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26822): Launched 17:23:13.601760 run osmo-msc_10.42.42.6(pid=26823): Launched 17:23:13.955464 run osmo-stp_10.42.42.5(pid=26820): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26820)] 17:23:14.224889 run osmo-stp_10.42.42.5(pid=26820): stdout: | (launched: 2022-12-09_17:23:12.238180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:14.510022 run osmo-stp_10.42.42.5(pid=26820): stderr: | 20221209172312577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172312577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172312578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172312578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172312579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172312579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172312579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:14.659094 run osmo-stp_10.42.42.5(pid=26820): stdout: | (launched: 2022-12-09_17:23:12.238180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:14.786632 run osmo-stp_10.42.42.5(pid=26820): stderr: | 20221209172312577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172312577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172312578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172312578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172312579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172312579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172312579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:14.935825 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26820): Process ended prematurely: osmo-stp_10.42.42.5(pid=26820) [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26820)] [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:23:14.946069 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 17:23:14.976696 run osmo-hlr_10.42.42.2(pid=26817): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26817)] 17:23:15.027592 run osmo-hlr_10.42.42.2(pid=26817): stdout: | (launched: 2022-12-09_17:23:10.942184) 17:23:15.080044 run osmo-hlr_10.42.42.2(pid=26817): stderr: | 20221209172311287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172311287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172311287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172311287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172311287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172311287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172311298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172311311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172311311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172311311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:15.154936 run osmo-msc_10.42.42.6(pid=26823): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26823)] 17:23:15.205730 run osmo-msc_10.42.42.6(pid=26823): stdout: | (launched: 2022-12-09_17:23:13.529824) 17:23:15.258672 run osmo-msc_10.42.42.6(pid=26823): stderr: | 20221209172314120 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172314125 DLGLOBAL DEBUG validating counter group 0x7f4c0db5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172314125 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172314125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172314125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172314125 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172314127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172314128 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172314128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172314128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:15.311563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26816): Terminating (SIGTERM) 17:23:15.356605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26819): Terminating (SIGTERM) 17:23:15.401852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26822): Terminating (SIGTERM) 17:23:15.446916 --- ParallelTerminationStrategy: PID 26816 died... 17:23:15.467339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26816): Terminated: ok {rc=0} 17:23:15.516599 --- ParallelTerminationStrategy: PID 26819 died... 17:23:15.537778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26819): Terminated: ok {rc=0} 17:23:15.586655 --- ParallelTerminationStrategy: PID 26822 died... 17:23:15.606971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26822): Terminated: ok {rc=0} 17:23:15.697380 bus /sierra_3: Setting Powered False 17:23:16.814541 bus /sierra_3: Setting Powered False 17:23:17.953449 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:23:19.106565 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:19.119253 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:23:19.179184 tst mo_mt_call_osmux.py: using LAC 22545 17:23:19.302993 tst mo_mt_call_osmux.py: using RAC 105 17:23:19.426375 tst mo_mt_call_osmux.py: using CellId 22545 17:23:19.549483 tst mo_mt_call_osmux.py: using BVCI 22546 17:23:19.662196 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:19.674124 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:19.685770 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:19.699660 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:19.711256 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:23:19.724244 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:19.842154 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:23:19.960796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:20.448933 run create_hlr_db(pid=26825): Launched 17:23:20.607006 bus /sierra_2: Setting Powered False 17:23:21.668831 run create_hlr_db(pid=26825): Terminated: ok {rc=0} 17:23:22.113248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26827): Launched 17:23:22.448774 run osmo-hlr_10.42.42.2(pid=26828): Launched 17:23:22.695102 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:23.417657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26830): Launched 17:23:23.738137 run osmo-stp_10.42.42.5(pid=26831): Launched 17:23:23.977251 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:24.574314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26833): Launched 17:23:24.898356 run osmo-msc_10.42.42.6(pid=26834): Launched 17:23:25.078995 run osmo-stp_10.42.42.5(pid=26831): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26831)] 17:23:25.216656 run osmo-stp_10.42.42.5(pid=26831): stdout: | (launched: 2022-12-09_17:23:23.674576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:25.354270 run osmo-stp_10.42.42.5(pid=26831): stderr: | 20221209172324009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172324009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172324009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172324010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172324010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172324010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172324010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:25.490446 run osmo-stp_10.42.42.5(pid=26831): stdout: | (launched: 2022-12-09_17:23:23.674576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:25.619392 run osmo-stp_10.42.42.5(pid=26831): stderr: | 20221209172324009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172324009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172324009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172324010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172324010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172324010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172324010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:25.773650 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26831): Process ended prematurely: osmo-stp_10.42.42.5(pid=26831) [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26831)] [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:23:25.783153 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 17:23:25.811139 run osmo-hlr_10.42.42.2(pid=26828): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26828)] 17:23:25.861393 run osmo-hlr_10.42.42.2(pid=26828): stdout: | (launched: 2022-12-09_17:23:22.383833) 17:23:25.913583 run osmo-hlr_10.42.42.2(pid=26828): stderr: | 20221209172322725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172322725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172322725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172322726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172322726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172322726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172322746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172322758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172322759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172322759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:25.986750 run osmo-msc_10.42.42.6(pid=26834): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26834)] 17:23:26.037142 run osmo-msc_10.42.42.6(pid=26834): stdout: | (launched: 2022-12-09_17:23:24.839893) 17:23:26.089247 run osmo-msc_10.42.42.6(pid=26834): stderr: | 20221209172325161 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172325161 DLGLOBAL DEBUG validating counter group 0x7fdbdd92bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172325162 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172325162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172325162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172325162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172325164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172325164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172325164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172325164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:26.141635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26827): Terminating (SIGTERM) 17:23:26.183470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26830): Terminating (SIGTERM) 17:23:26.225504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26833): Terminating (SIGTERM) 17:23:26.267731 --- ParallelTerminationStrategy: PID 26827 died... 17:23:26.288018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26827): Terminated: ok {rc=0} 17:23:26.334550 --- ParallelTerminationStrategy: PID 26830 died... 17:23:26.354676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26830): Terminated: ok {rc=0} 17:23:26.401136 --- ParallelTerminationStrategy: PID 26833 died... 17:23:26.421092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26833): Terminated: ok {rc=0} 17:23:26.509557 bus /sierra_3: Setting Powered False 17:23:27.605834 bus /sierra_3: Setting Powered False 17:23:28.722318 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 emergency:oc2g --------------------------------------------------------------------- 17:23:29.958599 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:23:29.963398 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 17:23:29.984438 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 17:23:30.011787 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 17:23:30.097264 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 17:23:30.118053 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 17:23:30.144898 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 17:23:30.728942 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2362 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 17:23:30.734119 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:30.745461 tst emergency:oc2g: Using 1 x bts (candidates: 1) 17:23:30.782252 tst emergency_mo_mt_call.py: using LAC 22546 17:23:30.923428 tst emergency_mo_mt_call.py: using RAC 106 17:23:31.058379 tst emergency_mo_mt_call.py: using CellId 22546 17:23:31.213512 tst emergency_mo_mt_call.py: using BVCI 22547 17:23:31.325856 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:31.338465 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:31.351283 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:31.362602 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:31.374829 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:31.387248 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:31.508546 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:31.655376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:32.177567 run create_hlr_db(pid=26839): Launched 17:23:32.339293 bus /sierra_2: Setting Powered False 17:23:33.401702 run create_hlr_db(pid=26839): Terminated: ok {rc=0} 17:23:33.827507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26841): Launched 17:23:34.125531 run osmo-hlr_10.42.42.2(pid=26842): Launched 17:23:34.239176 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:34.761790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26844): Launched 17:23:35.057656 run osmo-stp_10.42.42.5(pid=26845): Launched 17:23:35.183480 tst emergency_mo_mt_call.py: using MSISDN 7294 17:23:35.350186 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:35.882555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26847): Launched 17:23:36.179738 run osmo-msc_10.42.42.6(pid=26848): Launched 17:23:36.345906 run osmo-stp_10.42.42.5(pid=26845): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26845)] 17:23:36.471134 run osmo-stp_10.42.42.5(pid=26845): stdout: | (launched: 2022-12-09_17:23:35.003472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:36.596499 run osmo-stp_10.42.42.5(pid=26845): stderr: | 20221209172335175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172335175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172335175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172335175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172335176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172335176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172335176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:36.720229 run osmo-stp_10.42.42.5(pid=26845): stdout: | (launched: 2022-12-09_17:23:35.003472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:36.838335 run osmo-stp_10.42.42.5(pid=26845): stderr: | 20221209172335175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172335175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172335175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172335175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172335176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172335176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172335176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:36.979652 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26845): Process ended prematurely: osmo-stp_10.42.42.5(pid=26845) [trial-2362↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26845)] [trial-2362↪emergency:oc2g↪emergency_mo_mt_call.py:19] 17:23:36.987911 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 17:23:37.014751 run osmo-hlr_10.42.42.2(pid=26842): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26842)] 17:23:37.064719 run osmo-hlr_10.42.42.2(pid=26842): stdout: | (launched: 2022-12-09_17:23:34.071106) 17:23:37.115321 run osmo-hlr_10.42.42.2(pid=26842): stderr: | 20221209172334246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172334246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172334246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172334246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172334246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172334246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172334258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172334266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172334266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172334266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:37.185280 run osmo-msc_10.42.42.6(pid=26848): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26848)] 17:23:37.233895 run osmo-msc_10.42.42.6(pid=26848): stdout: | (launched: 2022-12-09_17:23:36.125437) 17:23:37.284073 run osmo-msc_10.42.42.6(pid=26848): stderr: | 20221209172336395 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172336395 DLGLOBAL DEBUG validating counter group 0x7fa1bcb26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172336396 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172336396 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172336396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172336396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172336398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172336399 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172336399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172336399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:37.334829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26841): Terminating (SIGTERM) 17:23:37.375074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26844): Terminating (SIGTERM) 17:23:37.415683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26847): Terminating (SIGTERM) 17:23:37.456782 --- ParallelTerminationStrategy: PID 26841 died... 17:23:37.476012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26841): Terminated: ok {rc=0} 17:23:37.521733 --- ParallelTerminationStrategy: PID 26844 died... 17:23:37.540817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26844): Terminated: ok {rc=0} 17:23:37.586451 --- ParallelTerminationStrategy: PID 26847 died... 17:23:37.605126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26847): Terminated: ok {rc=0} 17:23:37.691885 bus /sierra_3: Setting Powered False 17:23:38.793119 bus /sierra_3: Setting Powered False 17:23:39.906892 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 17:23:40.993948 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:41.005637 tst emergency:oc2g: Using 1 x bts (candidates: 1) 17:23:41.043619 tst emergency_preemptive_call.py: using LAC 22547 17:23:41.168852 tst emergency_preemptive_call.py: using RAC 107 17:23:41.292605 tst emergency_preemptive_call.py: using CellId 22547 17:23:41.418214 tst emergency_preemptive_call.py: using BVCI 22548 17:23:41.534159 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:41.545423 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:41.556130 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:41.566988 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:41.577723 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:23:41.588554 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:41.705824 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:41.821364 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:41.939497 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:23:42.052892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:23:42.512021 run create_hlr_db(pid=26850): Launched 17:23:42.626842 bus /sierra_2: Setting Powered False 17:23:43.687030 run create_hlr_db(pid=26850): Terminated: ok {rc=0} 17:23:44.123673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26852): Launched 17:23:44.442547 run osmo-hlr_10.42.42.2(pid=26853): Launched 17:23:44.564437 run osmo-stp_10.42.42.5: Starting osmo-stp 17:23:45.117606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26855): Launched 17:23:45.435403 run osmo-stp_10.42.42.5(pid=26856): Launched 17:23:45.566905 tst emergency_preemptive_call.py: using MSISDN 7295 17:23:45.729545 run osmo-msc_10.42.42.6: Starting osmo-msc 17:23:46.325804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26858): Launched 17:23:46.663659 run osmo-msc_10.42.42.6(pid=26859): Launched 17:23:47.035230 run osmo-stp_10.42.42.5(pid=26856): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26856)] 17:23:47.261068 run osmo-stp_10.42.42.5(pid=26856): stdout: | (launched: 2022-12-09_17:23:45.377454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:47.393942 run osmo-stp_10.42.42.5(pid=26856): stderr: | 20221209172345569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172345569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172345569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172345570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172345570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172345570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172345570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:47.527001 run osmo-stp_10.42.42.5(pid=26856): stdout: | (launched: 2022-12-09_17:23:45.377454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:23:47.653074 run osmo-stp_10.42.42.5(pid=26856): stderr: | 20221209172345569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172345569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172345569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172345570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172345570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172345570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172345570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:23:47.804444 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26856): Process ended prematurely: osmo-stp_10.42.42.5(pid=26856) [trial-2362↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26856)] [trial-2362↪emergency:oc2g↪emergency_preemptive_call.py:32] 17:23:47.813464 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 17:23:47.841119 run osmo-hlr_10.42.42.2(pid=26853): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26853)] 17:23:47.891201 run osmo-hlr_10.42.42.2(pid=26853): stdout: | (launched: 2022-12-09_17:23:44.384290) 17:23:47.943086 run osmo-hlr_10.42.42.2(pid=26853): stderr: | 20221209172344583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172344583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172344583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172344583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172344583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172344583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172344595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172344604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172344604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172344604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:23:48.015575 run osmo-msc_10.42.42.6(pid=26859): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26859)] 17:23:48.065536 run osmo-msc_10.42.42.6(pid=26859): stdout: | (launched: 2022-12-09_17:23:46.600608) 17:23:48.117569 run osmo-msc_10.42.42.6(pid=26859): stderr: | 20221209172347039 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172347039 DLGLOBAL DEBUG validating counter group 0x7f34ffaeac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172347039 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172347039 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172347039 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172347039 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172347045 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172347046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172347046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172347046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:23:48.170242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26852): Terminating (SIGTERM) 17:23:48.211981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26855): Terminating (SIGTERM) 17:23:48.254037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26858): Terminating (SIGTERM) 17:23:48.296112 --- ParallelTerminationStrategy: PID 26852 died... 17:23:48.316144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26852): Terminated: ok {rc=0} 17:23:48.362467 --- ParallelTerminationStrategy: PID 26855 died... 17:23:48.382041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26855): Terminated: ok {rc=0} 17:23:48.428517 --- ParallelTerminationStrategy: PID 26858 died... 17:23:48.448277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26858): Terminated: ok {rc=0} 17:23:48.536708 bus /sierra_9: Setting Powered False 17:23:49.635172 bus /sierra_9: Setting Powered False 17:23:50.749608 bus /sierra_8: Setting Powered False 17:23:51.847238 bus /sierra_8: Setting Powered False 17:23:52.961838 bus /sierra_3: Setting Powered False 17:23:54.059829 bus /sierra_3: Setting Powered False 17:23:55.176093 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:oc2g --------------------------------------------------------------------- 17:23:56.431203 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:23:56.435666 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 17:23:56.456210 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 17:23:56.495000 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 17:23:56.578629 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 17:23:56.599236 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 17:23:56.637308 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 17:23:57.226412 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 17:23:57.276076 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.286517 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:23:57.319987 tst cs_paging_gprs_active.py: using LAC 22548 17:23:57.436318 tst cs_paging_gprs_active.py: using RAC 108 17:23:57.552650 tst cs_paging_gprs_active.py: using CellId 22548 17:23:57.668743 tst cs_paging_gprs_active.py: using BVCI 22549 17:23:57.778028 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.788460 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.798742 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.809193 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.819503 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.829947 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.840396 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.850938 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:23:57.861465 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:23:57.979419 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:23:58.094673 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:23:58.298393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:23:58.600931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26864): Launched 17:23:58.864524 run iperf3-srv_10.42.42.10(pid=26865): Launched 17:23:58.978267 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:23:59.179964 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:23:59.482395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26866): Launched 17:23:59.745488 run iperf3-srv_10.42.42.10(pid=26867): Launched 17:23:59.859198 tst cs_paging_gprs_active.py:38: start network... 17:24:00.061179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:00.527849 run create_hlr_db(pid=26868): Launched 17:24:00.642922 bus /sierra_2: Setting Powered False 17:24:01.706192 run create_hlr_db(pid=26868): Terminated: ok {rc=0} 17:24:02.176626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26870): Launched 17:24:02.512252 run osmo-hlr_10.42.42.2(pid=26871): Launched 17:24:02.637046 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:03.192811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26873): Launched 17:24:03.516252 run osmo-stp_10.42.42.5(pid=26874): Launched 17:24:03.640261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:04.196479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26876): Launched 17:24:04.320367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:04.593739 run patchelf(pid=26877): Launched 17:24:04.773856 run osmo-stp_10.42.42.5(pid=26874): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26874)] 17:24:04.911100 run osmo-stp_10.42.42.5(pid=26874): stdout: | (launched: 2022-12-09_17:24:03.457357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:05.049735 run osmo-stp_10.42.42.5(pid=26874): stderr: | 20221209172403651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172403651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172403651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172403651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172403652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172403652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172403652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:05.187779 run osmo-stp_10.42.42.5(pid=26874): stdout: | (launched: 2022-12-09_17:24:03.457357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:05.320019 run osmo-stp_10.42.42.5(pid=26874): stderr: | 20221209172403651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172403651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172403651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172403651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172403652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172403652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172403652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:05.477532 run patchelf(pid=26877): Terminating (SIGINT) 17:24:05.659278 run patchelf(pid=26877): Terminated: ok {rc=0} 17:24:05.791065 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26874): Process ended prematurely: osmo-stp_10.42.42.5(pid=26874) [trial-2362↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26874)] [trial-2362↪gprs:oc2g↪cs_paging_gprs_active.py:38] 17:24:05.800915 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:24:05.829721 run osmo-hlr_10.42.42.2(pid=26871): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26871)] 17:24:05.879832 run osmo-hlr_10.42.42.2(pid=26871): stdout: | (launched: 2022-12-09_17:24:02.453310) 17:24:05.931819 run osmo-hlr_10.42.42.2(pid=26871): stderr: | 20221209172402652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172402652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172402652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172402652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172402652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172402652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172402668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172402678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172402678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172402678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:05.984463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26864): Terminating (SIGTERM) 17:24:06.026420 run iperf3-srv_10.42.42.10(pid=26865): Terminating (SIGTERM) 17:24:06.068124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26866): Terminating (SIGTERM) 17:24:06.109816 run iperf3-srv_10.42.42.10(pid=26867): Terminating (SIGTERM) 17:24:06.151253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26870): Terminating (SIGTERM) 17:24:06.192714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26873): Terminating (SIGTERM) 17:24:06.234632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26876): Terminating (SIGTERM) 17:24:06.277152 --- ParallelTerminationStrategy: PID 26864 died... 17:24:06.297171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26864): Terminated: ok {rc=0} 17:24:06.343378 --- ParallelTerminationStrategy: PID 26865 died... 17:24:06.363225 run iperf3-srv_10.42.42.10(pid=26865): Terminated {rc=256} 17:24:06.408742 --- ParallelTerminationStrategy: PID 26866 died... 17:24:06.428026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26866): Terminated: ok {rc=0} 17:24:06.474089 --- ParallelTerminationStrategy: PID 26867 died... 17:24:06.493852 run iperf3-srv_10.42.42.10(pid=26867): Terminated {rc=256} 17:24:06.539558 --- ParallelTerminationStrategy: PID 26870 died... 17:24:06.558784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26870): Terminated: ok {rc=0} 17:24:06.604564 --- ParallelTerminationStrategy: PID 26873 died... 17:24:06.623976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26873): Terminated: ok {rc=0} 17:24:06.669722 --- ParallelTerminationStrategy: PID 26876 died... 17:24:06.689135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26876): Terminated: ok {rc=0} 17:24:06.776412 bus /gobi_0: Setting Powered False 17:24:07.875495 bus /gobi_0: Setting Powered False 17:24:08.988987 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g iperf3.py ---------------------------------------------- 17:24:10.136479 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.148093 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:10.184371 tst iperf3.py: using LAC 22549 17:24:10.310392 tst iperf3.py: using RAC 109 17:24:10.438603 tst iperf3.py: using CellId 22549 17:24:10.567000 tst iperf3.py: using BVCI 22550 17:24:10.684392 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.695448 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.706224 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.717150 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.727874 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.738652 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.749534 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.760229 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:10.771271 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:10.891609 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:24:11.110661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:11.434879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26878): Launched 17:24:11.717346 run iperf3-srv_10.42.42.10(pid=26879): Launched 17:24:11.839287 tst iperf3.py:8: start network... 17:24:12.057511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:12.559844 run create_hlr_db(pid=26880): Launched 17:24:12.691057 bus /gobi_6: Setting Powered False 17:24:13.755865 run create_hlr_db(pid=26880): Terminated: ok {rc=0} 17:24:14.187639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26882): Launched 17:24:14.490244 run osmo-hlr_10.42.42.2(pid=26883): Launched 17:24:14.605697 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:15.137220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26885): Launched 17:24:15.438789 run osmo-stp_10.42.42.5(pid=26886): Launched 17:24:15.554753 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:16.122567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26888): Launched 17:24:16.256744 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:16.545795 run patchelf(pid=26889): Launched 17:24:16.736369 run osmo-stp_10.42.42.5(pid=26886): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26886)] 17:24:16.878346 run osmo-stp_10.42.42.5(pid=26886): stdout: | (launched: 2022-12-09_17:24:15.383757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:17.020526 run osmo-stp_10.42.42.5(pid=26886): stderr: | 20221209172415553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172415553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172415553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172415554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172415554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172415554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172415554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:17.163236 run osmo-stp_10.42.42.5(pid=26886): stdout: | (launched: 2022-12-09_17:24:15.383757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:17.295776 run osmo-stp_10.42.42.5(pid=26886): stderr: | 20221209172415553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172415553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172415553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172415554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172415554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172415554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172415554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:17.454291 run patchelf(pid=26889): Terminating (SIGINT) 17:24:17.636347 run patchelf(pid=26889): Terminated: ok {rc=0} 17:24:17.767607 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26886): Process ended prematurely: osmo-stp_10.42.42.5(pid=26886) [trial-2362↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26886)] [trial-2362↪gprs:oc2g↪iperf3.py:8] 17:24:17.777827 tst iperf3.py:8: Test FAILED (7.7 sec) 17:24:17.806590 run osmo-hlr_10.42.42.2(pid=26883): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26883)] 17:24:17.856470 run osmo-hlr_10.42.42.2(pid=26883): stdout: | (launched: 2022-12-09_17:24:14.435018) 17:24:17.908263 run osmo-hlr_10.42.42.2(pid=26883): stderr: | 20221209172414613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172414613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172414613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172414613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172414613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172414613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172414625 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172414633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172414634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172414634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:17.960536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26878): Terminating (SIGTERM) 17:24:18.002291 run iperf3-srv_10.42.42.10(pid=26879): Terminating (SIGTERM) 17:24:18.043869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26882): Terminating (SIGTERM) 17:24:18.085844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26885): Terminating (SIGTERM) 17:24:18.127936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26888): Terminating (SIGTERM) 17:24:18.170062 --- ParallelTerminationStrategy: PID 26878 died... 17:24:18.190051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26878): Terminated: ok {rc=0} 17:24:18.236441 --- ParallelTerminationStrategy: PID 26879 died... 17:24:18.256021 run iperf3-srv_10.42.42.10(pid=26879): Terminated {rc=256} 17:24:18.302465 --- ParallelTerminationStrategy: PID 26882 died... 17:24:18.322435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26882): Terminated: ok {rc=0} 17:24:18.369411 --- ParallelTerminationStrategy: PID 26885 died... 17:24:18.389361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26885): Terminated: ok {rc=0} 17:24:18.436477 --- ParallelTerminationStrategy: PID 26888 died... 17:24:18.456123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26888): Terminated: ok {rc=0} 17:24:18.544122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g iperf3m4.py ---------------------------------------------- 17:24:19.695144 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:19.706676 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:19.741985 tst iperf3m4.py: using LAC 22550 17:24:19.867554 tst iperf3m4.py: using RAC 110 17:24:19.993563 tst iperf3m4.py: using CellId 22550 17:24:20.113215 tst iperf3m4.py: using BVCI 22551 17:24:20.223746 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:20.234336 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:20.244694 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:20.255640 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:20.266572 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:20.277424 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:20.288224 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:20.298988 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:20.310019 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:20.428240 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:20.548482 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:20.666054 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:20.780392 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:24:20.984010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:21.288625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26890): Launched 17:24:21.552676 run iperf3-srv_10.42.42.10(pid=26891): Launched 17:24:21.667198 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:24:21.869608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:22.172048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26892): Launched 17:24:22.436310 run iperf3-srv_10.42.42.10(pid=26893): Launched 17:24:22.550039 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:24:22.751650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:23.054610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26894): Launched 17:24:23.317515 run iperf3-srv_10.42.42.10(pid=26895): Launched 17:24:23.430800 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:24:23.631433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:23.933175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26896): Launched 17:24:24.196155 run iperf3-srv_10.42.42.10(pid=26897): Launched 17:24:24.309523 tst iperf3m4.py:8: start network... 17:24:24.510832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:24.977378 run create_hlr_db(pid=26898): Launched 17:24:25.093413 bus /gobi_6: Setting Powered False 17:24:26.153506 run create_hlr_db(pid=26898): Terminated: ok {rc=0} 17:24:26.597761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26900): Launched 17:24:26.922590 run osmo-hlr_10.42.42.2(pid=26901): Launched 17:24:27.046193 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:27.601319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26903): Launched 17:24:27.925564 run osmo-stp_10.42.42.5(pid=26904): Launched 17:24:28.049054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:28.607205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26906): Launched 17:24:28.732015 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:29.004897 run patchelf(pid=26907): Launched 17:24:29.185226 run osmo-stp_10.42.42.5(pid=26904): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26904)] 17:24:29.322362 run osmo-stp_10.42.42.5(pid=26904): stdout: | (launched: 2022-12-09_17:24:27.866700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:29.461575 run osmo-stp_10.42.42.5(pid=26904): stderr: | 20221209172428054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172428054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172428054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172428055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172428055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172428055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172428055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:29.600298 run osmo-stp_10.42.42.5(pid=26904): stdout: | (launched: 2022-12-09_17:24:27.866700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:29.732658 run osmo-stp_10.42.42.5(pid=26904): stderr: | 20221209172428054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172428054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172428054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172428055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172428055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172428055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172428055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:29.889961 run patchelf(pid=26907): Terminating (SIGINT) 17:24:30.071415 run patchelf(pid=26907): Terminated: ok {rc=0} 17:24:30.201953 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26904): Process ended prematurely: osmo-stp_10.42.42.5(pid=26904) [trial-2362↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26904)] [trial-2362↪gprs:oc2g↪iperf3m4.py:8] 17:24:30.211976 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:24:30.240771 run osmo-hlr_10.42.42.2(pid=26901): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26901)] 17:24:30.290663 run osmo-hlr_10.42.42.2(pid=26901): stdout: | (launched: 2022-12-09_17:24:26.863665) 17:24:30.342370 run osmo-hlr_10.42.42.2(pid=26901): stderr: | 20221209172427061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172427061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172427061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172427061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172427061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172427061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172427074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172427082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172427082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172427082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:30.394514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26890): Terminating (SIGTERM) 17:24:30.436226 run iperf3-srv_10.42.42.10(pid=26891): Terminating (SIGTERM) 17:24:30.478427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26892): Terminating (SIGTERM) 17:24:30.520278 run iperf3-srv_10.42.42.10(pid=26893): Terminating (SIGTERM) 17:24:30.561929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26894): Terminating (SIGTERM) 17:24:30.603660 run iperf3-srv_10.42.42.10(pid=26895): Terminating (SIGTERM) 17:24:30.645249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26896): Terminating (SIGTERM) 17:24:30.686908 run iperf3-srv_10.42.42.10(pid=26897): Terminating (SIGTERM) 17:24:30.728582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26900): Terminating (SIGTERM) 17:24:30.770400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26903): Terminating (SIGTERM) 17:24:30.812159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26906): Terminating (SIGTERM) 17:24:30.854445 --- ParallelTerminationStrategy: PID 26890 died... 17:24:30.874600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26890): Terminated: ok {rc=0} 17:24:30.922553 --- ParallelTerminationStrategy: PID 26891 died... 17:24:30.947229 run iperf3-srv_10.42.42.10(pid=26891): Terminated {rc=256} 17:24:30.994031 --- ParallelTerminationStrategy: PID 26892 died... 17:24:31.014752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26892): Terminated: ok {rc=0} 17:24:31.061982 --- ParallelTerminationStrategy: PID 26893 died... 17:24:31.082141 run iperf3-srv_10.42.42.10(pid=26893): Terminated {rc=256} 17:24:31.129762 --- ParallelTerminationStrategy: PID 26894 died... 17:24:31.149861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26894): Terminated: ok {rc=0} 17:24:31.197296 --- ParallelTerminationStrategy: PID 26895 died... 17:24:31.217518 run iperf3-srv_10.42.42.10(pid=26895): Terminated {rc=256} 17:24:31.265039 --- ParallelTerminationStrategy: PID 26896 died... 17:24:31.285346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26896): Terminated: ok {rc=0} 17:24:31.332541 --- ParallelTerminationStrategy: PID 26897 died... 17:24:31.352665 run iperf3-srv_10.42.42.10(pid=26897): Terminated {rc=256} 17:24:31.400233 --- ParallelTerminationStrategy: PID 26900 died... 17:24:31.420528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26900): Terminated: ok {rc=0} 17:24:31.467962 --- ParallelTerminationStrategy: PID 26903 died... 17:24:31.488209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26903): Terminated: ok {rc=0} 17:24:31.535542 --- ParallelTerminationStrategy: PID 26906 died... 17:24:31.555780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26906): Terminated: ok {rc=0} 17:24:31.644029 bus /gobi_4: Setting Powered False 17:24:32.742571 bus /gobi_4: Setting Powered False 17:24:33.859157 bus /gobi_1: Setting Powered False 17:24:34.958515 bus /gobi_1: Setting Powered False 17:24:36.072830 bus /gobi_0: Setting Powered False 17:24:37.171256 bus /gobi_0: Setting Powered False 17:24:38.287557 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g ping.py ---------------------------------------------- 17:24:39.389851 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:39.400875 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:39.437791 tst ping.py: using LAC 22551 17:24:39.563815 tst ping.py: using RAC 111 17:24:39.688770 tst ping.py: using CellId 22551 17:24:39.812679 tst ping.py: using BVCI 22552 17:24:39.929101 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:39.939993 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:39.950818 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:39.961586 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:39.972183 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:39.982911 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:39.993789 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:40.004355 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:40.118398 tst ping.py:19: start network... 17:24:40.317554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:40.774430 run create_hlr_db(pid=26908): Launched 17:24:40.888413 bus /gobi_6: Setting Powered False 17:24:41.948341 run create_hlr_db(pid=26908): Terminated: ok {rc=0} 17:24:42.383299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26910): Launched 17:24:42.702995 run osmo-hlr_10.42.42.2(pid=26911): Launched 17:24:42.824936 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:43.373596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26913): Launched 17:24:43.692028 run osmo-stp_10.42.42.5(pid=26914): Launched 17:24:43.813724 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:44.360916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26916): Launched 17:24:44.483949 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:44.752318 run patchelf(pid=26917): Launched 17:24:44.929767 run osmo-stp_10.42.42.5(pid=26914): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26914)] 17:24:45.064556 run osmo-stp_10.42.42.5(pid=26914): stdout: | (launched: 2022-12-09_17:24:43.634129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:45.201193 run osmo-stp_10.42.42.5(pid=26914): stderr: | 20221209172443828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172443828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172443828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172443828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172443829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172443829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172443829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:45.338394 run osmo-stp_10.42.42.5(pid=26914): stdout: | (launched: 2022-12-09_17:24:43.634129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:45.468632 run osmo-stp_10.42.42.5(pid=26914): stderr: | 20221209172443828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172443828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172443828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172443828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172443829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172443829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172443829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:45.622945 run patchelf(pid=26917): Terminating (SIGINT) 17:24:45.801295 run patchelf(pid=26917): Terminated: ok {rc=0} 17:24:45.946009 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26914): Process ended prematurely: osmo-stp_10.42.42.5(pid=26914) [trial-2362↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26914)] [trial-2362↪gprs:oc2g↪ping.py:22] 17:24:45.955998 tst ping.py:22: Test FAILED (6.6 sec) 17:24:45.985424 run osmo-hlr_10.42.42.2(pid=26911): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26911)] 17:24:46.037412 run osmo-hlr_10.42.42.2(pid=26911): stdout: | (launched: 2022-12-09_17:24:42.645236) 17:24:46.090759 run osmo-hlr_10.42.42.2(pid=26911): stderr: | 20221209172442845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172442845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172442845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172442845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172442845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172442845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172442862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172442871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172442871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172442871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:46.145026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26910): Terminating (SIGTERM) 17:24:46.189068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26913): Terminating (SIGTERM) 17:24:46.233424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26916): Terminating (SIGTERM) 17:24:46.277394 --- ParallelTerminationStrategy: PID 26910 died... 17:24:46.298202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26910): Terminated: ok {rc=0} 17:24:46.345765 --- ParallelTerminationStrategy: PID 26913 died... 17:24:46.366525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26913): Terminated: ok {rc=0} 17:24:46.414627 --- ParallelTerminationStrategy: PID 26916 died... 17:24:46.435351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26916): Terminated: ok {rc=0} 17:24:46.523910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 17:24:47.612192 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:47.623701 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:24:47.661107 tst ping_idle_ping.py: using LAC 22552 17:24:47.787626 tst ping_idle_ping.py: using RAC 112 17:24:47.913832 tst ping_idle_ping.py: using CellId 22552 17:24:48.038855 tst ping_idle_ping.py: using BVCI 22553 17:24:48.154098 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:48.164930 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:48.175721 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:48.186448 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:48.197080 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:48.207810 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:48.218619 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:24:48.229258 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:24:48.347863 tst ping_idle_ping.py:24: start network... 17:24:48.547330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:24:49.009468 run create_hlr_db(pid=26918): Launched 17:24:49.123812 bus /gobi_6: Setting Powered False 17:24:50.183055 run create_hlr_db(pid=26918): Terminated: ok {rc=0} 17:24:50.620008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26920): Launched 17:24:50.938976 run osmo-hlr_10.42.42.2(pid=26921): Launched 17:24:51.061665 run osmo-stp_10.42.42.5: Starting osmo-stp 17:24:51.611384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26923): Launched 17:24:51.930531 run osmo-stp_10.42.42.5(pid=26924): Launched 17:24:52.052032 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:24:52.601202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26926): Launched 17:24:52.723561 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:24:52.991318 run patchelf(pid=26927): Launched 17:24:53.168399 run osmo-stp_10.42.42.5(pid=26924): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26924)] 17:24:53.303008 run osmo-stp_10.42.42.5(pid=26924): stdout: | (launched: 2022-12-09_17:24:51.872548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:53.439861 run osmo-stp_10.42.42.5(pid=26924): stderr: | 20221209172452065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172452065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172452065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172452066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172452066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172452066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172452066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:53.577686 run osmo-stp_10.42.42.5(pid=26924): stdout: | (launched: 2022-12-09_17:24:51.872548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:24:53.707956 run osmo-stp_10.42.42.5(pid=26924): stderr: | 20221209172452065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172452065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172452065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172452066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172452066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172452066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172452066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:24:53.862713 run patchelf(pid=26927): Terminating (SIGINT) 17:24:54.040849 run patchelf(pid=26927): Terminated: ok {rc=0} 17:24:54.169286 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26924): Process ended prematurely: osmo-stp_10.42.42.5(pid=26924) [trial-2362↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26924)] [trial-2362↪gprs:oc2g↪ping_idle_ping.py:27] 17:24:54.178806 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:24:54.207046 run osmo-hlr_10.42.42.2(pid=26921): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26921)] 17:24:54.256669 run osmo-hlr_10.42.42.2(pid=26921): stdout: | (launched: 2022-12-09_17:24:50.880934) 17:24:54.308097 run osmo-hlr_10.42.42.2(pid=26921): stderr: | 20221209172451077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172451077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172451077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172451077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172451078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172451078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172451090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172451098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172451098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172451098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:24:54.360074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26920): Terminating (SIGTERM) 17:24:54.401548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26923): Terminating (SIGTERM) 17:24:54.443337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26926): Terminating (SIGTERM) 17:24:54.485713 --- ParallelTerminationStrategy: PID 26920 died... 17:24:54.505871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26920): Terminated: ok {rc=0} 17:24:54.552345 --- ParallelTerminationStrategy: PID 26923 died... 17:24:54.572007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26923): Terminated: ok {rc=0} 17:24:54.618469 --- ParallelTerminationStrategy: PID 26926 died... 17:24:54.638308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26926): Terminated: ok {rc=0} 17:24:54.726238 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 17:24:56.012708 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:24:56.018053 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:24:56.038643 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:24:56.076736 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:24:56.167561 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:24:56.189451 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:24:56.227159 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:24:56.810669 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:24:56.858598 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:56.869149 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:24:56.903932 tst cs_paging_gprs_active.py: using LAC 22553 17:24:57.019435 tst cs_paging_gprs_active.py: using RAC 113 17:24:57.138745 tst cs_paging_gprs_active.py: using CellId 22553 17:24:57.254877 tst cs_paging_gprs_active.py: using BVCI 22554 17:24:57.372288 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:57.383487 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:57.394395 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:57.405377 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:57.416148 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:57.427010 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:57.438119 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:57.448733 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:24:57.460080 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:24:57.577780 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:24:57.691405 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:24:57.906497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:58.224853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26931): Launched 17:24:58.500806 run iperf3-srv_10.42.42.10(pid=26932): Launched 17:24:58.620006 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:24:58.834856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:24:59.153102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26933): Launched 17:24:59.429608 run iperf3-srv_10.42.42.10(pid=26934): Launched 17:24:59.548863 tst cs_paging_gprs_active.py:38: start network... 17:24:59.763022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:00.256475 run create_hlr_db(pid=26935): Launched 17:25:00.385641 bus /gobi_6: Setting Powered False 17:25:01.446193 run create_hlr_db(pid=26935): Terminated: ok {rc=0} 17:25:01.895343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26940): Launched 17:25:02.343966 run osmo-hlr_10.42.42.2(pid=26943): Launched 17:25:02.520382 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:03.177106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26950): Launched 17:25:03.476240 run osmo-stp_10.42.42.5(pid=26951): Launched 17:25:03.591807 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:04.103557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26953): Launched 17:25:04.218558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:04.469460 run patchelf(pid=26954): Launched 17:25:04.635569 run osmo-stp_10.42.42.5(pid=26951): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26951)] 17:25:04.762833 run osmo-stp_10.42.42.5(pid=26951): stdout: | (launched: 2022-12-09_17:25:03.421737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:04.890656 run osmo-stp_10.42.42.5(pid=26951): stderr: | 20221209172503591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172503591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172503591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172503592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172503592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172503592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172503592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:05.019577 run osmo-stp_10.42.42.5(pid=26951): stdout: | (launched: 2022-12-09_17:25:03.421737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:05.141789 run osmo-stp_10.42.42.5(pid=26951): stderr: | 20221209172503591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172503591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172503591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172503592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172503592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172503592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172503592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:05.286582 run patchelf(pid=26954): Terminating (SIGINT) 17:25:05.454318 run patchelf(pid=26954): Terminated: ok {rc=0} 17:25:05.576326 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26951): Process ended prematurely: osmo-stp_10.42.42.5(pid=26951) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26951)] [trial-2362↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:25:05.585857 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:25:05.613392 run osmo-hlr_10.42.42.2(pid=26943): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26943)] 17:25:05.661126 run osmo-hlr_10.42.42.2(pid=26943): stdout: | (launched: 2022-12-09_17:25:02.263341) 17:25:05.710532 run osmo-hlr_10.42.42.2(pid=26943): stderr: | 20221209172502581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172502581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172502582 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172502582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172502582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172502582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172502608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172502620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172502621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172502621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:05.760528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26931): Terminating (SIGTERM) 17:25:05.800255 run iperf3-srv_10.42.42.10(pid=26932): Terminating (SIGTERM) 17:25:05.840035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26933): Terminating (SIGTERM) 17:25:05.879828 run iperf3-srv_10.42.42.10(pid=26934): Terminating (SIGTERM) 17:25:05.919420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26940): Terminating (SIGTERM) 17:25:05.959204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26950): Terminating (SIGTERM) 17:25:05.999294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26953): Terminating (SIGTERM) 17:25:06.039353 --- ParallelTerminationStrategy: PID 26931 died... 17:25:06.058114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26931): Terminated: ok {rc=0} 17:25:06.102445 --- ParallelTerminationStrategy: PID 26932 died... 17:25:06.120668 run iperf3-srv_10.42.42.10(pid=26932): Terminated {rc=256} 17:25:06.164707 --- ParallelTerminationStrategy: PID 26933 died... 17:25:06.183027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26933): Terminated: ok {rc=0} 17:25:06.227082 --- ParallelTerminationStrategy: PID 26934 died... 17:25:06.245301 run iperf3-srv_10.42.42.10(pid=26934): Terminated {rc=256} 17:25:06.289139 --- ParallelTerminationStrategy: PID 26940 died... 17:25:06.307397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26940): Terminated: ok {rc=0} 17:25:06.351505 --- ParallelTerminationStrategy: PID 26950 died... 17:25:06.369864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26950): Terminated: ok {rc=0} 17:25:06.413814 --- ParallelTerminationStrategy: PID 26953 died... 17:25:06.432319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26953): Terminated: ok {rc=0} 17:25:06.519163 bus /gobi_0: Setting Powered False 17:25:07.617297 bus /gobi_0: Setting Powered False 17:25:08.729926 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:25:09.878438 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:09.890399 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:09.929065 tst iperf3.py: using LAC 22554 17:25:10.055488 tst iperf3.py: using RAC 114 17:25:10.181398 tst iperf3.py: using CellId 22554 17:25:10.298267 tst iperf3.py: using BVCI 22555 17:25:10.407898 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.418564 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.429131 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.439823 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.450368 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.460911 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.471712 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.482445 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:10.493187 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:10.612208 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:25:10.827056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:11.145706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26955): Launched 17:25:11.421331 run iperf3-srv_10.42.42.10(pid=26956): Launched 17:25:11.540852 tst iperf3.py:8: start network... 17:25:11.753967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:12.243164 run create_hlr_db(pid=26957): Launched 17:25:12.372420 bus /gobi_6: Setting Powered False 17:25:13.434961 run create_hlr_db(pid=26957): Terminated: ok {rc=0} 17:25:13.879398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27136): Launched 17:25:14.203352 run osmo-hlr_10.42.42.2(pid=27173): Launched 17:25:14.414105 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:15.008643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27313): Launched 17:25:15.306702 run osmo-stp_10.42.42.5(pid=27314): Launched 17:25:15.419974 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:15.950916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27316): Launched 17:25:16.096298 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:16.425796 run patchelf(pid=27317): Launched 17:25:16.613215 run osmo-stp_10.42.42.5(pid=27314): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27314)] 17:25:16.754589 run osmo-stp_10.42.42.5(pid=27314): stdout: | (launched: 2022-12-09_17:25:15.252551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:16.897676 run osmo-stp_10.42.42.5(pid=27314): stderr: | 20221209172515422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172515422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172515423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172515423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172515425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172515425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172515425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:17.039493 run osmo-stp_10.42.42.5(pid=27314): stdout: | (launched: 2022-12-09_17:25:15.252551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:17.174751 run osmo-stp_10.42.42.5(pid=27314): stderr: | 20221209172515422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172515422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172515423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172515423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172515425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172515425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172515425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:17.331419 run patchelf(pid=27317): Terminating (SIGINT) 17:25:17.511195 run patchelf(pid=27317): Terminated: ok {rc=0} 17:25:17.641245 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27314): Process ended prematurely: osmo-stp_10.42.42.5(pid=27314) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27314)] [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 17:25:17.651768 tst iperf3.py:8: Test FAILED (7.8 sec) 17:25:17.681580 run osmo-hlr_10.42.42.2(pid=27173): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27173)] 17:25:17.732183 run osmo-hlr_10.42.42.2(pid=27173): stdout: | (launched: 2022-12-09_17:25:14.141326) 17:25:17.784801 run osmo-hlr_10.42.42.2(pid=27173): stderr: | 20221209172514445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172514445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172514445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172514445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172514445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172514445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172514469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172514479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172514479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172514479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:17.837778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26955): Terminating (SIGTERM) 17:25:17.880494 run iperf3-srv_10.42.42.10(pid=26956): Terminating (SIGTERM) 17:25:17.922943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27136): Terminating (SIGTERM) 17:25:17.965717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27313): Terminating (SIGTERM) 17:25:18.008447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27316): Terminating (SIGTERM) 17:25:18.051466 --- ParallelTerminationStrategy: PID 26955 died... 17:25:18.071506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26955): Terminated: ok {rc=0} 17:25:18.119175 --- ParallelTerminationStrategy: PID 26956 died... 17:25:18.138856 run iperf3-srv_10.42.42.10(pid=26956): Terminated {rc=256} 17:25:18.186402 --- ParallelTerminationStrategy: PID 27136 died... 17:25:18.206006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27136): Terminated: ok {rc=0} 17:25:18.253492 --- ParallelTerminationStrategy: PID 27313 died... 17:25:18.272893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27313): Terminated: ok {rc=0} 17:25:18.320536 --- ParallelTerminationStrategy: PID 27316 died... 17:25:18.340098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27316): Terminated: ok {rc=0} 17:25:18.430778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:25:19.580163 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:19.592073 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:19.631264 tst iperf3m4.py: using LAC 22555 17:25:19.758999 tst iperf3m4.py: using RAC 115 17:25:19.883944 tst iperf3m4.py: using CellId 22555 17:25:20.006828 tst iperf3m4.py: using BVCI 22556 17:25:20.123934 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.135303 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.146470 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.157932 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.169326 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.180729 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.192543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.203852 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:20.215592 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:20.333524 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:20.447005 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:20.565983 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:20.681976 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:25:20.881247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:21.179666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27319): Launched 17:25:21.438629 run iperf3-srv_10.42.42.10(pid=27320): Launched 17:25:21.550263 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:25:21.747739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:22.044704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27321): Launched 17:25:22.302919 run iperf3-srv_10.42.42.10(pid=27322): Launched 17:25:22.414787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:25:22.612508 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:22.910044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27323): Launched 17:25:23.169719 run iperf3-srv_10.42.42.10(pid=27324): Launched 17:25:23.301036 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:25:23.520245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:23.862634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27416): Launched 17:25:24.132755 run iperf3-srv_10.42.42.10(pid=27453): Launched 17:25:24.270061 tst iperf3m4.py:8: start network... 17:25:24.476226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:24.944782 run create_hlr_db(pid=27502): Launched 17:25:25.102072 bus /gobi_6: Setting Powered False 17:25:26.162139 run create_hlr_db(pid=27502): Terminated: ok {rc=0} 17:25:26.601754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27504): Launched 17:25:26.922626 run osmo-hlr_10.42.42.2(pid=27505): Launched 17:25:27.162262 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:27.865315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27507): Launched 17:25:28.189349 run osmo-stp_10.42.42.5(pid=27508): Launched 17:25:28.426542 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:29.118317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27511): Launched 17:25:29.237147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:29.494032 run patchelf(pid=27512): Launched 17:25:29.663859 run osmo-stp_10.42.42.5(pid=27508): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27508)] 17:25:29.793184 run osmo-stp_10.42.42.5(pid=27508): stdout: | (launched: 2022-12-09_17:25:28.131610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:29.923558 run osmo-stp_10.42.42.5(pid=27508): stderr: | 20221209172528460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172528460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172528460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172528460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172528467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172528467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172528467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:30.053882 run osmo-stp_10.42.42.5(pid=27508): stdout: | (launched: 2022-12-09_17:25:28.131610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:30.178294 run osmo-stp_10.42.42.5(pid=27508): stderr: | 20221209172528460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172528460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172528460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172528460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172528467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172528467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172528467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:30.325669 run patchelf(pid=27512): Terminating (SIGINT) 17:25:30.495724 run patchelf(pid=27512): Terminated: ok {rc=0} 17:25:30.618561 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27508): Process ended prematurely: osmo-stp_10.42.42.5(pid=27508) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27508)] [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 17:25:30.628302 tst iperf3m4.py:8: Test FAILED (11.1 sec) 17:25:30.656638 run osmo-hlr_10.42.42.2(pid=27505): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27505)] 17:25:30.705482 run osmo-hlr_10.42.42.2(pid=27505): stdout: | (launched: 2022-12-09_17:25:26.866181) 17:25:30.755830 run osmo-hlr_10.42.42.2(pid=27505): stderr: | 20221209172527201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172527201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172527201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172527201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172527201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172527201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172527222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172527231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172527231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172527231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:30.806749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27319): Terminating (SIGTERM) 17:25:30.865456 run iperf3-srv_10.42.42.10(pid=27320): Terminating (SIGTERM) 17:25:30.908381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27321): Terminating (SIGTERM) 17:25:30.950740 run iperf3-srv_10.42.42.10(pid=27322): Terminating (SIGTERM) 17:25:30.991949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27323): Terminating (SIGTERM) 17:25:31.033267 run iperf3-srv_10.42.42.10(pid=27324): Terminating (SIGTERM) 17:25:31.074512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27416): Terminating (SIGTERM) 17:25:31.115874 run iperf3-srv_10.42.42.10(pid=27453): Terminating (SIGTERM) 17:25:31.157063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27504): Terminating (SIGTERM) 17:25:31.199097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27507): Terminating (SIGTERM) 17:25:31.242688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27511): Terminating (SIGTERM) 17:25:31.286073 --- ParallelTerminationStrategy: PID 27319 died... 17:25:31.305572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27319): Terminated: ok {rc=0} 17:25:31.351628 --- ParallelTerminationStrategy: PID 27320 died... 17:25:31.371056 run iperf3-srv_10.42.42.10(pid=27320): Terminated {rc=256} 17:25:31.417104 --- ParallelTerminationStrategy: PID 27321 died... 17:25:31.436518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27321): Terminated: ok {rc=0} 17:25:31.482417 --- ParallelTerminationStrategy: PID 27322 died... 17:25:31.501788 run iperf3-srv_10.42.42.10(pid=27322): Terminated {rc=256} 17:25:31.547465 --- ParallelTerminationStrategy: PID 27323 died... 17:25:31.566912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27323): Terminated: ok {rc=0} 17:25:31.613134 --- ParallelTerminationStrategy: PID 27324 died... 17:25:31.632369 run iperf3-srv_10.42.42.10(pid=27324): Terminated {rc=256} 17:25:31.678090 --- ParallelTerminationStrategy: PID 27416 died... 17:25:31.697513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27416): Terminated: ok {rc=0} 17:25:31.743383 --- ParallelTerminationStrategy: PID 27453 died... 17:25:31.762887 run iperf3-srv_10.42.42.10(pid=27453): Terminated {rc=256} 17:25:31.808885 --- ParallelTerminationStrategy: PID 27504 died... 17:25:31.828340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27504): Terminated: ok {rc=0} 17:25:31.874406 --- ParallelTerminationStrategy: PID 27507 died... 17:25:31.894017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27507): Terminated: ok {rc=0} 17:25:31.939986 --- ParallelTerminationStrategy: PID 27511 died... 17:25:31.959505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27511): Terminated: ok {rc=0} 17:25:32.047605 bus /gobi_4: Setting Powered False 17:25:33.145143 bus /gobi_4: Setting Powered False 17:25:34.261293 bus /gobi_1: Setting Powered False 17:25:35.360776 bus /gobi_1: Setting Powered False 17:25:36.480115 bus /gobi_0: Setting Powered False 17:25:37.578645 bus /gobi_0: Setting Powered False 17:25:38.696275 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 17:25:39.799690 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:39.811109 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:39.852431 tst ping.py: using LAC 22556 17:25:39.976263 tst ping.py: using RAC 116 17:25:40.097908 tst ping.py: using CellId 22556 17:25:40.221760 tst ping.py: using BVCI 22557 17:25:40.335886 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.347166 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.358285 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.369342 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.380245 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.391223 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.402641 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:40.413690 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:40.526839 tst ping.py:19: start network... 17:25:40.725024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:41.183485 run create_hlr_db(pid=27513): Launched 17:25:41.298050 bus /gobi_6: Setting Powered False 17:25:42.358137 run create_hlr_db(pid=27513): Terminated: ok {rc=0} 17:25:42.771960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27515): Launched 17:25:43.069519 run osmo-hlr_10.42.42.2(pid=27516): Launched 17:25:43.182914 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:43.707375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27518): Launched 17:25:44.003961 run osmo-stp_10.42.42.5(pid=27519): Launched 17:25:44.117805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:44.629730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27521): Launched 17:25:44.743836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:44.994074 run patchelf(pid=27522): Launched 17:25:45.161901 run osmo-stp_10.42.42.5(pid=27519): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27519)] 17:25:45.288111 run osmo-stp_10.42.42.5(pid=27519): stdout: | (launched: 2022-12-09_17:25:43.949660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:45.416209 run osmo-stp_10.42.42.5(pid=27519): stderr: | 20221209172544117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172544118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172544118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172544118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172544120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172544121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172544121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:45.544688 run osmo-stp_10.42.42.5(pid=27519): stdout: | (launched: 2022-12-09_17:25:43.949660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:45.666469 run osmo-stp_10.42.42.5(pid=27519): stderr: | 20221209172544117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172544118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172544118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172544118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172544120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172544121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172544121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:45.810851 run patchelf(pid=27522): Terminating (SIGINT) 17:25:46.019736 run patchelf(pid=27522): Terminated: ok {rc=0} 17:25:46.155019 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27519): Process ended prematurely: osmo-stp_10.42.42.5(pid=27519) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27519)] [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 17:25:46.165355 tst ping.py:22: Test FAILED (6.4 sec) 17:25:46.194443 run osmo-hlr_10.42.42.2(pid=27516): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27516)] 17:25:46.246537 run osmo-hlr_10.42.42.2(pid=27516): stdout: | (launched: 2022-12-09_17:25:43.014729) 17:25:46.300238 run osmo-hlr_10.42.42.2(pid=27516): stderr: | 20221209172543192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172543192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172543192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172543193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172543193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172543193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172543205 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172543213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172543214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172543214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:46.355883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27515): Terminating (SIGTERM) 17:25:46.400876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27518): Terminating (SIGTERM) 17:25:46.447516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27521): Terminating (SIGTERM) 17:25:46.495793 --- ParallelTerminationStrategy: PID 27515 died... 17:25:46.519796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27515): Terminated: ok {rc=0} 17:25:46.575116 --- ParallelTerminationStrategy: PID 27518 died... 17:25:46.598683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27518): Terminated: ok {rc=0} 17:25:46.655702 --- ParallelTerminationStrategy: PID 27521 died... 17:25:46.678139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27521): Terminated: ok {rc=0} 17:25:46.783415 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:25:47.874077 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:47.886586 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:25:47.926466 tst ping_idle_ping.py: using LAC 22557 17:25:48.052485 tst ping_idle_ping.py: using RAC 117 17:25:48.177975 tst ping_idle_ping.py: using CellId 22557 17:25:48.306095 tst ping_idle_ping.py: using BVCI 22558 17:25:48.421709 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:48.433102 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:48.444084 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:48.455136 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:48.466034 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:48.477079 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:48.488440 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:25:48.499755 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:25:48.615707 tst ping_idle_ping.py:24: start network... 17:25:48.814633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:25:49.278372 run create_hlr_db(pid=27523): Launched 17:25:49.393763 bus /gobi_6: Setting Powered False 17:25:50.453411 run create_hlr_db(pid=27523): Terminated: ok {rc=0} 17:25:50.891016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27525): Launched 17:25:51.195366 run osmo-hlr_10.42.42.2(pid=27526): Launched 17:25:51.310557 run osmo-stp_10.42.42.5: Starting osmo-stp 17:25:51.822838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27528): Launched 17:25:52.122631 run osmo-stp_10.42.42.5(pid=27529): Launched 17:25:52.239440 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:25:52.753931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27531): Launched 17:25:52.870426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:25:53.123037 run patchelf(pid=27532): Launched 17:25:53.291329 run osmo-stp_10.42.42.5(pid=27529): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27529)] 17:25:53.418075 run osmo-stp_10.42.42.5(pid=27529): stdout: | (launched: 2022-12-09_17:25:52.067396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:53.547430 run osmo-stp_10.42.42.5(pid=27529): stderr: | 20221209172552236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172552236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172552236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172552237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172552239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172552239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172552239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:53.676230 run osmo-stp_10.42.42.5(pid=27529): stdout: | (launched: 2022-12-09_17:25:52.067396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:25:53.798482 run osmo-stp_10.42.42.5(pid=27529): stderr: | 20221209172552236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172552236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172552236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172552237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172552239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172552239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172552239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:25:53.943652 run patchelf(pid=27532): Terminating (SIGINT) 17:25:54.111161 run patchelf(pid=27532): Terminated: ok {rc=0} 17:25:54.232106 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27529): Process ended prematurely: osmo-stp_10.42.42.5(pid=27529) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27529)] [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 17:25:54.241353 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 17:25:54.269079 run osmo-hlr_10.42.42.2(pid=27526): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27526)] 17:25:54.317684 run osmo-hlr_10.42.42.2(pid=27526): stdout: | (launched: 2022-12-09_17:25:51.140421) 17:25:54.368135 run osmo-hlr_10.42.42.2(pid=27526): stderr: | 20221209172551317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172551317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172551317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172551317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172551317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172551318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172551329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172551338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172551338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172551338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:25:54.418631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27525): Terminating (SIGTERM) 17:25:54.459174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27528): Terminating (SIGTERM) 17:25:54.499615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27531): Terminating (SIGTERM) 17:25:54.540439 --- ParallelTerminationStrategy: PID 27525 died... 17:25:54.559922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27525): Terminated: ok {rc=0} 17:25:54.605088 --- ParallelTerminationStrategy: PID 27528 died... 17:25:54.623910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27528): Terminated: ok {rc=0} 17:25:54.668919 --- ParallelTerminationStrategy: PID 27531 died... 17:25:54.688207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27531): Terminated: ok {rc=0} 17:25:54.775965 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:25:56.066736 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:25:56.072818 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:25:56.093650 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:25:56.133772 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:25:56.220538 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:25:56.241834 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:25:56.279800 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:25:56.870977 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:25:56.920381 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:56.931281 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:25:56.986630 tst cs_paging_gprs_active.py: using LAC 22558 17:25:57.109936 tst cs_paging_gprs_active.py: using RAC 118 17:25:57.229216 tst cs_paging_gprs_active.py: using CellId 22558 17:25:57.346547 tst cs_paging_gprs_active.py: using BVCI 22559 17:25:57.456610 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:57.467628 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:57.478164 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:57.489216 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:57.500033 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:57.510835 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:57.521877 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:57.532904 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:25:57.543932 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:25:57.663380 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:25:57.779191 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:25:57.985101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:58.291169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27540): Launched 17:25:58.557017 run iperf3-srv_10.42.42.10(pid=27541): Launched 17:25:58.672269 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:25:58.876789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:25:59.183149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27542): Launched 17:25:59.449416 run iperf3-srv_10.42.42.10(pid=27543): Launched 17:25:59.564560 tst cs_paging_gprs_active.py:38: start network... 17:25:59.769020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:00.240809 run create_hlr_db(pid=27544): Launched 17:26:00.357521 bus /gobi_6: Setting Powered False 17:26:01.442107 run create_hlr_db(pid=27544): Terminated: ok {rc=0} 17:26:01.950290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27546): Launched 17:26:02.274236 run osmo-hlr_10.42.42.2(pid=27547): Launched 17:26:02.394076 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:02.935242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27549): Launched 17:26:03.240270 run osmo-stp_10.42.42.5(pid=27550): Launched 17:26:03.357623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:03.883514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27552): Launched 17:26:04.000248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:04.257096 run patchelf(pid=27553): Launched 17:26:04.426701 run osmo-stp_10.42.42.5(pid=27550): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27550)] 17:26:04.555959 run osmo-stp_10.42.42.5(pid=27550): stdout: | (launched: 2022-12-09_17:26:03.184275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:04.686425 run osmo-stp_10.42.42.5(pid=27550): stderr: | 20221209172603356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172603356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172603357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172603357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172603357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172603357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172603358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:04.816582 run osmo-stp_10.42.42.5(pid=27550): stdout: | (launched: 2022-12-09_17:26:03.184275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:04.940916 run osmo-stp_10.42.42.5(pid=27550): stderr: | 20221209172603356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172603356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172603357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172603357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172603357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172603357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172603358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:05.088144 run patchelf(pid=27553): Terminating (SIGINT) 17:26:05.259860 run patchelf(pid=27553): Terminated: ok {rc=0} 17:26:05.384018 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27550): Process ended prematurely: osmo-stp_10.42.42.5(pid=27550) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27550)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:26:05.393512 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 17:26:05.421195 run osmo-hlr_10.42.42.2(pid=27547): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27547)] 17:26:05.469708 run osmo-hlr_10.42.42.2(pid=27547): stdout: | (launched: 2022-12-09_17:26:02.217583) 17:26:05.519772 run osmo-hlr_10.42.42.2(pid=27547): stderr: | 20221209172602415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172602416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172602416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172602416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172602416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172602416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172602426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172602435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172602435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172602435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:05.570166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27540): Terminating (SIGTERM) 17:26:05.610546 run iperf3-srv_10.42.42.10(pid=27541): Terminating (SIGTERM) 17:26:05.650717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27542): Terminating (SIGTERM) 17:26:05.690935 run iperf3-srv_10.42.42.10(pid=27543): Terminating (SIGTERM) 17:26:05.730967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27546): Terminating (SIGTERM) 17:26:05.771475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27549): Terminating (SIGTERM) 17:26:05.811648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27552): Terminating (SIGTERM) 17:26:05.851989 --- ParallelTerminationStrategy: PID 27540 died... 17:26:05.871166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27540): Terminated: ok {rc=0} 17:26:05.915648 --- ParallelTerminationStrategy: PID 27541 died... 17:26:05.934168 run iperf3-srv_10.42.42.10(pid=27541): Terminated {rc=256} 17:26:05.978992 --- ParallelTerminationStrategy: PID 27542 died... 17:26:05.997511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27542): Terminated: ok {rc=0} 17:26:06.042260 --- ParallelTerminationStrategy: PID 27543 died... 17:26:06.060723 run iperf3-srv_10.42.42.10(pid=27543): Terminated {rc=256} 17:26:06.104782 --- ParallelTerminationStrategy: PID 27546 died... 17:26:06.123480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27546): Terminated: ok {rc=0} 17:26:06.168353 --- ParallelTerminationStrategy: PID 27549 died... 17:26:06.186941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27549): Terminated: ok {rc=0} 17:26:06.231257 --- ParallelTerminationStrategy: PID 27552 died... 17:26:06.249844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27552): Terminated: ok {rc=0} 17:26:06.336219 bus /gobi_0: Setting Powered False 17:26:07.435523 bus /gobi_0: Setting Powered False 17:26:08.551216 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:26:09.701798 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:09.713829 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:09.774605 tst iperf3.py: using LAC 22559 17:26:09.902715 tst iperf3.py: using RAC 119 17:26:10.030371 tst iperf3.py: using CellId 22559 17:26:10.161296 tst iperf3.py: using BVCI 22560 17:26:10.273770 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.284779 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.295461 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.306622 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.317663 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.328787 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.340170 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.353954 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:10.365115 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:10.483766 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:26:10.702169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:11.025713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27554): Launched 17:26:11.308047 run iperf3-srv_10.42.42.10(pid=27555): Launched 17:26:11.430012 tst iperf3.py:8: start network... 17:26:11.648122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:12.148569 run create_hlr_db(pid=27556): Launched 17:26:12.280014 bus /gobi_6: Setting Powered False 17:26:13.344361 run create_hlr_db(pid=27556): Terminated: ok {rc=0} 17:26:13.777256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27558): Launched 17:26:14.080736 run osmo-hlr_10.42.42.2(pid=27559): Launched 17:26:14.196709 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:14.723678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27561): Launched 17:26:15.027122 run osmo-stp_10.42.42.5(pid=27562): Launched 17:26:15.143644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:15.678290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27564): Launched 17:26:15.796805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:16.063840 run patchelf(pid=27565): Launched 17:26:16.254801 run osmo-stp_10.42.42.5(pid=27562): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27562)] 17:26:16.396683 run osmo-stp_10.42.42.5(pid=27562): stdout: | (launched: 2022-12-09_17:26:14.971663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:16.539521 run osmo-stp_10.42.42.5(pid=27562): stderr: | 20221209172615145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172615145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172615145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172615146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172615146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172615146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172615146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:16.683487 run osmo-stp_10.42.42.5(pid=27562): stdout: | (launched: 2022-12-09_17:26:14.971663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:16.820925 run osmo-stp_10.42.42.5(pid=27562): stderr: | 20221209172615145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172615145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172615145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172615146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172615146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172615146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172615146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:16.984555 run patchelf(pid=27565): Terminating (SIGINT) 17:26:17.170360 run patchelf(pid=27565): Terminated: ok {rc=0} 17:26:17.295230 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27562): Process ended prematurely: osmo-stp_10.42.42.5(pid=27562) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27562)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 17:26:17.305310 tst iperf3.py:8: Test FAILED (7.6 sec) 17:26:17.334523 run osmo-hlr_10.42.42.2(pid=27559): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27559)] 17:26:17.383568 run osmo-hlr_10.42.42.2(pid=27559): stdout: | (launched: 2022-12-09_17:26:14.024881) 17:26:17.434338 run osmo-hlr_10.42.42.2(pid=27559): stderr: | 20221209172614199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172614199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172614199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172614199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172614199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172614200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172614211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172614222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172614222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172614222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:17.485273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27554): Terminating (SIGTERM) 17:26:17.526410 run iperf3-srv_10.42.42.10(pid=27555): Terminating (SIGTERM) 17:26:17.567337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27558): Terminating (SIGTERM) 17:26:17.608364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27561): Terminating (SIGTERM) 17:26:17.648471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27564): Terminating (SIGTERM) 17:26:17.690950 --- ParallelTerminationStrategy: PID 27554 died... 17:26:17.710153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27554): Terminated: ok {rc=0} 17:26:17.756497 --- ParallelTerminationStrategy: PID 27555 died... 17:26:17.775288 run iperf3-srv_10.42.42.10(pid=27555): Terminated {rc=256} 17:26:17.821177 --- ParallelTerminationStrategy: PID 27558 died... 17:26:17.839676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27558): Terminated: ok {rc=0} 17:26:17.885103 --- ParallelTerminationStrategy: PID 27561 died... 17:26:17.903689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27561): Terminated: ok {rc=0} 17:26:17.948607 --- ParallelTerminationStrategy: PID 27564 died... 17:26:17.967331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27564): Terminated: ok {rc=0} 17:26:18.052868 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:26:19.196351 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.211714 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:19.269120 tst iperf3m4.py: using LAC 22560 17:26:19.396341 tst iperf3m4.py: using RAC 120 17:26:19.523128 tst iperf3m4.py: using CellId 22560 17:26:19.650490 tst iperf3m4.py: using BVCI 22561 17:26:19.767914 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.779467 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.790738 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.802214 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.813544 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.824830 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.836485 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.847808 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:19.859239 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:19.977491 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:20.094112 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:20.214526 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:20.332874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:26:20.535860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:20.840103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27566): Launched 17:26:21.105387 run iperf3-srv_10.42.42.10(pid=27567): Launched 17:26:21.219930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:26:21.422972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:21.727415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27568): Launched 17:26:21.994206 run iperf3-srv_10.42.42.10(pid=27569): Launched 17:26:22.110252 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:26:22.311872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:22.616466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27570): Launched 17:26:22.882135 run iperf3-srv_10.42.42.10(pid=27571): Launched 17:26:22.998747 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:26:23.201167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:23.506913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27572): Launched 17:26:23.774237 run iperf3-srv_10.42.42.10(pid=27573): Launched 17:26:23.890920 tst iperf3m4.py:8: start network... 17:26:24.094074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:24.564364 run create_hlr_db(pid=27574): Launched 17:26:24.681636 bus /gobi_6: Setting Powered False 17:26:25.741815 run create_hlr_db(pid=27574): Terminated: ok {rc=0} 17:26:26.166334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27576): Launched 17:26:26.470281 run osmo-hlr_10.42.42.2(pid=27577): Launched 17:26:26.586039 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:27.128386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27579): Launched 17:26:27.432823 run osmo-stp_10.42.42.5(pid=27580): Launched 17:26:27.549332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:28.072734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27582): Launched 17:26:28.190328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:28.446909 run patchelf(pid=27583): Launched 17:26:28.617181 run osmo-stp_10.42.42.5(pid=27580): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27580)] 17:26:28.746463 run osmo-stp_10.42.42.5(pid=27580): stdout: | (launched: 2022-12-09_17:26:27.376628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:28.877219 run osmo-stp_10.42.42.5(pid=27580): stderr: | 20221209172627550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172627550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172627551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172627551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172627551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172627552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172627552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:29.007633 run osmo-stp_10.42.42.5(pid=27580): stdout: | (launched: 2022-12-09_17:26:27.376628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:29.132234 run osmo-stp_10.42.42.5(pid=27580): stderr: | 20221209172627550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172627550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172627551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172627551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172627551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172627552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172627552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:29.280261 run patchelf(pid=27583): Terminating (SIGINT) 17:26:29.451980 run patchelf(pid=27583): Terminated: ok {rc=0} 17:26:29.575514 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27580): Process ended prematurely: osmo-stp_10.42.42.5(pid=27580) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27580)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:26:29.585117 tst iperf3m4.py:8: Test FAILED (10.4 sec) 17:26:29.613476 run osmo-hlr_10.42.42.2(pid=27577): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27577)] 17:26:29.662021 run osmo-hlr_10.42.42.2(pid=27577): stdout: | (launched: 2022-12-09_17:26:26.414619) 17:26:29.712098 run osmo-hlr_10.42.42.2(pid=27577): stderr: | 20221209172626594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172626594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172626594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172626594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172626594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172626594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172626606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172626615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172626615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172626615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:29.762500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27566): Terminating (SIGTERM) 17:26:29.803076 run iperf3-srv_10.42.42.10(pid=27567): Terminating (SIGTERM) 17:26:29.843302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27568): Terminating (SIGTERM) 17:26:29.883807 run iperf3-srv_10.42.42.10(pid=27569): Terminating (SIGTERM) 17:26:29.924055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27570): Terminating (SIGTERM) 17:26:29.964525 run iperf3-srv_10.42.42.10(pid=27571): Terminating (SIGTERM) 17:26:30.004901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27572): Terminating (SIGTERM) 17:26:30.045242 run iperf3-srv_10.42.42.10(pid=27573): Terminating (SIGTERM) 17:26:30.085629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27576): Terminating (SIGTERM) 17:26:30.126055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27579): Terminating (SIGTERM) 17:26:30.166450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27582): Terminating (SIGTERM) 17:26:30.207147 --- ParallelTerminationStrategy: PID 27566 died... 17:26:30.226544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27566): Terminated: ok {rc=0} 17:26:30.271578 --- ParallelTerminationStrategy: PID 27567 died... 17:26:30.290212 run iperf3-srv_10.42.42.10(pid=27567): Terminated {rc=256} 17:26:30.335085 --- ParallelTerminationStrategy: PID 27568 died... 17:26:30.353834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27568): Terminated: ok {rc=0} 17:26:30.398882 --- ParallelTerminationStrategy: PID 27569 died... 17:26:30.417615 run iperf3-srv_10.42.42.10(pid=27569): Terminated {rc=256} 17:26:30.462191 --- ParallelTerminationStrategy: PID 27570 died... 17:26:30.480879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27570): Terminated: ok {rc=0} 17:26:30.525575 --- ParallelTerminationStrategy: PID 27571 died... 17:26:30.544210 run iperf3-srv_10.42.42.10(pid=27571): Terminated {rc=256} 17:26:30.588933 --- ParallelTerminationStrategy: PID 27572 died... 17:26:30.608043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27572): Terminated: ok {rc=0} 17:26:30.653023 --- ParallelTerminationStrategy: PID 27573 died... 17:26:30.671742 run iperf3-srv_10.42.42.10(pid=27573): Terminated {rc=256} 17:26:30.716937 --- ParallelTerminationStrategy: PID 27576 died... 17:26:30.735819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27576): Terminated: ok {rc=0} 17:26:30.781006 --- ParallelTerminationStrategy: PID 27579 died... 17:26:30.800304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27579): Terminated: ok {rc=0} 17:26:30.848485 --- ParallelTerminationStrategy: PID 27582 died... 17:26:30.868279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27582): Terminated: ok {rc=0} 17:26:30.956655 bus /gobi_4: Setting Powered False 17:26:32.060717 bus /gobi_4: Setting Powered False 17:26:33.178683 bus /gobi_1: Setting Powered False 17:26:34.279038 bus /gobi_1: Setting Powered False 17:26:35.394486 bus /gobi_0: Setting Powered False 17:26:36.494858 bus /gobi_0: Setting Powered False 17:26:37.613414 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:26:38.719062 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:38.731178 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:38.790357 tst ping.py: using LAC 22561 17:26:38.916069 tst ping.py: using RAC 121 17:26:39.039809 tst ping.py: using CellId 22561 17:26:39.164001 tst ping.py: using BVCI 22562 17:26:39.278754 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.290087 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.301180 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.312197 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.323303 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.334339 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.345846 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:39.356871 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:39.472158 tst ping.py:19: start network... 17:26:39.673765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:40.148589 run create_hlr_db(pid=27584): Launched 17:26:40.280141 bus /gobi_6: Setting Powered False 17:26:41.343983 run create_hlr_db(pid=27584): Terminated: ok {rc=0} 17:26:41.789146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27586): Launched 17:26:42.108682 run osmo-hlr_10.42.42.2(pid=27587): Launched 17:26:42.231227 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:42.781159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27589): Launched 17:26:43.099990 run osmo-stp_10.42.42.5(pid=27590): Launched 17:26:43.221191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:43.774509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27592): Launched 17:26:43.898031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:44.166338 run patchelf(pid=27593): Launched 17:26:44.345219 run osmo-stp_10.42.42.5(pid=27590): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27590)] 17:26:44.480020 run osmo-stp_10.42.42.5(pid=27590): stdout: | (launched: 2022-12-09_17:26:43.042009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:44.617868 run osmo-stp_10.42.42.5(pid=27590): stderr: | 20221209172643234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172643234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172643235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172643235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172643235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172643236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172643236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:44.755111 run osmo-stp_10.42.42.5(pid=27590): stdout: | (launched: 2022-12-09_17:26:43.042009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:44.885446 run osmo-stp_10.42.42.5(pid=27590): stderr: | 20221209172643234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172643234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172643235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172643235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172643235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172643236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172643236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:45.039854 run patchelf(pid=27593): Terminating (SIGINT) 17:26:45.218523 run patchelf(pid=27593): Terminated: ok {rc=0} 17:26:45.347306 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27590): Process ended prematurely: osmo-stp_10.42.42.5(pid=27590) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27590)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 17:26:45.357047 tst ping.py:22: Test FAILED (6.6 sec) 17:26:45.385061 run osmo-hlr_10.42.42.2(pid=27587): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27587)] 17:26:45.435031 run osmo-hlr_10.42.42.2(pid=27587): stdout: | (launched: 2022-12-09_17:26:42.050497) 17:26:45.486877 run osmo-hlr_10.42.42.2(pid=27587): stderr: | 20221209172642252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172642252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172642252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172642252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172642252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172642252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172642266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172642274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172642274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172642274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:45.539884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27586): Terminating (SIGTERM) 17:26:45.582360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27589): Terminating (SIGTERM) 17:26:45.624651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27592): Terminating (SIGTERM) 17:26:45.667100 --- ParallelTerminationStrategy: PID 27586 died... 17:26:45.687234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27586): Terminated: ok {rc=0} 17:26:45.734055 --- ParallelTerminationStrategy: PID 27589 died... 17:26:45.753959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27589): Terminated: ok {rc=0} 17:26:45.800400 --- ParallelTerminationStrategy: PID 27592 died... 17:26:45.820208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27592): Terminated: ok {rc=0} 17:26:45.937368 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:26:47.034666 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.052086 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:26:47.122885 tst ping_idle_ping.py: using LAC 22562 17:26:47.265415 tst ping_idle_ping.py: using RAC 122 17:26:47.390512 tst ping_idle_ping.py: using CellId 22562 17:26:47.508700 tst ping_idle_ping.py: using BVCI 22563 17:26:47.617943 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.628895 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.639629 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.651173 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.662546 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.674271 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.686158 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:26:47.698080 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:26:47.817116 tst ping_idle_ping.py:24: start network... 17:26:48.033092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:48.530564 run create_hlr_db(pid=27594): Launched 17:26:48.663558 bus /gobi_6: Setting Powered False 17:26:49.726680 run create_hlr_db(pid=27594): Terminated: ok {rc=0} 17:26:50.158315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27596): Launched 17:26:50.457505 run osmo-hlr_10.42.42.2(pid=27597): Launched 17:26:50.573757 run osmo-stp_10.42.42.5: Starting osmo-stp 17:26:51.106538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27599): Launched 17:26:51.406025 run osmo-stp_10.42.42.5(pid=27600): Launched 17:26:51.521150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:26:52.037007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27602): Launched 17:26:52.152173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:26:52.405402 run patchelf(pid=27603): Launched 17:26:52.573192 run osmo-stp_10.42.42.5(pid=27600): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27600)] 17:26:52.700196 run osmo-stp_10.42.42.5(pid=27600): stdout: | (launched: 2022-12-09_17:26:51.351033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:52.829668 run osmo-stp_10.42.42.5(pid=27600): stderr: | 20221209172651519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172651519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172651520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172651520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172651520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172651521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172651521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:52.959095 run osmo-stp_10.42.42.5(pid=27600): stdout: | (launched: 2022-12-09_17:26:51.351033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:26:53.081928 run osmo-stp_10.42.42.5(pid=27600): stderr: | 20221209172651519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172651519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172651520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172651520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172651520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172651521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172651521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:26:53.227215 run patchelf(pid=27603): Terminating (SIGINT) 17:26:53.395307 run patchelf(pid=27603): Terminated: ok {rc=0} 17:26:53.516774 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27600): Process ended prematurely: osmo-stp_10.42.42.5(pid=27600) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27600)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:26:53.526091 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:26:53.553416 run osmo-hlr_10.42.42.2(pid=27597): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27597)] 17:26:53.602896 run osmo-hlr_10.42.42.2(pid=27597): stdout: | (launched: 2022-12-09_17:26:50.402683) 17:26:53.653348 run osmo-hlr_10.42.42.2(pid=27597): stderr: | 20221209172650578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172650578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172650578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172650578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172650578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172650578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172650590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172650598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172650599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172650599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:26:53.704212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27596): Terminating (SIGTERM) 17:26:53.745081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27599): Terminating (SIGTERM) 17:26:53.786018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27602): Terminating (SIGTERM) 17:26:53.827168 --- ParallelTerminationStrategy: PID 27596 died... 17:26:53.846469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27596): Terminated: ok {rc=0} 17:26:53.891959 --- ParallelTerminationStrategy: PID 27599 died... 17:26:53.911055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27599): Terminated: ok {rc=0} 17:26:53.956425 --- ParallelTerminationStrategy: PID 27602 died... 17:26:53.975737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27602): Terminated: ok {rc=0} 17:26:54.060695 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:26:55.361704 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:26:55.368754 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:26:55.390478 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:26:55.430005 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:26:55.517963 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:26:55.539194 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:26:55.578563 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:26:56.173926 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:26:56.226440 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.237891 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:26:56.296721 tst cs_paging_gprs_active.py: using LAC 22563 17:26:56.427184 tst cs_paging_gprs_active.py: using RAC 123 17:26:56.556351 tst cs_paging_gprs_active.py: using CellId 22563 17:26:56.685531 tst cs_paging_gprs_active.py: using BVCI 22564 17:26:56.803088 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.814440 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.825479 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.836638 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.847709 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.858914 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.870445 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.881815 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:26:56.893308 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:26:57.009378 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:26:57.128054 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:26:57.348493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:57.676793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27607): Launched 17:26:57.961330 run iperf3-srv_10.42.42.10(pid=27608): Launched 17:26:58.083945 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:26:58.304043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:26:58.632071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27609): Launched 17:26:58.915768 run iperf3-srv_10.42.42.10(pid=27610): Launched 17:26:59.038433 tst cs_paging_gprs_active.py:38: start network... 17:26:59.258361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:26:59.764626 run create_hlr_db(pid=27611): Launched 17:26:59.897107 bus /gobi_6: Setting Powered False 17:27:00.975016 run create_hlr_db(pid=27611): Terminated: ok {rc=0} 17:27:01.502222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27613): Launched 17:27:01.848608 run osmo-hlr_10.42.42.2(pid=27614): Launched 17:27:02.063322 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:02.732461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27616): Launched 17:27:03.038313 run osmo-stp_10.42.42.5(pid=27617): Launched 17:27:03.154943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:03.678820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27619): Launched 17:27:03.795838 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:04.052871 run patchelf(pid=27620): Launched 17:27:04.222970 run osmo-stp_10.42.42.5(pid=27617): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27617)] 17:27:04.352531 run osmo-stp_10.42.42.5(pid=27617): stdout: | (launched: 2022-12-09_17:27:02.982584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:04.482947 run osmo-stp_10.42.42.5(pid=27617): stderr: | 20221209172703153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172703153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172703153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172703153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172703154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172703154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172703154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:04.613454 run osmo-stp_10.42.42.5(pid=27617): stdout: | (launched: 2022-12-09_17:27:02.982584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:04.738027 run osmo-stp_10.42.42.5(pid=27617): stderr: | 20221209172703153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172703153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172703153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172703153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172703154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172703154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172703154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:04.885826 run patchelf(pid=27620): Terminating (SIGINT) 17:27:05.056551 run patchelf(pid=27620): Terminated: ok {rc=0} 17:27:05.180889 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27617): Process ended prematurely: osmo-stp_10.42.42.5(pid=27617) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27617)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:27:05.190666 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 17:27:05.218439 run osmo-hlr_10.42.42.2(pid=27614): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27614)] 17:27:05.266508 run osmo-hlr_10.42.42.2(pid=27614): stdout: | (launched: 2022-12-09_17:27:01.775097) 17:27:05.316256 run osmo-hlr_10.42.42.2(pid=27614): stderr: | 20221209172702135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172702135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172702135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172702135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172702135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172702135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172702158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172702183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172702183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172702183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:05.366252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27607): Terminating (SIGTERM) 17:27:05.406099 run iperf3-srv_10.42.42.10(pid=27608): Terminating (SIGTERM) 17:27:05.445852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27609): Terminating (SIGTERM) 17:27:05.485750 run iperf3-srv_10.42.42.10(pid=27610): Terminating (SIGTERM) 17:27:05.525705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27613): Terminating (SIGTERM) 17:27:05.565803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27616): Terminating (SIGTERM) 17:27:05.605928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27619): Terminating (SIGTERM) 17:27:05.645953 --- ParallelTerminationStrategy: PID 27607 died... 17:27:05.664882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27607): Terminated: ok {rc=0} 17:27:05.709701 --- ParallelTerminationStrategy: PID 27608 died... 17:27:05.728118 run iperf3-srv_10.42.42.10(pid=27608): Terminated {rc=256} 17:27:05.772399 --- ParallelTerminationStrategy: PID 27609 died... 17:27:05.791278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27609): Terminated: ok {rc=0} 17:27:05.835452 --- ParallelTerminationStrategy: PID 27610 died... 17:27:05.853839 run iperf3-srv_10.42.42.10(pid=27610): Terminated {rc=256} 17:27:05.898331 --- ParallelTerminationStrategy: PID 27613 died... 17:27:05.916815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27613): Terminated: ok {rc=0} 17:27:05.961372 --- ParallelTerminationStrategy: PID 27616 died... 17:27:05.979890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27616): Terminated: ok {rc=0} 17:27:06.024036 --- ParallelTerminationStrategy: PID 27619 died... 17:27:06.042584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27619): Terminated: ok {rc=0} 17:27:06.129912 bus /gobi_0: Setting Powered False 17:27:07.229678 bus /gobi_0: Setting Powered False 17:27:08.346636 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:27:09.493067 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:09.504478 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:09.565353 tst iperf3.py: using LAC 22564 17:27:09.692916 tst iperf3.py: using RAC 124 17:27:09.820208 tst iperf3.py: using CellId 22564 17:27:09.946675 tst iperf3.py: using BVCI 22565 17:27:10.063862 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:10.075436 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:10.086670 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:10.097744 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:10.108757 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:10.119870 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:10.131081 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:10.142049 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:10.153191 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:10.273101 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:27:10.491328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:10.817152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27621): Launched 17:27:11.099870 run iperf3-srv_10.42.42.10(pid=27622): Launched 17:27:11.223311 tst iperf3.py:8: start network... 17:27:11.440755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:11.943897 run create_hlr_db(pid=27623): Launched 17:27:12.075819 bus /gobi_6: Setting Powered False 17:27:13.140562 run create_hlr_db(pid=27623): Terminated: ok {rc=0} 17:27:13.577442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27625): Launched 17:27:13.882541 run osmo-hlr_10.42.42.2(pid=27626): Launched 17:27:13.998143 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:14.537621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27628): Launched 17:27:14.841711 run osmo-stp_10.42.42.5(pid=27629): Launched 17:27:14.957480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:15.480541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27631): Launched 17:27:15.597811 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:15.859315 run patchelf(pid=27632): Launched 17:27:16.072231 run osmo-stp_10.42.42.5(pid=27629): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27629)] 17:27:16.213340 run osmo-stp_10.42.42.5(pid=27629): stdout: | (launched: 2022-12-09_17:27:14.785738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:16.348142 run osmo-stp_10.42.42.5(pid=27629): stderr: | 20221209172714958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172714959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172714959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172714959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172714960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172714960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172714960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:16.482022 run osmo-stp_10.42.42.5(pid=27629): stdout: | (launched: 2022-12-09_17:27:14.785738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:16.608872 run osmo-stp_10.42.42.5(pid=27629): stderr: | 20221209172714958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172714959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172714959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172714959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172714960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172714960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172714960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:16.763478 run patchelf(pid=27632): Terminating (SIGINT) 17:27:16.952194 run patchelf(pid=27632): Terminated: ok {rc=0} 17:27:17.086480 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27629): Process ended prematurely: osmo-stp_10.42.42.5(pid=27629) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27629)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 17:27:17.097711 tst iperf3.py:8: Test FAILED (7.6 sec) 17:27:17.128044 run osmo-hlr_10.42.42.2(pid=27626): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27626)] 17:27:17.180294 run osmo-hlr_10.42.42.2(pid=27626): stdout: | (launched: 2022-12-09_17:27:13.826962) 17:27:17.234082 run osmo-hlr_10.42.42.2(pid=27626): stderr: | 20221209172714006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172714006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172714006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172714006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172714006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172714006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172714018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172714027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172714027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172714027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:17.288018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27621): Terminating (SIGTERM) 17:27:17.330718 run iperf3-srv_10.42.42.10(pid=27622): Terminating (SIGTERM) 17:27:17.373607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27625): Terminating (SIGTERM) 17:27:17.416149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27628): Terminating (SIGTERM) 17:27:17.458355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27631): Terminating (SIGTERM) 17:27:17.501065 --- ParallelTerminationStrategy: PID 27621 died... 17:27:17.521322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27621): Terminated: ok {rc=0} 17:27:17.568810 --- ParallelTerminationStrategy: PID 27622 died... 17:27:17.589313 run iperf3-srv_10.42.42.10(pid=27622): Terminated {rc=256} 17:27:17.636372 --- ParallelTerminationStrategy: PID 27625 died... 17:27:17.656332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27625): Terminated: ok {rc=0} 17:27:17.703337 --- ParallelTerminationStrategy: PID 27628 died... 17:27:17.723219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27628): Terminated: ok {rc=0} 17:27:17.770456 --- ParallelTerminationStrategy: PID 27631 died... 17:27:17.790576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27631): Terminated: ok {rc=0} 17:27:17.879862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:27:19.028417 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.039826 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:19.094943 tst iperf3m4.py: using LAC 22565 17:27:19.213615 tst iperf3m4.py: using RAC 125 17:27:19.331380 tst iperf3m4.py: using CellId 22565 17:27:19.451474 tst iperf3m4.py: using BVCI 22566 17:27:19.561893 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.572732 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.583428 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.594365 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.605092 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.615965 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.626966 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.637764 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:19.648747 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:19.768415 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:19.890783 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:20.007021 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:20.128659 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:27:20.348374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:20.674356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27633): Launched 17:27:20.958132 run iperf3-srv_10.42.42.10(pid=27634): Launched 17:27:21.082271 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:27:21.300271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:21.626569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27635): Launched 17:27:21.909667 run iperf3-srv_10.42.42.10(pid=27636): Launched 17:27:22.032785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:27:22.250690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:22.576623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27637): Launched 17:27:22.859584 run iperf3-srv_10.42.42.10(pid=27638): Launched 17:27:22.981322 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:27:23.198917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:27:23.524559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27639): Launched 17:27:23.807850 run iperf3-srv_10.42.42.10(pid=27640): Launched 17:27:23.930472 tst iperf3m4.py:8: start network... 17:27:24.148634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:24.653601 run create_hlr_db(pid=27641): Launched 17:27:24.787444 bus /gobi_6: Setting Powered False 17:27:25.851599 run create_hlr_db(pid=27641): Terminated: ok {rc=0} 17:27:26.287295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27643): Launched 17:27:26.593410 run osmo-hlr_10.42.42.2(pid=27644): Launched 17:27:26.711718 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:27.236702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27646): Launched 17:27:27.564686 run osmo-stp_10.42.42.5(pid=27647): Launched 17:27:27.688629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:28.249963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27649): Launched 17:27:28.375245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:28.650988 run patchelf(pid=27650): Launched 17:27:28.833915 run osmo-stp_10.42.42.5(pid=27647): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27647)] 17:27:28.971598 run osmo-stp_10.42.42.5(pid=27647): stdout: | (launched: 2022-12-09_17:27:27.505137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:29.110928 run osmo-stp_10.42.42.5(pid=27647): stderr: | 20221209172727698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172727698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172727698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172727699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172727699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172727699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172727699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:29.250139 run osmo-stp_10.42.42.5(pid=27647): stdout: | (launched: 2022-12-09_17:27:27.505137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:29.383244 run osmo-stp_10.42.42.5(pid=27647): stderr: | 20221209172727698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172727698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172727698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172727699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172727699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172727699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172727699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:29.541334 run patchelf(pid=27650): Terminating (SIGINT) 17:27:29.723092 run patchelf(pid=27650): Terminated: ok {rc=0} 17:27:29.854112 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27647): Process ended prematurely: osmo-stp_10.42.42.5(pid=27647) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27647)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:27:29.864418 tst iperf3m4.py:8: Test FAILED (10.9 sec) 17:27:29.894074 run osmo-hlr_10.42.42.2(pid=27644): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27644)] 17:27:29.944761 run osmo-hlr_10.42.42.2(pid=27644): stdout: | (launched: 2022-12-09_17:27:26.537357) 17:27:29.997261 run osmo-hlr_10.42.42.2(pid=27644): stderr: | 20221209172726715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172726715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172726715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172726715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172726715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172726715 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172726730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172726738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172726739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172726739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:30.049988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27633): Terminating (SIGTERM) 17:27:30.092500 run iperf3-srv_10.42.42.10(pid=27634): Terminating (SIGTERM) 17:27:30.135089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27635): Terminating (SIGTERM) 17:27:30.177577 run iperf3-srv_10.42.42.10(pid=27636): Terminating (SIGTERM) 17:27:30.220022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27637): Terminating (SIGTERM) 17:27:30.262831 run iperf3-srv_10.42.42.10(pid=27638): Terminating (SIGTERM) 17:27:30.305299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27639): Terminating (SIGTERM) 17:27:30.347898 run iperf3-srv_10.42.42.10(pid=27640): Terminating (SIGTERM) 17:27:30.390473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27643): Terminating (SIGTERM) 17:27:30.433041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27646): Terminating (SIGTERM) 17:27:30.475532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27649): Terminating (SIGTERM) 17:27:30.518186 --- ParallelTerminationStrategy: PID 27633 died... 17:27:30.538870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27633): Terminated: ok {rc=0} 17:27:30.586007 --- ParallelTerminationStrategy: PID 27634 died... 17:27:30.605765 run iperf3-srv_10.42.42.10(pid=27634): Terminated {rc=256} 17:27:30.652244 --- ParallelTerminationStrategy: PID 27635 died... 17:27:30.672093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27635): Terminated: ok {rc=0} 17:27:30.719429 --- ParallelTerminationStrategy: PID 27636 died... 17:27:30.739000 run iperf3-srv_10.42.42.10(pid=27636): Terminated {rc=256} 17:27:30.785446 --- ParallelTerminationStrategy: PID 27637 died... 17:27:30.805083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27637): Terminated: ok {rc=0} 17:27:30.856507 --- ParallelTerminationStrategy: PID 27638 died... 17:27:30.876593 run iperf3-srv_10.42.42.10(pid=27638): Terminated {rc=256} 17:27:30.923700 --- ParallelTerminationStrategy: PID 27639 died... 17:27:30.943511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27639): Terminated: ok {rc=0} 17:27:30.990789 --- ParallelTerminationStrategy: PID 27640 died... 17:27:31.010961 run iperf3-srv_10.42.42.10(pid=27640): Terminated {rc=256} 17:27:31.057877 --- ParallelTerminationStrategy: PID 27643 died... 17:27:31.078032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27643): Terminated: ok {rc=0} 17:27:31.125299 --- ParallelTerminationStrategy: PID 27646 died... 17:27:31.145458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27646): Terminated: ok {rc=0} 17:27:31.192565 --- ParallelTerminationStrategy: PID 27649 died... 17:27:31.212846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27649): Terminated: ok {rc=0} 17:27:31.306717 bus /gobi_4: Setting Powered False 17:27:32.417770 bus /gobi_4: Setting Powered False 17:27:33.535370 bus /gobi_1: Setting Powered False 17:27:34.635758 bus /gobi_1: Setting Powered False 17:27:35.752853 bus /gobi_0: Setting Powered False 17:27:36.852397 bus /gobi_0: Setting Powered False 17:27:37.970692 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:27:39.074882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:39.086367 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:39.144315 tst ping.py: using LAC 22566 17:27:39.269087 tst ping.py: using RAC 126 17:27:39.393431 tst ping.py: using CellId 22566 17:27:39.518597 tst ping.py: using BVCI 22567 17:27:39.634831 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:39.646282 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:39.657341 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:39.668376 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:39.679842 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:39.690907 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:39.702215 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:39.713311 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:39.825776 tst ping.py:19: start network... 17:27:40.026411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:40.487047 run create_hlr_db(pid=27653): Launched 17:27:40.602516 bus /gobi_6: Setting Powered False 17:27:41.662004 run create_hlr_db(pid=27653): Terminated: ok {rc=0} 17:27:42.100921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27655): Launched 17:27:42.419127 run osmo-hlr_10.42.42.2(pid=27656): Launched 17:27:42.542154 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:43.098363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27658): Launched 17:27:43.417691 run osmo-stp_10.42.42.5(pid=27659): Launched 17:27:43.541720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:44.093283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27661): Launched 17:27:44.215017 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:44.483379 run patchelf(pid=27662): Launched 17:27:44.661238 run osmo-stp_10.42.42.5(pid=27659): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27659)] 17:27:44.796382 run osmo-stp_10.42.42.5(pid=27659): stdout: | (launched: 2022-12-09_17:27:43.359545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:44.933698 run osmo-stp_10.42.42.5(pid=27659): stderr: | 20221209172743552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172743552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172743553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172743554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172743554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172743554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172743554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:45.070723 run osmo-stp_10.42.42.5(pid=27659): stdout: | (launched: 2022-12-09_17:27:43.359545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:45.201212 run osmo-stp_10.42.42.5(pid=27659): stderr: | 20221209172743552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172743552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172743553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172743554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172743554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172743554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172743554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:45.355534 run patchelf(pid=27662): Terminating (SIGINT) 17:27:45.533328 run patchelf(pid=27662): Terminated: ok {rc=0} 17:27:45.662005 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27659): Process ended prematurely: osmo-stp_10.42.42.5(pid=27659) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27659)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 17:27:45.671724 tst ping.py:22: Test FAILED (6.6 sec) 17:27:45.700135 run osmo-hlr_10.42.42.2(pid=27656): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27656)] 17:27:45.750963 run osmo-hlr_10.42.42.2(pid=27656): stdout: | (launched: 2022-12-09_17:27:42.361027) 17:27:45.803535 run osmo-hlr_10.42.42.2(pid=27656): stderr: | 20221209172742560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172742560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172742560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172742560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172742560 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172742560 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172742573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172742581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172742581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172742581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:45.863658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27655): Terminating (SIGTERM) 17:27:45.913740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27658): Terminating (SIGTERM) 17:27:45.960366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27661): Terminating (SIGTERM) 17:27:46.006360 --- ParallelTerminationStrategy: PID 27655 died... 17:27:46.026678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27655): Terminated: ok {rc=0} 17:27:46.076313 --- ParallelTerminationStrategy: PID 27658 died... 17:27:46.096294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27658): Terminated: ok {rc=0} 17:27:46.145313 --- ParallelTerminationStrategy: PID 27661 died... 17:27:46.165356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27661): Terminated: ok {rc=0} 17:27:46.254289 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:27:47.341701 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.354003 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:27:47.413399 tst ping_idle_ping.py: using LAC 22567 17:27:47.540257 tst ping_idle_ping.py: using RAC 127 17:27:47.664923 tst ping_idle_ping.py: using CellId 22567 17:27:47.789685 tst ping_idle_ping.py: using BVCI 22568 17:27:47.899731 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.910891 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.921996 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.933731 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.945478 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.956822 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.968781 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:27:47.980551 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:27:48.096499 tst ping_idle_ping.py:24: start network... 17:27:48.298513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:48.768122 run create_hlr_db(pid=27663): Launched 17:27:48.882505 bus /gobi_6: Setting Powered False 17:27:49.941653 run create_hlr_db(pid=27663): Terminated: ok {rc=0} 17:27:50.381288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27665): Launched 17:27:50.702989 run osmo-hlr_10.42.42.2(pid=27666): Launched 17:27:50.824701 run osmo-stp_10.42.42.5: Starting osmo-stp 17:27:51.377936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27668): Launched 17:27:51.697816 run osmo-stp_10.42.42.5(pid=27669): Launched 17:27:51.820408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:27:52.386347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27671): Launched 17:27:52.510564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:27:52.780256 run patchelf(pid=27672): Launched 17:27:52.958685 run osmo-stp_10.42.42.5(pid=27669): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27669)] 17:27:53.094248 run osmo-stp_10.42.42.5(pid=27669): stdout: | (launched: 2022-12-09_17:27:51.639639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:53.231814 run osmo-stp_10.42.42.5(pid=27669): stderr: | 20221209172751830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172751830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172751831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172751831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172751831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172751832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172751832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:53.369707 run osmo-stp_10.42.42.5(pid=27669): stdout: | (launched: 2022-12-09_17:27:51.639639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:27:53.500823 run osmo-stp_10.42.42.5(pid=27669): stderr: | 20221209172751830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172751830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172751831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172751831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172751831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172751832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172751832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:27:53.656545 run patchelf(pid=27672): Terminating (SIGINT) 17:27:53.835377 run patchelf(pid=27672): Terminated: ok {rc=0} 17:27:53.964708 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27669): Process ended prematurely: osmo-stp_10.42.42.5(pid=27669) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27669)] [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:27:53.974495 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:27:54.002599 run osmo-hlr_10.42.42.2(pid=27666): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27666)] 17:27:54.053082 run osmo-hlr_10.42.42.2(pid=27666): stdout: | (launched: 2022-12-09_17:27:50.644273) 17:27:54.105898 run osmo-hlr_10.42.42.2(pid=27666): stderr: | 20221209172750842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172750842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172750842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172750842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172750842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172750843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172750855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172750863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172750864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172750864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:27:54.159097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27665): Terminating (SIGTERM) 17:27:54.201389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27668): Terminating (SIGTERM) 17:27:54.243800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27671): Terminating (SIGTERM) 17:27:54.286747 --- ParallelTerminationStrategy: PID 27665 died... 17:27:54.306916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27665): Terminated: ok {rc=0} 17:27:54.353674 --- ParallelTerminationStrategy: PID 27668 died... 17:27:54.373482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27668): Terminated: ok {rc=0} 17:27:54.419829 --- ParallelTerminationStrategy: PID 27671 died... 17:27:54.439469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27671): Terminated: ok {rc=0} 17:27:54.527617 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:27:55.823755 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:27:55.831508 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:27:55.853261 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:27:55.888339 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:27:55.943279 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:27:55.964570 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:27:55.999427 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:27:56.557359 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:27:56.563047 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:56.574523 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:27:56.632802 tst switch_tch_pdch.py: using LAC 22568 17:27:56.758512 tst switch_tch_pdch.py: using RAC 128 17:27:56.884762 tst switch_tch_pdch.py: using CellId 22568 17:27:57.010533 tst switch_tch_pdch.py: using BVCI 22569 17:27:57.127336 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:57.139077 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:57.150465 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:57.161868 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:57.173111 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:57.184466 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:57.196027 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:27:57.207402 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:27:57.322008 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:27:57.439185 tst switch_tch_pdch.py:51: start network... 17:27:57.639919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:27:58.103121 run create_hlr_db(pid=27676): Launched 17:27:58.218892 bus /gobi_6: Setting Powered False 17:27:59.278520 run create_hlr_db(pid=27676): Terminated: ok {rc=0} 17:27:59.716652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27678): Launched 17:28:00.034428 run osmo-hlr_10.42.42.2(pid=27679): Launched 17:28:00.158392 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:00.712397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27681): Launched 17:28:01.066095 run osmo-stp_10.42.42.5(pid=27682): Launched 17:28:01.287378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:28:02.073060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27684): Launched 17:28:02.207012 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:28:02.465761 run patchelf(pid=27685): Launched 17:28:02.634251 run osmo-stp_10.42.42.5(pid=27682): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27682)] 17:28:02.761604 run osmo-stp_10.42.42.5(pid=27682): stdout: | (launched: 2022-12-09_17:28:01.001023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:02.890974 run osmo-stp_10.42.42.5(pid=27682): stderr: | 20221209172801384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172801384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172801384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172801388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172801390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172801391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172801391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:03.020186 run osmo-stp_10.42.42.5(pid=27682): stdout: | (launched: 2022-12-09_17:28:01.001023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:03.142792 run osmo-stp_10.42.42.5(pid=27682): stderr: | 20221209172801384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172801384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172801384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172801388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172801390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172801391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172801391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:03.287866 run patchelf(pid=27685): Terminating (SIGINT) 17:28:03.455335 run patchelf(pid=27685): Terminated: ok {rc=0} 17:28:03.576652 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27682): Process ended prematurely: osmo-stp_10.42.42.5(pid=27682) [trial-2362↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27682)] [trial-2362↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:28:03.585660 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 17:28:03.613642 run osmo-hlr_10.42.42.2(pid=27679): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27679)] 17:28:03.661903 run osmo-hlr_10.42.42.2(pid=27679): stdout: | (launched: 2022-12-09_17:27:59.976556) 17:28:03.712083 run osmo-hlr_10.42.42.2(pid=27679): stderr: | 20221209172800176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172800176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172800176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172800176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172800176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172800176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172800188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172800197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172800197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172800197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:03.762582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27678): Terminating (SIGTERM) 17:28:03.803118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27681): Terminating (SIGTERM) 17:28:03.843680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27684): Terminating (SIGTERM) 17:28:03.884351 --- ParallelTerminationStrategy: PID 27678 died... 17:28:03.903442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27678): Terminated: ok {rc=0} 17:28:03.948772 --- ParallelTerminationStrategy: PID 27681 died... 17:28:03.967199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27681): Terminated: ok {rc=0} 17:28:04.012517 --- ParallelTerminationStrategy: PID 27684 died... 17:28:04.031035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27684): Terminated: ok {rc=0} 17:28:04.118541 bus /gobi_0: Setting Powered False 17:28:05.217405 bus /gobi_0: Setting Powered False 17:28:06.334167 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:28:07.569943 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:07.575649 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:28:07.596771 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:28:07.631505 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:28:07.683730 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:28:07.703991 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:28:07.737975 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:28:08.292033 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:28:08.297154 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:08.307880 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:28:08.364143 tst switch_tch_pdch.py: using LAC 22569 17:28:08.483109 tst switch_tch_pdch.py: using RAC 129 17:28:08.601680 tst switch_tch_pdch.py: using CellId 22569 17:28:08.726527 tst switch_tch_pdch.py: using BVCI 22570 17:28:08.843664 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:08.855174 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:08.866497 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:08.877901 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:08.889043 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:08.900059 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:08.911423 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:28:08.922555 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:28:09.038092 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:28:09.155112 tst switch_tch_pdch.py:51: start network... 17:28:09.355762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:09.791678 run create_hlr_db(pid=27690): Launched 17:28:09.906812 bus /gobi_6: Setting Powered False 17:28:10.966070 run create_hlr_db(pid=27690): Terminated: ok {rc=0} 17:28:11.357398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27692): Launched 17:28:11.655465 run osmo-hlr_10.42.42.2(pid=27693): Launched 17:28:11.769477 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:12.274581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27695): Launched 17:28:12.574677 run osmo-stp_10.42.42.5(pid=27696): Launched 17:28:12.691270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:28:13.181555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27698): Launched 17:28:13.296119 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:28:13.547547 run patchelf(pid=27699): Launched 17:28:13.712854 run osmo-stp_10.42.42.5(pid=27696): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27696)] 17:28:13.839165 run osmo-stp_10.42.42.5(pid=27696): stdout: | (launched: 2022-12-09_17:28:12.519740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:13.967161 run osmo-stp_10.42.42.5(pid=27696): stderr: | 20221209172812689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172812689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172812690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172812690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172812690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172812690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172812691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:14.095531 run osmo-stp_10.42.42.5(pid=27696): stdout: | (launched: 2022-12-09_17:28:12.519740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:14.217588 run osmo-stp_10.42.42.5(pid=27696): stderr: | 20221209172812689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172812689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172812690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172812690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172812690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172812690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172812691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:14.374108 run patchelf(pid=27699): Terminating (SIGINT) 17:28:14.551575 run patchelf(pid=27699): Terminated: ok {rc=0} 17:28:14.680840 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27696): Process ended prematurely: osmo-stp_10.42.42.5(pid=27696) [trial-2362↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27696)] [trial-2362↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:28:14.690820 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 17:28:14.718875 run osmo-hlr_10.42.42.2(pid=27693): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27693)] 17:28:14.769249 run osmo-hlr_10.42.42.2(pid=27693): stdout: | (launched: 2022-12-09_17:28:11.600437) 17:28:14.821515 run osmo-hlr_10.42.42.2(pid=27693): stderr: | 20221209172811775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172811775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172811775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172811775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172811775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172811775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172811787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172811796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172811796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172811796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:14.874244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27692): Terminating (SIGTERM) 17:28:14.916989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27695): Terminating (SIGTERM) 17:28:14.959341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27698): Terminating (SIGTERM) 17:28:15.001605 --- ParallelTerminationStrategy: PID 27692 died... 17:28:15.021509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27692): Terminated: ok {rc=0} 17:28:15.067862 --- ParallelTerminationStrategy: PID 27695 died... 17:28:15.087683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27695): Terminated: ok {rc=0} 17:28:15.134103 --- ParallelTerminationStrategy: PID 27698 died... 17:28:15.153720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27698): Terminated: ok {rc=0} 17:28:15.241788 bus /gobi_0: Setting Powered False 17:28:16.340048 bus /gobi_0: Setting Powered False 17:28:17.455350 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_sms:trx-b200 --------------------------------------------------------------------- 17:28:18.685227 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:18.688942 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:18.722049 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 17:28:18.728638 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 17:28:18.781391 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:18.815002 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 17:28:18.821860 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 17:28:19.360092 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 17:28:19.365088 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 17:28:19.376044 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 17:28:19.424008 tst mo_mt_sms.py: using LAC 22570 17:28:19.540080 tst mo_mt_sms.py: using RAC 130 17:28:19.657408 tst mo_mt_sms.py: using CellId 22570 17:28:19.782579 tst mo_mt_sms.py: using BVCI 22571 17:28:19.897790 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:20.013838 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:20.126840 tst mo_mt_sms.py:9: start nitb and bts... 17:28:20.327502 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:28:20.936586 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27703): Launched 17:28:21.236634 run osmo-nitb_10.42.42.2(pid=27704): Launched 17:28:21.402287 run osmo-nitb_10.42.42.2(pid=27704): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27704)] 17:28:21.536456 run osmo-nitb_10.42.42.2(pid=27704): stdout: | (launched: 2022-12-09_17:28:21.182024) 17:28:21.672558 run osmo-nitb_10.42.42.2(pid=27704): stderr: | (launched: 2022-12-09_17:28:21.226246) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:21.808261 run osmo-nitb_10.42.42.2(pid=27704): stdout: | (launched: 2022-12-09_17:28:21.182024) 17:28:21.938329 run osmo-nitb_10.42.42.2(pid=27704): stderr: | (launched: 2022-12-09_17:28:21.226246) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27704): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27704) [trial-2362↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27704)] 17:28:22.349921 tst osmo-nitb_10.42.42.2(pid=27704): stdout: | (launched: 2022-12-09_17:28:21.182024) 17:28:22.470514 tst osmo-nitb_10.42.42.2(pid=27704): stderr: | (launched: 2022-12-09_17:28:21.226246) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:22.612321 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27704): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27704) [trial-2362↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27704)] [trial-2362↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 17:28:22.621099 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 17:28:22.627981 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27703): Terminating (SIGTERM) 17:28:22.837765 --- ParallelTerminationStrategy: PID 27703 died... 17:28:22.858901 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27703): Terminated: ok {rc=0} 17:28:22.946194 bus /sierra_3: Setting Powered False 17:28:24.047849 bus /sierra_3: Setting Powered False 17:28:25.167068 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 sms:trx-b200 --------------------------------------------------------------------- 17:28:26.369954 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:26.374946 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:26.408725 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:28:26.434769 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 17:28:26.493999 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:26.526735 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:28:26.552714 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 17:28:27.095974 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 17:28:27.100826 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:27.113859 tst sms:trx-b200: Using 1 x bts (candidates: 1) 17:28:27.160570 tst mo_mt_sms.py: using LAC 22571 17:28:27.277180 tst mo_mt_sms.py: using RAC 131 17:28:27.393678 tst mo_mt_sms.py: using CellId 22571 17:28:27.520407 tst mo_mt_sms.py: using BVCI 22572 17:28:27.636892 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:27.648183 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:27.659266 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:27.670881 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:27.682523 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:27.694066 tst sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:27.811859 tst sms:trx-b200: Using 1 x modem (candidates: 2) 17:28:27.928902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:28.425285 run create_hlr_db(pid=27708): Launched 17:28:28.557743 bus /sierra_2: Setting Powered False 17:28:29.621424 run create_hlr_db(pid=27708): Terminated: ok {rc=0} 17:28:30.050017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27710): Launched 17:28:30.350294 run osmo-hlr_10.42.42.2(pid=27711): Launched 17:28:30.464523 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:31.029458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27713): Launched 17:28:31.347902 run osmo-stp_10.42.42.5(pid=27714): Launched 17:28:31.527462 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:32.438232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27716): Launched 17:28:32.758981 run osmo-msc_10.42.42.6(pid=27717): Launched 17:28:32.937192 run osmo-stp_10.42.42.5(pid=27714): ERR: Terminated: ERROR {rc=1} [trial-2362↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27714)] 17:28:33.070549 run osmo-stp_10.42.42.5(pid=27714): stdout: | (launched: 2022-12-09_17:28:31.290489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:33.204523 run osmo-stp_10.42.42.5(pid=27714): stderr: | 20221209172831671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172831671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172831672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172831673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172831674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172831675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172831675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:33.337947 run osmo-stp_10.42.42.5(pid=27714): stdout: | (launched: 2022-12-09_17:28:31.290489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:33.464507 run osmo-stp_10.42.42.5(pid=27714): stderr: | 20221209172831671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172831671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172831672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172831673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172831674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172831675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172831675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:33.616754 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27714): Process ended prematurely: osmo-stp_10.42.42.5(pid=27714) [trial-2362↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27714)] [trial-2362↪sms:trx-b200↪mo_mt_sms.py:16] 17:28:33.625724 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 17:28:33.653184 run osmo-hlr_10.42.42.2(pid=27711): ERR: Terminated: ERROR {rc=237} [trial-2362↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27711)] 17:28:33.703796 run osmo-hlr_10.42.42.2(pid=27711): stdout: | (launched: 2022-12-09_17:28:30.294278) 17:28:33.756143 run osmo-hlr_10.42.42.2(pid=27711): stderr: | 20221209172830472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172830472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172830472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172830472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172830472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172830472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172830484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172830492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172830493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172830493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:33.828835 run osmo-msc_10.42.42.6(pid=27717): ERR: Terminated: ERROR {rc=2} [trial-2362↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27717)] 17:28:33.879374 run osmo-msc_10.42.42.6(pid=27717): stdout: | (launched: 2022-12-09_17:28:32.701025) 17:28:33.931473 run osmo-msc_10.42.42.6(pid=27717): stderr: | 20221209172833024 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172833024 DLGLOBAL DEBUG validating counter group 0x7f9288a7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172833024 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172833024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172833024 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172833024 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172833028 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172833028 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172833028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172833028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:33.983787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27710): Terminating (SIGTERM) 17:28:34.025728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27713): Terminating (SIGTERM) 17:28:34.067835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27716): Terminating (SIGTERM) 17:28:34.110051 --- ParallelTerminationStrategy: PID 27710 died... 17:28:34.130023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27710): Terminated: ok {rc=0} 17:28:34.176376 --- ParallelTerminationStrategy: PID 27713 died... 17:28:34.195983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27713): Terminated: ok {rc=0} 17:28:34.242787 --- ParallelTerminationStrategy: PID 27716 died... 17:28:34.262499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27716): Terminated: ok {rc=0} 17:28:34.350969 bus /sierra_3: Setting Powered False 17:28:35.451196 bus /sierra_3: Setting Powered False 17:28:36.567689 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-b200 --------------------------------------------------------------------- 17:28:37.799283 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:37.803310 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:37.837358 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 17:28:37.844300 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 17:28:37.880287 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:37.914748 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 17:28:37.921765 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 17:28:38.440804 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 17:28:38.447181 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 17:28:38.458458 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 17:28:38.506849 tst assert_extension.py: using LAC 22572 17:28:38.629707 tst assert_extension.py: using RAC 132 17:28:38.746290 tst assert_extension.py: using CellId 22572 17:28:38.861493 tst assert_extension.py: using BVCI 22573 17:28:38.972245 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 17:28:39.089391 tst assert_extension.py:10: start nitb and bts... 17:28:39.304643 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:28:39.956180 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27722): Launched 17:28:40.276577 run osmo-nitb_10.42.42.2(pid=27723): Launched 17:28:40.453188 run osmo-nitb_10.42.42.2(pid=27723): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27723)] 17:28:40.596327 run osmo-nitb_10.42.42.2(pid=27723): stdout: | (launched: 2022-12-09_17:28:40.218133) 17:28:40.740709 run osmo-nitb_10.42.42.2(pid=27723): stderr: | (launched: 2022-12-09_17:28:40.265957) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:40.884631 run osmo-nitb_10.42.42.2(pid=27723): stdout: | (launched: 2022-12-09_17:28:40.218133) 17:28:41.022901 run osmo-nitb_10.42.42.2(pid=27723): stderr: | (launched: 2022-12-09_17:28:40.265957) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27723): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27723) [trial-2362↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27723)] 17:28:41.396460 tst osmo-nitb_10.42.42.2(pid=27723): stdout: | (launched: 2022-12-09_17:28:40.218133) 17:28:41.524345 tst osmo-nitb_10.42.42.2(pid=27723): stderr: | (launched: 2022-12-09_17:28:40.265957) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:28:41.676232 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27723): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27723) [trial-2362↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27723)] [trial-2362↪nitb_ussd:trx-b200↪assert_extension.py:12] 17:28:41.685357 tst assert_extension.py:12: Test FAILED (3.2 sec) 17:28:41.692406 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27722): Terminating (SIGTERM) 17:28:41.903101 --- ParallelTerminationStrategy: PID 27722 died... 17:28:41.924745 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27722): Terminated: ok {rc=0} 17:28:42.012686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 ussd:trx-b200 --------------------------------------------------------------------- 17:28:43.194130 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:43.198768 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 17:28:43.232372 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:28:43.259387 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 17:28:43.295677 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 17:28:43.329268 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:28:43.356185 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 17:28:43.886442 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 ussd:trx-b200 assert_extension.py ---------------------------------------------- 17:28:43.891536 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:43.902511 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 17:28:43.951001 tst assert_extension.py: using LAC 22573 17:28:44.076456 tst assert_extension.py: using RAC 133 17:28:44.200507 tst assert_extension.py: using CellId 22573 17:28:44.325002 tst assert_extension.py: using BVCI 22574 17:28:44.439987 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:44.450952 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:44.462039 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:44.473028 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:44.483931 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 17:28:44.494806 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 17:28:44.609322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:45.070182 run create_hlr_db(pid=27727): Launched 17:28:45.186700 bus /sierra_2: Setting Powered False 17:28:46.249327 run create_hlr_db(pid=27727): Terminated: ok {rc=0} 17:28:46.708500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27729): Launched 17:28:47.046054 run osmo-hlr_10.42.42.2(pid=27730): Launched 17:28:47.198752 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:47.754405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27732): Launched 17:28:48.072754 run osmo-stp_10.42.42.5(pid=27733): Launched 17:28:48.193369 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:48.767947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27735): Launched 17:28:49.086506 run osmo-msc_10.42.42.6(pid=27736): Launched 17:28:49.266027 run osmo-stp_10.42.42.5(pid=27733): ERR: Terminated: ERROR {rc=1} [trial-2362↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27733)] 17:28:49.400869 run osmo-stp_10.42.42.5(pid=27733): stdout: | (launched: 2022-12-09_17:28:48.014494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:49.535889 run osmo-stp_10.42.42.5(pid=27733): stderr: | 20221209172848206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172848206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172848206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172848206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172848207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172848207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172848207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:49.669935 run osmo-stp_10.42.42.5(pid=27733): stdout: | (launched: 2022-12-09_17:28:48.014494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:49.796282 run osmo-stp_10.42.42.5(pid=27733): stderr: | 20221209172848206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172848206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172848206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172848206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172848207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172848207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172848207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:49.947946 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27733): Process ended prematurely: osmo-stp_10.42.42.5(pid=27733) [trial-2362↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27733)] [trial-2362↪ussd:trx-b200↪assert_extension.py:17] 17:28:49.957447 tst assert_extension.py:17: Test FAILED (6.1 sec) 17:28:49.985204 run osmo-hlr_10.42.42.2(pid=27730): ERR: Terminated: ERROR {rc=237} [trial-2362↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27730)] 17:28:50.035848 run osmo-hlr_10.42.42.2(pid=27730): stdout: | (launched: 2022-12-09_17:28:46.986599) 17:28:50.088256 run osmo-hlr_10.42.42.2(pid=27730): stderr: | 20221209172847211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172847211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172847211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172847211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172847211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172847211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172847224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172847234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172847234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172847234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:50.161159 run osmo-msc_10.42.42.6(pid=27736): ERR: Terminated: ERROR {rc=2} [trial-2362↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27736)] 17:28:50.211455 run osmo-msc_10.42.42.6(pid=27736): stdout: | (launched: 2022-12-09_17:28:49.028221) 17:28:50.263685 run osmo-msc_10.42.42.6(pid=27736): stderr: | 20221209172849350 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172849351 DLGLOBAL DEBUG validating counter group 0x7f447f56cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172849351 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172849351 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172849351 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172849351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172849353 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172849353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172849354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172849354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:50.316338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27729): Terminating (SIGTERM) 17:28:50.358633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27732): Terminating (SIGTERM) 17:28:50.400871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27735): Terminating (SIGTERM) 17:28:50.443368 --- ParallelTerminationStrategy: PID 27729 died... 17:28:50.463518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27729): Terminated: ok {rc=0} 17:28:50.511104 --- ParallelTerminationStrategy: PID 27732 died... 17:28:50.530839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27732): Terminated: ok {rc=0} 17:28:50.577388 --- ParallelTerminationStrategy: PID 27735 died... 17:28:50.596776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27735): Terminated: ok {rc=0} 17:28:50.685112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:28:51.904215 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:28:51.911287 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:28:51.944908 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:28:51.971947 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:28:52.026700 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:28:52.059676 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:28:52.086138 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:28:52.638894 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:28:52.691412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:52.702868 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:28:52.773779 tst mo_mt_call.py: using LAC 22574 17:28:52.905570 tst mo_mt_call.py: using RAC 134 17:28:53.033398 tst mo_mt_call.py: using CellId 22574 17:28:53.161910 tst mo_mt_call.py: using BVCI 22575 17:28:53.280836 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:53.292326 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:53.303606 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:53.314955 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:53.326312 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:28:53.337625 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:28:53.452479 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:28:53.572289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:28:54.078416 run create_hlr_db(pid=27741): Launched 17:28:54.212233 bus /sierra_2: Setting Powered False 17:28:55.276803 run create_hlr_db(pid=27741): Terminated: ok {rc=0} 17:28:55.713283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27743): Launched 17:28:56.018562 run osmo-hlr_10.42.42.2(pid=27744): Launched 17:28:56.135420 run osmo-stp_10.42.42.5: Starting osmo-stp 17:28:56.675504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27746): Launched 17:28:56.980169 run osmo-stp_10.42.42.5(pid=27747): Launched 17:28:57.096112 run osmo-msc_10.42.42.6: Starting osmo-msc 17:28:57.647126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27749): Launched 17:28:57.954036 run osmo-msc_10.42.42.6(pid=27750): Launched 17:28:58.124670 run osmo-stp_10.42.42.5(pid=27747): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27747)] 17:28:58.254188 run osmo-stp_10.42.42.5(pid=27747): stdout: | (launched: 2022-12-09_17:28:56.924417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:58.383252 run osmo-stp_10.42.42.5(pid=27747): stderr: | 20221209172857095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172857096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172857096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172857096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172857097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172857097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172857097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:58.510801 run osmo-stp_10.42.42.5(pid=27747): stdout: | (launched: 2022-12-09_17:28:56.924417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:28:58.632583 run osmo-stp_10.42.42.5(pid=27747): stderr: | 20221209172857095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172857096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172857096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172857096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172857097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172857097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172857097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:28:58.778274 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27747): Process ended prematurely: osmo-stp_10.42.42.5(pid=27747) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27747)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:28:58.787415 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:28:58.814620 run osmo-hlr_10.42.42.2(pid=27744): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27744)] 17:28:58.863232 run osmo-hlr_10.42.42.2(pid=27744): stdout: | (launched: 2022-12-09_17:28:55.963032) 17:28:58.913809 run osmo-hlr_10.42.42.2(pid=27744): stderr: | 20221209172856140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172856140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172856140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172856140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172856140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172856141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172856152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172856161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172856161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172856161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:28:58.984004 run osmo-msc_10.42.42.6(pid=27750): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27750)] 17:28:59.032746 run osmo-msc_10.42.42.6(pid=27750): stdout: | (launched: 2022-12-09_17:28:57.897082) 17:28:59.083232 run osmo-msc_10.42.42.6(pid=27750): stderr: | 20221209172858171 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172858171 DLGLOBAL DEBUG validating counter group 0x7fdc536f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172858172 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172858172 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172858172 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172858172 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172858174 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172858174 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172858174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172858174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:28:59.134452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27743): Terminating (SIGTERM) 17:28:59.174972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27746): Terminating (SIGTERM) 17:28:59.215593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27749): Terminating (SIGTERM) 17:28:59.256221 --- ParallelTerminationStrategy: PID 27743 died... 17:28:59.275447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27743): Terminated: ok {rc=0} 17:28:59.320443 --- ParallelTerminationStrategy: PID 27746 died... 17:28:59.339347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27746): Terminated: ok {rc=0} 17:28:59.384373 --- ParallelTerminationStrategy: PID 27749 died... 17:28:59.403187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27749): Terminated: ok {rc=0} 17:28:59.490900 bus /sierra_3: Setting Powered False 17:29:00.590294 bus /sierra_3: Setting Powered False 17:29:01.717332 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:29:02.882141 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:02.893831 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:29:02.963451 tst mo_mt_call_osmux.py: using LAC 22575 17:29:03.084759 tst mo_mt_call_osmux.py: using RAC 135 17:29:03.204426 tst mo_mt_call_osmux.py: using CellId 22575 17:29:03.323414 tst mo_mt_call_osmux.py: using BVCI 22576 17:29:03.433467 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:03.444443 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:03.455315 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:03.466426 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:03.477609 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:29:03.488922 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:29:03.610807 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:29:03.728324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:04.197827 run create_hlr_db(pid=27752): Launched 17:29:04.313934 bus /sierra_2: Setting Powered False 17:29:05.374430 run create_hlr_db(pid=27752): Terminated: ok {rc=0} 17:29:05.799818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27754): Launched 17:29:06.105450 run osmo-hlr_10.42.42.2(pid=27755): Launched 17:29:06.222332 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:06.758057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27757): Launched 17:29:07.062403 run osmo-stp_10.42.42.5(pid=27758): Launched 17:29:07.178664 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:07.727319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27760): Launched 17:29:08.031939 run osmo-msc_10.42.42.6(pid=27761): Launched 17:29:08.201568 run osmo-stp_10.42.42.5(pid=27758): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27758)] 17:29:08.330300 run osmo-stp_10.42.42.5(pid=27758): stdout: | (launched: 2022-12-09_17:29:07.006659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:08.458972 run osmo-stp_10.42.42.5(pid=27758): stderr: | 20221209172907179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172907179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172907179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172907179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172907180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172907180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172907180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:08.585757 run osmo-stp_10.42.42.5(pid=27758): stdout: | (launched: 2022-12-09_17:29:07.006659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:08.706336 run osmo-stp_10.42.42.5(pid=27758): stderr: | 20221209172907179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172907179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172907179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172907179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172907180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172907180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172907180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:08.850995 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27758): Process ended prematurely: osmo-stp_10.42.42.5(pid=27758) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27758)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:29:08.859965 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:29:08.886812 run osmo-hlr_10.42.42.2(pid=27755): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27755)] 17:29:08.935100 run osmo-hlr_10.42.42.2(pid=27755): stdout: | (launched: 2022-12-09_17:29:06.048933) 17:29:08.985117 run osmo-hlr_10.42.42.2(pid=27755): stderr: | 20221209172906229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172906229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172906229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172906229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172906229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172906229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172906241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172906250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172906250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172906250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:09.054515 run osmo-msc_10.42.42.6(pid=27761): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27761)] 17:29:09.102451 run osmo-msc_10.42.42.6(pid=27761): stdout: | (launched: 2022-12-09_17:29:07.975773) 17:29:09.152016 run osmo-msc_10.42.42.6(pid=27761): stderr: | 20221209172908251 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172908251 DLGLOBAL DEBUG validating counter group 0x7f0bb4ca4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172908251 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172908251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172908251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172908252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172908254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172908254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172908255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172908255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:09.201935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27754): Terminating (SIGTERM) 17:29:09.242047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27757): Terminating (SIGTERM) 17:29:09.282279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27760): Terminating (SIGTERM) 17:29:09.322717 --- ParallelTerminationStrategy: PID 27754 died... 17:29:09.341824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27754): Terminated: ok {rc=0} 17:29:09.386408 --- ParallelTerminationStrategy: PID 27757 died... 17:29:09.405047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27757): Terminated: ok {rc=0} 17:29:09.449420 --- ParallelTerminationStrategy: PID 27760 died... 17:29:09.468059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27760): Terminated: ok {rc=0} 17:29:09.554892 bus /sierra_3: Setting Powered False 17:29:10.656175 bus /sierra_3: Setting Powered False 17:29:11.772369 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:29:13.022594 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:13.029423 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:29:13.063591 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:29:13.089633 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:29:13.142465 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:29:13.175726 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:29:13.202315 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:29:13.751159 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:29:13.800166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:13.811267 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:29:13.880105 tst mo_mt_call.py: using LAC 22576 17:29:14.000380 tst mo_mt_call.py: using RAC 136 17:29:14.118670 tst mo_mt_call.py: using CellId 22576 17:29:14.239065 tst mo_mt_call.py: using BVCI 22577 17:29:14.350474 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:14.361533 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:14.372463 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:14.383595 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:14.394777 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:14.405833 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:14.521191 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:14.635257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:15.105734 run create_hlr_db(pid=27766): Launched 17:29:15.222291 bus /sierra_2: Setting Powered False 17:29:16.298633 run create_hlr_db(pid=27766): Terminated: ok {rc=0} 17:29:16.792190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27768): Launched 17:29:17.135192 run osmo-hlr_10.42.42.2(pid=27769): Launched 17:29:17.276793 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:17.812130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27771): Launched 17:29:18.115696 run osmo-stp_10.42.42.5(pid=27772): Launched 17:29:18.230875 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:18.779495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27774): Launched 17:29:19.083651 run osmo-msc_10.42.42.6(pid=27775): Launched 17:29:19.252918 run osmo-stp_10.42.42.5(pid=27772): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27772)] 17:29:19.380824 run osmo-stp_10.42.42.5(pid=27772): stdout: | (launched: 2022-12-09_17:29:18.059935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:19.508878 run osmo-stp_10.42.42.5(pid=27772): stderr: | 20221209172918232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172918232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172918232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172918233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172918233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172918233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172918233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:19.635830 run osmo-stp_10.42.42.5(pid=27772): stdout: | (launched: 2022-12-09_17:29:18.059935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:19.755609 run osmo-stp_10.42.42.5(pid=27772): stderr: | 20221209172918232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172918232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172918232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172918233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172918233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172918233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172918233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:19.899205 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27772): Process ended prematurely: osmo-stp_10.42.42.5(pid=27772) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27772)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:29:19.908207 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:29:19.935446 run osmo-hlr_10.42.42.2(pid=27769): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27769)] 17:29:19.983308 run osmo-hlr_10.42.42.2(pid=27769): stdout: | (launched: 2022-12-09_17:29:17.074941) 17:29:20.033357 run osmo-hlr_10.42.42.2(pid=27769): stderr: | 20221209172917276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172917276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172917276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172917276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172917276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172917276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172917288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172917297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172917297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172917297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:20.102098 run osmo-msc_10.42.42.6(pid=27775): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27775)] 17:29:20.149922 run osmo-msc_10.42.42.6(pid=27775): stdout: | (launched: 2022-12-09_17:29:19.027765) 17:29:20.199505 run osmo-msc_10.42.42.6(pid=27775): stderr: | 20221209172919299 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172919299 DLGLOBAL DEBUG validating counter group 0x7efd2fb42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172919299 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172919299 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172919299 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172919299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172919301 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172919302 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172919302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172919302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:20.249437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27768): Terminating (SIGTERM) 17:29:20.289363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27771): Terminating (SIGTERM) 17:29:20.329651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27774): Terminating (SIGTERM) 17:29:20.369908 --- ParallelTerminationStrategy: PID 27768 died... 17:29:20.388778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27768): Terminated: ok {rc=0} 17:29:20.433298 --- ParallelTerminationStrategy: PID 27771 died... 17:29:20.451986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27771): Terminated: ok {rc=0} 17:29:20.496815 --- ParallelTerminationStrategy: PID 27774 died... 17:29:20.515901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27774): Terminated: ok {rc=0} 17:29:20.600592 bus /sierra_3: Setting Powered False 17:29:21.700156 bus /sierra_3: Setting Powered False 17:29:22.816762 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:29:23.966868 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:23.979196 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:29:24.050765 tst mo_mt_call_osmux.py: using LAC 22577 17:29:24.177813 tst mo_mt_call_osmux.py: using RAC 137 17:29:24.304849 tst mo_mt_call_osmux.py: using CellId 22577 17:29:24.431721 tst mo_mt_call_osmux.py: using BVCI 22578 17:29:24.543599 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:24.554662 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:24.565508 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:24.576695 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:24.587902 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:29:24.598934 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:24.713279 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:29:24.830033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:25.300683 run create_hlr_db(pid=27777): Launched 17:29:25.417162 bus /sierra_2: Setting Powered False 17:29:26.477489 run create_hlr_db(pid=27777): Terminated: ok {rc=0} 17:29:26.923946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27779): Launched 17:29:27.250287 run osmo-hlr_10.42.42.2(pid=27780): Launched 17:29:27.376857 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:27.936128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27782): Launched 17:29:28.261736 run osmo-stp_10.42.42.5(pid=27783): Launched 17:29:28.385299 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:28.978452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27785): Launched 17:29:29.305049 run osmo-msc_10.42.42.6(pid=27786): Launched 17:29:29.487832 run osmo-stp_10.42.42.5(pid=27783): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27783)] 17:29:29.624739 run osmo-stp_10.42.42.5(pid=27783): stdout: | (launched: 2022-12-09_17:29:28.202616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:29.762210 run osmo-stp_10.42.42.5(pid=27783): stderr: | 20221209172928393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172928393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172928394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172928394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172928394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172928395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172928395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:29.898164 run osmo-stp_10.42.42.5(pid=27783): stdout: | (launched: 2022-12-09_17:29:28.202616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:30.027166 run osmo-stp_10.42.42.5(pid=27783): stderr: | 20221209172928393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172928393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172928394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172928394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172928394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172928395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172928395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:30.181753 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27783): Process ended prematurely: osmo-stp_10.42.42.5(pid=27783) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27783)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:29:30.191626 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:29:30.219792 run osmo-hlr_10.42.42.2(pid=27780): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27780)] 17:29:30.270817 run osmo-hlr_10.42.42.2(pid=27780): stdout: | (launched: 2022-12-09_17:29:27.190968) 17:29:30.323702 run osmo-hlr_10.42.42.2(pid=27780): stderr: | 20221209172927388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172927388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172927388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172927388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172927389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172927389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172927401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172927410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172927410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172927410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:30.397200 run osmo-msc_10.42.42.6(pid=27786): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27786)] 17:29:30.447796 run osmo-msc_10.42.42.6(pid=27786): stdout: | (launched: 2022-12-09_17:29:29.245698) 17:29:30.500249 run osmo-msc_10.42.42.6(pid=27786): stderr: | 20221209172929570 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172929571 DLGLOBAL DEBUG validating counter group 0x7fe9139acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172929571 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172929571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172929571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172929571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172929573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172929573 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172929573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172929573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:30.553281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27779): Terminating (SIGTERM) 17:29:30.595910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27782): Terminating (SIGTERM) 17:29:30.638362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27785): Terminating (SIGTERM) 17:29:30.680864 --- ParallelTerminationStrategy: PID 27779 died... 17:29:30.701138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27779): Terminated: ok {rc=0} 17:29:30.748129 --- ParallelTerminationStrategy: PID 27782 died... 17:29:30.767919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27782): Terminated: ok {rc=0} 17:29:30.814645 --- ParallelTerminationStrategy: PID 27785 died... 17:29:30.834716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27785): Terminated: ok {rc=0} 17:29:30.924785 bus /sierra_3: Setting Powered False 17:29:32.031689 bus /sierra_3: Setting Powered False 17:29:33.148466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:29:34.405654 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:34.412807 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:29:34.446580 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:29:34.473716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:29:34.527377 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:29:34.561226 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:29:34.588014 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:29:35.139022 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:29:35.190821 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.202350 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:29:35.273084 tst mo_mt_call.py: using LAC 22578 17:29:35.400067 tst mo_mt_call.py: using RAC 138 17:29:35.528513 tst mo_mt_call.py: using CellId 22578 17:29:35.656085 tst mo_mt_call.py: using BVCI 22579 17:29:35.769425 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.780688 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.791723 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.803010 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.814220 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:35.825624 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:35.943896 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:36.063322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:36.566630 run create_hlr_db(pid=27791): Launched 17:29:36.701599 bus /sierra_2: Setting Powered False 17:29:37.765945 run create_hlr_db(pid=27791): Terminated: ok {rc=0} 17:29:38.200391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27793): Launched 17:29:38.505728 run osmo-hlr_10.42.42.2(pid=27794): Launched 17:29:38.625306 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:39.158585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27796): Launched 17:29:39.463007 run osmo-stp_10.42.42.5(pid=27797): Launched 17:29:39.580090 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:40.130364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27799): Launched 17:29:40.438098 run osmo-msc_10.42.42.6(pid=27800): Launched 17:29:40.611848 run osmo-stp_10.42.42.5(pid=27797): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27797)] 17:29:40.741228 run osmo-stp_10.42.42.5(pid=27797): stdout: | (launched: 2022-12-09_17:29:39.406880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:40.869913 run osmo-stp_10.42.42.5(pid=27797): stderr: | 20221209172939577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172939577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172939578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172939578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172939579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172939579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172939579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:40.997678 run osmo-stp_10.42.42.5(pid=27797): stdout: | (launched: 2022-12-09_17:29:39.406880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:41.118487 run osmo-stp_10.42.42.5(pid=27797): stderr: | 20221209172939577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172939577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172939578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172939578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172939579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172939579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172939579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:41.263336 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27797): Process ended prematurely: osmo-stp_10.42.42.5(pid=27797) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27797)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:29:41.272450 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:29:41.299725 run osmo-hlr_10.42.42.2(pid=27794): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27794)] 17:29:41.348171 run osmo-hlr_10.42.42.2(pid=27794): stdout: | (launched: 2022-12-09_17:29:38.449943) 17:29:41.398583 run osmo-hlr_10.42.42.2(pid=27794): stderr: | 20221209172938628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172938628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172938628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172938629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172938629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172938629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172938644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172938655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172938655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172938655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:41.468267 run osmo-msc_10.42.42.6(pid=27800): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27800)] 17:29:41.516587 run osmo-msc_10.42.42.6(pid=27800): stdout: | (launched: 2022-12-09_17:29:40.381979) 17:29:41.566788 run osmo-msc_10.42.42.6(pid=27800): stderr: | 20221209172940654 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172940654 DLGLOBAL DEBUG validating counter group 0x7fe3d3c31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172940654 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172940655 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172940655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172940655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172940657 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172940657 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172940657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172940657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:41.617557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27793): Terminating (SIGTERM) 17:29:41.658019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27796): Terminating (SIGTERM) 17:29:41.698314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27799): Terminating (SIGTERM) 17:29:41.738776 --- ParallelTerminationStrategy: PID 27793 died... 17:29:41.757973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27793): Terminated: ok {rc=0} 17:29:41.802735 --- ParallelTerminationStrategy: PID 27796 died... 17:29:41.821253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27796): Terminated: ok {rc=0} 17:29:41.865978 --- ParallelTerminationStrategy: PID 27799 died... 17:29:41.884802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27799): Terminated: ok {rc=0} 17:29:41.971004 bus /sierra_3: Setting Powered False 17:29:43.067559 bus /sierra_3: Setting Powered False 17:29:44.180112 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:29:45.329185 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.341448 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:29:45.416753 tst mo_mt_call_osmux.py: using LAC 22579 17:29:45.543662 tst mo_mt_call_osmux.py: using RAC 139 17:29:45.671279 tst mo_mt_call_osmux.py: using CellId 22579 17:29:45.796858 tst mo_mt_call_osmux.py: using BVCI 22580 17:29:45.925675 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.938077 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.950082 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.962118 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.974342 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:29:45.986421 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:46.124365 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:29:46.243301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:46.735297 run create_hlr_db(pid=27802): Launched 17:29:46.874999 bus /sierra_2: Setting Powered False 17:29:47.935094 run create_hlr_db(pid=27802): Terminated: ok {rc=0} 17:29:48.379692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27804): Launched 17:29:48.705564 run osmo-hlr_10.42.42.2(pid=27805): Launched 17:29:48.829475 run osmo-stp_10.42.42.5: Starting osmo-stp 17:29:49.385353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27807): Launched 17:29:49.711211 run osmo-stp_10.42.42.5(pid=27808): Launched 17:29:49.833920 run osmo-msc_10.42.42.6: Starting osmo-msc 17:29:50.418829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27810): Launched 17:29:50.744030 run osmo-msc_10.42.42.6(pid=27811): Launched 17:29:50.924346 run osmo-stp_10.42.42.5(pid=27808): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27808)] 17:29:51.060458 run osmo-stp_10.42.42.5(pid=27808): stdout: | (launched: 2022-12-09_17:29:49.652127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:51.196600 run osmo-stp_10.42.42.5(pid=27808): stderr: | 20221209172949847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172949847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172949847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172949848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172949848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172949848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172949848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:51.332628 run osmo-stp_10.42.42.5(pid=27808): stdout: | (launched: 2022-12-09_17:29:49.652127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:29:51.460934 run osmo-stp_10.42.42.5(pid=27808): stderr: | 20221209172949847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209172949847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209172949847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209172949848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209172949848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209172949848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209172949848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:29:51.615298 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27808): Process ended prematurely: osmo-stp_10.42.42.5(pid=27808) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27808)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:29:51.625141 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:29:51.653377 run osmo-hlr_10.42.42.2(pid=27805): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27805)] 17:29:51.703298 run osmo-hlr_10.42.42.2(pid=27805): stdout: | (launched: 2022-12-09_17:29:48.645191) 17:29:51.754989 run osmo-hlr_10.42.42.2(pid=27805): stderr: | 20221209172948847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209172948847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209172948847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209172948847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209172948847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209172948847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209172948859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209172948868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209172948868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209172948868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:29:51.826875 run osmo-msc_10.42.42.6(pid=27811): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27811)] 17:29:51.876410 run osmo-msc_10.42.42.6(pid=27811): stdout: | (launched: 2022-12-09_17:29:50.684836) 17:29:51.928387 run osmo-msc_10.42.42.6(pid=27811): stderr: | 20221209172951008 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209172951009 DLGLOBAL DEBUG validating counter group 0x7f6e2fbcfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209172951009 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209172951009 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209172951009 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209172951009 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209172951011 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209172951011 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209172951011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209172951012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:29:51.980285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27804): Terminating (SIGTERM) 17:29:52.021641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27807): Terminating (SIGTERM) 17:29:52.063036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27810): Terminating (SIGTERM) 17:29:52.104521 --- ParallelTerminationStrategy: PID 27804 died... 17:29:52.124546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27804): Terminated: ok {rc=0} 17:29:52.170894 --- ParallelTerminationStrategy: PID 27807 died... 17:29:52.190444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27807): Terminated: ok {rc=0} 17:29:52.236465 --- ParallelTerminationStrategy: PID 27810 died... 17:29:52.255889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27810): Terminated: ok {rc=0} 17:29:52.343307 bus /sierra_3: Setting Powered False 17:29:53.442397 bus /sierra_3: Setting Powered False 17:29:54.557660 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:29:55.810898 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:29:55.817958 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:29:55.851836 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:29:55.878955 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:29:55.930342 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:29:55.964011 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:29:55.991127 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:29:56.541425 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:29:56.592219 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:56.603333 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:29:56.671842 tst mo_mt_call.py: using LAC 22580 17:29:56.789431 tst mo_mt_call.py: using RAC 140 17:29:56.915629 tst mo_mt_call.py: using CellId 22580 17:29:57.041435 tst mo_mt_call.py: using BVCI 22581 17:29:57.161277 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:57.172648 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:57.183945 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:57.195208 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:57.206640 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:29:57.217962 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:29:57.336762 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:29:57.452466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:29:57.921553 run create_hlr_db(pid=27816): Launched 17:29:58.037090 bus /sierra_2: Setting Powered False 17:29:59.098179 run create_hlr_db(pid=27816): Terminated: ok {rc=0} 17:29:59.542408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27818): Launched 17:29:59.870528 run osmo-hlr_10.42.42.2(pid=27819): Launched 17:29:59.996411 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:00.558963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27821): Launched 17:30:00.896689 run osmo-stp_10.42.42.5(pid=27822): Launched 17:30:01.195914 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:01.778768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27827): Launched 17:30:02.153958 run osmo-msc_10.42.42.6(pid=27828): Launched 17:30:02.524592 run osmo-stp_10.42.42.5(pid=27822): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27822)] 17:30:02.654789 run osmo-stp_10.42.42.5(pid=27822): stdout: | (launched: 2022-12-09_17:30:00.826460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:02.782539 run osmo-stp_10.42.42.5(pid=27822): stderr: | 20221209173001067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173001067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173001067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173001068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173001068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173001068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173001068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:02.909886 run osmo-stp_10.42.42.5(pid=27822): stdout: | (launched: 2022-12-09_17:30:00.826460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:03.031185 run osmo-stp_10.42.42.5(pid=27822): stderr: | 20221209173001067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173001067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173001067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173001068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173001068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173001068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173001068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:03.176532 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27822): Process ended prematurely: osmo-stp_10.42.42.5(pid=27822) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27822)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:30:03.185756 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 17:30:03.213095 run osmo-hlr_10.42.42.2(pid=27819): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27819)] 17:30:03.261602 run osmo-hlr_10.42.42.2(pid=27819): stdout: | (launched: 2022-12-09_17:29:59.811652) 17:30:03.311755 run osmo-hlr_10.42.42.2(pid=27819): stderr: | 20221209173000010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173000010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173000010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173000010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173000010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173000010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173000022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173000031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173000031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173000031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:03.381278 run osmo-msc_10.42.42.6(pid=27828): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27828)] 17:30:03.429581 run osmo-msc_10.42.42.6(pid=27828): stdout: | (launched: 2022-12-09_17:30:02.094484) 17:30:03.479608 run osmo-msc_10.42.42.6(pid=27828): stderr: | 20221209173002471 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173002471 DLGLOBAL DEBUG validating counter group 0x7f378b7e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173002471 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173002471 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173002471 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173002471 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173002473 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173002474 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173002474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173002474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:03.529943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27818): Terminating (SIGTERM) 17:30:03.570057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27821): Terminating (SIGTERM) 17:30:03.610445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27827): Terminating (SIGTERM) 17:30:03.650573 --- ParallelTerminationStrategy: PID 27818 died... 17:30:03.669779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27818): Terminated: ok {rc=0} 17:30:03.714523 --- ParallelTerminationStrategy: PID 27821 died... 17:30:03.733205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27821): Terminated: ok {rc=0} 17:30:03.778300 --- ParallelTerminationStrategy: PID 27827 died... 17:30:03.797117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27827): Terminated: ok {rc=0} 17:30:03.884383 bus /sierra_3: Setting Powered False 17:30:04.985153 bus /sierra_3: Setting Powered False 17:30:06.102387 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:30:07.249172 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.260709 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:30:07.329080 tst mo_mt_call_osmux.py: using LAC 22581 17:30:07.448760 tst mo_mt_call_osmux.py: using RAC 141 17:30:07.573788 tst mo_mt_call_osmux.py: using CellId 22581 17:30:07.693643 tst mo_mt_call_osmux.py: using BVCI 22582 17:30:07.813024 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.824600 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.835928 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.847267 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.858669 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:30:07.870080 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:30:07.983822 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:30:08.105132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:08.610149 run create_hlr_db(pid=27830): Launched 17:30:08.743197 bus /sierra_2: Setting Powered False 17:30:09.807023 run create_hlr_db(pid=27830): Terminated: ok {rc=0} 17:30:10.242620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27832): Launched 17:30:10.547527 run osmo-hlr_10.42.42.2(pid=27833): Launched 17:30:10.664387 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:11.189043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27835): Launched 17:30:11.494267 run osmo-stp_10.42.42.5(pid=27836): Launched 17:30:11.613787 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:12.163478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27838): Launched 17:30:12.468806 run osmo-msc_10.42.42.6(pid=27839): Launched 17:30:12.640297 run osmo-stp_10.42.42.5(pid=27836): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27836)] 17:30:12.770343 run osmo-stp_10.42.42.5(pid=27836): stdout: | (launched: 2022-12-09_17:30:11.438395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:12.899682 run osmo-stp_10.42.42.5(pid=27836): stderr: | 20221209173011608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173011608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173011609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173011609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173011611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173011612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173011612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:13.026766 run osmo-stp_10.42.42.5(pid=27836): stdout: | (launched: 2022-12-09_17:30:11.438395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:13.147739 run osmo-stp_10.42.42.5(pid=27836): stderr: | 20221209173011608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173011608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173011609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173011609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173011611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173011612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173011612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:13.293122 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27836): Process ended prematurely: osmo-stp_10.42.42.5(pid=27836) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27836)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:30:13.302097 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:30:13.329365 run osmo-hlr_10.42.42.2(pid=27833): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27833)] 17:30:13.377901 run osmo-hlr_10.42.42.2(pid=27833): stdout: | (launched: 2022-12-09_17:30:10.492092) 17:30:13.428261 run osmo-hlr_10.42.42.2(pid=27833): stderr: | 20221209173010670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173010670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173010670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173010670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173010670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173010670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173010702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173010713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173010714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173010714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:13.498583 run osmo-msc_10.42.42.6(pid=27839): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27839)] 17:30:13.547140 run osmo-msc_10.42.42.6(pid=27839): stdout: | (launched: 2022-12-09_17:30:12.413139) 17:30:13.597927 run osmo-msc_10.42.42.6(pid=27839): stderr: | 20221209173012686 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173012687 DLGLOBAL DEBUG validating counter group 0x7f269684fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173012687 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173012687 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173012687 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173012687 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173012689 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173012689 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173012690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173012690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:13.648498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27832): Terminating (SIGTERM) 17:30:13.689110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27835): Terminating (SIGTERM) 17:30:13.729561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27838): Terminating (SIGTERM) 17:30:13.770316 --- ParallelTerminationStrategy: PID 27832 died... 17:30:13.789605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27832): Terminated: ok {rc=0} 17:30:13.834808 --- ParallelTerminationStrategy: PID 27835 died... 17:30:13.853416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27835): Terminated: ok {rc=0} 17:30:13.898202 --- ParallelTerminationStrategy: PID 27838 died... 17:30:13.916987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27838): Terminated: ok {rc=0} 17:30:14.005110 bus /sierra_3: Setting Powered False 17:30:15.105047 bus /sierra_3: Setting Powered False 17:30:16.221841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:30:17.483638 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:17.492184 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:30:17.527782 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:30:17.555594 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:30:17.615530 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:30:17.650015 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:30:17.675992 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:30:18.225088 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:30:18.278744 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.290405 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:30:18.360679 tst mo_mt_call.py: using LAC 22582 17:30:18.486693 tst mo_mt_call.py: using RAC 142 17:30:18.613031 tst mo_mt_call.py: using CellId 22582 17:30:18.739316 tst mo_mt_call.py: using BVCI 22583 17:30:18.858173 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.869637 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.880817 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.892147 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.903684 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:18.915009 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:19.034175 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:19.154169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:19.657309 run create_hlr_db(pid=27845): Launched 17:30:19.789664 bus /sierra_2: Setting Powered False 17:30:20.853783 run create_hlr_db(pid=27845): Terminated: ok {rc=0} 17:30:21.287052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27847): Launched 17:30:21.592191 run osmo-hlr_10.42.42.2(pid=27848): Launched 17:30:21.707934 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:22.241830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27850): Launched 17:30:22.546599 run osmo-stp_10.42.42.5(pid=27851): Launched 17:30:22.662187 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:23.226852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27853): Launched 17:30:23.531687 run osmo-msc_10.42.42.6(pid=27854): Launched 17:30:23.701941 run osmo-stp_10.42.42.5(pid=27851): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27851)] 17:30:23.831401 run osmo-stp_10.42.42.5(pid=27851): stdout: | (launched: 2022-12-09_17:30:22.490298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:23.960868 run osmo-stp_10.42.42.5(pid=27851): stderr: | 20221209173022664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173022665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173022665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173022665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173022666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173022666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173022666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:24.087774 run osmo-stp_10.42.42.5(pid=27851): stdout: | (launched: 2022-12-09_17:30:22.490298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:24.207832 run osmo-stp_10.42.42.5(pid=27851): stderr: | 20221209173022664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173022665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173022665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173022665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173022666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173022666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173022666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:24.352074 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27851): Process ended prematurely: osmo-stp_10.42.42.5(pid=27851) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27851)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:30:24.361554 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:30:24.388281 run osmo-hlr_10.42.42.2(pid=27848): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27848)] 17:30:24.436582 run osmo-hlr_10.42.42.2(pid=27848): stdout: | (launched: 2022-12-09_17:30:21.536468) 17:30:24.486423 run osmo-hlr_10.42.42.2(pid=27848): stderr: | 20221209173021712 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173021712 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173021713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173021713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173021713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173021713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173021724 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173021733 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173021733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173021733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:24.555711 run osmo-msc_10.42.42.6(pid=27854): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27854)] 17:30:24.603578 run osmo-msc_10.42.42.6(pid=27854): stdout: | (launched: 2022-12-09_17:30:23.475938) 17:30:24.653272 run osmo-msc_10.42.42.6(pid=27854): stderr: | 20221209173023748 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173023748 DLGLOBAL DEBUG validating counter group 0x7f11b3a2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173023748 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173023749 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173023749 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173023749 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173023751 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173023751 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173023751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173023751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:24.703281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27847): Terminating (SIGTERM) 17:30:24.743331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27850): Terminating (SIGTERM) 17:30:24.783272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27853): Terminating (SIGTERM) 17:30:24.823223 --- ParallelTerminationStrategy: PID 27847 died... 17:30:24.842348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27847): Terminated: ok {rc=0} 17:30:24.886788 --- ParallelTerminationStrategy: PID 27850 died... 17:30:24.905302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27850): Terminated: ok {rc=0} 17:30:24.949993 --- ParallelTerminationStrategy: PID 27853 died... 17:30:24.968639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27853): Terminated: ok {rc=0} 17:30:25.056148 bus /sierra_3: Setting Powered False 17:30:26.156732 bus /sierra_3: Setting Powered False 17:30:27.274476 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:30:28.422208 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:28.433998 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:30:28.505328 tst mo_mt_call_osmux.py: using LAC 22583 17:30:28.625606 tst mo_mt_call_osmux.py: using RAC 143 17:30:28.745404 tst mo_mt_call_osmux.py: using CellId 22583 17:30:28.866405 tst mo_mt_call_osmux.py: using BVCI 22584 17:30:28.976441 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:28.987564 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:28.998498 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:29.009648 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:29.020825 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:30:29.032054 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:29.147124 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:30:29.267403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:29.774343 run create_hlr_db(pid=27856): Launched 17:30:29.908129 bus /sierra_2: Setting Powered False 17:30:30.980514 run create_hlr_db(pid=27856): Terminated: ok {rc=0} 17:30:31.445759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27858): Launched 17:30:31.788998 run osmo-hlr_10.42.42.2(pid=27859): Launched 17:30:31.966478 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:32.651083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27861): Launched 17:30:32.978646 run osmo-stp_10.42.42.5(pid=27862): Launched 17:30:33.105218 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:33.695228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27864): Launched 17:30:34.022090 run osmo-msc_10.42.42.6(pid=27865): Launched 17:30:34.202678 run osmo-stp_10.42.42.5(pid=27862): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27862)] 17:30:34.339187 run osmo-stp_10.42.42.5(pid=27862): stdout: | (launched: 2022-12-09_17:30:32.919451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:34.476513 run osmo-stp_10.42.42.5(pid=27862): stderr: | 20221209173033114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173033114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173033114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173033114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173033115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173033115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173033115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:34.613194 run osmo-stp_10.42.42.5(pid=27862): stdout: | (launched: 2022-12-09_17:30:32.919451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:34.742435 run osmo-stp_10.42.42.5(pid=27862): stderr: | 20221209173033114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173033114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173033114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173033114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173033115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173033115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173033115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:34.897207 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27862): Process ended prematurely: osmo-stp_10.42.42.5(pid=27862) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27862)] [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:30:34.906941 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:30:34.935038 run osmo-hlr_10.42.42.2(pid=27859): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27859)] 17:30:34.985363 run osmo-hlr_10.42.42.2(pid=27859): stdout: | (launched: 2022-12-09_17:30:31.729862) 17:30:35.037575 run osmo-hlr_10.42.42.2(pid=27859): stderr: | 20221209173032073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173032073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173032073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173032073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173032073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173032073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173032088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173032097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173032097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173032097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:35.110542 run osmo-msc_10.42.42.6(pid=27865): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27865)] 17:30:35.160644 run osmo-msc_10.42.42.6(pid=27865): stdout: | (launched: 2022-12-09_17:30:33.962284) 17:30:35.212659 run osmo-msc_10.42.42.6(pid=27865): stderr: | 20221209173034285 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173034285 DLGLOBAL DEBUG validating counter group 0x7f067fef0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173034286 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173034286 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173034286 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173034286 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173034288 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173034288 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173034288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173034288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:35.265013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27858): Terminating (SIGTERM) 17:30:35.306966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27861): Terminating (SIGTERM) 17:30:35.349398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27864): Terminating (SIGTERM) 17:30:35.392030 --- ParallelTerminationStrategy: PID 27858 died... 17:30:35.412124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27858): Terminated: ok {rc=0} 17:30:35.458678 --- ParallelTerminationStrategy: PID 27861 died... 17:30:35.478297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27861): Terminated: ok {rc=0} 17:30:35.524524 --- ParallelTerminationStrategy: PID 27864 died... 17:30:35.544130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27864): Terminated: ok {rc=0} 17:30:35.634100 bus /sierra_3: Setting Powered False 17:30:36.734743 bus /sierra_3: Setting Powered False 17:30:37.850883 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:30:39.102839 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:30:39.109918 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:30:39.143562 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:30:39.170884 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:30:39.222078 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:30:39.255507 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:30:39.282472 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:30:39.841889 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:30:39.893436 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:39.904921 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:30:39.975068 tst mo_mt_call.py: using LAC 22584 17:30:40.102752 tst mo_mt_call.py: using RAC 144 17:30:40.230621 tst mo_mt_call.py: using CellId 22584 17:30:40.358414 tst mo_mt_call.py: using BVCI 22585 17:30:40.476153 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:40.487754 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:40.499135 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:40.510554 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:40.522012 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:40.533407 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:40.653805 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:40.774007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:41.278306 run create_hlr_db(pid=27871): Launched 17:30:41.411194 bus /sierra_2: Setting Powered False 17:30:42.475152 run create_hlr_db(pid=27871): Terminated: ok {rc=0} 17:30:42.912661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27873): Launched 17:30:43.217926 run osmo-hlr_10.42.42.2(pid=27874): Launched 17:30:43.333357 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:43.871097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27876): Launched 17:30:44.174796 run osmo-stp_10.42.42.5(pid=27877): Launched 17:30:44.290844 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:44.840605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27879): Launched 17:30:45.146411 run osmo-msc_10.42.42.6(pid=27880): Launched 17:30:45.316940 run osmo-stp_10.42.42.5(pid=27877): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27877)] 17:30:45.446500 run osmo-stp_10.42.42.5(pid=27877): stdout: | (launched: 2022-12-09_17:30:44.119404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:45.575689 run osmo-stp_10.42.42.5(pid=27877): stderr: | 20221209173044287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173044287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173044288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173044288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173044290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173044291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173044291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:45.702265 run osmo-stp_10.42.42.5(pid=27877): stdout: | (launched: 2022-12-09_17:30:44.119404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:45.822472 run osmo-stp_10.42.42.5(pid=27877): stderr: | 20221209173044287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173044287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173044288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173044288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173044290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173044291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173044291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:45.984150 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27877): Process ended prematurely: osmo-stp_10.42.42.5(pid=27877) [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27877)] [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:30:45.994263 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:30:46.024053 run osmo-hlr_10.42.42.2(pid=27874): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27874)] 17:30:46.074355 run osmo-hlr_10.42.42.2(pid=27874): stdout: | (launched: 2022-12-09_17:30:43.162298) 17:30:46.126716 run osmo-hlr_10.42.42.2(pid=27874): stderr: | 20221209173043340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173043340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173043340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173043340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173043340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173043340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173043355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173043365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173043365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173043365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:46.198855 run osmo-msc_10.42.42.6(pid=27880): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27880)] 17:30:46.249236 run osmo-msc_10.42.42.6(pid=27880): stdout: | (launched: 2022-12-09_17:30:45.089757) 17:30:46.301322 run osmo-msc_10.42.42.6(pid=27880): stderr: | 20221209173045364 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173045364 DLGLOBAL DEBUG validating counter group 0x7f4f415acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173045364 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173045364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173045365 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173045365 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173045367 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173045367 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173045367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173045367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:46.354137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27873): Terminating (SIGTERM) 17:30:46.396923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27876): Terminating (SIGTERM) 17:30:46.440843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27879): Terminating (SIGTERM) 17:30:46.483611 --- ParallelTerminationStrategy: PID 27873 died... 17:30:46.503341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27873): Terminated: ok {rc=0} 17:30:46.551236 --- ParallelTerminationStrategy: PID 27876 died... 17:30:46.571005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27876): Terminated: ok {rc=0} 17:30:46.618870 --- ParallelTerminationStrategy: PID 27879 died... 17:30:46.638637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27879): Terminated: ok {rc=0} 17:30:46.728542 bus /sierra_3: Setting Powered False 17:30:47.830096 bus /sierra_3: Setting Powered False 17:30:48.945581 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:30:50.093881 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:50.105695 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:30:50.175039 tst mo_mt_call_osmux.py: using LAC 22585 17:30:50.296315 tst mo_mt_call_osmux.py: using RAC 145 17:30:50.425174 tst mo_mt_call_osmux.py: using CellId 22585 17:30:50.553983 tst mo_mt_call_osmux.py: using BVCI 22586 17:30:50.672643 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:50.684484 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:50.696149 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:50.707724 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:50.719196 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:30:50.730658 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:50.850716 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:30:50.971056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:30:51.445616 run create_hlr_db(pid=27882): Launched 17:30:51.562864 bus /sierra_2: Setting Powered False 17:30:52.624451 run create_hlr_db(pid=27882): Terminated: ok {rc=0} 17:30:53.071890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27884): Launched 17:30:53.399769 run osmo-hlr_10.42.42.2(pid=27885): Launched 17:30:53.523993 run osmo-stp_10.42.42.5: Starting osmo-stp 17:30:54.082724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27887): Launched 17:30:54.410827 run osmo-stp_10.42.42.5(pid=27888): Launched 17:30:54.534683 run osmo-msc_10.42.42.6: Starting osmo-msc 17:30:55.123158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27890): Launched 17:30:55.450384 run osmo-msc_10.42.42.6(pid=27891): Launched 17:30:55.632650 run osmo-stp_10.42.42.5(pid=27888): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27888)] 17:30:55.769143 run osmo-stp_10.42.42.5(pid=27888): stdout: | (launched: 2022-12-09_17:30:54.351148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:55.906324 run osmo-stp_10.42.42.5(pid=27888): stderr: | 20221209173054545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173054545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173054545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173054546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173054546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173054546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173054546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:56.043004 run osmo-stp_10.42.42.5(pid=27888): stdout: | (launched: 2022-12-09_17:30:54.351148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:30:56.171732 run osmo-stp_10.42.42.5(pid=27888): stderr: | 20221209173054545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173054545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173054545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173054546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173054546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173054546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173054546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:30:56.326187 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27888): Process ended prematurely: osmo-stp_10.42.42.5(pid=27888) [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27888)] [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:30:56.336038 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:30:56.364207 run osmo-hlr_10.42.42.2(pid=27885): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27885)] 17:30:56.414726 run osmo-hlr_10.42.42.2(pid=27885): stdout: | (launched: 2022-12-09_17:30:53.340037) 17:30:56.467352 run osmo-hlr_10.42.42.2(pid=27885): stderr: | 20221209173053538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173053538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173053538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173053538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173053538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173053538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173053551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173053560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173053561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173053561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:30:56.539868 run osmo-msc_10.42.42.6(pid=27891): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27891)] 17:30:56.590301 run osmo-msc_10.42.42.6(pid=27891): stdout: | (launched: 2022-12-09_17:30:55.390981) 17:30:56.642578 run osmo-msc_10.42.42.6(pid=27891): stderr: | 20221209173055716 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173055716 DLGLOBAL DEBUG validating counter group 0x7f420cdc9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173055716 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173055716 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173055716 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173055716 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173055718 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173055718 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173055719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173055719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:30:56.694851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27884): Terminating (SIGTERM) 17:30:56.736722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27887): Terminating (SIGTERM) 17:30:56.778950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27890): Terminating (SIGTERM) 17:30:56.821252 --- ParallelTerminationStrategy: PID 27884 died... 17:30:56.840922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27884): Terminated: ok {rc=0} 17:30:56.887657 --- ParallelTerminationStrategy: PID 27887 died... 17:30:56.907406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27887): Terminated: ok {rc=0} 17:30:56.954181 --- ParallelTerminationStrategy: PID 27890 died... 17:30:56.973968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27890): Terminated: ok {rc=0} 17:30:57.062786 bus /sierra_3: Setting Powered False 17:30:58.162951 bus /sierra_3: Setting Powered False 17:30:59.281981 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:31:00.531609 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:31:00.537719 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:31:00.570949 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:31:00.597114 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:31:00.649384 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:31:00.682782 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:31:00.709234 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:31:01.260192 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:31:01.326347 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:01.342113 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:31:01.425356 tst mo_mt_call.py: using LAC 22586 17:31:01.592848 tst mo_mt_call.py: using RAC 146 17:31:01.717490 tst mo_mt_call.py: using CellId 22586 17:31:01.840283 tst mo_mt_call.py: using BVCI 22587 17:31:01.967272 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:01.979340 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:01.991127 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:02.003875 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:02.017648 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:02.030564 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:02.147113 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:02.265415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:02.739572 run create_hlr_db(pid=27896): Launched 17:31:02.856395 bus /sierra_2: Setting Powered False 17:31:03.917246 run create_hlr_db(pid=27896): Terminated: ok {rc=0} 17:31:04.363371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27898): Launched 17:31:04.692747 run osmo-hlr_10.42.42.2(pid=27899): Launched 17:31:04.818862 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:05.377491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27901): Launched 17:31:05.705139 run osmo-stp_10.42.42.5(pid=27902): Launched 17:31:05.829263 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:06.417556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27904): Launched 17:31:06.744998 run osmo-msc_10.42.42.6(pid=27905): Launched 17:31:06.927946 run osmo-stp_10.42.42.5(pid=27902): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27902)] 17:31:07.064790 run osmo-stp_10.42.42.5(pid=27902): stdout: | (launched: 2022-12-09_17:31:05.645323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:07.202209 run osmo-stp_10.42.42.5(pid=27902): stderr: | 20221209173105839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173105840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173105840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173105840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173105843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173105843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173105843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:07.338687 run osmo-stp_10.42.42.5(pid=27902): stdout: | (launched: 2022-12-09_17:31:05.645323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:07.468115 run osmo-stp_10.42.42.5(pid=27902): stderr: | 20221209173105839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173105840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173105840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173105840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173105843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173105843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173105843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:07.623332 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27902): Process ended prematurely: osmo-stp_10.42.42.5(pid=27902) [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27902)] [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:31:07.632873 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:31:07.661219 run osmo-hlr_10.42.42.2(pid=27899): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27899)] 17:31:07.711941 run osmo-hlr_10.42.42.2(pid=27899): stdout: | (launched: 2022-12-09_17:31:04.632802) 17:31:07.764412 run osmo-hlr_10.42.42.2(pid=27899): stderr: | 20221209173104835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173104835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173104835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173104835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173104835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173104835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173104852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173104862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173104862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173104862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:07.837312 run osmo-msc_10.42.42.6(pid=27905): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27905)] 17:31:07.887603 run osmo-msc_10.42.42.6(pid=27905): stdout: | (launched: 2022-12-09_17:31:06.685320) 17:31:07.939731 run osmo-msc_10.42.42.6(pid=27905): stderr: | 20221209173107011 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173107011 DLGLOBAL DEBUG validating counter group 0x7f003fd86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173107011 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173107011 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173107011 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173107011 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173107013 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173107013 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173107014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173107014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:07.992169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27898): Terminating (SIGTERM) 17:31:08.034282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27901): Terminating (SIGTERM) 17:31:08.076233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27904): Terminating (SIGTERM) 17:31:08.118706 --- ParallelTerminationStrategy: PID 27898 died... 17:31:08.138864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27898): Terminated: ok {rc=0} 17:31:08.185640 --- ParallelTerminationStrategy: PID 27901 died... 17:31:08.205393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27901): Terminated: ok {rc=0} 17:31:08.252007 --- ParallelTerminationStrategy: PID 27904 died... 17:31:08.271702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27904): Terminated: ok {rc=0} 17:31:08.360702 bus /sierra_3: Setting Powered False 17:31:09.460163 bus /sierra_3: Setting Powered False 17:31:10.577384 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:31:11.723673 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:11.735508 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:31:11.805391 tst mo_mt_call_osmux.py: using LAC 22587 17:31:11.926820 tst mo_mt_call_osmux.py: using RAC 147 17:31:12.047762 tst mo_mt_call_osmux.py: using CellId 22587 17:31:12.170949 tst mo_mt_call_osmux.py: using BVCI 22588 17:31:12.282945 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:12.294029 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:12.304850 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:12.315901 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:12.326839 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:31:12.337868 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:12.459463 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:31:12.581433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:13.086416 run create_hlr_db(pid=27907): Launched 17:31:13.220053 bus /sierra_2: Setting Powered False 17:31:14.283606 run create_hlr_db(pid=27907): Terminated: ok {rc=0} 17:31:14.719502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27909): Launched 17:31:15.024774 run osmo-hlr_10.42.42.2(pid=27910): Launched 17:31:15.142578 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:15.679200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27912): Launched 17:31:16.003024 run osmo-stp_10.42.42.5(pid=27913): Launched 17:31:16.276477 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:16.924346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27915): Launched 17:31:17.237602 run osmo-msc_10.42.42.6(pid=27916): Launched 17:31:17.436873 run osmo-stp_10.42.42.5(pid=27913): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27913)] 17:31:17.575581 run osmo-stp_10.42.42.5(pid=27913): stdout: | (launched: 2022-12-09_17:31:15.938041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:17.715607 run osmo-stp_10.42.42.5(pid=27913): stderr: | 20221209173116163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173116163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173116163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173116164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173116164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173116164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173116164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:17.853300 run osmo-stp_10.42.42.5(pid=27913): stdout: | (launched: 2022-12-09_17:31:15.938041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:17.982533 run osmo-stp_10.42.42.5(pid=27913): stderr: | 20221209173116163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173116163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173116163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173116164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173116164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173116164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173116164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:18.137448 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27913): Process ended prematurely: osmo-stp_10.42.42.5(pid=27913) [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27913)] [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:31:18.147274 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:31:18.175574 run osmo-hlr_10.42.42.2(pid=27910): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27910)] 17:31:18.226602 run osmo-hlr_10.42.42.2(pid=27910): stdout: | (launched: 2022-12-09_17:31:14.969058) 17:31:18.279164 run osmo-hlr_10.42.42.2(pid=27910): stderr: | 20221209173115149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173115149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173115149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173115149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173115149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173115149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173115161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173115170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173115171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173115171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:18.352389 run osmo-msc_10.42.42.6(pid=27916): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27916)] 17:31:18.403404 run osmo-msc_10.42.42.6(pid=27916): stdout: | (launched: 2022-12-09_17:31:17.180582) 17:31:18.455771 run osmo-msc_10.42.42.6(pid=27916): stderr: | 20221209173117554 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173117554 DLGLOBAL DEBUG validating counter group 0x7fbaffebcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173117554 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173117554 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173117555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173117555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173117556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173117557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173117557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173117557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:18.508530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27909): Terminating (SIGTERM) 17:31:18.550789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27912): Terminating (SIGTERM) 17:31:18.593734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27915): Terminating (SIGTERM) 17:31:18.636562 --- ParallelTerminationStrategy: PID 27909 died... 17:31:18.657136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27909): Terminated: ok {rc=0} 17:31:18.704076 --- ParallelTerminationStrategy: PID 27912 died... 17:31:18.723873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27912): Terminated: ok {rc=0} 17:31:18.770634 --- ParallelTerminationStrategy: PID 27915 died... 17:31:18.790481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27915): Terminated: ok {rc=0} 17:31:18.879500 bus /sierra_3: Setting Powered False 17:31:19.977593 bus /sierra_3: Setting Powered False 17:31:21.093829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 17:31:22.350541 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:31:22.356257 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 17:31:22.389778 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 17:31:22.416822 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 17:31:22.471005 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 17:31:22.504544 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 17:31:22.531308 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 17:31:23.080681 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 17:31:23.132142 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:23.143491 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 17:31:23.194903 tst mo_mt_call.py: using LAC 22588 17:31:23.323592 tst mo_mt_call.py: using RAC 148 17:31:23.452273 tst mo_mt_call.py: using CellId 22588 17:31:23.580740 tst mo_mt_call.py: using BVCI 22589 17:31:23.691988 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:23.702940 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:23.714037 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:23.725247 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:23.736199 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:23.747217 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:23.863696 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:23.982096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:24.454855 run create_hlr_db(pid=27921): Launched 17:31:24.574172 bus /sierra_2: Setting Powered False 17:31:25.634996 run create_hlr_db(pid=27921): Terminated: ok {rc=0} 17:31:26.081544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27923): Launched 17:31:26.409728 run osmo-hlr_10.42.42.2(pid=27924): Launched 17:31:26.534388 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:27.093635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27926): Launched 17:31:27.420775 run osmo-stp_10.42.42.5(pid=27927): Launched 17:31:27.546908 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:28.137249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27929): Launched 17:31:28.462750 run osmo-msc_10.42.42.6(pid=27930): Launched 17:31:28.645304 run osmo-stp_10.42.42.5(pid=27927): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27927)] 17:31:28.782275 run osmo-stp_10.42.42.5(pid=27927): stdout: | (launched: 2022-12-09_17:31:27.361643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:28.919257 run osmo-stp_10.42.42.5(pid=27927): stderr: | 20221209173127553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173127553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173127553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173127553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173127557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173127557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173127557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:29.055531 run osmo-stp_10.42.42.5(pid=27927): stdout: | (launched: 2022-12-09_17:31:27.361643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:29.184286 run osmo-stp_10.42.42.5(pid=27927): stderr: | 20221209173127553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173127553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173127553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173127553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173127557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173127557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173127557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:29.339119 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27927): Process ended prematurely: osmo-stp_10.42.42.5(pid=27927) [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27927)] [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 17:31:29.348828 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:31:29.376733 run osmo-hlr_10.42.42.2(pid=27924): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27924)] 17:31:29.426835 run osmo-hlr_10.42.42.2(pid=27924): stdout: | (launched: 2022-12-09_17:31:26.350704) 17:31:29.478864 run osmo-hlr_10.42.42.2(pid=27924): stderr: | 20221209173126549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173126549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173126549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173126549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173126549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173126549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173126561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173126570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173126570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173126570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:29.551237 run osmo-msc_10.42.42.6(pid=27930): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27930)] 17:31:29.601348 run osmo-msc_10.42.42.6(pid=27930): stdout: | (launched: 2022-12-09_17:31:28.403410) 17:31:29.653202 run osmo-msc_10.42.42.6(pid=27930): stderr: | 20221209173128729 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173128729 DLGLOBAL DEBUG validating counter group 0x7facb512fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173128730 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173128730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173128730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173128730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173128732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173128732 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173128732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173128732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:29.705643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27923): Terminating (SIGTERM) 17:31:29.747755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27926): Terminating (SIGTERM) 17:31:29.790464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27929): Terminating (SIGTERM) 17:31:29.833133 --- ParallelTerminationStrategy: PID 27923 died... 17:31:29.853233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27923): Terminated: ok {rc=0} 17:31:29.900061 --- ParallelTerminationStrategy: PID 27926 died... 17:31:29.919677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27926): Terminated: ok {rc=0} 17:31:29.966151 --- ParallelTerminationStrategy: PID 27929 died... 17:31:29.985604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27929): Terminated: ok {rc=0} 17:31:30.074390 bus /sierra_3: Setting Powered False 17:31:31.177699 bus /sierra_3: Setting Powered False 17:31:32.305979 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 17:31:33.452051 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:33.463540 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 17:31:33.514266 tst mo_mt_call_osmux.py: using LAC 22589 17:31:33.635025 tst mo_mt_call_osmux.py: using RAC 149 17:31:33.754008 tst mo_mt_call_osmux.py: using CellId 22589 17:31:33.875136 tst mo_mt_call_osmux.py: using BVCI 22590 17:31:33.986919 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:33.997979 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:34.008696 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:34.019785 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:34.030771 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 17:31:34.041878 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:34.156268 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 17:31:34.277216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:34.784138 run create_hlr_db(pid=27932): Launched 17:31:34.904622 bus /sierra_2: Setting Powered False 17:31:35.965297 run create_hlr_db(pid=27932): Terminated: ok {rc=0} 17:31:36.411090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27934): Launched 17:31:36.740850 run osmo-hlr_10.42.42.2(pid=27935): Launched 17:31:36.867133 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:37.427596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27937): Launched 17:31:37.755734 run osmo-stp_10.42.42.5(pid=27938): Launched 17:31:37.881071 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:38.471256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27940): Launched 17:31:38.800626 run osmo-msc_10.42.42.6(pid=27941): Launched 17:31:38.981738 run osmo-stp_10.42.42.5(pid=27938): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27938)] 17:31:39.117816 run osmo-stp_10.42.42.5(pid=27938): stdout: | (launched: 2022-12-09_17:31:37.695881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:39.255170 run osmo-stp_10.42.42.5(pid=27938): stderr: | 20221209173137888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173137889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173137889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173137889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173137890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173137890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173137890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:39.391546 run osmo-stp_10.42.42.5(pid=27938): stdout: | (launched: 2022-12-09_17:31:37.695881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:39.520792 run osmo-stp_10.42.42.5(pid=27938): stderr: | 20221209173137888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173137889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173137889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173137889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173137890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173137890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173137890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:39.676134 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27938): Process ended prematurely: osmo-stp_10.42.42.5(pid=27938) [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27938)] [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 17:31:39.685844 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:31:39.713842 run osmo-hlr_10.42.42.2(pid=27935): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27935)] 17:31:39.764517 run osmo-hlr_10.42.42.2(pid=27935): stdout: | (launched: 2022-12-09_17:31:36.681384) 17:31:39.816774 run osmo-hlr_10.42.42.2(pid=27935): stderr: | 20221209173136883 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173136883 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173136883 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173136883 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173136883 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173136883 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173136895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173136904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173136904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173136904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:39.890061 run osmo-msc_10.42.42.6(pid=27941): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27941)] 17:31:39.940840 run osmo-msc_10.42.42.6(pid=27941): stdout: | (launched: 2022-12-09_17:31:38.740489) 17:31:39.993259 run osmo-msc_10.42.42.6(pid=27941): stderr: | 20221209173139064 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173139064 DLGLOBAL DEBUG validating counter group 0x7f40a5924c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173139064 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173139064 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173139064 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173139065 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173139066 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173139067 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173139067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173139067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:40.045754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27934): Terminating (SIGTERM) 17:31:40.087564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27937): Terminating (SIGTERM) 17:31:40.129804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27940): Terminating (SIGTERM) 17:31:40.172057 --- ParallelTerminationStrategy: PID 27934 died... 17:31:40.192122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27934): Terminated: ok {rc=0} 17:31:40.238767 --- ParallelTerminationStrategy: PID 27937 died... 17:31:40.258438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27937): Terminated: ok {rc=0} 17:31:40.304550 --- ParallelTerminationStrategy: PID 27940 died... 17:31:40.324110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27940): Terminated: ok {rc=0} 17:31:40.412432 bus /sierra_3: Setting Powered False 17:31:41.511784 bus /sierra_3: Setting Powered False 17:31:42.627625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:31:43.878374 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:31:43.884513 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:31:43.917926 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 17:31:43.944550 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 17:31:43.996651 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:31:44.029545 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 17:31:44.055751 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 17:31:44.611173 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 17:31:44.663290 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:44.674983 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:31:44.729092 tst mo_mt_call.py: using LAC 22590 17:31:44.857074 tst mo_mt_call.py: using RAC 150 17:31:44.983848 tst mo_mt_call.py: using CellId 22590 17:31:45.112559 tst mo_mt_call.py: using BVCI 22591 17:31:45.230170 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:45.241922 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:45.253433 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:45.265042 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:45.276565 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:45.288128 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:45.404827 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:45.521754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:46.073921 run create_hlr_db(pid=27946): Launched 17:31:46.266484 bus /sierra_2: Setting Powered False 17:31:47.331161 run create_hlr_db(pid=27946): Terminated: ok {rc=0} 17:31:47.795567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27948): Launched 17:31:48.101917 run osmo-hlr_10.42.42.2(pid=27949): Launched 17:31:48.220256 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:48.758919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27951): Launched 17:31:49.065673 run osmo-stp_10.42.42.5(pid=27952): Launched 17:31:49.183153 run osmo-msc_10.42.42.6: Starting osmo-msc 17:31:49.735049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27954): Launched 17:31:50.041890 run osmo-msc_10.42.42.6(pid=27955): Launched 17:31:50.212094 run osmo-stp_10.42.42.5(pid=27952): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27952)] 17:31:50.340917 run osmo-stp_10.42.42.5(pid=27952): stdout: | (launched: 2022-12-09_17:31:49.009779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:50.470612 run osmo-stp_10.42.42.5(pid=27952): stderr: | 20221209173149182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173149182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173149183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173149183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173149184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173149184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173149184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:50.598073 run osmo-stp_10.42.42.5(pid=27952): stdout: | (launched: 2022-12-09_17:31:49.009779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:31:50.719080 run osmo-stp_10.42.42.5(pid=27952): stderr: | 20221209173149182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173149182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173149183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173149183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173149184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173149184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173149184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:31:50.863964 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27952): Process ended prematurely: osmo-stp_10.42.42.5(pid=27952) [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27952)] [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 17:31:50.873069 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:31:50.899931 run osmo-hlr_10.42.42.2(pid=27949): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27949)] 17:31:50.947770 run osmo-hlr_10.42.42.2(pid=27949): stdout: | (launched: 2022-12-09_17:31:48.046228) 17:31:50.997384 run osmo-hlr_10.42.42.2(pid=27949): stderr: | 20221209173148222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173148222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173148222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173148222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173148222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173148222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173148234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173148243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173148243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173148243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:31:51.066394 run osmo-msc_10.42.42.6(pid=27955): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27955)] 17:31:51.114257 run osmo-msc_10.42.42.6(pid=27955): stdout: | (launched: 2022-12-09_17:31:49.985754) 17:31:51.163617 run osmo-msc_10.42.42.6(pid=27955): stderr: | 20221209173150279 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173150279 DLGLOBAL DEBUG validating counter group 0x7f2b484e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173150279 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173150279 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173150279 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173150279 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173150281 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173150281 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173150282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173150282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:31:51.213469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27948): Terminating (SIGTERM) 17:31:51.253564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27951): Terminating (SIGTERM) 17:31:51.293289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27954): Terminating (SIGTERM) 17:31:51.334237 --- ParallelTerminationStrategy: PID 27948 died... 17:31:51.353249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27948): Terminated: ok {rc=0} 17:31:51.397753 --- ParallelTerminationStrategy: PID 27951 died... 17:31:51.416221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27951): Terminated: ok {rc=0} 17:31:51.460873 --- ParallelTerminationStrategy: PID 27954 died... 17:31:51.479804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27954): Terminated: ok {rc=0} 17:31:51.566466 bus /sierra_3: Setting Powered False 17:31:52.667476 bus /sierra_3: Setting Powered False 17:31:53.782643 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 17:31:54.931323 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:54.943778 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:31:54.997040 tst mo_mt_call_osmux.py: using LAC 22591 17:31:55.122880 tst mo_mt_call_osmux.py: using RAC 151 17:31:55.249536 tst mo_mt_call_osmux.py: using CellId 22591 17:31:55.374175 tst mo_mt_call_osmux.py: using BVCI 22592 17:31:55.493682 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:55.505504 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:55.517150 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:55.528750 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:55.540341 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:31:55.552332 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:55.669981 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:31:55.793615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:31:56.298962 run create_hlr_db(pid=27957): Launched 17:31:56.434128 bus /sierra_2: Setting Powered False 17:31:57.498718 run create_hlr_db(pid=27957): Terminated: ok {rc=0} 17:31:57.953375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27959): Launched 17:31:58.280258 run osmo-hlr_10.42.42.2(pid=27960): Launched 17:31:58.403939 run osmo-stp_10.42.42.5: Starting osmo-stp 17:31:58.963572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27962): Launched 17:31:59.289493 run osmo-stp_10.42.42.5(pid=27963): Launched 17:31:59.413486 run osmo-msc_10.42.42.6: Starting osmo-msc 17:32:00.003538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27965): Launched 17:32:00.331951 run osmo-msc_10.42.42.6(pid=27966): Launched 17:32:00.513215 run osmo-stp_10.42.42.5(pid=27963): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27963)] 17:32:00.651266 run osmo-stp_10.42.42.5(pid=27963): stdout: | (launched: 2022-12-09_17:31:59.229891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:00.789674 run osmo-stp_10.42.42.5(pid=27963): stderr: | 20221209173159426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173159426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173159426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173159426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173159427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173159427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173159427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:00.933450 run osmo-stp_10.42.42.5(pid=27963): stdout: | (launched: 2022-12-09_17:31:59.229891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:01.066855 run osmo-stp_10.42.42.5(pid=27963): stderr: | 20221209173159426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173159426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173159426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173159426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173159427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173159427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173159427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:01.224418 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27963): Process ended prematurely: osmo-stp_10.42.42.5(pid=27963) [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27963)] [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 17:32:01.235184 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:32:01.264267 run osmo-hlr_10.42.42.2(pid=27960): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27960)] 17:32:01.316096 run osmo-hlr_10.42.42.2(pid=27960): stdout: | (launched: 2022-12-09_17:31:58.221053) 17:32:01.369171 run osmo-hlr_10.42.42.2(pid=27960): stderr: | 20221209173158423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173158423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173158423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173158423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173158423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173158423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173158435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173158443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173158443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173158443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:01.442869 run osmo-msc_10.42.42.6(pid=27966): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27966)] 17:32:01.494452 run osmo-msc_10.42.42.6(pid=27966): stdout: | (launched: 2022-12-09_17:32:00.272252) 17:32:01.547251 run osmo-msc_10.42.42.6(pid=27966): stderr: | 20221209173200596 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173200596 DLGLOBAL DEBUG validating counter group 0x7f25b3254c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173200596 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173200596 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173200596 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173200596 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173200598 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173200598 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173200598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173200599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:32:01.600414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27959): Terminating (SIGTERM) 17:32:01.643242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27962): Terminating (SIGTERM) 17:32:01.687014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27965): Terminating (SIGTERM) 17:32:01.731815 --- ParallelTerminationStrategy: PID 27959 died... 17:32:01.752346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27959): Terminated: ok {rc=0} 17:32:01.799575 --- ParallelTerminationStrategy: PID 27962 died... 17:32:01.819655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27962): Terminated: ok {rc=0} 17:32:01.867399 --- ParallelTerminationStrategy: PID 27965 died... 17:32:01.887735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27965): Terminated: ok {rc=0} 17:32:01.977993 bus /sierra_3: Setting Powered False 17:32:03.078422 bus /sierra_3: Setting Powered False 17:32:04.193802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 emergency:trx-b200 --------------------------------------------------------------------- 17:32:05.452406 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:32:05.458114 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 17:32:05.492212 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:32:05.519549 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 17:32:05.605615 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 17:32:05.639141 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:32:05.666267 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 17:32:06.251209 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2362 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 17:32:06.256602 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:06.267721 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 17:32:06.317316 tst emergency_mo_mt_call.py: using LAC 22592 17:32:06.441356 tst emergency_mo_mt_call.py: using RAC 152 17:32:06.568529 tst emergency_mo_mt_call.py: using CellId 22592 17:32:06.695725 tst emergency_mo_mt_call.py: using BVCI 22593 17:32:06.813110 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:06.824233 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:06.835121 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:06.846029 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:06.856853 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:06.867733 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:06.982657 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:07.099238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:07.595155 run create_hlr_db(pid=27972): Launched 17:32:07.726077 bus /sierra_2: Setting Powered False 17:32:08.788855 run create_hlr_db(pid=27972): Terminated: ok {rc=0} 17:32:09.218240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27974): Launched 17:32:09.518089 run osmo-hlr_10.42.42.2(pid=27975): Launched 17:32:09.633125 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:10.165980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27977): Launched 17:32:10.465643 run osmo-stp_10.42.42.5(pid=27978): Launched 17:32:10.592051 tst emergency_mo_mt_call.py: using MSISDN 7296 17:32:10.745396 run osmo-msc_10.42.42.6: Starting osmo-msc 17:32:11.285247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27980): Launched 17:32:11.584765 run osmo-msc_10.42.42.6(pid=27981): Launched 17:32:11.755372 run osmo-stp_10.42.42.5(pid=27978): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27978)] 17:32:11.883665 run osmo-stp_10.42.42.5(pid=27978): stdout: | (launched: 2022-12-09_17:32:10.410560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:12.011369 run osmo-stp_10.42.42.5(pid=27978): stderr: | 20221209173210582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173210582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173210582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173210582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173210583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173210583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173210583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:12.136597 run osmo-stp_10.42.42.5(pid=27978): stdout: | (launched: 2022-12-09_17:32:10.410560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:12.255997 run osmo-stp_10.42.42.5(pid=27978): stderr: | 20221209173210582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173210582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173210582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173210582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173210583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173210583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173210583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:12.398782 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27978): Process ended prematurely: osmo-stp_10.42.42.5(pid=27978) [trial-2362↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27978)] [trial-2362↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 17:32:12.407336 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 17:32:12.434066 run osmo-hlr_10.42.42.2(pid=27975): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27975)] 17:32:12.482810 run osmo-hlr_10.42.42.2(pid=27975): stdout: | (launched: 2022-12-09_17:32:09.463185) 17:32:12.533213 run osmo-hlr_10.42.42.2(pid=27975): stderr: | 20221209173209639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173209639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173209639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173209639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173209639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173209639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173209651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173209660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173209661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173209661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:12.603187 run osmo-msc_10.42.42.6(pid=27981): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27981)] 17:32:12.651364 run osmo-msc_10.42.42.6(pid=27981): stdout: | (launched: 2022-12-09_17:32:11.529722) 17:32:12.701601 run osmo-msc_10.42.42.6(pid=27981): stderr: | 20221209173211803 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173211803 DLGLOBAL DEBUG validating counter group 0x7f151253bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173211803 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173211803 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173211803 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173211804 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173211805 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173211806 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173211806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173211806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:32:12.751977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27974): Terminating (SIGTERM) 17:32:12.792171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27977): Terminating (SIGTERM) 17:32:12.832520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27980): Terminating (SIGTERM) 17:32:12.872734 --- ParallelTerminationStrategy: PID 27974 died... 17:32:12.891976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27974): Terminated: ok {rc=0} 17:32:12.936634 --- ParallelTerminationStrategy: PID 27977 died... 17:32:12.955241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27977): Terminated: ok {rc=0} 17:32:12.999575 --- ParallelTerminationStrategy: PID 27980 died... 17:32:13.018374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27980): Terminated: ok {rc=0} 17:32:13.105088 bus /sierra_3: Setting Powered False 17:32:14.203771 bus /sierra_3: Setting Powered False 17:32:15.316505 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 17:32:16.402191 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:16.414513 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 17:32:16.467490 tst emergency_preemptive_call.py: using LAC 22593 17:32:16.594692 tst emergency_preemptive_call.py: using RAC 153 17:32:16.718837 tst emergency_preemptive_call.py: using CellId 22593 17:32:16.883962 tst emergency_preemptive_call.py: using BVCI 22594 17:32:17.023250 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:17.034936 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:17.046886 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:17.058846 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:17.070517 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 17:32:17.081975 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:17.204906 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:17.325862 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:17.440272 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 17:32:17.555575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:18.023126 run create_hlr_db(pid=27983): Launched 17:32:18.138708 bus /sierra_2: Setting Powered False 17:32:19.198616 run create_hlr_db(pid=27983): Terminated: ok {rc=0} 17:32:19.639819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27985): Launched 17:32:19.960940 run osmo-hlr_10.42.42.2(pid=27986): Launched 17:32:20.082460 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:20.633932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27988): Launched 17:32:20.954045 run osmo-stp_10.42.42.5(pid=27989): Launched 17:32:21.086451 tst emergency_preemptive_call.py: using MSISDN 7297 17:32:21.249811 run osmo-msc_10.42.42.6: Starting osmo-msc 17:32:21.824737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27991): Launched 17:32:22.144562 run osmo-msc_10.42.42.6(pid=27992): Launched 17:32:22.323898 run osmo-stp_10.42.42.5(pid=27989): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27989)] 17:32:22.458945 run osmo-stp_10.42.42.5(pid=27989): stdout: | (launched: 2022-12-09_17:32:20.895785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:22.594501 run osmo-stp_10.42.42.5(pid=27989): stderr: | 20221209173221086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173221086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173221087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173221087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173221089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173221089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173221090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:22.730158 run osmo-stp_10.42.42.5(pid=27989): stdout: | (launched: 2022-12-09_17:32:20.895785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:22.858432 run osmo-stp_10.42.42.5(pid=27989): stderr: | 20221209173221086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173221086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173221087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173221087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173221089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173221089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173221090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:23.011712 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27989): Process ended prematurely: osmo-stp_10.42.42.5(pid=27989) [trial-2362↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27989)] [trial-2362↪emergency:trx-b200↪emergency_preemptive_call.py:32] 17:32:23.020748 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 17:32:23.048798 run osmo-hlr_10.42.42.2(pid=27986): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27986)] 17:32:23.099431 run osmo-hlr_10.42.42.2(pid=27986): stdout: | (launched: 2022-12-09_17:32:19.902313) 17:32:23.151902 run osmo-hlr_10.42.42.2(pid=27986): stderr: | 20221209173220102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173220102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173220102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173220102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173220103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173220103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173220115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173220124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173220124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173220124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:23.225298 run osmo-msc_10.42.42.6(pid=27992): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27992)] 17:32:23.275782 run osmo-msc_10.42.42.6(pid=27992): stdout: | (launched: 2022-12-09_17:32:22.086018) 17:32:23.327933 run osmo-msc_10.42.42.6(pid=27992): stderr: | 20221209173222411 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173222411 DLGLOBAL DEBUG validating counter group 0x7f6a3f390c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173222411 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173222411 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173222412 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173222412 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173222414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173222414 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173222414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173222414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:32:23.380204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27985): Terminating (SIGTERM) 17:32:23.422424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27988): Terminating (SIGTERM) 17:32:23.464460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27991): Terminating (SIGTERM) 17:32:23.506934 --- ParallelTerminationStrategy: PID 27985 died... 17:32:23.527198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27985): Terminated: ok {rc=0} 17:32:23.574464 --- ParallelTerminationStrategy: PID 27988 died... 17:32:23.594375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27988): Terminated: ok {rc=0} 17:32:23.641157 --- ParallelTerminationStrategy: PID 27991 died... 17:32:23.660920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27991): Terminated: ok {rc=0} 17:32:23.750375 bus /sierra_9: Setting Powered False 17:32:24.851230 bus /sierra_9: Setting Powered False 17:32:25.969845 bus /sierra_8: Setting Powered False 17:32:27.071251 bus /sierra_8: Setting Powered False 17:32:28.187731 bus /sierra_3: Setting Powered False 17:32:29.285908 bus /sierra_3: Setting Powered False 17:32:30.401324 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-b200 --------------------------------------------------------------------- 17:32:31.694829 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:32:31.703636 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 17:32:31.741046 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 17:32:31.781495 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 17:32:31.866868 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 17:32:31.902345 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 17:32:31.942695 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 17:32:32.529286 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 17:32:32.582787 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:32.593450 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:32:32.641280 tst cs_paging_gprs_active.py: using LAC 22594 17:32:32.761782 tst cs_paging_gprs_active.py: using RAC 154 17:32:32.883421 tst cs_paging_gprs_active.py: using CellId 22594 17:32:33.004316 tst cs_paging_gprs_active.py: using BVCI 22595 17:32:33.115591 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:33.126217 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:33.136591 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:33.147772 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:33.158761 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:33.169685 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:33.180690 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:33.191861 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:33.203059 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:33.323090 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:33.443503 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:32:33.667109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:33.997502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27997): Launched 17:32:34.283296 run iperf3-srv_10.42.42.10(pid=27998): Launched 17:32:34.407587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:32:34.628438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:34.957386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27999): Launched 17:32:35.242599 run iperf3-srv_10.42.42.10(pid=28000): Launched 17:32:35.365351 tst cs_paging_gprs_active.py:38: start network... 17:32:35.585380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:36.091697 run create_hlr_db(pid=28005): Launched 17:32:36.226122 bus /sierra_2: Setting Powered False 17:32:37.290262 run create_hlr_db(pid=28005): Terminated: ok {rc=0} 17:32:37.726278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28007): Launched 17:32:38.033708 run osmo-hlr_10.42.42.2(pid=28008): Launched 17:32:38.151123 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:38.691829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28010): Launched 17:32:38.998495 run osmo-stp_10.42.42.5(pid=28011): Launched 17:32:39.117154 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:32:39.645058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28013): Launched 17:32:39.762989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:32:40.025537 run patchelf(pid=28014): Launched 17:32:40.198063 run osmo-stp_10.42.42.5(pid=28011): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28011)] 17:32:40.328688 run osmo-stp_10.42.42.5(pid=28011): stdout: | (launched: 2022-12-09_17:32:38.942456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:40.460436 run osmo-stp_10.42.42.5(pid=28011): stderr: | 20221209173239113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173239113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173239113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173239113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173239114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173239114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173239114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:40.591618 run osmo-stp_10.42.42.5(pid=28011): stdout: | (launched: 2022-12-09_17:32:38.942456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:40.716935 run osmo-stp_10.42.42.5(pid=28011): stderr: | 20221209173239113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173239113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173239113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173239113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173239114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173239114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173239114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:40.865867 run patchelf(pid=28014): Terminating (SIGINT) 17:32:41.038105 run patchelf(pid=28014): Terminated: ok {rc=0} 17:32:41.162866 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28011): Process ended prematurely: osmo-stp_10.42.42.5(pid=28011) [trial-2362↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28011)] [trial-2362↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 17:32:41.172456 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:32:41.200329 run osmo-hlr_10.42.42.2(pid=28008): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28008)] 17:32:41.248564 run osmo-hlr_10.42.42.2(pid=28008): stdout: | (launched: 2022-12-09_17:32:37.977790) 17:32:41.298330 run osmo-hlr_10.42.42.2(pid=28008): stderr: | 20221209173238153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173238153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173238154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173238154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173238154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173238154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173238166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173238174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173238174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173238175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:41.348582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27997): Terminating (SIGTERM) 17:32:41.388780 run iperf3-srv_10.42.42.10(pid=27998): Terminating (SIGTERM) 17:32:41.429004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27999): Terminating (SIGTERM) 17:32:41.469228 run iperf3-srv_10.42.42.10(pid=28000): Terminating (SIGTERM) 17:32:41.509235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28007): Terminating (SIGTERM) 17:32:41.550214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28010): Terminating (SIGTERM) 17:32:41.590839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28013): Terminating (SIGTERM) 17:32:41.631448 --- ParallelTerminationStrategy: PID 27997 died... 17:32:41.650668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27997): Terminated: ok {rc=0} 17:32:41.696288 --- ParallelTerminationStrategy: PID 27998 died... 17:32:41.714933 run iperf3-srv_10.42.42.10(pid=27998): Terminated {rc=256} 17:32:41.759490 --- ParallelTerminationStrategy: PID 27999 died... 17:32:41.778123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27999): Terminated: ok {rc=0} 17:32:41.822858 --- ParallelTerminationStrategy: PID 28000 died... 17:32:41.841667 run iperf3-srv_10.42.42.10(pid=28000): Terminated {rc=256} 17:32:41.886696 --- ParallelTerminationStrategy: PID 28007 died... 17:32:41.905549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28007): Terminated: ok {rc=0} 17:32:41.950094 --- ParallelTerminationStrategy: PID 28010 died... 17:32:41.968755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28010): Terminated: ok {rc=0} 17:32:42.013840 --- ParallelTerminationStrategy: PID 28013 died... 17:32:42.032416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28013): Terminated: ok {rc=0} 17:32:42.117014 bus /gobi_0: Setting Powered False 17:32:43.213620 bus /gobi_0: Setting Powered False 17:32:44.328357 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200 iperf3.py ---------------------------------------------- 17:32:45.475287 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:45.486606 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:32:45.538395 tst iperf3.py: using LAC 22595 17:32:45.660305 tst iperf3.py: using RAC 155 17:32:45.781708 tst iperf3.py: using CellId 22595 17:32:45.939388 tst iperf3.py: using BVCI 22596 17:32:46.067560 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:46.079175 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:46.090656 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:46.102673 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:46.114544 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:46.126299 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:46.138183 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:46.150225 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:46.162914 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:46.286064 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:32:46.496440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:46.809401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28015): Launched 17:32:47.117827 run iperf3-srv_10.42.42.10(pid=28016): Launched 17:32:47.242317 tst iperf3.py:8: start network... 17:32:47.446768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:32:47.918194 run create_hlr_db(pid=28017): Launched 17:32:48.037421 bus /gobi_6: Setting Powered False 17:32:49.097790 run create_hlr_db(pid=28017): Terminated: ok {rc=0} 17:32:49.543393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28019): Launched 17:32:49.872200 run osmo-hlr_10.42.42.2(pid=28020): Launched 17:32:49.995921 run osmo-stp_10.42.42.5: Starting osmo-stp 17:32:50.563363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28022): Launched 17:32:50.893151 run osmo-stp_10.42.42.5(pid=28023): Launched 17:32:51.018660 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:32:51.582332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28025): Launched 17:32:51.710154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:32:51.985427 run patchelf(pid=28026): Launched 17:32:52.167608 run osmo-stp_10.42.42.5(pid=28023): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28023)] 17:32:52.305937 run osmo-stp_10.42.42.5(pid=28023): stdout: | (launched: 2022-12-09_17:32:50.833622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:52.446098 run osmo-stp_10.42.42.5(pid=28023): stderr: | 20221209173251029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173251029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173251029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173251030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173251030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173251030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173251030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:52.586136 run osmo-stp_10.42.42.5(pid=28023): stdout: | (launched: 2022-12-09_17:32:50.833622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:32:52.719936 run osmo-stp_10.42.42.5(pid=28023): stderr: | 20221209173251029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173251029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173251029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173251030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173251030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173251030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173251030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:32:52.878473 run patchelf(pid=28026): Terminating (SIGINT) 17:32:53.061184 run patchelf(pid=28026): Terminated: ok {rc=0} 17:32:53.193134 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28023): Process ended prematurely: osmo-stp_10.42.42.5(pid=28023) [trial-2362↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28023)] [trial-2362↪gprs:trx-b200↪iperf3.py:8] 17:32:53.203478 tst iperf3.py:8: Test FAILED (7.8 sec) 17:32:53.231946 run osmo-hlr_10.42.42.2(pid=28020): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28020)] 17:32:53.282039 run osmo-hlr_10.42.42.2(pid=28020): stdout: | (launched: 2022-12-09_17:32:49.812878) 17:32:53.333745 run osmo-hlr_10.42.42.2(pid=28020): stderr: | 20221209173250013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173250013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173250013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173250013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173250013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173250013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173250025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173250033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173250033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173250033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:32:53.385979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28015): Terminating (SIGTERM) 17:32:53.427944 run iperf3-srv_10.42.42.10(pid=28016): Terminating (SIGTERM) 17:32:53.469859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28019): Terminating (SIGTERM) 17:32:53.511930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28022): Terminating (SIGTERM) 17:32:53.553945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28025): Terminating (SIGTERM) 17:32:53.596255 --- ParallelTerminationStrategy: PID 28015 died... 17:32:53.616516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28015): Terminated: ok {rc=0} 17:32:53.663727 --- ParallelTerminationStrategy: PID 28016 died... 17:32:53.683333 run iperf3-srv_10.42.42.10(pid=28016): Terminated {rc=256} 17:32:53.730340 --- ParallelTerminationStrategy: PID 28019 died... 17:32:53.750192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28019): Terminated: ok {rc=0} 17:32:53.796854 --- ParallelTerminationStrategy: PID 28022 died... 17:32:53.817006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28022): Terminated: ok {rc=0} 17:32:53.863323 --- ParallelTerminationStrategy: PID 28025 died... 17:32:53.883000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28025): Terminated: ok {rc=0} 17:32:53.971566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 17:32:55.124307 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.136182 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:32:55.187710 tst iperf3m4.py: using LAC 22596 17:32:55.318923 tst iperf3m4.py: using RAC 156 17:32:55.446322 tst iperf3m4.py: using CellId 22596 17:32:55.573048 tst iperf3m4.py: using BVCI 22597 17:32:55.691434 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.703040 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.714015 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.724940 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.735802 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.746590 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.757762 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.768493 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:32:55.779453 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:55.902108 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:56.024018 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:56.142374 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:32:56.263069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:32:56.483687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:56.811735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28027): Launched 17:32:57.096415 run iperf3-srv_10.42.42.10(pid=28028): Launched 17:32:57.219199 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:32:57.438947 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:57.767118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28029): Launched 17:32:58.051314 run iperf3-srv_10.42.42.10(pid=28030): Launched 17:32:58.175238 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:32:58.394892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:58.723466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28031): Launched 17:32:59.009529 run iperf3-srv_10.42.42.10(pid=28032): Launched 17:32:59.133456 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:32:59.352614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:32:59.680656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28033): Launched 17:32:59.966286 run iperf3-srv_10.42.42.10(pid=28034): Launched 17:33:00.089029 tst iperf3m4.py:8: start network... 17:33:00.308595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:00.815349 run create_hlr_db(pid=28035): Launched 17:33:00.982734 bus /gobi_6: Setting Powered False 17:33:02.044873 run create_hlr_db(pid=28035): Terminated: ok {rc=0} 17:33:02.513426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28038): Launched 17:33:02.841590 run osmo-hlr_10.42.42.2(pid=28039): Launched 17:33:02.967375 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:03.531827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28041): Launched 17:33:03.861146 run osmo-stp_10.42.42.5(pid=28042): Launched 17:33:03.985852 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:04.547957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28044): Launched 17:33:04.673229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:04.948460 run patchelf(pid=28045): Launched 17:33:05.131810 run osmo-stp_10.42.42.5(pid=28042): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28042)] 17:33:05.270297 run osmo-stp_10.42.42.5(pid=28042): stdout: | (launched: 2022-12-09_17:33:03.801646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:05.410265 run osmo-stp_10.42.42.5(pid=28042): stderr: | 20221209173303996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173303996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173303997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173303997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173303998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173303998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173303998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:05.550141 run osmo-stp_10.42.42.5(pid=28042): stdout: | (launched: 2022-12-09_17:33:03.801646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:05.683751 run osmo-stp_10.42.42.5(pid=28042): stderr: | 20221209173303996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173303996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173303997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173303997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173303998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173303998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173303998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:05.843206 run patchelf(pid=28045): Terminating (SIGINT) 17:33:06.025896 run patchelf(pid=28045): Terminated: ok {rc=0} 17:33:06.157993 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28042): Process ended prematurely: osmo-stp_10.42.42.5(pid=28042) [trial-2362↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28042)] [trial-2362↪gprs:trx-b200↪iperf3m4.py:8] 17:33:06.168373 tst iperf3m4.py:8: Test FAILED (11.1 sec) 17:33:06.197791 run osmo-hlr_10.42.42.2(pid=28039): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28039)] 17:33:06.248360 run osmo-hlr_10.42.42.2(pid=28039): stdout: | (launched: 2022-12-09_17:33:02.781874) 17:33:06.300571 run osmo-hlr_10.42.42.2(pid=28039): stderr: | 20221209173302984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173302984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173302985 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173302985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173302985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173302985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173302998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173303007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173303007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173303008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:06.353234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28027): Terminating (SIGTERM) 17:33:06.395642 run iperf3-srv_10.42.42.10(pid=28028): Terminating (SIGTERM) 17:33:06.438023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28029): Terminating (SIGTERM) 17:33:06.480719 run iperf3-srv_10.42.42.10(pid=28030): Terminating (SIGTERM) 17:33:06.523191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28031): Terminating (SIGTERM) 17:33:06.565948 run iperf3-srv_10.42.42.10(pid=28032): Terminating (SIGTERM) 17:33:06.608093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28033): Terminating (SIGTERM) 17:33:06.650431 run iperf3-srv_10.42.42.10(pid=28034): Terminating (SIGTERM) 17:33:06.692390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28038): Terminating (SIGTERM) 17:33:06.735086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28041): Terminating (SIGTERM) 17:33:06.777355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28044): Terminating (SIGTERM) 17:33:06.819779 --- ParallelTerminationStrategy: PID 28027 died... 17:33:06.839866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28027): Terminated: ok {rc=0} 17:33:06.886937 --- ParallelTerminationStrategy: PID 28028 died... 17:33:06.906582 run iperf3-srv_10.42.42.10(pid=28028): Terminated {rc=256} 17:33:06.953498 --- ParallelTerminationStrategy: PID 28029 died... 17:33:06.973220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28029): Terminated: ok {rc=0} 17:33:07.020116 --- ParallelTerminationStrategy: PID 28030 died... 17:33:07.039669 run iperf3-srv_10.42.42.10(pid=28030): Terminated {rc=256} 17:33:07.085575 --- ParallelTerminationStrategy: PID 28031 died... 17:33:07.105000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28031): Terminated: ok {rc=0} 17:33:07.151357 --- ParallelTerminationStrategy: PID 28032 died... 17:33:07.170735 run iperf3-srv_10.42.42.10(pid=28032): Terminated {rc=256} 17:33:07.216663 --- ParallelTerminationStrategy: PID 28033 died... 17:33:07.236160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28033): Terminated: ok {rc=0} 17:33:07.282429 --- ParallelTerminationStrategy: PID 28034 died... 17:33:07.302072 run iperf3-srv_10.42.42.10(pid=28034): Terminated {rc=256} 17:33:07.348153 --- ParallelTerminationStrategy: PID 28038 died... 17:33:07.367728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28038): Terminated: ok {rc=0} 17:33:07.413862 --- ParallelTerminationStrategy: PID 28041 died... 17:33:07.433587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28041): Terminated: ok {rc=0} 17:33:07.479860 --- ParallelTerminationStrategy: PID 28044 died... 17:33:07.499632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28044): Terminated: ok {rc=0} 17:33:07.588921 bus /gobi_4: Setting Powered False 17:33:08.689922 bus /gobi_4: Setting Powered False 17:33:09.808847 bus /gobi_1: Setting Powered False 17:33:10.908479 bus /gobi_1: Setting Powered False 17:33:12.026069 bus /gobi_0: Setting Powered False 17:33:13.125931 bus /gobi_0: Setting Powered False 17:33:14.249967 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200 ping.py ---------------------------------------------- 17:33:15.355144 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:15.366974 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:33:15.417580 tst ping.py: using LAC 22597 17:33:15.543547 tst ping.py: using RAC 157 17:33:15.663316 tst ping.py: using CellId 22597 17:33:15.781304 tst ping.py: using BVCI 22598 17:33:15.912883 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:15.925362 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:15.936390 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:15.948159 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:15.960366 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:15.972335 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:15.984728 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:15.998513 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:16.122896 tst ping.py:19: start network... 17:33:16.328411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:16.843543 run create_hlr_db(pid=28046): Launched 17:33:16.964209 bus /gobi_6: Setting Powered False 17:33:18.025156 run create_hlr_db(pid=28046): Terminated: ok {rc=0} 17:33:18.454232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28048): Launched 17:33:18.755702 run osmo-hlr_10.42.42.2(pid=28049): Launched 17:33:18.870741 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:19.411103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28051): Launched 17:33:19.711893 run osmo-stp_10.42.42.5(pid=28052): Launched 17:33:19.826787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:20.342871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28054): Launched 17:33:20.458963 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:20.713401 run patchelf(pid=28055): Launched 17:33:20.880454 run osmo-stp_10.42.42.5(pid=28052): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28052)] 17:33:21.008309 run osmo-stp_10.42.42.5(pid=28052): stdout: | (launched: 2022-12-09_17:33:19.656623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:21.138241 run osmo-stp_10.42.42.5(pid=28052): stderr: | 20221209173319826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173319827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173319827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173319827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173319828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173319828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173319828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:21.268402 run osmo-stp_10.42.42.5(pid=28052): stdout: | (launched: 2022-12-09_17:33:19.656623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:21.391986 run osmo-stp_10.42.42.5(pid=28052): stderr: | 20221209173319826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173319827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173319827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173319827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173319828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173319828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173319828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:21.538388 run patchelf(pid=28055): Terminating (SIGINT) 17:33:21.707951 run patchelf(pid=28055): Terminated: ok {rc=0} 17:33:21.830503 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28052): Process ended prematurely: osmo-stp_10.42.42.5(pid=28052) [trial-2362↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28052)] [trial-2362↪gprs:trx-b200↪ping.py:22] 17:33:21.839695 tst ping.py:22: Test FAILED (6.5 sec) 17:33:21.867503 run osmo-hlr_10.42.42.2(pid=28049): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28049)] 17:33:21.915934 run osmo-hlr_10.42.42.2(pid=28049): stdout: | (launched: 2022-12-09_17:33:18.700396) 17:33:21.966365 run osmo-hlr_10.42.42.2(pid=28049): stderr: | 20221209173318877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173318877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173318878 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173318878 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173318878 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173318878 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173318890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173318898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173318899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173318899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:22.017191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28048): Terminating (SIGTERM) 17:33:22.057517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28051): Terminating (SIGTERM) 17:33:22.097985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28054): Terminating (SIGTERM) 17:33:22.138510 --- ParallelTerminationStrategy: PID 28048 died... 17:33:22.157820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28048): Terminated: ok {rc=0} 17:33:22.202965 --- ParallelTerminationStrategy: PID 28051 died... 17:33:22.221911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28051): Terminated: ok {rc=0} 17:33:22.266996 --- ParallelTerminationStrategy: PID 28054 died... 17:33:22.285868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28054): Terminated: ok {rc=0} 17:33:22.370509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 17:33:23.458364 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:23.470293 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 17:33:23.523123 tst ping_idle_ping.py: using LAC 22598 17:33:23.651326 tst ping_idle_ping.py: using RAC 158 17:33:23.777940 tst ping_idle_ping.py: using CellId 22598 17:33:23.903943 tst ping_idle_ping.py: using BVCI 22599 17:33:24.020926 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:24.032127 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:24.043284 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:24.055443 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:24.066623 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:24.077440 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:24.088146 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 17:33:24.098902 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 17:33:24.217430 tst ping_idle_ping.py:24: start network... 17:33:24.434803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:24.936542 run create_hlr_db(pid=28056): Launched 17:33:25.066958 bus /gobi_6: Setting Powered False 17:33:26.131342 run create_hlr_db(pid=28056): Terminated: ok {rc=0} 17:33:26.562126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28058): Launched 17:33:26.863837 run osmo-hlr_10.42.42.2(pid=28059): Launched 17:33:26.978936 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:27.508307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28061): Launched 17:33:27.809923 run osmo-stp_10.42.42.5(pid=28062): Launched 17:33:27.927448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:28.445086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28064): Launched 17:33:28.561233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:28.814950 run patchelf(pid=28065): Launched 17:33:28.982391 run osmo-stp_10.42.42.5(pid=28062): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28062)] 17:33:29.110315 run osmo-stp_10.42.42.5(pid=28062): stdout: | (launched: 2022-12-09_17:33:27.754340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:29.239891 run osmo-stp_10.42.42.5(pid=28062): stderr: | 20221209173327924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173327924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173327924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173327925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173327925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173327925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173327925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:29.369957 run osmo-stp_10.42.42.5(pid=28062): stdout: | (launched: 2022-12-09_17:33:27.754340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:29.493082 run osmo-stp_10.42.42.5(pid=28062): stderr: | 20221209173327924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173327924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173327924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173327925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173327925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173327925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173327925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:29.639152 run patchelf(pid=28065): Terminating (SIGINT) 17:33:29.808220 run patchelf(pid=28065): Terminated: ok {rc=0} 17:33:29.930095 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28062): Process ended prematurely: osmo-stp_10.42.42.5(pid=28062) [trial-2362↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28062)] [trial-2362↪gprs:trx-b200↪ping_idle_ping.py:27] 17:33:29.939097 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:33:29.966648 run osmo-hlr_10.42.42.2(pid=28059): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28059)] 17:33:30.014703 run osmo-hlr_10.42.42.2(pid=28059): stdout: | (launched: 2022-12-09_17:33:26.808811) 17:33:30.064396 run osmo-hlr_10.42.42.2(pid=28059): stderr: | 20221209173326988 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173326988 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173326988 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173326988 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173326988 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173326989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173326999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173327008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173327008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173327008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:30.114444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28058): Terminating (SIGTERM) 17:33:30.154363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28061): Terminating (SIGTERM) 17:33:30.194309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28064): Terminating (SIGTERM) 17:33:30.234538 --- ParallelTerminationStrategy: PID 28058 died... 17:33:30.253443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28058): Terminated: ok {rc=0} 17:33:30.297981 --- ParallelTerminationStrategy: PID 28061 died... 17:33:30.316686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28061): Terminated: ok {rc=0} 17:33:30.361156 --- ParallelTerminationStrategy: PID 28064 died... 17:33:30.379799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28064): Terminated: ok {rc=0} 17:33:30.463961 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 17:33:31.780404 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:33:31.787107 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:33:31.822642 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:33:31.862974 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:33:31.952216 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:33:31.998227 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:33:32.049787 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:33:32.621668 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:33:32.674246 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:32.685686 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:33:32.737770 tst cs_paging_gprs_active.py: using LAC 22599 17:33:32.867818 tst cs_paging_gprs_active.py: using RAC 159 17:33:32.995178 tst cs_paging_gprs_active.py: using CellId 22599 17:33:33.122164 tst cs_paging_gprs_active.py: using BVCI 22600 17:33:33.242294 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:33.253665 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:33.264579 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:33.275622 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:33.286694 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:33.297699 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:33.308928 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:33.320017 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:33.331377 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:33.447626 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:33.567219 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:33:33.789539 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:34.118318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28069): Launched 17:33:34.404000 run iperf3-srv_10.42.42.10(pid=28070): Launched 17:33:34.527361 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:33:34.748672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:35.078654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28071): Launched 17:33:35.365454 run iperf3-srv_10.42.42.10(pid=28072): Launched 17:33:35.488795 tst cs_paging_gprs_active.py:38: start network... 17:33:35.709503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:36.216877 run create_hlr_db(pid=28073): Launched 17:33:36.349943 bus /gobi_6: Setting Powered False 17:33:37.414751 run create_hlr_db(pid=28073): Terminated: ok {rc=0} 17:33:37.851061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28075): Launched 17:33:38.157710 run osmo-hlr_10.42.42.2(pid=28076): Launched 17:33:38.275050 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:38.818805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28078): Launched 17:33:39.125640 run osmo-stp_10.42.42.5(pid=28079): Launched 17:33:39.242632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:39.776716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28081): Launched 17:33:39.894538 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:40.154401 run patchelf(pid=28082): Launched 17:33:40.326536 run osmo-stp_10.42.42.5(pid=28079): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28079)] 17:33:40.456754 run osmo-stp_10.42.42.5(pid=28079): stdout: | (launched: 2022-12-09_17:33:39.069334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:40.588336 run osmo-stp_10.42.42.5(pid=28079): stderr: | 20221209173339242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173339243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173339243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173339243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173339244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173339244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173339244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:40.719419 run osmo-stp_10.42.42.5(pid=28079): stdout: | (launched: 2022-12-09_17:33:39.069334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:40.845703 run osmo-stp_10.42.42.5(pid=28079): stderr: | 20221209173339242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173339243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173339243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173339243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173339244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173339244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173339244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:40.995113 run patchelf(pid=28082): Terminating (SIGINT) 17:33:41.168070 run patchelf(pid=28082): Terminated: ok {rc=0} 17:33:41.293472 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28079): Process ended prematurely: osmo-stp_10.42.42.5(pid=28079) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28079)] [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:33:41.303056 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:33:41.330813 run osmo-hlr_10.42.42.2(pid=28076): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28076)] 17:33:41.379315 run osmo-hlr_10.42.42.2(pid=28076): stdout: | (launched: 2022-12-09_17:33:38.101893) 17:33:41.429289 run osmo-hlr_10.42.42.2(pid=28076): stderr: | 20221209173338278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173338278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173338278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173338278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173338278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173338278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173338290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173338301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173338301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173338301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:41.479439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28069): Terminating (SIGTERM) 17:33:41.519754 run iperf3-srv_10.42.42.10(pid=28070): Terminating (SIGTERM) 17:33:41.561213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28071): Terminating (SIGTERM) 17:33:41.605969 run iperf3-srv_10.42.42.10(pid=28072): Terminating (SIGTERM) 17:33:41.648276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28075): Terminating (SIGTERM) 17:33:41.690936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28078): Terminating (SIGTERM) 17:33:41.733923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28081): Terminating (SIGTERM) 17:33:41.776907 --- ParallelTerminationStrategy: PID 28069 died... 17:33:41.796752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28069): Terminated: ok {rc=0} 17:33:41.844207 --- ParallelTerminationStrategy: PID 28070 died... 17:33:41.863801 run iperf3-srv_10.42.42.10(pid=28070): Terminated {rc=256} 17:33:41.911016 --- ParallelTerminationStrategy: PID 28071 died... 17:33:41.930476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28071): Terminated: ok {rc=0} 17:33:41.977393 --- ParallelTerminationStrategy: PID 28072 died... 17:33:41.996733 run iperf3-srv_10.42.42.10(pid=28072): Terminated {rc=256} 17:33:42.043708 --- ParallelTerminationStrategy: PID 28075 died... 17:33:42.063302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28075): Terminated: ok {rc=0} 17:33:42.110594 --- ParallelTerminationStrategy: PID 28078 died... 17:33:42.130134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28078): Terminated: ok {rc=0} 17:33:42.177305 --- ParallelTerminationStrategy: PID 28081 died... 17:33:42.196776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28081): Terminated: ok {rc=0} 17:33:42.285586 bus /gobi_0: Setting Powered False 17:33:43.386271 bus /gobi_0: Setting Powered False 17:33:44.504350 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:33:45.654798 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:45.666895 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:33:45.720743 tst iperf3.py: using LAC 22600 17:33:45.853964 tst iperf3.py: using RAC 160 17:33:45.982978 tst iperf3.py: using CellId 22600 17:33:46.138047 tst iperf3.py: using BVCI 22601 17:33:46.259628 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:46.272075 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:46.284137 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:46.296432 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:46.308338 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:46.320222 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:46.332181 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:46.344179 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:46.356164 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:46.481207 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:33:46.705772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:47.042992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28083): Launched 17:33:47.355006 run iperf3-srv_10.42.42.10(pid=28084): Launched 17:33:47.471157 tst iperf3.py:8: start network... 17:33:47.676288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:33:48.148688 run create_hlr_db(pid=28085): Launched 17:33:48.266436 bus /gobi_6: Setting Powered False 17:33:49.327294 run create_hlr_db(pid=28085): Terminated: ok {rc=0} 17:33:49.752431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28087): Launched 17:33:50.058293 run osmo-hlr_10.42.42.2(pid=28088): Launched 17:33:50.175401 run osmo-stp_10.42.42.5: Starting osmo-stp 17:33:50.700899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28090): Launched 17:33:51.009039 run osmo-stp_10.42.42.5(pid=28091): Launched 17:33:51.126408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:33:51.652683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28093): Launched 17:33:51.770314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:33:52.027916 run patchelf(pid=28094): Launched 17:33:52.198293 run osmo-stp_10.42.42.5(pid=28091): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28091)] 17:33:52.328378 run osmo-stp_10.42.42.5(pid=28091): stdout: | (launched: 2022-12-09_17:33:50.952416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:52.459888 run osmo-stp_10.42.42.5(pid=28091): stderr: | 20221209173351124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173351124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173351124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173351125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173351125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173351125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173351125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:52.591429 run osmo-stp_10.42.42.5(pid=28091): stdout: | (launched: 2022-12-09_17:33:50.952416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:33:52.716382 run osmo-stp_10.42.42.5(pid=28091): stderr: | 20221209173351124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173351124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173351124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173351125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173351125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173351125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173351125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:33:52.864872 run patchelf(pid=28094): Terminating (SIGINT) 17:33:53.036863 run patchelf(pid=28094): Terminated: ok {rc=0} 17:33:53.161067 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28091): Process ended prematurely: osmo-stp_10.42.42.5(pid=28091) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28091)] [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 17:33:53.170632 tst iperf3.py:8: Test FAILED (7.6 sec) 17:33:53.198326 run osmo-hlr_10.42.42.2(pid=28088): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28088)] 17:33:53.246821 run osmo-hlr_10.42.42.2(pid=28088): stdout: | (launched: 2022-12-09_17:33:50.002386) 17:33:53.297245 run osmo-hlr_10.42.42.2(pid=28088): stderr: | 20221209173350180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173350180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173350180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173350180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173350180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173350180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173350195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173350205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173350205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173350205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:33:53.348156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28083): Terminating (SIGTERM) 17:33:53.388734 run iperf3-srv_10.42.42.10(pid=28084): Terminating (SIGTERM) 17:33:53.429199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28087): Terminating (SIGTERM) 17:33:53.470210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28090): Terminating (SIGTERM) 17:33:53.510668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28093): Terminating (SIGTERM) 17:33:53.551267 --- ParallelTerminationStrategy: PID 28083 died... 17:33:53.570487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28083): Terminated: ok {rc=0} 17:33:53.615940 --- ParallelTerminationStrategy: PID 28084 died... 17:33:53.634630 run iperf3-srv_10.42.42.10(pid=28084): Terminated {rc=256} 17:33:53.679523 --- ParallelTerminationStrategy: PID 28087 died... 17:33:53.698427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28087): Terminated: ok {rc=0} 17:33:53.743757 --- ParallelTerminationStrategy: PID 28090 died... 17:33:53.762673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28090): Terminated: ok {rc=0} 17:33:53.807412 --- ParallelTerminationStrategy: PID 28093 died... 17:33:53.826181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28093): Terminated: ok {rc=0} 17:33:53.913712 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:33:55.061979 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:55.073793 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:33:55.124679 tst iperf3m4.py: using LAC 22601 17:33:55.245362 tst iperf3m4.py: using RAC 161 17:33:55.364110 tst iperf3m4.py: using CellId 22601 17:33:55.493560 tst iperf3m4.py: using BVCI 22602 17:33:55.612186 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:55.623699 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:55.634917 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:55.646337 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:55.657645 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:55.669158 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:55.680717 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:55.692049 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:33:55.703187 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:55.821858 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:55.944800 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:56.066583 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:33:56.183521 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:33:56.389407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:56.697501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28095): Launched 17:33:56.965151 run iperf3-srv_10.42.42.10(pid=28096): Launched 17:33:57.080395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:33:57.284924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:57.591776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28097): Launched 17:33:57.859181 run iperf3-srv_10.42.42.10(pid=28098): Launched 17:33:57.974810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:33:58.179591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:58.486710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28099): Launched 17:33:58.755749 run iperf3-srv_10.42.42.10(pid=28100): Launched 17:33:58.871321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:33:59.076270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:33:59.383552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28101): Launched 17:33:59.651023 run iperf3-srv_10.42.42.10(pid=28102): Launched 17:33:59.766437 tst iperf3m4.py:8: start network... 17:33:59.970945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:00.444099 run create_hlr_db(pid=28103): Launched 17:34:00.562292 bus /gobi_6: Setting Powered False 17:34:01.623268 run create_hlr_db(pid=28103): Terminated: ok {rc=0} 17:34:02.063590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28105): Launched 17:34:02.392911 run osmo-hlr_10.42.42.2(pid=28106): Launched 17:34:02.512269 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:03.055291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28108): Launched 17:34:03.361758 run osmo-stp_10.42.42.5(pid=28109): Launched 17:34:03.478218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:04.006138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28111): Launched 17:34:04.124063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:04.382793 run patchelf(pid=28112): Launched 17:34:04.555222 run osmo-stp_10.42.42.5(pid=28109): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28109)] 17:34:04.685543 run osmo-stp_10.42.42.5(pid=28109): stdout: | (launched: 2022-12-09_17:34:03.305505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:04.817563 run osmo-stp_10.42.42.5(pid=28109): stderr: | 20221209173403477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173403478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173403478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173403478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173403479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173403479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173403479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:04.949225 run osmo-stp_10.42.42.5(pid=28109): stdout: | (launched: 2022-12-09_17:34:03.305505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:05.075289 run osmo-stp_10.42.42.5(pid=28109): stderr: | 20221209173403477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173403478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173403478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173403478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173403479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173403479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173403479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:05.223876 run patchelf(pid=28112): Terminating (SIGINT) 17:34:05.395904 run patchelf(pid=28112): Terminated: ok {rc=0} 17:34:05.519798 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28109): Process ended prematurely: osmo-stp_10.42.42.5(pid=28109) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28109)] [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 17:34:05.529492 tst iperf3m4.py:8: Test FAILED (10.5 sec) 17:34:05.557707 run osmo-hlr_10.42.42.2(pid=28106): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28106)] 17:34:05.606616 run osmo-hlr_10.42.42.2(pid=28106): stdout: | (launched: 2022-12-09_17:34:02.336312) 17:34:05.656836 run osmo-hlr_10.42.42.2(pid=28106): stderr: | 20221209173402513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173402513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173402513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173402513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173402513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173402513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173402529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173402538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173402538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173402538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:05.707595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28095): Terminating (SIGTERM) 17:34:05.748346 run iperf3-srv_10.42.42.10(pid=28096): Terminating (SIGTERM) 17:34:05.788882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28097): Terminating (SIGTERM) 17:34:05.829771 run iperf3-srv_10.42.42.10(pid=28098): Terminating (SIGTERM) 17:34:05.870319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28099): Terminating (SIGTERM) 17:34:05.911032 run iperf3-srv_10.42.42.10(pid=28100): Terminating (SIGTERM) 17:34:05.951519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28101): Terminating (SIGTERM) 17:34:05.992563 run iperf3-srv_10.42.42.10(pid=28102): Terminating (SIGTERM) 17:34:06.033055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28105): Terminating (SIGTERM) 17:34:06.074357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28108): Terminating (SIGTERM) 17:34:06.114957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28111): Terminating (SIGTERM) 17:34:06.155681 --- ParallelTerminationStrategy: PID 28095 died... 17:34:06.174993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28095): Terminated: ok {rc=0} 17:34:06.220204 --- ParallelTerminationStrategy: PID 28096 died... 17:34:06.238875 run iperf3-srv_10.42.42.10(pid=28096): Terminated {rc=256} 17:34:06.283605 --- ParallelTerminationStrategy: PID 28097 died... 17:34:06.302508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28097): Terminated: ok {rc=0} 17:34:06.347314 --- ParallelTerminationStrategy: PID 28098 died... 17:34:06.366264 run iperf3-srv_10.42.42.10(pid=28098): Terminated {rc=256} 17:34:06.411114 --- ParallelTerminationStrategy: PID 28099 died... 17:34:06.429955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28099): Terminated: ok {rc=0} 17:34:06.474741 --- ParallelTerminationStrategy: PID 28100 died... 17:34:06.493623 run iperf3-srv_10.42.42.10(pid=28100): Terminated {rc=256} 17:34:06.538556 --- ParallelTerminationStrategy: PID 28101 died... 17:34:06.557468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28101): Terminated: ok {rc=0} 17:34:06.602256 --- ParallelTerminationStrategy: PID 28102 died... 17:34:06.621259 run iperf3-srv_10.42.42.10(pid=28102): Terminated {rc=256} 17:34:06.666389 --- ParallelTerminationStrategy: PID 28105 died... 17:34:06.685459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28105): Terminated: ok {rc=0} 17:34:06.730460 --- ParallelTerminationStrategy: PID 28108 died... 17:34:06.749590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28108): Terminated: ok {rc=0} 17:34:06.794603 --- ParallelTerminationStrategy: PID 28111 died... 17:34:06.813591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28111): Terminated: ok {rc=0} 17:34:06.899818 bus /gobi_4: Setting Powered False 17:34:08.001040 bus /gobi_4: Setting Powered False 17:34:09.119172 bus /gobi_1: Setting Powered False 17:34:10.219680 bus /gobi_1: Setting Powered False 17:34:11.337781 bus /gobi_0: Setting Powered False 17:34:12.439612 bus /gobi_0: Setting Powered False 17:34:13.556346 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 17:34:14.661375 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:14.673646 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:34:14.729704 tst ping.py: using LAC 22602 17:34:14.854353 tst ping.py: using RAC 162 17:34:14.972834 tst ping.py: using CellId 22602 17:34:15.088815 tst ping.py: using BVCI 22603 17:34:15.198804 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:15.210078 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:15.220828 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:15.232134 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:15.243370 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:15.254548 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:15.265958 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:15.277050 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:15.395474 tst ping.py:19: start network... 17:34:15.611387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:16.126790 run create_hlr_db(pid=28113): Launched 17:34:16.286170 bus /gobi_6: Setting Powered False 17:34:17.345330 run create_hlr_db(pid=28113): Terminated: ok {rc=0} 17:34:17.792388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28115): Launched 17:34:18.114489 run osmo-hlr_10.42.42.2(pid=28116): Launched 17:34:18.238360 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:18.796822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28118): Launched 17:34:19.117196 run osmo-stp_10.42.42.5(pid=28119): Launched 17:34:19.238848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:19.792671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28121): Launched 17:34:19.917264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:20.187936 run patchelf(pid=28122): Launched 17:34:20.368398 run osmo-stp_10.42.42.5(pid=28119): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28119)] 17:34:20.504222 run osmo-stp_10.42.42.5(pid=28119): stdout: | (launched: 2022-12-09_17:34:19.058309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:20.642621 run osmo-stp_10.42.42.5(pid=28119): stderr: | 20221209173419254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173419254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173419254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173419254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173419255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173419255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173419255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:20.781409 run osmo-stp_10.42.42.5(pid=28119): stdout: | (launched: 2022-12-09_17:34:19.058309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:20.912717 run osmo-stp_10.42.42.5(pid=28119): stderr: | 20221209173419254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173419254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173419254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173419254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173419255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173419255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173419255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:21.068222 run patchelf(pid=28122): Terminating (SIGINT) 17:34:21.248650 run patchelf(pid=28122): Terminated: ok {rc=0} 17:34:21.378220 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28119): Process ended prematurely: osmo-stp_10.42.42.5(pid=28119) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28119)] [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 17:34:21.387948 tst ping.py:22: Test FAILED (6.7 sec) 17:34:21.416443 run osmo-hlr_10.42.42.2(pid=28116): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28116)] 17:34:21.467079 run osmo-hlr_10.42.42.2(pid=28116): stdout: | (launched: 2022-12-09_17:34:18.056003) 17:34:21.519428 run osmo-hlr_10.42.42.2(pid=28116): stderr: | 20221209173418254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173418254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173418254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173418254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173418254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173418254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173418265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173418273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173418274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173418274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:21.572319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28115): Terminating (SIGTERM) 17:34:21.614832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28118): Terminating (SIGTERM) 17:34:21.657305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28121): Terminating (SIGTERM) 17:34:21.700353 --- ParallelTerminationStrategy: PID 28115 died... 17:34:21.720779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28115): Terminated: ok {rc=0} 17:34:21.768386 --- ParallelTerminationStrategy: PID 28118 died... 17:34:21.788330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28118): Terminated: ok {rc=0} 17:34:21.835031 --- ParallelTerminationStrategy: PID 28121 died... 17:34:21.854856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28121): Terminated: ok {rc=0} 17:34:21.943871 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:34:23.032106 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:23.044231 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:34:23.098461 tst ping_idle_ping.py: using LAC 22603 17:34:23.226619 tst ping_idle_ping.py: using RAC 163 17:34:23.354711 tst ping_idle_ping.py: using CellId 22603 17:34:23.482401 tst ping_idle_ping.py: using BVCI 22604 17:34:23.599208 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:23.610642 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:23.621840 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:23.633602 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:23.645285 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:23.657104 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:23.668879 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:34:23.680482 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:34:23.798639 tst ping_idle_ping.py:24: start network... 17:34:24.001533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:24.470641 run create_hlr_db(pid=28123): Launched 17:34:24.588779 bus /gobi_6: Setting Powered False 17:34:25.649479 run create_hlr_db(pid=28123): Terminated: ok {rc=0} 17:34:26.091941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28125): Launched 17:34:26.414138 run osmo-hlr_10.42.42.2(pid=28126): Launched 17:34:26.537636 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:27.091963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28128): Launched 17:34:27.414982 run osmo-stp_10.42.42.5(pid=28129): Launched 17:34:27.540786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:28.098157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28131): Launched 17:34:28.223255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:28.496299 run patchelf(pid=28132): Launched 17:34:28.675734 run osmo-stp_10.42.42.5(pid=28129): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28129)] 17:34:28.813510 run osmo-stp_10.42.42.5(pid=28129): stdout: | (launched: 2022-12-09_17:34:27.356062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:28.952185 run osmo-stp_10.42.42.5(pid=28129): stderr: | 20221209173427547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173427547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173427547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173427548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173427550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173427550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173427550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:29.091135 run osmo-stp_10.42.42.5(pid=28129): stdout: | (launched: 2022-12-09_17:34:27.356062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:29.223677 run osmo-stp_10.42.42.5(pid=28129): stderr: | 20221209173427547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173427547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173427547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173427548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173427550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173427550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173427550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:29.380221 run patchelf(pid=28132): Terminating (SIGINT) 17:34:29.561644 run patchelf(pid=28132): Terminated: ok {rc=0} 17:34:29.692187 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28129): Process ended prematurely: osmo-stp_10.42.42.5(pid=28129) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28129)] [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 17:34:29.702029 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:34:29.730746 run osmo-hlr_10.42.42.2(pid=28126): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28126)] 17:34:29.781640 run osmo-hlr_10.42.42.2(pid=28126): stdout: | (launched: 2022-12-09_17:34:26.355363) 17:34:29.834127 run osmo-hlr_10.42.42.2(pid=28126): stderr: | 20221209173426553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173426553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173426553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173426553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173426553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173426553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173426565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173426573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173426573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173426573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:29.886998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28125): Terminating (SIGTERM) 17:34:29.929571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28128): Terminating (SIGTERM) 17:34:29.972040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28131): Terminating (SIGTERM) 17:34:30.014937 --- ParallelTerminationStrategy: PID 28125 died... 17:34:30.035240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28125): Terminated: ok {rc=0} 17:34:30.082538 --- ParallelTerminationStrategy: PID 28128 died... 17:34:30.102632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28128): Terminated: ok {rc=0} 17:34:30.149408 --- ParallelTerminationStrategy: PID 28131 died... 17:34:30.169149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28131): Terminated: ok {rc=0} 17:34:30.257483 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:34:31.613564 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:34:31.620659 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:34:31.658684 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:34:31.700287 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:34:31.793064 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:34:31.845490 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:34:31.899309 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:34:32.463494 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:34:32.518323 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:32.529828 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:34:32.599322 tst cs_paging_gprs_active.py: using LAC 22604 17:34:32.725728 tst cs_paging_gprs_active.py: using RAC 164 17:34:32.852931 tst cs_paging_gprs_active.py: using CellId 22604 17:34:32.979235 tst cs_paging_gprs_active.py: using BVCI 22605 17:34:33.098198 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:33.109480 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:33.120503 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:33.131629 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:33.142665 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:33.153892 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:33.165100 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:33.176249 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:33.187691 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:33.306691 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:33.424678 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:34:33.632561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:33.941742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28136): Launched 17:34:34.209657 run iperf3-srv_10.42.42.10(pid=28137): Launched 17:34:34.325874 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:34:34.532764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:34.841492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28138): Launched 17:34:35.108735 run iperf3-srv_10.42.42.10(pid=28139): Launched 17:34:35.224538 tst cs_paging_gprs_active.py:38: start network... 17:34:35.430512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:35.904163 run create_hlr_db(pid=28140): Launched 17:34:36.022479 bus /gobi_6: Setting Powered False 17:34:37.082839 run create_hlr_db(pid=28140): Terminated: ok {rc=0} 17:34:37.530938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28142): Launched 17:34:37.861019 run osmo-hlr_10.42.42.2(pid=28143): Launched 17:34:37.987494 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:38.554132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28145): Launched 17:34:38.882477 run osmo-stp_10.42.42.5(pid=28146): Launched 17:34:39.009036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:39.573446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28148): Launched 17:34:39.700250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:39.977535 run patchelf(pid=28149): Launched 17:34:40.159973 run osmo-stp_10.42.42.5(pid=28146): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28146)] 17:34:40.299381 run osmo-stp_10.42.42.5(pid=28146): stdout: | (launched: 2022-12-09_17:34:38.823124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:40.439832 run osmo-stp_10.42.42.5(pid=28146): stderr: | 20221209173439017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173439017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173439018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173439018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173439018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173439018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173439019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:40.579895 run osmo-stp_10.42.42.5(pid=28146): stdout: | (launched: 2022-12-09_17:34:38.823124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:40.714237 run osmo-stp_10.42.42.5(pid=28146): stderr: | 20221209173439017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173439017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173439018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173439018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173439018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173439018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173439019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:40.873951 run patchelf(pid=28149): Terminating (SIGINT) 17:34:41.057539 run patchelf(pid=28149): Terminated: ok {rc=0} 17:34:41.190967 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28146): Process ended prematurely: osmo-stp_10.42.42.5(pid=28146) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28146)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:34:41.201493 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:34:41.230055 run osmo-hlr_10.42.42.2(pid=28143): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28143)] 17:34:41.280525 run osmo-hlr_10.42.42.2(pid=28143): stdout: | (launched: 2022-12-09_17:34:37.801478) 17:34:41.333350 run osmo-hlr_10.42.42.2(pid=28143): stderr: | 20221209173438002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173438002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173438002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173438002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173438002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173438002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173438014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173438023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173438023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173438023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:41.386231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28136): Terminating (SIGTERM) 17:34:41.428589 run iperf3-srv_10.42.42.10(pid=28137): Terminating (SIGTERM) 17:34:41.470785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28138): Terminating (SIGTERM) 17:34:41.513030 run iperf3-srv_10.42.42.10(pid=28139): Terminating (SIGTERM) 17:34:41.555155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28142): Terminating (SIGTERM) 17:34:41.597479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28145): Terminating (SIGTERM) 17:34:41.639586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28148): Terminating (SIGTERM) 17:34:41.681797 --- ParallelTerminationStrategy: PID 28136 died... 17:34:41.701788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28136): Terminated: ok {rc=0} 17:34:41.748545 --- ParallelTerminationStrategy: PID 28137 died... 17:34:41.768589 run iperf3-srv_10.42.42.10(pid=28137): Terminated {rc=256} 17:34:41.815407 --- ParallelTerminationStrategy: PID 28138 died... 17:34:41.835246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28138): Terminated: ok {rc=0} 17:34:41.881816 --- ParallelTerminationStrategy: PID 28139 died... 17:34:41.901533 run iperf3-srv_10.42.42.10(pid=28139): Terminated {rc=256} 17:34:41.947826 --- ParallelTerminationStrategy: PID 28142 died... 17:34:41.967473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28142): Terminated: ok {rc=0} 17:34:42.013989 --- ParallelTerminationStrategy: PID 28145 died... 17:34:42.033706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28145): Terminated: ok {rc=0} 17:34:42.080055 --- ParallelTerminationStrategy: PID 28148 died... 17:34:42.099897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28148): Terminated: ok {rc=0} 17:34:42.187739 bus /gobi_0: Setting Powered False 17:34:43.290430 bus /gobi_0: Setting Powered False 17:34:44.408686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:34:45.556504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:45.568118 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:34:45.640499 tst iperf3.py: using LAC 22605 17:34:45.760195 tst iperf3.py: using RAC 165 17:34:45.892075 tst iperf3.py: using CellId 22605 17:34:46.039560 tst iperf3.py: using BVCI 22606 17:34:46.176664 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:46.188741 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:46.200489 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:46.213099 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:46.225410 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:46.238956 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:46.250914 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:46.263910 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:46.278004 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:46.398912 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:34:46.663490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:47.000051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28150): Launched 17:34:47.298862 run iperf3-srv_10.42.42.10(pid=28151): Launched 17:34:47.424399 tst iperf3.py:8: start network... 17:34:47.644848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:34:48.151455 run create_hlr_db(pid=28152): Launched 17:34:48.286415 bus /gobi_6: Setting Powered False 17:34:49.351166 run create_hlr_db(pid=28152): Terminated: ok {rc=0} 17:34:49.807208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28154): Launched 17:34:50.136112 run osmo-hlr_10.42.42.2(pid=28155): Launched 17:34:50.259986 run osmo-stp_10.42.42.5: Starting osmo-stp 17:34:50.822860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28157): Launched 17:34:51.149771 run osmo-stp_10.42.42.5(pid=28158): Launched 17:34:51.275511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:34:51.841077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28160): Launched 17:34:51.967229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:34:52.243771 run patchelf(pid=28161): Launched 17:34:52.426816 run osmo-stp_10.42.42.5(pid=28158): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28158)] 17:34:52.565632 run osmo-stp_10.42.42.5(pid=28158): stdout: | (launched: 2022-12-09_17:34:51.090272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:52.706136 run osmo-stp_10.42.42.5(pid=28158): stderr: | 20221209173451283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173451284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173451284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173451284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173451285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173451285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173451285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:52.847035 run osmo-stp_10.42.42.5(pid=28158): stdout: | (launched: 2022-12-09_17:34:51.090272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:34:52.981210 run osmo-stp_10.42.42.5(pid=28158): stderr: | 20221209173451283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173451284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173451284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173451284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173451285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173451285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173451285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:34:53.140268 run patchelf(pid=28161): Terminating (SIGINT) 17:34:53.323669 run patchelf(pid=28161): Terminated: ok {rc=0} 17:34:53.457139 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28158): Process ended prematurely: osmo-stp_10.42.42.5(pid=28158) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28158)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 17:34:53.467522 tst iperf3.py:8: Test FAILED (7.9 sec) 17:34:53.496644 run osmo-hlr_10.42.42.2(pid=28155): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28155)] 17:34:53.547343 run osmo-hlr_10.42.42.2(pid=28155): stdout: | (launched: 2022-12-09_17:34:50.076569) 17:34:53.599920 run osmo-hlr_10.42.42.2(pid=28155): stderr: | 20221209173450276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173450276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173450276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173450277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173450277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173450277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173450293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173450303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173450303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173450303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:34:53.652932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28150): Terminating (SIGTERM) 17:34:53.695535 run iperf3-srv_10.42.42.10(pid=28151): Terminating (SIGTERM) 17:34:53.738207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28154): Terminating (SIGTERM) 17:34:53.781433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28157): Terminating (SIGTERM) 17:34:53.824375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28160): Terminating (SIGTERM) 17:34:53.867551 --- ParallelTerminationStrategy: PID 28150 died... 17:34:53.887918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28150): Terminated: ok {rc=0} 17:34:53.935631 --- ParallelTerminationStrategy: PID 28151 died... 17:34:53.955562 run iperf3-srv_10.42.42.10(pid=28151): Terminated {rc=256} 17:34:54.002941 --- ParallelTerminationStrategy: PID 28154 died... 17:34:54.022918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28154): Terminated: ok {rc=0} 17:34:54.070117 --- ParallelTerminationStrategy: PID 28157 died... 17:34:54.090170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28157): Terminated: ok {rc=0} 17:34:54.137408 --- ParallelTerminationStrategy: PID 28160 died... 17:34:54.157403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28160): Terminated: ok {rc=0} 17:34:54.247388 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:34:55.401522 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:55.414183 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:34:55.485487 tst iperf3m4.py: using LAC 22606 17:34:55.614412 tst iperf3m4.py: using RAC 166 17:34:55.744271 tst iperf3m4.py: using CellId 22606 17:34:55.875717 tst iperf3m4.py: using BVCI 22607 17:34:55.995275 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:56.006842 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:56.018219 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:56.029803 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:56.041056 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:56.052352 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:56.063812 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:56.075074 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:34:56.086341 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:56.207167 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:56.325733 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:56.443158 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:34:56.562735 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:34:56.784674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:57.114044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28162): Launched 17:34:57.400192 run iperf3-srv_10.42.42.10(pid=28163): Launched 17:34:57.524239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:34:57.745046 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:58.074528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28164): Launched 17:34:58.362437 run iperf3-srv_10.42.42.10(pid=28165): Launched 17:34:58.487582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:34:58.708145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:59.038410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28166): Launched 17:34:59.324562 run iperf3-srv_10.42.42.10(pid=28167): Launched 17:34:59.447508 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:34:59.667889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:34:59.996568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28168): Launched 17:35:00.282048 run iperf3-srv_10.42.42.10(pid=28169): Launched 17:35:00.406723 tst iperf3m4.py:8: start network... 17:35:00.626749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:01.138447 run create_hlr_db(pid=28170): Launched 17:35:01.314592 bus /gobi_6: Setting Powered False 17:35:02.378374 run create_hlr_db(pid=28170): Terminated: ok {rc=0} 17:35:02.817350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28176): Launched 17:35:03.126017 run osmo-hlr_10.42.42.2(pid=28177): Launched 17:35:03.244852 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:03.789337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28179): Launched 17:35:04.095537 run osmo-stp_10.42.42.5(pid=28180): Launched 17:35:04.212308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:04.741918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28182): Launched 17:35:04.861721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:05.119723 run patchelf(pid=28183): Launched 17:35:05.290705 run osmo-stp_10.42.42.5(pid=28180): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28180)] 17:35:05.420680 run osmo-stp_10.42.42.5(pid=28180): stdout: | (launched: 2022-12-09_17:35:04.039273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:05.552833 run osmo-stp_10.42.42.5(pid=28180): stderr: | 20221209173504209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173504209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173504209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173504209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173504212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173504212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173504212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:05.684534 run osmo-stp_10.42.42.5(pid=28180): stdout: | (launched: 2022-12-09_17:35:04.039273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:05.810127 run osmo-stp_10.42.42.5(pid=28180): stderr: | 20221209173504209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173504209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173504209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173504209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173504212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173504212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173504212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:05.958775 run patchelf(pid=28183): Terminating (SIGINT) 17:35:06.131552 run patchelf(pid=28183): Terminated: ok {rc=0} 17:35:06.256235 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28180): Process ended prematurely: osmo-stp_10.42.42.5(pid=28180) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28180)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:35:06.265885 tst iperf3m4.py:8: Test FAILED (10.9 sec) 17:35:06.294446 run osmo-hlr_10.42.42.2(pid=28177): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28177)] 17:35:06.342615 run osmo-hlr_10.42.42.2(pid=28177): stdout: | (launched: 2022-12-09_17:35:03.069516) 17:35:06.392615 run osmo-hlr_10.42.42.2(pid=28177): stderr: | 20221209173503247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173503247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173503247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173503247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173503248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173503248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173503260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173503268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173503269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173503269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:06.442890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28162): Terminating (SIGTERM) 17:35:06.483471 run iperf3-srv_10.42.42.10(pid=28163): Terminating (SIGTERM) 17:35:06.524064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28164): Terminating (SIGTERM) 17:35:06.564613 run iperf3-srv_10.42.42.10(pid=28165): Terminating (SIGTERM) 17:35:06.605042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28166): Terminating (SIGTERM) 17:35:06.645487 run iperf3-srv_10.42.42.10(pid=28167): Terminating (SIGTERM) 17:35:06.685974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28168): Terminating (SIGTERM) 17:35:06.726404 run iperf3-srv_10.42.42.10(pid=28169): Terminating (SIGTERM) 17:35:06.766607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28176): Terminating (SIGTERM) 17:35:06.806928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28179): Terminating (SIGTERM) 17:35:06.847150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28182): Terminating (SIGTERM) 17:35:06.887665 --- ParallelTerminationStrategy: PID 28162 died... 17:35:06.906865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28162): Terminated: ok {rc=0} 17:35:06.951811 --- ParallelTerminationStrategy: PID 28163 died... 17:35:06.970563 run iperf3-srv_10.42.42.10(pid=28163): Terminated {rc=256} 17:35:07.014952 --- ParallelTerminationStrategy: PID 28164 died... 17:35:07.033961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28164): Terminated: ok {rc=0} 17:35:07.079217 --- ParallelTerminationStrategy: PID 28165 died... 17:35:07.097956 run iperf3-srv_10.42.42.10(pid=28165): Terminated {rc=256} 17:35:07.142624 --- ParallelTerminationStrategy: PID 28166 died... 17:35:07.161338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28166): Terminated: ok {rc=0} 17:35:07.205882 --- ParallelTerminationStrategy: PID 28167 died... 17:35:07.224492 run iperf3-srv_10.42.42.10(pid=28167): Terminated {rc=256} 17:35:07.269490 --- ParallelTerminationStrategy: PID 28168 died... 17:35:07.288152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28168): Terminated: ok {rc=0} 17:35:07.333189 --- ParallelTerminationStrategy: PID 28169 died... 17:35:07.351807 run iperf3-srv_10.42.42.10(pid=28169): Terminated {rc=256} 17:35:07.396418 --- ParallelTerminationStrategy: PID 28176 died... 17:35:07.415231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28176): Terminated: ok {rc=0} 17:35:07.459711 --- ParallelTerminationStrategy: PID 28179 died... 17:35:07.478537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28179): Terminated: ok {rc=0} 17:35:07.523993 --- ParallelTerminationStrategy: PID 28182 died... 17:35:07.542790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28182): Terminated: ok {rc=0} 17:35:07.629294 bus /gobi_4: Setting Powered False 17:35:08.730056 bus /gobi_4: Setting Powered False 17:35:09.847705 bus /gobi_1: Setting Powered False 17:35:10.947582 bus /gobi_1: Setting Powered False 17:35:12.063902 bus /gobi_0: Setting Powered False 17:35:13.163727 bus /gobi_0: Setting Powered False 17:35:14.282703 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:35:15.386553 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:15.398793 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:35:15.472355 tst ping.py: using LAC 22607 17:35:15.599366 tst ping.py: using RAC 167 17:35:15.724377 tst ping.py: using CellId 22607 17:35:15.857758 tst ping.py: using BVCI 22608 17:35:15.994752 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:16.006757 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:16.018480 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:16.030288 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:16.042191 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:16.054269 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:16.066387 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:16.078452 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:16.196660 tst ping.py:19: start network... 17:35:16.412014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:16.896283 run create_hlr_db(pid=28186): Launched 17:35:17.056123 bus /gobi_6: Setting Powered False 17:35:18.117220 run create_hlr_db(pid=28186): Terminated: ok {rc=0} 17:35:18.558368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28188): Launched 17:35:18.881396 run osmo-hlr_10.42.42.2(pid=28189): Launched 17:35:19.004719 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:19.563424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28191): Launched 17:35:19.885708 run osmo-stp_10.42.42.5(pid=28192): Launched 17:35:20.009598 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:20.563165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28194): Launched 17:35:20.687603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:20.959033 run patchelf(pid=28195): Launched 17:35:21.137459 run osmo-stp_10.42.42.5(pid=28192): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28192)] 17:35:21.273109 run osmo-stp_10.42.42.5(pid=28192): stdout: | (launched: 2022-12-09_17:35:19.827121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:21.411315 run osmo-stp_10.42.42.5(pid=28192): stderr: | 20221209173520018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173520018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173520018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173520019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173520019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173520019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173520019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:21.549384 run osmo-stp_10.42.42.5(pid=28192): stdout: | (launched: 2022-12-09_17:35:19.827121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:21.681192 run osmo-stp_10.42.42.5(pid=28192): stderr: | 20221209173520018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173520018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173520018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173520019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173520019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173520019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173520019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:21.837217 run patchelf(pid=28195): Terminating (SIGINT) 17:35:22.016836 run patchelf(pid=28195): Terminated: ok {rc=0} 17:35:22.146393 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28192): Process ended prematurely: osmo-stp_10.42.42.5(pid=28192) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28192)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 17:35:22.156013 tst ping.py:22: Test FAILED (6.8 sec) 17:35:22.184613 run osmo-hlr_10.42.42.2(pid=28189): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28189)] 17:35:22.235323 run osmo-hlr_10.42.42.2(pid=28189): stdout: | (launched: 2022-12-09_17:35:18.822775) 17:35:22.287633 run osmo-hlr_10.42.42.2(pid=28189): stderr: | 20221209173519020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173519020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173519020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173519021 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173519021 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173519021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173519033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173519041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173519041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173519041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:22.340454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28188): Terminating (SIGTERM) 17:35:22.382692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28191): Terminating (SIGTERM) 17:35:22.424811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28194): Terminating (SIGTERM) 17:35:22.467458 --- ParallelTerminationStrategy: PID 28188 died... 17:35:22.487643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28188): Terminated: ok {rc=0} 17:35:22.535067 --- ParallelTerminationStrategy: PID 28191 died... 17:35:22.554831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28191): Terminated: ok {rc=0} 17:35:22.602238 --- ParallelTerminationStrategy: PID 28194 died... 17:35:22.622081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28194): Terminated: ok {rc=0} 17:35:22.711014 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:35:23.798219 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:23.809845 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:35:23.881462 tst ping_idle_ping.py: using LAC 22608 17:35:24.001075 tst ping_idle_ping.py: using RAC 168 17:35:24.119459 tst ping_idle_ping.py: using CellId 22608 17:35:24.238655 tst ping_idle_ping.py: using BVCI 22609 17:35:24.349851 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:24.360706 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:24.371509 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:24.382602 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:24.393535 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:24.404370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:24.415481 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:35:24.426539 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:35:24.545164 tst ping_idle_ping.py:24: start network... 17:35:24.763535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:25.270514 run create_hlr_db(pid=28196): Launched 17:35:25.401609 bus /gobi_6: Setting Powered False 17:35:26.465727 run create_hlr_db(pid=28196): Terminated: ok {rc=0} 17:35:26.896543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28198): Launched 17:35:27.198617 run osmo-hlr_10.42.42.2(pid=28199): Launched 17:35:27.315432 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:27.852334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28201): Launched 17:35:28.153710 run osmo-stp_10.42.42.5(pid=28202): Launched 17:35:28.268149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:28.788260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28204): Launched 17:35:28.904302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:29.158411 run patchelf(pid=28205): Launched 17:35:29.328085 run osmo-stp_10.42.42.5(pid=28202): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28202)] 17:35:29.456281 run osmo-stp_10.42.42.5(pid=28202): stdout: | (launched: 2022-12-09_17:35:28.098314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:29.586480 run osmo-stp_10.42.42.5(pid=28202): stderr: | 20221209173528270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173528270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173528270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173528271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173528271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173528271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173528271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:29.716648 run osmo-stp_10.42.42.5(pid=28202): stdout: | (launched: 2022-12-09_17:35:28.098314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:29.840114 run osmo-stp_10.42.42.5(pid=28202): stderr: | 20221209173528270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173528270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173528270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173528271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173528271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173528271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173528271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:29.986258 run patchelf(pid=28205): Terminating (SIGINT) 17:35:30.155324 run patchelf(pid=28205): Terminated: ok {rc=0} 17:35:30.276901 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28202): Process ended prematurely: osmo-stp_10.42.42.5(pid=28202) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28202)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:35:30.286047 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:35:30.313348 run osmo-hlr_10.42.42.2(pid=28199): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28199)] 17:35:30.362232 run osmo-hlr_10.42.42.2(pid=28199): stdout: | (launched: 2022-12-09_17:35:27.143430) 17:35:30.412528 run osmo-hlr_10.42.42.2(pid=28199): stderr: | 20221209173527319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173527319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173527319 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173527319 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173527319 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173527319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173527330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173527339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173527339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173527339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:30.463249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28198): Terminating (SIGTERM) 17:35:30.503748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28201): Terminating (SIGTERM) 17:35:30.544312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28204): Terminating (SIGTERM) 17:35:30.585083 --- ParallelTerminationStrategy: PID 28198 died... 17:35:30.604247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28198): Terminated: ok {rc=0} 17:35:30.649621 --- ParallelTerminationStrategy: PID 28201 died... 17:35:30.668392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28201): Terminated: ok {rc=0} 17:35:30.713225 --- ParallelTerminationStrategy: PID 28204 died... 17:35:30.731996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28204): Terminated: ok {rc=0} 17:35:30.819698 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:35:32.164744 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:35:32.172160 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:35:32.217962 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:35:32.256376 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:35:32.344200 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:35:32.379103 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:35:32.418524 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:35:33.006958 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:35:33.057664 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:33.068427 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:35:33.137766 tst cs_paging_gprs_active.py: using LAC 22609 17:35:33.256543 tst cs_paging_gprs_active.py: using RAC 169 17:35:33.376394 tst cs_paging_gprs_active.py: using CellId 22609 17:35:33.497791 tst cs_paging_gprs_active.py: using BVCI 22610 17:35:33.610583 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:33.621497 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:33.632204 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:33.643138 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:33.653977 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:33.664873 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:33.675894 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:33.686772 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:33.697835 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:33.819529 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:33.940764 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:35:34.146633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:34.453145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28209): Launched 17:35:34.719616 run iperf3-srv_10.42.42.10(pid=28210): Launched 17:35:34.835234 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:35:35.039653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:35.346552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28211): Launched 17:35:35.614474 run iperf3-srv_10.42.42.10(pid=28212): Launched 17:35:35.731044 tst cs_paging_gprs_active.py:38: start network... 17:35:35.935597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:36.408460 run create_hlr_db(pid=28213): Launched 17:35:36.525244 bus /gobi_6: Setting Powered False 17:35:37.585796 run create_hlr_db(pid=28213): Terminated: ok {rc=0} 17:35:38.031717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28215): Launched 17:35:38.360775 run osmo-hlr_10.42.42.2(pid=28216): Launched 17:35:38.486401 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:39.050034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28218): Launched 17:35:39.376695 run osmo-stp_10.42.42.5(pid=28219): Launched 17:35:39.502843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:40.068136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28222): Launched 17:35:40.196748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:40.473555 run patchelf(pid=28223): Launched 17:35:40.657213 run osmo-stp_10.42.42.5(pid=28219): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28219)] 17:35:40.795860 run osmo-stp_10.42.42.5(pid=28219): stdout: | (launched: 2022-12-09_17:35:39.317189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:40.935845 run osmo-stp_10.42.42.5(pid=28219): stderr: | 20221209173539510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173539510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173539510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173539511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173539511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173539511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173539511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:41.075562 run osmo-stp_10.42.42.5(pid=28219): stdout: | (launched: 2022-12-09_17:35:39.317189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:41.209200 run osmo-stp_10.42.42.5(pid=28219): stderr: | 20221209173539510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173539510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173539510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173539511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173539511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173539511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173539511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:41.367765 run patchelf(pid=28223): Terminating (SIGINT) 17:35:41.551450 run patchelf(pid=28223): Terminated: ok {rc=0} 17:35:41.684545 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28219): Process ended prematurely: osmo-stp_10.42.42.5(pid=28219) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28219)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:35:41.694992 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:35:41.723651 run osmo-hlr_10.42.42.2(pid=28216): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28216)] 17:35:41.774144 run osmo-hlr_10.42.42.2(pid=28216): stdout: | (launched: 2022-12-09_17:35:38.301420) 17:35:41.826770 run osmo-hlr_10.42.42.2(pid=28216): stderr: | 20221209173538499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173538499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173538499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173538499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173538499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173538500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173538515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173538524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173538525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173538525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:41.879202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28209): Terminating (SIGTERM) 17:35:41.921420 run iperf3-srv_10.42.42.10(pid=28210): Terminating (SIGTERM) 17:35:41.963364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28211): Terminating (SIGTERM) 17:35:42.005610 run iperf3-srv_10.42.42.10(pid=28212): Terminating (SIGTERM) 17:35:42.047500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28215): Terminating (SIGTERM) 17:35:42.089756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28218): Terminating (SIGTERM) 17:35:42.131812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28222): Terminating (SIGTERM) 17:35:42.174071 --- ParallelTerminationStrategy: PID 28209 died... 17:35:42.194228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28209): Terminated: ok {rc=0} 17:35:42.241167 --- ParallelTerminationStrategy: PID 28210 died... 17:35:42.260718 run iperf3-srv_10.42.42.10(pid=28210): Terminated {rc=256} 17:35:42.306678 --- ParallelTerminationStrategy: PID 28211 died... 17:35:42.326341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28211): Terminated: ok {rc=0} 17:35:42.372322 --- ParallelTerminationStrategy: PID 28212 died... 17:35:42.391729 run iperf3-srv_10.42.42.10(pid=28212): Terminated {rc=256} 17:35:42.437540 --- ParallelTerminationStrategy: PID 28215 died... 17:35:42.456874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28215): Terminated: ok {rc=0} 17:35:42.503189 --- ParallelTerminationStrategy: PID 28218 died... 17:35:42.522674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28218): Terminated: ok {rc=0} 17:35:42.568594 --- ParallelTerminationStrategy: PID 28222 died... 17:35:42.588113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28222): Terminated: ok {rc=0} 17:35:42.675604 bus /gobi_0: Setting Powered False 17:35:43.775547 bus /gobi_0: Setting Powered False 17:35:44.891778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:35:46.041841 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.054432 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:35:46.130909 tst iperf3.py: using LAC 22610 17:35:46.256397 tst iperf3.py: using RAC 170 17:35:46.406957 tst iperf3.py: using CellId 22610 17:35:46.569064 tst iperf3.py: using BVCI 22611 17:35:46.709920 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.722152 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.735321 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.748474 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.761082 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.774102 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.788365 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.800238 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:46.813564 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:46.934759 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:35:47.151685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:47.461535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28224): Launched 17:35:47.729103 run iperf3-srv_10.42.42.10(pid=28225): Launched 17:35:47.845162 tst iperf3.py:8: start network... 17:35:48.050284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:35:48.523171 run create_hlr_db(pid=28226): Launched 17:35:48.640830 bus /gobi_6: Setting Powered False 17:35:49.701903 run create_hlr_db(pid=28226): Terminated: ok {rc=0} 17:35:50.149453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Launched 17:35:50.480033 run osmo-hlr_10.42.42.2(pid=28229): Launched 17:35:50.605039 run osmo-stp_10.42.42.5: Starting osmo-stp 17:35:51.167720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Launched 17:35:51.494596 run osmo-stp_10.42.42.5(pid=28232): Launched 17:35:51.620062 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:35:52.182904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28234): Launched 17:35:52.309861 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:35:52.585801 run patchelf(pid=28235): Launched 17:35:52.767794 run osmo-stp_10.42.42.5(pid=28232): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] 17:35:52.906849 run osmo-stp_10.42.42.5(pid=28232): stdout: | (launched: 2022-12-09_17:35:51.435038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:53.046963 run osmo-stp_10.42.42.5(pid=28232): stderr: | 20221209173551633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173551633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173551633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173551633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173551634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173551634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173551634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:53.187313 run osmo-stp_10.42.42.5(pid=28232): stdout: | (launched: 2022-12-09_17:35:51.435038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:35:53.320803 run osmo-stp_10.42.42.5(pid=28232): stderr: | 20221209173551633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173551633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173551633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173551633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173551634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173551634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173551634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:35:53.479317 run patchelf(pid=28235): Terminating (SIGINT) 17:35:53.662269 run patchelf(pid=28235): Terminated: ok {rc=0} 17:35:53.794946 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28232): Process ended prematurely: osmo-stp_10.42.42.5(pid=28232) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 17:35:53.805408 tst iperf3.py:8: Test FAILED (7.8 sec) 17:35:53.834049 run osmo-hlr_10.42.42.2(pid=28229): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28229)] 17:35:53.885105 run osmo-hlr_10.42.42.2(pid=28229): stdout: | (launched: 2022-12-09_17:35:50.420353) 17:35:53.937627 run osmo-hlr_10.42.42.2(pid=28229): stderr: | 20221209173550623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173550623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173550623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173550623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173550623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173550623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173550635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173550643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173550643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173550643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:35:53.990244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28224): Terminating (SIGTERM) 17:35:54.032198 run iperf3-srv_10.42.42.10(pid=28225): Terminating (SIGTERM) 17:35:54.074548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Terminating (SIGTERM) 17:35:54.116856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Terminating (SIGTERM) 17:35:54.159329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28234): Terminating (SIGTERM) 17:35:54.201935 --- ParallelTerminationStrategy: PID 28224 died... 17:35:54.222159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28224): Terminated: ok {rc=0} 17:35:54.269055 --- ParallelTerminationStrategy: PID 28225 died... 17:35:54.288605 run iperf3-srv_10.42.42.10(pid=28225): Terminated {rc=256} 17:35:54.335335 --- ParallelTerminationStrategy: PID 28228 died... 17:35:54.355205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Terminated: ok {rc=0} 17:35:54.401874 --- ParallelTerminationStrategy: PID 28231 died... 17:35:54.421629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Terminated: ok {rc=0} 17:35:54.468089 --- ParallelTerminationStrategy: PID 28234 died... 17:35:54.487810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28234): Terminated: ok {rc=0} 17:35:54.577397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:35:55.729965 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:55.741883 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:35:55.814252 tst iperf3m4.py: using LAC 22611 17:35:55.944423 tst iperf3m4.py: using RAC 171 17:35:56.073542 tst iperf3m4.py: using CellId 22611 17:35:56.203475 tst iperf3m4.py: using BVCI 22612 17:35:56.322161 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:56.333603 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:56.344661 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:56.355827 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:56.366976 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:56.378225 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:56.389484 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:56.400420 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:35:56.411791 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:56.528296 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:56.649424 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:56.768457 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:35:56.888420 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:35:57.094181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:57.401725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28236): Launched 17:35:57.669553 run iperf3-srv_10.42.42.10(pid=28237): Launched 17:35:57.784814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:35:57.990497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:58.298326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28238): Launched 17:35:58.568504 run iperf3-srv_10.42.42.10(pid=28239): Launched 17:35:58.683351 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:35:58.888105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:35:59.195435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28240): Launched 17:35:59.463239 run iperf3-srv_10.42.42.10(pid=28241): Launched 17:35:59.578449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:35:59.783625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:00.091866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28242): Launched 17:36:00.359059 run iperf3-srv_10.42.42.10(pid=28243): Launched 17:36:00.473793 tst iperf3m4.py:8: start network... 17:36:00.677395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:01.187400 run create_hlr_db(pid=28244): Launched 17:36:01.345458 bus /gobi_6: Setting Powered False 17:36:02.409247 run create_hlr_db(pid=28244): Terminated: ok {rc=0} 17:36:02.850827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28246): Launched 17:36:03.157608 run osmo-hlr_10.42.42.2(pid=28247): Launched 17:36:03.274071 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:03.813528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28249): Launched 17:36:04.119786 run osmo-stp_10.42.42.5(pid=28250): Launched 17:36:04.235532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:04.762468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28252): Launched 17:36:04.882717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:05.140146 run patchelf(pid=28253): Launched 17:36:05.310557 run osmo-stp_10.42.42.5(pid=28250): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28250)] 17:36:05.440413 run osmo-stp_10.42.42.5(pid=28250): stdout: | (launched: 2022-12-09_17:36:04.063565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:05.572051 run osmo-stp_10.42.42.5(pid=28250): stderr: | 20221209173604234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173604234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173604235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173604235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173604237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173604238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173604238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:05.703414 run osmo-stp_10.42.42.5(pid=28250): stdout: | (launched: 2022-12-09_17:36:04.063565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:05.828908 run osmo-stp_10.42.42.5(pid=28250): stderr: | 20221209173604234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173604234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173604235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173604235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173604237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173604238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173604238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:05.977757 run patchelf(pid=28253): Terminating (SIGINT) 17:36:06.149568 run patchelf(pid=28253): Terminated: ok {rc=0} 17:36:06.273502 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28250): Process ended prematurely: osmo-stp_10.42.42.5(pid=28250) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28250)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:36:06.283038 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:36:06.311261 run osmo-hlr_10.42.42.2(pid=28247): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28247)] 17:36:06.359297 run osmo-hlr_10.42.42.2(pid=28247): stdout: | (launched: 2022-12-09_17:36:03.101147) 17:36:06.409200 run osmo-hlr_10.42.42.2(pid=28247): stderr: | 20221209173603278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173603278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173603278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173603278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173603278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173603278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173603290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173603299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173603299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173603299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:06.459339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28236): Terminating (SIGTERM) 17:36:06.499560 run iperf3-srv_10.42.42.10(pid=28237): Terminating (SIGTERM) 17:36:06.539621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28238): Terminating (SIGTERM) 17:36:06.579897 run iperf3-srv_10.42.42.10(pid=28239): Terminating (SIGTERM) 17:36:06.619940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28240): Terminating (SIGTERM) 17:36:06.660064 run iperf3-srv_10.42.42.10(pid=28241): Terminating (SIGTERM) 17:36:06.700218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28242): Terminating (SIGTERM) 17:36:06.739927 run iperf3-srv_10.42.42.10(pid=28243): Terminating (SIGTERM) 17:36:06.779621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28246): Terminating (SIGTERM) 17:36:06.819596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28249): Terminating (SIGTERM) 17:36:06.859483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28252): Terminating (SIGTERM) 17:36:06.899427 --- ParallelTerminationStrategy: PID 28236 died... 17:36:06.918477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28236): Terminated: ok {rc=0} 17:36:06.962861 --- ParallelTerminationStrategy: PID 28237 died... 17:36:06.981285 run iperf3-srv_10.42.42.10(pid=28237): Terminated {rc=256} 17:36:07.025640 --- ParallelTerminationStrategy: PID 28238 died... 17:36:07.044236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28238): Terminated: ok {rc=0} 17:36:07.088668 --- ParallelTerminationStrategy: PID 28239 died... 17:36:07.107231 run iperf3-srv_10.42.42.10(pid=28239): Terminated {rc=256} 17:36:07.151585 --- ParallelTerminationStrategy: PID 28240 died... 17:36:07.170312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28240): Terminated: ok {rc=0} 17:36:07.214876 --- ParallelTerminationStrategy: PID 28241 died... 17:36:07.233342 run iperf3-srv_10.42.42.10(pid=28241): Terminated {rc=256} 17:36:07.277327 --- ParallelTerminationStrategy: PID 28242 died... 17:36:07.295813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28242): Terminated: ok {rc=0} 17:36:07.339882 --- ParallelTerminationStrategy: PID 28243 died... 17:36:07.358344 run iperf3-srv_10.42.42.10(pid=28243): Terminated {rc=256} 17:36:07.402281 --- ParallelTerminationStrategy: PID 28246 died... 17:36:07.420676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28246): Terminated: ok {rc=0} 17:36:07.464803 --- ParallelTerminationStrategy: PID 28249 died... 17:36:07.484127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28249): Terminated: ok {rc=0} 17:36:07.528644 --- ParallelTerminationStrategy: PID 28252 died... 17:36:07.547289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28252): Terminated: ok {rc=0} 17:36:07.633176 bus /gobi_4: Setting Powered False 17:36:08.733522 bus /gobi_4: Setting Powered False 17:36:09.849922 bus /gobi_1: Setting Powered False 17:36:10.948883 bus /gobi_1: Setting Powered False 17:36:12.062264 bus /gobi_0: Setting Powered False 17:36:13.161084 bus /gobi_0: Setting Powered False 17:36:14.277857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:36:15.381645 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:15.393820 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:36:15.467063 tst ping.py: using LAC 22612 17:36:15.594868 tst ping.py: using RAC 172 17:36:15.722202 tst ping.py: using CellId 22612 17:36:15.855097 tst ping.py: using BVCI 22613 17:36:15.986249 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:15.998355 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:16.011056 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:16.024916 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:16.038008 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:16.050020 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:16.063310 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:16.076150 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:16.195552 tst ping.py:19: start network... 17:36:16.432286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:16.935313 run create_hlr_db(pid=28254): Launched 17:36:17.098078 bus /gobi_6: Setting Powered False 17:36:18.161593 run create_hlr_db(pid=28254): Terminated: ok {rc=0} 17:36:18.592286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28256): Launched 17:36:18.894796 run osmo-hlr_10.42.42.2(pid=28257): Launched 17:36:19.010578 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:19.551123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Launched 17:36:19.853265 run osmo-stp_10.42.42.5(pid=28260): Launched 17:36:19.968318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:20.488056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28262): Launched 17:36:20.604291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:20.858686 run patchelf(pid=28263): Launched 17:36:21.026638 run osmo-stp_10.42.42.5(pid=28260): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] 17:36:21.154661 run osmo-stp_10.42.42.5(pid=28260): stdout: | (launched: 2022-12-09_17:36:19.796827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:21.284231 run osmo-stp_10.42.42.5(pid=28260): stderr: | 20221209173619969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173619969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173619969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173619970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173619970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173619970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173619970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:21.413682 run osmo-stp_10.42.42.5(pid=28260): stdout: | (launched: 2022-12-09_17:36:19.796827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:21.536736 run osmo-stp_10.42.42.5(pid=28260): stderr: | 20221209173619969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173619969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173619969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173619970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173619970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173619970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173619970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:21.682937 run patchelf(pid=28263): Terminating (SIGINT) 17:36:21.852270 run patchelf(pid=28263): Terminated: ok {rc=0} 17:36:22.002729 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28260): Process ended prematurely: osmo-stp_10.42.42.5(pid=28260) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 17:36:22.012536 tst ping.py:22: Test FAILED (6.6 sec) 17:36:22.041272 run osmo-hlr_10.42.42.2(pid=28257): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28257)] 17:36:22.092159 run osmo-hlr_10.42.42.2(pid=28257): stdout: | (launched: 2022-12-09_17:36:18.839434) 17:36:22.144863 run osmo-hlr_10.42.42.2(pid=28257): stderr: | 20221209173619014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173619014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173619014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173619014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173619014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173619014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173619026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173619034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173619034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173619034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:22.197914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28256): Terminating (SIGTERM) 17:36:22.240421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Terminating (SIGTERM) 17:36:22.282835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28262): Terminating (SIGTERM) 17:36:22.325958 --- ParallelTerminationStrategy: PID 28256 died... 17:36:22.345931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28256): Terminated: ok {rc=0} 17:36:22.392841 --- ParallelTerminationStrategy: PID 28259 died... 17:36:22.412915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Terminated: ok {rc=0} 17:36:22.460002 --- ParallelTerminationStrategy: PID 28262 died... 17:36:22.479727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28262): Terminated: ok {rc=0} 17:36:22.568793 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:36:23.657734 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:23.669784 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:36:23.741740 tst ping_idle_ping.py: using LAC 22613 17:36:23.861551 tst ping_idle_ping.py: using RAC 173 17:36:23.979190 tst ping_idle_ping.py: using CellId 22613 17:36:24.098085 tst ping_idle_ping.py: using BVCI 22614 17:36:24.209117 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:24.219919 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:24.230547 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:24.241540 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:24.252144 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:24.263282 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:24.274334 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:36:24.285152 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:36:24.404638 tst ping_idle_ping.py:24: start network... 17:36:24.622687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:25.124584 run create_hlr_db(pid=28264): Launched 17:36:25.256491 bus /gobi_6: Setting Powered False 17:36:26.320597 run create_hlr_db(pid=28264): Terminated: ok {rc=0} 17:36:26.753338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28266): Launched 17:36:27.055050 run osmo-hlr_10.42.42.2(pid=28267): Launched 17:36:27.170192 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:27.688818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28269): Launched 17:36:27.990758 run osmo-stp_10.42.42.5(pid=28270): Launched 17:36:28.108143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:28.628772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28272): Launched 17:36:28.745071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:28.998743 run patchelf(pid=28273): Launched 17:36:29.166682 run osmo-stp_10.42.42.5(pid=28270): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28270)] 17:36:29.294028 run osmo-stp_10.42.42.5(pid=28270): stdout: | (launched: 2022-12-09_17:36:27.935346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:29.423781 run osmo-stp_10.42.42.5(pid=28270): stderr: | 20221209173628104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173628104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173628105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173628105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173628105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173628106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173628106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:29.553264 run osmo-stp_10.42.42.5(pid=28270): stdout: | (launched: 2022-12-09_17:36:27.935346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:29.676292 run osmo-stp_10.42.42.5(pid=28270): stderr: | 20221209173628104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173628104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173628105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173628105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173628105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173628106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173628106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:29.822084 run patchelf(pid=28273): Terminating (SIGINT) 17:36:29.990902 run patchelf(pid=28273): Terminated: ok {rc=0} 17:36:30.112746 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28270): Process ended prematurely: osmo-stp_10.42.42.5(pid=28270) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28270)] [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:36:30.121811 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:36:30.149239 run osmo-hlr_10.42.42.2(pid=28267): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28267)] 17:36:30.197151 run osmo-hlr_10.42.42.2(pid=28267): stdout: | (launched: 2022-12-09_17:36:26.999910) 17:36:30.246294 run osmo-hlr_10.42.42.2(pid=28267): stderr: | 20221209173627177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173627177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173627177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173627177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173627177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173627177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173627188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173627197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173627197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173627197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:30.295989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28266): Terminating (SIGTERM) 17:36:30.336040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28269): Terminating (SIGTERM) 17:36:30.376056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28272): Terminating (SIGTERM) 17:36:30.416304 --- ParallelTerminationStrategy: PID 28266 died... 17:36:30.435247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28266): Terminated: ok {rc=0} 17:36:30.479613 --- ParallelTerminationStrategy: PID 28269 died... 17:36:30.498084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28269): Terminated: ok {rc=0} 17:36:30.542545 --- ParallelTerminationStrategy: PID 28272 died... 17:36:30.561224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28272): Terminated: ok {rc=0} 17:36:30.647915 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:36:31.966900 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:36:31.982783 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:36:32.040584 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 17:36:32.096939 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 17:36:32.188327 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:36:32.222900 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 17:36:32.260782 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 17:36:32.862829 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 17:36:32.917492 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:32.929457 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:36:32.984304 tst cs_paging_gprs_active.py: using LAC 22614 17:36:33.114392 tst cs_paging_gprs_active.py: using RAC 174 17:36:33.234668 tst cs_paging_gprs_active.py: using CellId 22614 17:36:33.356873 tst cs_paging_gprs_active.py: using BVCI 22615 17:36:33.469137 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:33.480321 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:33.491377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:33.502599 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:33.513838 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:33.525170 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:33.536542 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:33.547745 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:33.559257 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:33.681667 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:33.802956 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:36:34.026710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:34.358038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28277): Launched 17:36:34.644531 run iperf3-srv_10.42.42.10(pid=28278): Launched 17:36:34.768393 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:36:34.990909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:35.320618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28279): Launched 17:36:35.605502 run iperf3-srv_10.42.42.10(pid=28280): Launched 17:36:35.730079 tst cs_paging_gprs_active.py:38: start network... 17:36:35.951831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:36.460448 run create_hlr_db(pid=28281): Launched 17:36:36.594793 bus /gobi_6: Setting Powered False 17:36:37.658777 run create_hlr_db(pid=28281): Terminated: ok {rc=0} 17:36:38.094228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28283): Launched 17:36:38.401494 run osmo-hlr_10.42.42.2(pid=28284): Launched 17:36:38.519182 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:39.060624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28286): Launched 17:36:39.369386 run osmo-stp_10.42.42.5(pid=28287): Launched 17:36:39.486434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:40.016089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28289): Launched 17:36:40.133860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:40.394213 run patchelf(pid=28290): Launched 17:36:40.565831 run osmo-stp_10.42.42.5(pid=28287): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28287)] 17:36:40.696368 run osmo-stp_10.42.42.5(pid=28287): stdout: | (launched: 2022-12-09_17:36:39.312095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:40.828002 run osmo-stp_10.42.42.5(pid=28287): stderr: | 20221209173639485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173639486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173639486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173639486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173639487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173639487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173639487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:40.959306 run osmo-stp_10.42.42.5(pid=28287): stdout: | (launched: 2022-12-09_17:36:39.312095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:41.085177 run osmo-stp_10.42.42.5(pid=28287): stderr: | 20221209173639485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173639486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173639486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173639486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173639487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173639487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173639487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:41.234336 run patchelf(pid=28290): Terminating (SIGINT) 17:36:41.407142 run patchelf(pid=28290): Terminated: ok {rc=0} 17:36:41.532036 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28287): Process ended prematurely: osmo-stp_10.42.42.5(pid=28287) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28287)] [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 17:36:41.541776 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:36:41.569537 run osmo-hlr_10.42.42.2(pid=28284): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28284)] 17:36:41.618119 run osmo-hlr_10.42.42.2(pid=28284): stdout: | (launched: 2022-12-09_17:36:38.345247) 17:36:41.668306 run osmo-hlr_10.42.42.2(pid=28284): stderr: | 20221209173638524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173638524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173638524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173638524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173638524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173638524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173638537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173638546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173638547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173638547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:41.718680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28277): Terminating (SIGTERM) 17:36:41.759140 run iperf3-srv_10.42.42.10(pid=28278): Terminating (SIGTERM) 17:36:41.799269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28279): Terminating (SIGTERM) 17:36:41.839508 run iperf3-srv_10.42.42.10(pid=28280): Terminating (SIGTERM) 17:36:41.879670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28283): Terminating (SIGTERM) 17:36:41.919747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28286): Terminating (SIGTERM) 17:36:41.960165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28289): Terminating (SIGTERM) 17:36:42.000501 --- ParallelTerminationStrategy: PID 28277 died... 17:36:42.019644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28277): Terminated: ok {rc=0} 17:36:42.065134 --- ParallelTerminationStrategy: PID 28278 died... 17:36:42.083852 run iperf3-srv_10.42.42.10(pid=28278): Terminated {rc=256} 17:36:42.128405 --- ParallelTerminationStrategy: PID 28279 died... 17:36:42.147123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28279): Terminated: ok {rc=0} 17:36:42.191539 --- ParallelTerminationStrategy: PID 28280 died... 17:36:42.210118 run iperf3-srv_10.42.42.10(pid=28280): Terminated {rc=256} 17:36:42.254665 --- ParallelTerminationStrategy: PID 28283 died... 17:36:42.273517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28283): Terminated: ok {rc=0} 17:36:42.318038 --- ParallelTerminationStrategy: PID 28286 died... 17:36:42.336746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28286): Terminated: ok {rc=0} 17:36:42.381424 --- ParallelTerminationStrategy: PID 28289 died... 17:36:42.400056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28289): Terminated: ok {rc=0} 17:36:42.486810 bus /gobi_0: Setting Powered False 17:36:43.588172 bus /gobi_0: Setting Powered False 17:36:44.705390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 17:36:45.855659 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:45.868585 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:36:45.935535 tst iperf3.py: using LAC 22615 17:36:46.098332 tst iperf3.py: using RAC 175 17:36:46.233036 tst iperf3.py: using CellId 22615 17:36:46.364442 tst iperf3.py: using BVCI 22616 17:36:46.479148 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:46.490913 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:46.502961 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:46.515772 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:46.528767 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:46.542674 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:46.556082 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:46.567942 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:46.581334 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:46.702783 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:36:46.959086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:47.296448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28292): Launched 17:36:47.583490 run iperf3-srv_10.42.42.10(pid=28293): Launched 17:36:47.706681 tst iperf3.py:8: start network... 17:36:47.927830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:36:48.435990 run create_hlr_db(pid=28294): Launched 17:36:48.570603 bus /gobi_6: Setting Powered False 17:36:49.634604 run create_hlr_db(pid=28294): Terminated: ok {rc=0} 17:36:50.089990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28296): Launched 17:36:50.418828 run osmo-hlr_10.42.42.2(pid=28297): Launched 17:36:50.544366 run osmo-stp_10.42.42.5: Starting osmo-stp 17:36:51.107188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28299): Launched 17:36:51.435594 run osmo-stp_10.42.42.5(pid=28300): Launched 17:36:51.561588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:36:52.130022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28302): Launched 17:36:52.256767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:36:52.533590 run patchelf(pid=28303): Launched 17:36:52.715917 run osmo-stp_10.42.42.5(pid=28300): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28300)] 17:36:52.855092 run osmo-stp_10.42.42.5(pid=28300): stdout: | (launched: 2022-12-09_17:36:51.375848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:52.995673 run osmo-stp_10.42.42.5(pid=28300): stderr: | 20221209173651569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173651569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173651570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173651570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173651572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173651572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173651572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:53.135894 run osmo-stp_10.42.42.5(pid=28300): stdout: | (launched: 2022-12-09_17:36:51.375848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:36:53.269983 run osmo-stp_10.42.42.5(pid=28300): stderr: | 20221209173651569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173651569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173651570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173651570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173651572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173651572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173651572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:36:53.428361 run patchelf(pid=28303): Terminating (SIGINT) 17:36:53.612262 run patchelf(pid=28303): Terminated: ok {rc=0} 17:36:53.744660 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28300): Process ended prematurely: osmo-stp_10.42.42.5(pid=28300) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28300)] [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 17:36:53.755016 tst iperf3.py:8: Test FAILED (7.9 sec) 17:36:53.783706 run osmo-hlr_10.42.42.2(pid=28297): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28297)] 17:36:53.833980 run osmo-hlr_10.42.42.2(pid=28297): stdout: | (launched: 2022-12-09_17:36:50.359318) 17:36:53.885762 run osmo-hlr_10.42.42.2(pid=28297): stderr: | 20221209173650559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173650559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173650559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173650559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173650559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173650559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173650572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173650581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173650581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173650581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:36:53.937770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28292): Terminating (SIGTERM) 17:36:53.979578 run iperf3-srv_10.42.42.10(pid=28293): Terminating (SIGTERM) 17:36:54.021248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28296): Terminating (SIGTERM) 17:36:54.063199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28299): Terminating (SIGTERM) 17:36:54.105339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28302): Terminating (SIGTERM) 17:36:54.147293 --- ParallelTerminationStrategy: PID 28292 died... 17:36:54.167373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28292): Terminated: ok {rc=0} 17:36:54.213750 --- ParallelTerminationStrategy: PID 28293 died... 17:36:54.233190 run iperf3-srv_10.42.42.10(pid=28293): Terminated {rc=256} 17:36:54.279205 --- ParallelTerminationStrategy: PID 28296 died... 17:36:54.298619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28296): Terminated: ok {rc=0} 17:36:54.344765 --- ParallelTerminationStrategy: PID 28299 died... 17:36:54.364718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28299): Terminated: ok {rc=0} 17:36:54.411034 --- ParallelTerminationStrategy: PID 28302 died... 17:36:54.430699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28302): Terminated: ok {rc=0} 17:36:54.518690 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 17:36:55.670791 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:55.683351 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:36:55.741449 tst iperf3m4.py: using LAC 22616 17:36:55.870580 tst iperf3m4.py: using RAC 176 17:36:55.997401 tst iperf3m4.py: using CellId 22616 17:36:56.117457 tst iperf3m4.py: using BVCI 22617 17:36:56.237560 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:56.249577 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:56.261258 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:56.272700 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:56.284285 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:56.295862 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:56.307579 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:56.318996 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:36:56.330686 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:56.451619 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:56.575477 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:56.693990 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:36:56.815023 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:36:57.037755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:57.366828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28304): Launched 17:36:57.654928 run iperf3-srv_10.42.42.10(pid=28305): Launched 17:36:57.778038 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:36:57.999010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:58.328281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28306): Launched 17:36:58.614751 run iperf3-srv_10.42.42.10(pid=28307): Launched 17:36:58.737983 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:36:58.958982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:36:59.287840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28308): Launched 17:36:59.573753 run iperf3-srv_10.42.42.10(pid=28309): Launched 17:36:59.696279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:36:59.917051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:37:00.246079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28310): Launched 17:37:00.531373 run iperf3-srv_10.42.42.10(pid=28311): Launched 17:37:00.655434 tst iperf3m4.py:8: start network... 17:37:00.883622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:01.405575 run create_hlr_db(pid=28312): Launched 17:37:01.564053 bus /gobi_6: Setting Powered False 17:37:02.627848 run create_hlr_db(pid=28312): Terminated: ok {rc=0} 17:37:03.064668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28314): Launched 17:37:03.371370 run osmo-hlr_10.42.42.2(pid=28315): Launched 17:37:03.489082 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:04.032744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28317): Launched 17:37:04.339803 run osmo-stp_10.42.42.5(pid=28318): Launched 17:37:04.456794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:04.984404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28321): Launched 17:37:05.102157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:05.359758 run patchelf(pid=28322): Launched 17:37:05.530595 run osmo-stp_10.42.42.5(pid=28318): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28318)] 17:37:05.660484 run osmo-stp_10.42.42.5(pid=28318): stdout: | (launched: 2022-12-09_17:37:04.283075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:05.791595 run osmo-stp_10.42.42.5(pid=28318): stderr: | 20221209173704455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173704455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173704455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173704456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173704458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173704458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173704458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:05.923215 run osmo-stp_10.42.42.5(pid=28318): stdout: | (launched: 2022-12-09_17:37:04.283075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:06.048613 run osmo-stp_10.42.42.5(pid=28318): stderr: | 20221209173704455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173704455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173704455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173704456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173704458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173704458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173704458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:06.197926 run patchelf(pid=28322): Terminating (SIGINT) 17:37:06.369884 run patchelf(pid=28322): Terminated: ok {rc=0} 17:37:06.494565 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28318): Process ended prematurely: osmo-stp_10.42.42.5(pid=28318) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28318)] [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 17:37:06.504281 tst iperf3m4.py:8: Test FAILED (10.9 sec) 17:37:06.532459 run osmo-hlr_10.42.42.2(pid=28315): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28315)] 17:37:06.580872 run osmo-hlr_10.42.42.2(pid=28315): stdout: | (launched: 2022-12-09_17:37:03.315058) 17:37:06.630870 run osmo-hlr_10.42.42.2(pid=28315): stderr: | 20221209173703490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173703490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173703490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173703490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173703490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173703490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173703503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173703514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173703514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173703514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:06.681111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28304): Terminating (SIGTERM) 17:37:06.721103 run iperf3-srv_10.42.42.10(pid=28305): Terminating (SIGTERM) 17:37:06.760873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28306): Terminating (SIGTERM) 17:37:06.801067 run iperf3-srv_10.42.42.10(pid=28307): Terminating (SIGTERM) 17:37:06.842646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28308): Terminating (SIGTERM) 17:37:06.883568 run iperf3-srv_10.42.42.10(pid=28309): Terminating (SIGTERM) 17:37:06.923656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28310): Terminating (SIGTERM) 17:37:06.963766 run iperf3-srv_10.42.42.10(pid=28311): Terminating (SIGTERM) 17:37:07.003650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28314): Terminating (SIGTERM) 17:37:07.043372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28317): Terminating (SIGTERM) 17:37:07.083881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28321): Terminating (SIGTERM) 17:37:07.124146 --- ParallelTerminationStrategy: PID 28304 died... 17:37:07.143227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28304): Terminated: ok {rc=0} 17:37:07.187749 --- ParallelTerminationStrategy: PID 28305 died... 17:37:07.206407 run iperf3-srv_10.42.42.10(pid=28305): Terminated {rc=256} 17:37:07.250707 --- ParallelTerminationStrategy: PID 28306 died... 17:37:07.269457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28306): Terminated: ok {rc=0} 17:37:07.313809 --- ParallelTerminationStrategy: PID 28307 died... 17:37:07.332521 run iperf3-srv_10.42.42.10(pid=28307): Terminated {rc=256} 17:37:07.376878 --- ParallelTerminationStrategy: PID 28308 died... 17:37:07.395928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28308): Terminated: ok {rc=0} 17:37:07.440227 --- ParallelTerminationStrategy: PID 28309 died... 17:37:07.458902 run iperf3-srv_10.42.42.10(pid=28309): Terminated {rc=256} 17:37:07.503874 --- ParallelTerminationStrategy: PID 28310 died... 17:37:07.522579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28310): Terminated: ok {rc=0} 17:37:07.566984 --- ParallelTerminationStrategy: PID 28311 died... 17:37:07.585629 run iperf3-srv_10.42.42.10(pid=28311): Terminated {rc=256} 17:37:07.629875 --- ParallelTerminationStrategy: PID 28314 died... 17:37:07.648608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28314): Terminated: ok {rc=0} 17:37:07.693166 --- ParallelTerminationStrategy: PID 28317 died... 17:37:07.711844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28317): Terminated: ok {rc=0} 17:37:07.756057 --- ParallelTerminationStrategy: PID 28321 died... 17:37:07.774673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28321): Terminated: ok {rc=0} 17:37:07.861178 bus /gobi_4: Setting Powered False 17:37:08.961529 bus /gobi_4: Setting Powered False 17:37:10.077496 bus /gobi_1: Setting Powered False 17:37:11.176020 bus /gobi_1: Setting Powered False 17:37:12.294314 bus /gobi_0: Setting Powered False 17:37:13.393655 bus /gobi_0: Setting Powered False 17:37:14.510271 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 17:37:15.613937 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:15.625869 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:37:15.682015 tst ping.py: using LAC 22617 17:37:15.798801 tst ping.py: using RAC 177 17:37:15.938870 tst ping.py: using CellId 22617 17:37:16.056416 tst ping.py: using BVCI 22618 17:37:16.183216 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:16.195927 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:16.208431 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:16.221660 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:16.235840 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:16.249415 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:16.263282 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:16.275773 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:16.420310 tst ping.py:19: start network... 17:37:16.626499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:17.090061 run create_hlr_db(pid=28323): Launched 17:37:17.237725 bus /gobi_6: Setting Powered False 17:37:18.296778 run create_hlr_db(pid=28323): Terminated: ok {rc=0} 17:37:18.729525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28325): Launched 17:37:19.045368 run osmo-hlr_10.42.42.2(pid=28326): Launched 17:37:19.166030 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:19.710996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28328): Launched 17:37:20.026960 run osmo-stp_10.42.42.5(pid=28329): Launched 17:37:20.146766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:20.689306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28331): Launched 17:37:20.809592 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:21.074786 run patchelf(pid=28332): Launched 17:37:21.249991 run osmo-stp_10.42.42.5(pid=28329): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28329)] 17:37:21.383339 run osmo-stp_10.42.42.5(pid=28329): stdout: | (launched: 2022-12-09_17:37:19.969128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:21.518883 run osmo-stp_10.42.42.5(pid=28329): stderr: | 20221209173720159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173720159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173720159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173720160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173720160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173720160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173720160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:21.654924 run osmo-stp_10.42.42.5(pid=28329): stdout: | (launched: 2022-12-09_17:37:19.969128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:21.784172 run osmo-stp_10.42.42.5(pid=28329): stderr: | 20221209173720159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173720159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173720159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173720160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173720160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173720160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173720160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:21.938035 run patchelf(pid=28332): Terminating (SIGINT) 17:37:22.114617 run patchelf(pid=28332): Terminated: ok {rc=0} 17:37:22.241914 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28329): Process ended prematurely: osmo-stp_10.42.42.5(pid=28329) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28329)] [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 17:37:22.251669 tst ping.py:22: Test FAILED (6.6 sec) 17:37:22.279897 run osmo-hlr_10.42.42.2(pid=28326): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28326)] 17:37:22.329485 run osmo-hlr_10.42.42.2(pid=28326): stdout: | (launched: 2022-12-09_17:37:18.987453) 17:37:22.381166 run osmo-hlr_10.42.42.2(pid=28326): stderr: | 20221209173719187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173719187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173719187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173719187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173719187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173719187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173719200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173719208 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173719209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173719209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:22.433120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28325): Terminating (SIGTERM) 17:37:22.476933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28328): Terminating (SIGTERM) 17:37:22.518928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28331): Terminating (SIGTERM) 17:37:22.561064 --- ParallelTerminationStrategy: PID 28325 died... 17:37:22.581391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28325): Terminated: ok {rc=0} 17:37:22.627844 --- ParallelTerminationStrategy: PID 28328 died... 17:37:22.647421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28328): Terminated: ok {rc=0} 17:37:22.693974 --- ParallelTerminationStrategy: PID 28331 died... 17:37:22.713649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28331): Terminated: ok {rc=0} 17:37:22.801992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 17:37:23.890848 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:23.903812 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:37:23.960126 tst ping_idle_ping.py: using LAC 22618 17:37:24.085493 tst ping_idle_ping.py: using RAC 178 17:37:24.203908 tst ping_idle_ping.py: using CellId 22618 17:37:24.320631 tst ping_idle_ping.py: using BVCI 22619 17:37:24.428128 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:24.439454 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:24.450679 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:24.462661 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:24.474574 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:24.487053 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:24.498967 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:37:24.510709 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:37:24.629770 tst ping_idle_ping.py:24: start network... 17:37:24.844341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:25.336002 run create_hlr_db(pid=28333): Launched 17:37:25.466057 bus /gobi_6: Setting Powered False 17:37:26.527931 run create_hlr_db(pid=28333): Terminated: ok {rc=0} 17:37:26.944679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28335): Launched 17:37:27.236118 run osmo-hlr_10.42.42.2(pid=28336): Launched 17:37:27.347674 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:27.862150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28338): Launched 17:37:28.152508 run osmo-stp_10.42.42.5(pid=28339): Launched 17:37:28.263175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:28.764848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28341): Launched 17:37:28.876727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:29.121860 run patchelf(pid=28342): Launched 17:37:29.283496 run osmo-stp_10.42.42.5(pid=28339): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28339)] 17:37:29.406387 run osmo-stp_10.42.42.5(pid=28339): stdout: | (launched: 2022-12-09_17:37:28.099108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:29.531260 run osmo-stp_10.42.42.5(pid=28339): stderr: | 20221209173728269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173728269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173728269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173728270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173728270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173728270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173728270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:29.656146 run osmo-stp_10.42.42.5(pid=28339): stdout: | (launched: 2022-12-09_17:37:28.099108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:29.775074 run osmo-stp_10.42.42.5(pid=28339): stderr: | 20221209173728269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173728269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173728269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173728270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173728270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173728270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173728270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:29.916008 run patchelf(pid=28342): Terminating (SIGINT) 17:37:30.079031 run patchelf(pid=28342): Terminated: ok {rc=0} 17:37:30.197083 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28339): Process ended prematurely: osmo-stp_10.42.42.5(pid=28339) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28339)] [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 17:37:30.206051 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 17:37:30.232743 run osmo-hlr_10.42.42.2(pid=28336): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28336)] 17:37:30.280125 run osmo-hlr_10.42.42.2(pid=28336): stdout: | (launched: 2022-12-09_17:37:27.183074) 17:37:30.329191 run osmo-hlr_10.42.42.2(pid=28336): stderr: | 20221209173727358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173727358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173727358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173727358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173727358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173727358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173727371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173727379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173727379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173727379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:30.378338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28335): Terminating (SIGTERM) 17:37:30.417893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28338): Terminating (SIGTERM) 17:37:30.457275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28341): Terminating (SIGTERM) 17:37:30.496670 --- ParallelTerminationStrategy: PID 28335 died... 17:37:30.515461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28335): Terminated: ok {rc=0} 17:37:30.559361 --- ParallelTerminationStrategy: PID 28338 died... 17:37:30.577767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28338): Terminated: ok {rc=0} 17:37:30.621556 --- ParallelTerminationStrategy: PID 28341 died... 17:37:30.640000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28341): Terminated: ok {rc=0} 17:37:30.723403 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:37:32.093719 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:37:32.102626 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:37:32.140847 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:37:32.179596 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:37:32.238949 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:37:32.274830 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:37:32.310362 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:37:32.866256 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:37:32.871741 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:32.883503 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:37:32.954497 tst switch_tch_pdch.py: using LAC 22619 17:37:33.077496 tst switch_tch_pdch.py: using RAC 179 17:37:33.198265 tst switch_tch_pdch.py: using CellId 22619 17:37:33.318706 tst switch_tch_pdch.py: using BVCI 22620 17:37:33.431810 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:33.443575 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:33.455110 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:33.467187 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:33.479272 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:33.491315 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:33.503615 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:37:33.515568 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:37:33.632024 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:37:33.747174 tst switch_tch_pdch.py:51: start network... 17:37:33.940185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:34.386177 run create_hlr_db(pid=28346): Launched 17:37:34.496591 bus /gobi_6: Setting Powered False 17:37:35.554955 run create_hlr_db(pid=28346): Terminated: ok {rc=0} 17:37:35.984549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28349): Launched 17:37:36.293722 run osmo-hlr_10.42.42.2(pid=28350): Launched 17:37:36.411701 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:36.950630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28352): Launched 17:37:37.260192 run osmo-stp_10.42.42.5(pid=28353): Launched 17:37:37.379046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:37.918103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28355): Launched 17:37:38.036832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:38.298582 run patchelf(pid=28356): Launched 17:37:38.470932 run osmo-stp_10.42.42.5(pid=28353): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28353)] 17:37:38.602885 run osmo-stp_10.42.42.5(pid=28353): stdout: | (launched: 2022-12-09_17:37:37.203658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:38.737182 run osmo-stp_10.42.42.5(pid=28353): stderr: | 20221209173737394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173737394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173737394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173737395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173737395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173737395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173737395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:38.871471 run osmo-stp_10.42.42.5(pid=28353): stdout: | (launched: 2022-12-09_17:37:37.203658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:38.999023 run osmo-stp_10.42.42.5(pid=28353): stderr: | 20221209173737394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173737394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173737394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173737395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173737395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173737395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173737395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:39.149999 run patchelf(pid=28356): Terminating (SIGINT) 17:37:39.324259 run patchelf(pid=28356): Terminated: ok {rc=0} 17:37:39.450107 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28353): Process ended prematurely: osmo-stp_10.42.42.5(pid=28353) [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28353)] [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:37:39.459541 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 17:37:39.487403 run osmo-hlr_10.42.42.2(pid=28350): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28350)] 17:37:39.536766 run osmo-hlr_10.42.42.2(pid=28350): stdout: | (launched: 2022-12-09_17:37:36.237542) 17:37:39.588117 run osmo-hlr_10.42.42.2(pid=28350): stderr: | 20221209173736435 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173736435 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173736435 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173736435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173736435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173736435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173736448 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173736456 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173736456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173736457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:39.639820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28349): Terminating (SIGTERM) 17:37:39.681314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28352): Terminating (SIGTERM) 17:37:39.722511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28355): Terminating (SIGTERM) 17:37:39.764179 --- ParallelTerminationStrategy: PID 28349 died... 17:37:39.784151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28349): Terminated: ok {rc=0} 17:37:39.830197 --- ParallelTerminationStrategy: PID 28352 died... 17:37:39.849866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28352): Terminated: ok {rc=0} 17:37:39.895732 --- ParallelTerminationStrategy: PID 28355 died... 17:37:39.915081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28355): Terminated: ok {rc=0} 17:37:40.001743 bus /gobi_0: Setting Powered False 17:37:41.101054 bus /gobi_0: Setting Powered False 17:37:42.217423 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:37:43.466735 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:37:43.472469 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:37:43.509154 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:37:43.544590 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:37:43.596547 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:37:43.630157 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:37:43.665118 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:37:44.221995 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:37:44.229195 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:44.241186 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:37:44.312029 tst switch_tch_pdch.py: using LAC 22620 17:37:44.426328 tst switch_tch_pdch.py: using RAC 180 17:37:44.540838 tst switch_tch_pdch.py: using CellId 22620 17:37:44.653354 tst switch_tch_pdch.py: using BVCI 22621 17:37:44.758191 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:44.769169 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:44.779667 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:44.790735 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:44.801543 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:44.812283 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:44.823576 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:37:44.836077 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:37:44.987457 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:37:45.106269 tst switch_tch_pdch.py:51: start network... 17:37:45.300679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:37:45.722552 run create_hlr_db(pid=28360): Launched 17:37:45.842499 bus /gobi_6: Setting Powered False 17:37:46.900026 run create_hlr_db(pid=28360): Terminated: ok {rc=0} 17:37:47.290474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28362): Launched 17:37:47.600532 run osmo-hlr_10.42.42.2(pid=28363): Launched 17:37:47.719083 run osmo-stp_10.42.42.5: Starting osmo-stp 17:37:48.230405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28365): Launched 17:37:48.541389 run osmo-stp_10.42.42.5(pid=28366): Launched 17:37:48.659997 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:37:49.170837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28368): Launched 17:37:49.290113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:37:49.551264 run patchelf(pid=28369): Launched 17:37:49.724113 run osmo-stp_10.42.42.5(pid=28366): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28366)] 17:37:49.856080 run osmo-stp_10.42.42.5(pid=28366): stdout: | (launched: 2022-12-09_17:37:48.484525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:49.990083 run osmo-stp_10.42.42.5(pid=28366): stderr: | 20221209173748675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173748675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173748676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173748676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173748678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173748678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173748678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:50.123734 run osmo-stp_10.42.42.5(pid=28366): stdout: | (launched: 2022-12-09_17:37:48.484525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:37:50.250907 run osmo-stp_10.42.42.5(pid=28366): stderr: | 20221209173748675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173748675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173748676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173748676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173748678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173748678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173748678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:37:50.401850 run patchelf(pid=28369): Terminating (SIGINT) 17:37:50.575683 run patchelf(pid=28369): Terminated: ok {rc=0} 17:37:50.700849 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28366): Process ended prematurely: osmo-stp_10.42.42.5(pid=28366) [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28366)] [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:37:50.710379 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:37:50.738054 run osmo-hlr_10.42.42.2(pid=28363): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28363)] 17:37:50.787372 run osmo-hlr_10.42.42.2(pid=28363): stdout: | (launched: 2022-12-09_17:37:47.544002) 17:37:50.839080 run osmo-hlr_10.42.42.2(pid=28363): stderr: | 20221209173747739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173747739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173747739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173747739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173747739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173747739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173747751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173747760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173747760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173747760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:37:50.890971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28362): Terminating (SIGTERM) 17:37:50.932155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28365): Terminating (SIGTERM) 17:37:50.973513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28368): Terminating (SIGTERM) 17:37:51.015082 --- ParallelTerminationStrategy: PID 28362 died... 17:37:51.034870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28362): Terminated: ok {rc=0} 17:37:51.080563 --- ParallelTerminationStrategy: PID 28365 died... 17:37:51.099980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28365): Terminated: ok {rc=0} 17:37:51.145609 --- ParallelTerminationStrategy: PID 28368 died... 17:37:51.164876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28368): Terminated: ok {rc=0} 17:37:51.252117 bus /gobi_0: Setting Powered False 17:37:52.349710 bus /gobi_0: Setting Powered False 17:37:53.464134 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 17:37:54.719531 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:37:54.724239 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:37:54.759010 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 17:37:54.765596 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:37:54.819255 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:37:54.854419 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 17:37:54.861476 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:37:55.394677 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 17:37:55.399664 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 17:37:55.410608 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:37:55.461747 tst mo_mt_sms.py: using LAC 22621 17:37:55.575031 tst mo_mt_sms.py: using RAC 181 17:37:55.686428 tst mo_mt_sms.py: using CellId 22621 17:37:55.797892 tst mo_mt_sms.py: using BVCI 22622 17:37:55.902831 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:37:56.017084 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:37:56.129792 tst mo_mt_sms.py:9: start nitb and bts... 17:37:56.324464 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:37:56.915550 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28374): Launched 17:37:57.207018 run osmo-nitb_10.42.42.2(pid=28375): Launched 17:37:57.367417 run osmo-nitb_10.42.42.2(pid=28375): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28375)] 17:37:57.497734 run osmo-nitb_10.42.42.2(pid=28375): stdout: | (launched: 2022-12-09_17:37:57.154333) 17:37:57.628851 run osmo-nitb_10.42.42.2(pid=28375): stderr: | (launched: 2022-12-09_17:37:57.197089) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:37:57.760482 run osmo-nitb_10.42.42.2(pid=28375): stdout: | (launched: 2022-12-09_17:37:57.154333) 17:37:57.886145 run osmo-nitb_10.42.42.2(pid=28375): stderr: | (launched: 2022-12-09_17:37:57.197089) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28375): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28375) [trial-2362↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28375)] 17:37:58.316861 tst osmo-nitb_10.42.42.2(pid=28375): stdout: | (launched: 2022-12-09_17:37:57.154333) 17:37:58.432802 tst osmo-nitb_10.42.42.2(pid=28375): stderr: | (launched: 2022-12-09_17:37:57.197089) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:37:58.570199 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28375): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28375) [trial-2362↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28375)] [trial-2362↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 17:37:58.578618 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 17:37:58.585356 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28374): Terminating (SIGTERM) 17:37:58.794361 --- ParallelTerminationStrategy: PID 28374 died... 17:37:58.814954 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28374): Terminated: ok {rc=0} 17:37:58.900613 bus /sierra_3: Setting Powered False 17:38:00.000061 bus /sierra_3: Setting Powered False 17:38:01.113730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 sms:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:02.364726 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:02.369909 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:02.409432 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:38:02.437224 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 17:38:02.495143 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:02.538756 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:38:02.574774 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 17:38:03.140657 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 17:38:03.146478 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:03.158351 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:03.217246 tst mo_mt_sms.py: using LAC 22622 17:38:03.355177 tst mo_mt_sms.py: using RAC 182 17:38:03.514201 tst mo_mt_sms.py: using CellId 22622 17:38:03.665395 tst mo_mt_sms.py: using BVCI 22623 17:38:03.804639 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:03.816901 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:03.835097 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:03.848183 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:03.868408 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:03.880940 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:38:04.026237 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 17:38:04.171874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:04.681247 run create_hlr_db(pid=28648): Launched 17:38:04.835349 bus /sierra_2: Setting Powered False 17:38:05.895242 run create_hlr_db(pid=28648): Terminated: ok {rc=0} 17:38:06.325879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Launched 17:38:06.645695 run osmo-hlr_10.42.42.2(pid=28653): Launched 17:38:06.885765 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:07.580749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28655): Launched 17:38:07.901595 run osmo-stp_10.42.42.5(pid=28656): Launched 17:38:08.108227 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:08.757380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28658): Launched 17:38:09.081736 run osmo-msc_10.42.42.6(pid=28659): Launched 17:38:09.424904 run osmo-stp_10.42.42.5(pid=28656): ERR: Terminated: ERROR {rc=1} [trial-2362↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28656)] 17:38:09.696484 run osmo-stp_10.42.42.5(pid=28656): stdout: | (launched: 2022-12-09_17:38:07.840150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:09.969813 run osmo-stp_10.42.42.5(pid=28656): stderr: | 20221209173808070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173808070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173808071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173808071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173808071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173808072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173808072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:10.157815 run osmo-stp_10.42.42.5(pid=28656): stdout: | (launched: 2022-12-09_17:38:07.840150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:10.281853 run osmo-stp_10.42.42.5(pid=28656): stderr: | 20221209173808070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173808070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173808071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173808071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173808071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173808072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173808072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:10.431862 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28656): Process ended prematurely: osmo-stp_10.42.42.5(pid=28656) [trial-2362↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28656)] [trial-2362↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 17:38:10.441386 tst mo_mt_sms.py:16: Test FAILED (7.3 sec) 17:38:10.471671 run osmo-hlr_10.42.42.2(pid=28653): ERR: Terminated: ERROR {rc=237} [trial-2362↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28653)] 17:38:10.523757 run osmo-hlr_10.42.42.2(pid=28653): stdout: | (launched: 2022-12-09_17:38:06.575678) 17:38:10.577185 run osmo-hlr_10.42.42.2(pid=28653): stderr: | 20221209173806916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173806916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173806916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173806916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173806916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173806916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173806933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173806950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173806950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173806950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:10.651189 run osmo-msc_10.42.42.6(pid=28659): ERR: Terminated: ERROR {rc=2} [trial-2362↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28659)] 17:38:10.702415 run osmo-msc_10.42.42.6(pid=28659): stdout: | (launched: 2022-12-09_17:38:09.021661) 17:38:10.755294 run osmo-msc_10.42.42.6(pid=28659): stderr: | 20221209173809626 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173809626 DLGLOBAL DEBUG validating counter group 0x7f91e5563c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173809626 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173809626 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173809626 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173809626 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173809628 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173809628 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173809633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173809633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:10.809626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Terminating (SIGTERM) 17:38:10.853065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28655): Terminating (SIGTERM) 17:38:10.897969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28658): Terminating (SIGTERM) 17:38:10.942811 --- ParallelTerminationStrategy: PID 28651 died... 17:38:10.963409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Terminated: ok {rc=0} 17:38:11.013435 --- ParallelTerminationStrategy: PID 28655 died... 17:38:11.033346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28655): Terminated: ok {rc=0} 17:38:11.081207 --- ParallelTerminationStrategy: PID 28658 died... 17:38:11.100723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28658): Terminated: ok {rc=0} 17:38:11.190442 bus /sierra_3: Setting Powered False 17:38:12.291570 bus /sierra_3: Setting Powered False 17:38:13.409913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:14.645935 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:14.650637 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:14.688489 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 17:38:14.696433 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 17:38:14.733042 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:14.768531 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 17:38:14.776170 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 17:38:15.291429 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 17:38:15.298188 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 17:38:15.310034 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:15.368452 tst assert_extension.py: using LAC 22623 17:38:15.489488 tst assert_extension.py: using RAC 183 17:38:15.610257 tst assert_extension.py: using CellId 22623 17:38:15.729894 tst assert_extension.py: using BVCI 22624 17:38:15.853717 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 17:38:15.999211 tst assert_extension.py:10: start nitb and bts... 17:38:16.346765 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:38:17.146078 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28664): Launched 17:38:17.549746 run osmo-nitb_10.42.42.2(pid=28665): Launched 17:38:17.785558 run osmo-nitb_10.42.42.2(pid=28665): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28665)] 17:38:17.960740 run osmo-nitb_10.42.42.2(pid=28665): stdout: | (launched: 2022-12-09_17:38:17.476902) 17:38:18.135702 run osmo-nitb_10.42.42.2(pid=28665): stderr: | (launched: 2022-12-09_17:38:17.536307) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:38:18.284426 run osmo-nitb_10.42.42.2(pid=28665): stdout: | (launched: 2022-12-09_17:38:17.476902) 17:38:18.426089 run osmo-nitb_10.42.42.2(pid=28665): stderr: | (launched: 2022-12-09_17:38:17.536307) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28665): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28665) [trial-2362↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28665)] 17:38:18.710175 tst osmo-nitb_10.42.42.2(pid=28665): stdout: | (launched: 2022-12-09_17:38:17.476902) 17:38:18.840485 tst osmo-nitb_10.42.42.2(pid=28665): stderr: | (launched: 2022-12-09_17:38:17.536307) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:38:18.988434 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28665): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28665) [trial-2362↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28665)] [trial-2362↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 17:38:18.997838 tst assert_extension.py:12: Test FAILED (3.7 sec) 17:38:19.005392 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28664): Terminating (SIGTERM) 17:38:19.220536 --- ParallelTerminationStrategy: PID 28664 died... 17:38:19.242390 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28664): Terminated: ok {rc=0} 17:38:19.332672 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 17:38:20.518733 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:20.523804 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:38:20.559675 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:38:20.588459 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 17:38:20.624864 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:38:20.661130 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:38:20.690400 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 17:38:21.222490 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 17:38:21.229805 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:21.242082 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:38:21.294695 tst assert_extension.py: using LAC 22624 17:38:21.424620 tst assert_extension.py: using RAC 184 17:38:21.558345 tst assert_extension.py: using CellId 22624 17:38:21.686065 tst assert_extension.py: using BVCI 22625 17:38:21.805244 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:21.818532 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:21.830992 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:21.843034 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:21.855588 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:38:21.868710 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 17:38:21.990888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:22.504837 run create_hlr_db(pid=28669): Launched 17:38:22.672019 bus /sierra_2: Setting Powered False 17:38:23.739118 run create_hlr_db(pid=28669): Terminated: ok {rc=0} 17:38:24.203018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28671): Launched 17:38:24.545715 run osmo-hlr_10.42.42.2(pid=28672): Launched 17:38:24.787880 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:25.570560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28674): Launched 17:38:25.907822 run osmo-stp_10.42.42.5(pid=28675): Launched 17:38:26.118692 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:26.656920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28678): Launched 17:38:26.953494 run osmo-msc_10.42.42.6(pid=28679): Launched 17:38:27.120614 run osmo-stp_10.42.42.5(pid=28675): ERR: Terminated: ERROR {rc=1} [trial-2362↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28675)] 17:38:27.246896 run osmo-stp_10.42.42.5(pid=28675): stdout: | (launched: 2022-12-09_17:38:25.849421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:27.373275 run osmo-stp_10.42.42.5(pid=28675): stderr: | 20221209173826127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173826127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173826127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173826128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173826130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173826130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173826130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:27.497154 run osmo-stp_10.42.42.5(pid=28675): stdout: | (launched: 2022-12-09_17:38:25.849421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:27.614995 run osmo-stp_10.42.42.5(pid=28675): stderr: | 20221209173826127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173826127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173826127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173826128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173826130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173826130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173826130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:27.756061 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28675): Process ended prematurely: osmo-stp_10.42.42.5(pid=28675) [trial-2362↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28675)] [trial-2362↪ussd:trx-sysmocell5000↪assert_extension.py:17] 17:38:27.764384 tst assert_extension.py:17: Test FAILED (6.5 sec) 17:38:27.790964 run osmo-hlr_10.42.42.2(pid=28672): ERR: Terminated: ERROR {rc=237} [trial-2362↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28672)] 17:38:27.839893 run osmo-hlr_10.42.42.2(pid=28672): stdout: | (launched: 2022-12-09_17:38:24.485401) 17:38:27.890169 run osmo-hlr_10.42.42.2(pid=28672): stderr: | 20221209173824795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173824795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173824795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173824795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173824795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173824795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173824815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173824829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173824829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173824829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:27.959965 run osmo-msc_10.42.42.6(pid=28679): ERR: Terminated: ERROR {rc=2} [trial-2362↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28679)] 17:38:28.008513 run osmo-msc_10.42.42.6(pid=28679): stdout: | (launched: 2022-12-09_17:38:26.899291) 17:38:28.058631 run osmo-msc_10.42.42.6(pid=28679): stderr: | 20221209173827169 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173827169 DLGLOBAL DEBUG validating counter group 0x7f70f975ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173827169 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173827169 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173827169 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173827169 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173827171 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173827171 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173827172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173827172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:28.109327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28671): Terminating (SIGTERM) 17:38:28.149504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28674): Terminating (SIGTERM) 17:38:28.190022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28678): Terminating (SIGTERM) 17:38:28.230690 --- ParallelTerminationStrategy: PID 28671 died... 17:38:28.249872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28671): Terminated: ok {rc=0} 17:38:28.294536 --- ParallelTerminationStrategy: PID 28674 died... 17:38:28.313179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28674): Terminated: ok {rc=0} 17:38:28.357697 --- ParallelTerminationStrategy: PID 28678 died... 17:38:28.376207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28678): Terminated: ok {rc=0} 17:38:28.463143 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:38:29.672447 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:29.678880 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:38:29.712428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:38:29.738940 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:38:29.790794 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:38:29.824517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:38:29.850364 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:38:30.400781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:38:30.450202 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:30.461352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:38:30.530246 tst mo_mt_call.py: using LAC 22625 17:38:30.662945 tst mo_mt_call.py: using RAC 185 17:38:30.786157 tst mo_mt_call.py: using CellId 22625 17:38:30.927474 tst mo_mt_call.py: using BVCI 22626 17:38:31.042481 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:31.054302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:31.065809 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:31.077614 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:31.089408 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:31.101144 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:31.220736 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:31.338037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:31.876335 run create_hlr_db(pid=28684): Launched 17:38:32.043953 bus /sierra_2: Setting Powered False 17:38:33.108005 run create_hlr_db(pid=28684): Terminated: ok {rc=0} 17:38:33.541493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28686): Launched 17:38:33.844132 run osmo-hlr_10.42.42.2(pid=28687): Launched 17:38:33.959461 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:34.481715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28689): Launched 17:38:34.805970 run osmo-stp_10.42.42.5(pid=28690): Launched 17:38:34.927690 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:35.476154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28692): Launched 17:38:35.779483 run osmo-msc_10.42.42.6(pid=28693): Launched 17:38:35.948209 run osmo-stp_10.42.42.5(pid=28690): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28690)] 17:38:36.076289 run osmo-stp_10.42.42.5(pid=28690): stdout: | (launched: 2022-12-09_17:38:34.747619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:36.204634 run osmo-stp_10.42.42.5(pid=28690): stderr: | 20221209173834922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173834922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173834922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173834922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173834925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173834925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173834925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:36.331190 run osmo-stp_10.42.42.5(pid=28690): stdout: | (launched: 2022-12-09_17:38:34.747619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:36.451359 run osmo-stp_10.42.42.5(pid=28690): stderr: | 20221209173834922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173834922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173834922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173834922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173834925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173834925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173834925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:36.595562 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28690): Process ended prematurely: osmo-stp_10.42.42.5(pid=28690) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28690)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:38:36.604687 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:38:36.631995 run osmo-hlr_10.42.42.2(pid=28687): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28687)] 17:38:36.680543 run osmo-hlr_10.42.42.2(pid=28687): stdout: | (launched: 2022-12-09_17:38:33.788904) 17:38:36.730768 run osmo-hlr_10.42.42.2(pid=28687): stderr: | 20221209173833963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173833963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173833963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173833963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173833963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173833963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173833980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173833990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173833991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173833991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:36.800896 run osmo-msc_10.42.42.6(pid=28693): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28693)] 17:38:36.849368 run osmo-msc_10.42.42.6(pid=28693): stdout: | (launched: 2022-12-09_17:38:35.724344) 17:38:36.899572 run osmo-msc_10.42.42.6(pid=28693): stderr: | 20221209173835997 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173835997 DLGLOBAL DEBUG validating counter group 0x7fb634b9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173835997 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173835997 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173835997 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173835998 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173836000 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173836000 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173836001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173836001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:36.950170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28686): Terminating (SIGTERM) 17:38:36.990334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28689): Terminating (SIGTERM) 17:38:37.030627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28692): Terminating (SIGTERM) 17:38:37.070709 --- ParallelTerminationStrategy: PID 28686 died... 17:38:37.090131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28686): Terminated: ok {rc=0} 17:38:37.135095 --- ParallelTerminationStrategy: PID 28689 died... 17:38:37.153760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28689): Terminated: ok {rc=0} 17:38:37.198525 --- ParallelTerminationStrategy: PID 28692 died... 17:38:37.217190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28692): Terminated: ok {rc=0} 17:38:37.304640 bus /sierra_3: Setting Powered False 17:38:38.405867 bus /sierra_3: Setting Powered False 17:38:39.522594 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:38:40.668329 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:40.680519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:38:40.751780 tst mo_mt_call_osmux.py: using LAC 22626 17:38:40.871622 tst mo_mt_call_osmux.py: using RAC 186 17:38:40.990379 tst mo_mt_call_osmux.py: using CellId 22626 17:38:41.112444 tst mo_mt_call_osmux.py: using BVCI 22627 17:38:41.224321 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:41.235679 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:41.246696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:41.257946 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:41.269200 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:38:41.280281 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:41.400117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:38:41.522691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:42.024805 run create_hlr_db(pid=28695): Launched 17:38:42.158604 bus /sierra_2: Setting Powered False 17:38:43.222656 run create_hlr_db(pid=28695): Terminated: ok {rc=0} 17:38:43.655548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28697): Launched 17:38:43.959144 run osmo-hlr_10.42.42.2(pid=28698): Launched 17:38:44.075234 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:44.612474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28700): Launched 17:38:44.917344 run osmo-stp_10.42.42.5(pid=28701): Launched 17:38:45.032934 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:45.579795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28703): Launched 17:38:45.893857 run osmo-msc_10.42.42.6(pid=28704): Launched 17:38:46.299271 run osmo-stp_10.42.42.5(pid=28701): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28701)] 17:38:46.555846 run osmo-stp_10.42.42.5(pid=28701): stdout: | (launched: 2022-12-09_17:38:44.861938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:46.812449 run osmo-stp_10.42.42.5(pid=28701): stderr: | 20221209173845033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173845033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173845033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173845034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173845034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173845034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173845034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:46.975429 run osmo-stp_10.42.42.5(pid=28701): stdout: | (launched: 2022-12-09_17:38:44.861938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:47.134614 run osmo-stp_10.42.42.5(pid=28701): stderr: | 20221209173845033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173845033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173845033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173845034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173845034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173845034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173845034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:47.311203 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28701): Process ended prematurely: osmo-stp_10.42.42.5(pid=28701) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28701)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:38:47.321980 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 17:38:47.352181 run osmo-hlr_10.42.42.2(pid=28698): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28698)] 17:38:47.403872 run osmo-hlr_10.42.42.2(pid=28698): stdout: | (launched: 2022-12-09_17:38:43.904079) 17:38:47.458158 run osmo-hlr_10.42.42.2(pid=28698): stderr: | 20221209173844082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173844082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173844082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173844082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173844082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173844082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173844094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173844103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173844104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173844104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:47.532542 run osmo-msc_10.42.42.6(pid=28704): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28704)] 17:38:47.582819 run osmo-msc_10.42.42.6(pid=28704): stdout: | (launched: 2022-12-09_17:38:45.827376) 17:38:47.635146 run osmo-msc_10.42.42.6(pid=28704): stderr: | 20221209173846528 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173846528 DLGLOBAL DEBUG validating counter group 0x7f1548a14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173846528 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173846528 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173846528 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173846528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173846530 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173846531 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173846531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173846531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:47.687594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28697): Terminating (SIGTERM) 17:38:47.729535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28700): Terminating (SIGTERM) 17:38:47.771544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28703): Terminating (SIGTERM) 17:38:47.813676 --- ParallelTerminationStrategy: PID 28697 died... 17:38:47.833733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28697): Terminated: ok {rc=0} 17:38:47.880615 --- ParallelTerminationStrategy: PID 28700 died... 17:38:47.900275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28700): Terminated: ok {rc=0} 17:38:47.946546 --- ParallelTerminationStrategy: PID 28703 died... 17:38:47.966322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28703): Terminated: ok {rc=0} 17:38:48.053749 bus /sierra_3: Setting Powered False 17:38:49.152381 bus /sierra_3: Setting Powered False 17:38:50.267008 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:38:51.514520 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:38:51.521123 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:38:51.554928 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:38:51.581491 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:38:51.634372 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:38:51.667527 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:38:51.694614 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:38:52.251156 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:38:52.303199 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:52.315228 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:38:52.390372 tst mo_mt_call.py: using LAC 22627 17:38:52.517984 tst mo_mt_call.py: using RAC 187 17:38:52.643832 tst mo_mt_call.py: using CellId 22627 17:38:52.772007 tst mo_mt_call.py: using BVCI 22628 17:38:52.890044 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:52.901674 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:52.913106 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:52.924550 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:52.936354 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:38:52.947907 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:38:53.062293 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:38:53.177497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:38:53.646677 run create_hlr_db(pid=28709): Launched 17:38:53.763347 bus /sierra_2: Setting Powered False 17:38:54.822957 run create_hlr_db(pid=28709): Terminated: ok {rc=0} 17:38:55.244545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28711): Launched 17:38:55.547914 run osmo-hlr_10.42.42.2(pid=28712): Launched 17:38:55.663472 run osmo-stp_10.42.42.5: Starting osmo-stp 17:38:56.194748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28714): Launched 17:38:56.497148 run osmo-stp_10.42.42.5(pid=28715): Launched 17:38:56.612247 run osmo-msc_10.42.42.6: Starting osmo-msc 17:38:57.164062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28717): Launched 17:38:57.468941 run osmo-msc_10.42.42.6(pid=28718): Launched 17:38:57.638163 run osmo-stp_10.42.42.5(pid=28715): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28715)] 17:38:57.768252 run osmo-stp_10.42.42.5(pid=28715): stdout: | (launched: 2022-12-09_17:38:56.441630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:57.897606 run osmo-stp_10.42.42.5(pid=28715): stderr: | 20221209173856614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173856615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173856615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173856615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173856616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173856616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173856616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:58.024276 run osmo-stp_10.42.42.5(pid=28715): stdout: | (launched: 2022-12-09_17:38:56.441630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:38:58.144297 run osmo-stp_10.42.42.5(pid=28715): stderr: | 20221209173856614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173856615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173856615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173856615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173856616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173856616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173856616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:38:58.288205 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28715): Process ended prematurely: osmo-stp_10.42.42.5(pid=28715) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28715)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:38:58.297573 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:38:58.324884 run osmo-hlr_10.42.42.2(pid=28712): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28712)] 17:38:58.373403 run osmo-hlr_10.42.42.2(pid=28712): stdout: | (launched: 2022-12-09_17:38:55.492543) 17:38:58.423784 run osmo-hlr_10.42.42.2(pid=28712): stderr: | 20221209173855672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173855673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173855673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173855673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173855673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173855673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173855685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173855693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173855694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173855694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:38:58.493534 run osmo-msc_10.42.42.6(pid=28718): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28718)] 17:38:58.541880 run osmo-msc_10.42.42.6(pid=28718): stdout: | (launched: 2022-12-09_17:38:57.412796) 17:38:58.592021 run osmo-msc_10.42.42.6(pid=28718): stderr: | 20221209173857688 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173857688 DLGLOBAL DEBUG validating counter group 0x7f0a5160fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173857689 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173857689 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173857689 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173857689 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173857691 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173857691 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173857691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173857692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:38:58.642657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28711): Terminating (SIGTERM) 17:38:58.682882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28714): Terminating (SIGTERM) 17:38:58.723089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28717): Terminating (SIGTERM) 17:38:58.763804 --- ParallelTerminationStrategy: PID 28711 died... 17:38:58.782968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28711): Terminated: ok {rc=0} 17:38:58.827868 --- ParallelTerminationStrategy: PID 28714 died... 17:38:58.846578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28714): Terminated: ok {rc=0} 17:38:58.891353 --- ParallelTerminationStrategy: PID 28717 died... 17:38:58.910109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28717): Terminated: ok {rc=0} 17:38:58.996579 bus /sierra_3: Setting Powered False 17:39:00.095573 bus /sierra_3: Setting Powered False 17:39:01.223600 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:39:02.375432 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:02.387740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:39:02.460428 tst mo_mt_call_osmux.py: using LAC 22628 17:39:02.588751 tst mo_mt_call_osmux.py: using RAC 188 17:39:02.716497 tst mo_mt_call_osmux.py: using CellId 22628 17:39:02.842733 tst mo_mt_call_osmux.py: using BVCI 22629 17:39:02.961946 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:02.973698 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:02.984922 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:02.996317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:03.007828 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:39:03.019258 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:39:03.138982 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:39:03.256440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:03.725666 run create_hlr_db(pid=28720): Launched 17:39:03.841364 bus /sierra_2: Setting Powered False 17:39:04.901320 run create_hlr_db(pid=28720): Terminated: ok {rc=0} 17:39:05.322368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28722): Launched 17:39:05.624611 run osmo-hlr_10.42.42.2(pid=28723): Launched 17:39:05.739654 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:06.275483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28725): Launched 17:39:06.578198 run osmo-stp_10.42.42.5(pid=28726): Launched 17:39:06.693631 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:07.241533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28728): Launched 17:39:07.545554 run osmo-msc_10.42.42.6(pid=28729): Launched 17:39:07.715825 run osmo-stp_10.42.42.5(pid=28726): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28726)] 17:39:07.846065 run osmo-stp_10.42.42.5(pid=28726): stdout: | (launched: 2022-12-09_17:39:06.523076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:07.975126 run osmo-stp_10.42.42.5(pid=28726): stderr: | 20221209173906693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173906693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173906694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173906694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173906695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173906695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173906695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:08.102258 run osmo-stp_10.42.42.5(pid=28726): stdout: | (launched: 2022-12-09_17:39:06.523076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:08.223064 run osmo-stp_10.42.42.5(pid=28726): stderr: | 20221209173906693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173906693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173906694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173906694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173906695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173906695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173906695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:08.367198 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28726): Process ended prematurely: osmo-stp_10.42.42.5(pid=28726) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28726)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:39:08.376528 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:39:08.403689 run osmo-hlr_10.42.42.2(pid=28723): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28723)] 17:39:08.452662 run osmo-hlr_10.42.42.2(pid=28723): stdout: | (launched: 2022-12-09_17:39:05.569703) 17:39:08.503022 run osmo-hlr_10.42.42.2(pid=28723): stderr: | 20221209173905747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173905747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173905747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173905747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173905747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173905747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173905760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173905770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173905770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173905770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:08.573088 run osmo-msc_10.42.42.6(pid=28729): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28729)] 17:39:08.621463 run osmo-msc_10.42.42.6(pid=28729): stdout: | (launched: 2022-12-09_17:39:07.490139) 17:39:08.671500 run osmo-msc_10.42.42.6(pid=28729): stderr: | 20221209173907764 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173907765 DLGLOBAL DEBUG validating counter group 0x7f7c15e85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173907765 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173907765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173907765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173907765 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173907767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173907768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173907768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173907768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:08.722011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28722): Terminating (SIGTERM) 17:39:08.762315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28725): Terminating (SIGTERM) 17:39:08.802906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28728): Terminating (SIGTERM) 17:39:08.843649 --- ParallelTerminationStrategy: PID 28722 died... 17:39:08.862871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28722): Terminated: ok {rc=0} 17:39:08.907787 --- ParallelTerminationStrategy: PID 28725 died... 17:39:08.926482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28725): Terminated: ok {rc=0} 17:39:08.971268 --- ParallelTerminationStrategy: PID 28728 died... 17:39:08.990032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28728): Terminated: ok {rc=0} 17:39:09.076245 bus /sierra_3: Setting Powered False 17:39:10.174826 bus /sierra_3: Setting Powered False 17:39:11.287585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:39:12.546761 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:39:12.554912 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:39:12.589642 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:39:12.616749 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:39:12.668029 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:39:12.702554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:39:12.729617 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:39:13.284123 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:39:13.335590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:13.347308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:39:13.417124 tst mo_mt_call.py: using LAC 22629 17:39:13.543243 tst mo_mt_call.py: using RAC 189 17:39:13.669592 tst mo_mt_call.py: using CellId 22629 17:39:13.794546 tst mo_mt_call.py: using BVCI 22630 17:39:13.913669 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:13.925270 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:13.936792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:13.948237 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:13.959696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:13.971121 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:14.085752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:14.205885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:14.706046 run create_hlr_db(pid=28734): Launched 17:39:14.837402 bus /sierra_2: Setting Powered False 17:39:15.910750 run create_hlr_db(pid=28734): Terminated: ok {rc=0} 17:39:16.368299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28736): Launched 17:39:16.717532 run osmo-hlr_10.42.42.2(pid=28737): Launched 17:39:16.918953 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:17.638990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28739): Launched 17:39:17.943070 run osmo-stp_10.42.42.5(pid=28740): Launched 17:39:18.058812 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:18.606411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28742): Launched 17:39:18.910767 run osmo-msc_10.42.42.6(pid=28743): Launched 17:39:19.082550 run osmo-stp_10.42.42.5(pid=28740): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28740)] 17:39:19.211417 run osmo-stp_10.42.42.5(pid=28740): stdout: | (launched: 2022-12-09_17:39:17.886870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:19.340321 run osmo-stp_10.42.42.5(pid=28740): stderr: | 20221209173918058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173918058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173918058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173918058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173918059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173918059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173918059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:19.467243 run osmo-stp_10.42.42.5(pid=28740): stdout: | (launched: 2022-12-09_17:39:17.886870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:19.588077 run osmo-stp_10.42.42.5(pid=28740): stderr: | 20221209173918058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173918058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173918058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173918058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173918059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173918059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173918059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:19.732186 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28740): Process ended prematurely: osmo-stp_10.42.42.5(pid=28740) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28740)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:39:19.741452 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:39:19.768496 run osmo-hlr_10.42.42.2(pid=28737): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28737)] 17:39:19.817156 run osmo-hlr_10.42.42.2(pid=28737): stdout: | (launched: 2022-12-09_17:39:16.657515) 17:39:19.867478 run osmo-hlr_10.42.42.2(pid=28737): stderr: | 20221209173917011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173917012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173917012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173917012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173917012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173917012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173917035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173917043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173917043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173917043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:19.937014 run osmo-msc_10.42.42.6(pid=28743): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28743)] 17:39:19.984880 run osmo-msc_10.42.42.6(pid=28743): stdout: | (launched: 2022-12-09_17:39:18.855101) 17:39:20.034596 run osmo-msc_10.42.42.6(pid=28743): stderr: | 20221209173919127 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173919127 DLGLOBAL DEBUG validating counter group 0x7f10374ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173919127 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173919127 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173919127 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173919127 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173919129 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173919129 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173919130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173919130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:20.084546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28736): Terminating (SIGTERM) 17:39:20.124564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28739): Terminating (SIGTERM) 17:39:20.164583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28742): Terminating (SIGTERM) 17:39:20.204918 --- ParallelTerminationStrategy: PID 28736 died... 17:39:20.223888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28736): Terminated: ok {rc=0} 17:39:20.268785 --- ParallelTerminationStrategy: PID 28739 died... 17:39:20.287367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28739): Terminated: ok {rc=0} 17:39:20.331697 --- ParallelTerminationStrategy: PID 28742 died... 17:39:20.350380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28742): Terminated: ok {rc=0} 17:39:20.437013 bus /sierra_3: Setting Powered False 17:39:21.536525 bus /sierra_3: Setting Powered False 17:39:22.653411 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:39:23.805371 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:23.817915 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:39:23.889370 tst mo_mt_call_osmux.py: using LAC 22630 17:39:24.018979 tst mo_mt_call_osmux.py: using RAC 190 17:39:24.147004 tst mo_mt_call_osmux.py: using CellId 22630 17:39:24.275422 tst mo_mt_call_osmux.py: using BVCI 22631 17:39:24.393523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:24.405191 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:24.416627 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:24.428074 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:24.439686 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:39:24.451164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:24.570309 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:39:24.687111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:25.158047 run create_hlr_db(pid=28745): Launched 17:39:25.273972 bus /sierra_2: Setting Powered False 17:39:26.334438 run create_hlr_db(pid=28745): Terminated: ok {rc=0} 17:39:26.778821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28747): Launched 17:39:27.104075 run osmo-hlr_10.42.42.2(pid=28748): Launched 17:39:27.227960 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:27.785582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28750): Launched 17:39:28.111363 run osmo-stp_10.42.42.5(pid=28751): Launched 17:39:28.234697 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:28.820760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28753): Launched 17:39:29.145346 run osmo-msc_10.42.42.6(pid=28754): Launched 17:39:29.328021 run osmo-stp_10.42.42.5(pid=28751): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28751)] 17:39:29.464557 run osmo-stp_10.42.42.5(pid=28751): stdout: | (launched: 2022-12-09_17:39:28.052206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:29.602669 run osmo-stp_10.42.42.5(pid=28751): stderr: | 20221209173928246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173928246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173928246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173928246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173928247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173928247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173928247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:29.739385 run osmo-stp_10.42.42.5(pid=28751): stdout: | (launched: 2022-12-09_17:39:28.052206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:29.868054 run osmo-stp_10.42.42.5(pid=28751): stderr: | 20221209173928246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173928246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173928246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173928246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173928247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173928247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173928247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:30.023102 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28751): Process ended prematurely: osmo-stp_10.42.42.5(pid=28751) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28751)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:39:30.032846 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:39:30.060908 run osmo-hlr_10.42.42.2(pid=28748): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28748)] 17:39:30.111420 run osmo-hlr_10.42.42.2(pid=28748): stdout: | (launched: 2022-12-09_17:39:27.045580) 17:39:30.163645 run osmo-hlr_10.42.42.2(pid=28748): stderr: | 20221209173927244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173927244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173927244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173927244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173927244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173927244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173927256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173927265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173927265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173927265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:30.236218 run osmo-msc_10.42.42.6(pid=28754): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28754)] 17:39:30.286188 run osmo-msc_10.42.42.6(pid=28754): stdout: | (launched: 2022-12-09_17:39:29.086340) 17:39:30.338270 run osmo-msc_10.42.42.6(pid=28754): stderr: | 20221209173929408 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173929408 DLGLOBAL DEBUG validating counter group 0x7f36d2f4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173929408 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173929408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173929408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173929409 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173929411 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173929412 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173929412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173929412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:30.390766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28747): Terminating (SIGTERM) 17:39:30.432373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28750): Terminating (SIGTERM) 17:39:30.474201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28753): Terminating (SIGTERM) 17:39:30.516685 --- ParallelTerminationStrategy: PID 28747 died... 17:39:30.536846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28747): Terminated: ok {rc=0} 17:39:30.583593 --- ParallelTerminationStrategy: PID 28750 died... 17:39:30.603247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28750): Terminated: ok {rc=0} 17:39:30.649624 --- ParallelTerminationStrategy: PID 28753 died... 17:39:30.669298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28753): Terminated: ok {rc=0} 17:39:30.758063 bus /sierra_3: Setting Powered False 17:39:31.864384 bus /sierra_3: Setting Powered False 17:39:32.997306 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:39:34.248498 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:39:34.255237 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:39:34.289160 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:39:34.316770 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:39:34.368717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:39:34.402543 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:39:34.428784 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:39:34.984531 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:39:35.033426 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:35.044537 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:39:35.118150 tst mo_mt_call.py: using LAC 22631 17:39:35.236606 tst mo_mt_call.py: using RAC 191 17:39:35.354072 tst mo_mt_call.py: using CellId 22631 17:39:35.472934 tst mo_mt_call.py: using BVCI 22632 17:39:35.584203 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:35.595449 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:35.606449 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:35.617618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:35.629129 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:35.640253 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:35.755124 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:35.869705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:36.337406 run create_hlr_db(pid=28759): Launched 17:39:36.453224 bus /sierra_2: Setting Powered False 17:39:37.513905 run create_hlr_db(pid=28759): Terminated: ok {rc=0} 17:39:37.956671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28761): Launched 17:39:38.280255 run osmo-hlr_10.42.42.2(pid=28762): Launched 17:39:38.403528 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:38.958458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28764): Launched 17:39:39.282562 run osmo-stp_10.42.42.5(pid=28765): Launched 17:39:39.407872 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:40.000443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28769): Launched 17:39:40.332890 run osmo-msc_10.42.42.6(pid=28786): Launched 17:39:40.697354 run osmo-stp_10.42.42.5(pid=28765): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28765)] 17:39:40.981204 run osmo-stp_10.42.42.5(pid=28765): stdout: | (launched: 2022-12-09_17:39:39.224067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:41.153947 run osmo-stp_10.42.42.5(pid=28765): stderr: | 20221209173939415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173939416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173939416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173939416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173939417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173939417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173939417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:41.291375 run osmo-stp_10.42.42.5(pid=28765): stdout: | (launched: 2022-12-09_17:39:39.224067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:41.423024 run osmo-stp_10.42.42.5(pid=28765): stderr: | 20221209173939415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173939416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173939416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173939416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173939417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173939417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173939417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:41.581146 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28765): Process ended prematurely: osmo-stp_10.42.42.5(pid=28765) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28765)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:39:41.591838 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 17:39:41.621407 run osmo-hlr_10.42.42.2(pid=28762): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28762)] 17:39:41.674528 run osmo-hlr_10.42.42.2(pid=28762): stdout: | (launched: 2022-12-09_17:39:38.221347) 17:39:41.728669 run osmo-hlr_10.42.42.2(pid=28762): stderr: | 20221209173938419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173938419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173938419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173938419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173938419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173938419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173938431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173938440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173938440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173938440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:41.803184 run osmo-msc_10.42.42.6(pid=28786): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28786)] 17:39:41.854895 run osmo-msc_10.42.42.6(pid=28786): stdout: | (launched: 2022-12-09_17:39:40.276826) 17:39:41.908180 run osmo-msc_10.42.42.6(pid=28786): stderr: | 20221209173940779 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173940780 DLGLOBAL DEBUG validating counter group 0x7f5ae5eedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173940780 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173940780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173940780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173940780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173940786 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173940787 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173940787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173940787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:41.962371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28761): Terminating (SIGTERM) 17:39:42.006364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28764): Terminating (SIGTERM) 17:39:42.051294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28769): Terminating (SIGTERM) 17:39:42.095204 --- ParallelTerminationStrategy: PID 28761 died... 17:39:42.117098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28761): Terminated: ok {rc=0} 17:39:42.163855 --- ParallelTerminationStrategy: PID 28764 died... 17:39:42.183569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28764): Terminated: ok {rc=0} 17:39:42.229780 --- ParallelTerminationStrategy: PID 28769 died... 17:39:42.249520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28769): Terminated: ok {rc=0} 17:39:42.336900 bus /sierra_3: Setting Powered False 17:39:43.435981 bus /sierra_3: Setting Powered False 17:39:44.553815 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:39:45.699936 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:45.712190 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:39:45.787513 tst mo_mt_call_osmux.py: using LAC 22632 17:39:45.935169 tst mo_mt_call_osmux.py: using RAC 192 17:39:46.067533 tst mo_mt_call_osmux.py: using CellId 22632 17:39:46.224890 tst mo_mt_call_osmux.py: using BVCI 22633 17:39:46.377703 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:46.393371 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:46.410260 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:46.425362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:46.438239 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:39:46.450700 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:46.576712 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:39:46.709580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:47.209847 run create_hlr_db(pid=28818): Launched 17:39:47.361171 bus /sierra_2: Setting Powered False 17:39:48.421590 run create_hlr_db(pid=28818): Terminated: ok {rc=0} 17:39:48.864419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28820): Launched 17:39:49.188478 run osmo-hlr_10.42.42.2(pid=28821): Launched 17:39:49.312625 run osmo-stp_10.42.42.5: Starting osmo-stp 17:39:49.869305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28823): Launched 17:39:50.192824 run osmo-stp_10.42.42.5(pid=28824): Launched 17:39:50.315585 run osmo-msc_10.42.42.6: Starting osmo-msc 17:39:50.905672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28826): Launched 17:39:51.230131 run osmo-msc_10.42.42.6(pid=28827): Launched 17:39:51.410266 run osmo-stp_10.42.42.5(pid=28824): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28824)] 17:39:51.546377 run osmo-stp_10.42.42.5(pid=28824): stdout: | (launched: 2022-12-09_17:39:50.134228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:51.683911 run osmo-stp_10.42.42.5(pid=28824): stderr: | 20221209173950326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173950326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173950327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173950327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173950328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173950328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173950328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:51.820831 run osmo-stp_10.42.42.5(pid=28824): stdout: | (launched: 2022-12-09_17:39:50.134228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:39:51.949474 run osmo-stp_10.42.42.5(pid=28824): stderr: | 20221209173950326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209173950326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209173950327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209173950327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209173950328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209173950328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209173950328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:39:52.103330 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28824): Process ended prematurely: osmo-stp_10.42.42.5(pid=28824) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28824)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:39:52.113087 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:39:52.140857 run osmo-hlr_10.42.42.2(pid=28821): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28821)] 17:39:52.191211 run osmo-hlr_10.42.42.2(pid=28821): stdout: | (launched: 2022-12-09_17:39:49.129943) 17:39:52.243481 run osmo-hlr_10.42.42.2(pid=28821): stderr: | 20221209173949328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209173949328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209173949328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209173949328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209173949329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209173949329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209173949341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209173949349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209173949349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209173949349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:39:52.315878 run osmo-msc_10.42.42.6(pid=28827): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28827)] 17:39:52.366169 run osmo-msc_10.42.42.6(pid=28827): stdout: | (launched: 2022-12-09_17:39:51.171104) 17:39:52.418058 run osmo-msc_10.42.42.6(pid=28827): stderr: | 20221209173951494 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209173951494 DLGLOBAL DEBUG validating counter group 0x7f49dd54ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209173951494 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209173951494 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209173951494 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209173951494 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209173951496 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209173951496 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209173951497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209173951497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:39:52.470424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28820): Terminating (SIGTERM) 17:39:52.512058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28823): Terminating (SIGTERM) 17:39:52.553938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28826): Terminating (SIGTERM) 17:39:52.596178 --- ParallelTerminationStrategy: PID 28820 died... 17:39:52.615854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28820): Terminated: ok {rc=0} 17:39:52.662075 --- ParallelTerminationStrategy: PID 28823 died... 17:39:52.681696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28823): Terminated: ok {rc=0} 17:39:52.727874 --- ParallelTerminationStrategy: PID 28826 died... 17:39:52.747507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28826): Terminated: ok {rc=0} 17:39:52.835501 bus /sierra_3: Setting Powered False 17:39:53.935587 bus /sierra_3: Setting Powered False 17:39:55.054815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:39:56.308603 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:39:56.315399 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:39:56.350363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:39:56.376988 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:39:56.428480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:39:56.462205 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:39:56.488605 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:39:57.045133 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:39:57.095529 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:57.106937 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:39:57.174662 tst mo_mt_call.py: using LAC 22633 17:39:57.291686 tst mo_mt_call.py: using RAC 193 17:39:57.408455 tst mo_mt_call.py: using CellId 22633 17:39:57.525262 tst mo_mt_call.py: using BVCI 22634 17:39:57.634659 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:57.645877 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:57.656803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:57.668116 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:57.679476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:39:57.690614 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:39:57.810099 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:39:57.926252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:39:58.395331 run create_hlr_db(pid=28832): Launched 17:39:58.511101 bus /sierra_2: Setting Powered False 17:39:59.571203 run create_hlr_db(pid=28832): Terminated: ok {rc=0} 17:39:59.994285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Launched 17:40:00.297608 run osmo-hlr_10.42.42.2(pid=28835): Launched 17:40:00.413368 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:00.956193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Launched 17:40:01.289146 run osmo-stp_10.42.42.5(pid=28840): Launched 17:40:01.484082 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:02.214845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28843): Launched 17:40:02.532045 run osmo-msc_10.42.42.6(pid=28844): Launched 17:40:02.702263 run osmo-stp_10.42.42.5(pid=28840): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28840)] 17:40:02.831370 run osmo-stp_10.42.42.5(pid=28840): stdout: | (launched: 2022-12-09_17:40:01.219605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:02.960426 run osmo-stp_10.42.42.5(pid=28840): stderr: | 20221209174001577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174001577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174001577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174001578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174001578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174001578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174001578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:03.087789 run osmo-stp_10.42.42.5(pid=28840): stdout: | (launched: 2022-12-09_17:40:01.219605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:03.208132 run osmo-stp_10.42.42.5(pid=28840): stderr: | 20221209174001577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174001577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174001577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174001578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174001578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174001578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174001578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:03.352403 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28840): Process ended prematurely: osmo-stp_10.42.42.5(pid=28840) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28840)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:40:03.361630 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:40:03.388448 run osmo-hlr_10.42.42.2(pid=28835): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28835)] 17:40:03.436350 run osmo-hlr_10.42.42.2(pid=28835): stdout: | (launched: 2022-12-09_17:40:00.242492) 17:40:03.486138 run osmo-hlr_10.42.42.2(pid=28835): stderr: | 20221209174000418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174000418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174000418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174000418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174000418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174000419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174000432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174000440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174000441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174000441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:03.555143 run osmo-msc_10.42.42.6(pid=28844): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28844)] 17:40:03.602759 run osmo-msc_10.42.42.6(pid=28844): stdout: | (launched: 2022-12-09_17:40:02.476541) 17:40:03.652232 run osmo-msc_10.42.42.6(pid=28844): stderr: | 20221209174002751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174002751 DLGLOBAL DEBUG validating counter group 0x7fa70ef26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174002752 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174002752 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174002752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174002752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174002754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174002755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174002755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174002755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:03.702052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminating (SIGTERM) 17:40:03.742042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminating (SIGTERM) 17:40:03.781933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28843): Terminating (SIGTERM) 17:40:03.822400 --- ParallelTerminationStrategy: PID 28834 died... 17:40:03.841452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminated: ok {rc=0} 17:40:03.886471 --- ParallelTerminationStrategy: PID 28837 died... 17:40:03.905111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminated: ok {rc=0} 17:40:03.949813 --- ParallelTerminationStrategy: PID 28843 died... 17:40:03.968484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28843): Terminated: ok {rc=0} 17:40:04.055166 bus /sierra_3: Setting Powered False 17:40:05.155440 bus /sierra_3: Setting Powered False 17:40:06.269577 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:40:07.418553 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:07.431322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:40:07.503610 tst mo_mt_call_osmux.py: using LAC 22634 17:40:07.632846 tst mo_mt_call_osmux.py: using RAC 194 17:40:07.761169 tst mo_mt_call_osmux.py: using CellId 22634 17:40:07.886705 tst mo_mt_call_osmux.py: using BVCI 22635 17:40:08.004568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:08.016371 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:08.027891 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:08.039411 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:08.051137 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:40:08.062630 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:40:08.182307 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:40:08.298109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:08.768387 run create_hlr_db(pid=28846): Launched 17:40:08.885851 bus /sierra_2: Setting Powered False 17:40:09.950510 run create_hlr_db(pid=28846): Terminated: ok {rc=0} 17:40:10.402053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28848): Launched 17:40:10.727912 run osmo-hlr_10.42.42.2(pid=28849): Launched 17:40:10.851198 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:11.408691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28851): Launched 17:40:11.735308 run osmo-stp_10.42.42.5(pid=28852): Launched 17:40:11.859241 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:12.447406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28854): Launched 17:40:12.754085 run osmo-msc_10.42.42.6(pid=28855): Launched 17:40:12.924333 run osmo-stp_10.42.42.5(pid=28852): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28852)] 17:40:13.053684 run osmo-stp_10.42.42.5(pid=28852): stdout: | (launched: 2022-12-09_17:40:11.676336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:13.183210 run osmo-stp_10.42.42.5(pid=28852): stderr: | 20221209174011869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174011869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174011869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174011870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174011872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174011872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174011872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:13.310111 run osmo-stp_10.42.42.5(pid=28852): stdout: | (launched: 2022-12-09_17:40:11.676336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:13.431378 run osmo-stp_10.42.42.5(pid=28852): stderr: | 20221209174011869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174011869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174011869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174011870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174011872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174011872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174011872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:13.575931 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28852): Process ended prematurely: osmo-stp_10.42.42.5(pid=28852) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28852)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:40:13.585359 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:40:13.612439 run osmo-hlr_10.42.42.2(pid=28849): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28849)] 17:40:13.661128 run osmo-hlr_10.42.42.2(pid=28849): stdout: | (launched: 2022-12-09_17:40:10.669214) 17:40:13.711440 run osmo-hlr_10.42.42.2(pid=28849): stderr: | 20221209174010868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174010868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174010868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174010868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174010868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174010868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174010879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174010888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174010888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174010888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:13.781085 run osmo-msc_10.42.42.6(pid=28855): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28855)] 17:40:13.829328 run osmo-msc_10.42.42.6(pid=28855): stdout: | (launched: 2022-12-09_17:40:12.698368) 17:40:13.879231 run osmo-msc_10.42.42.6(pid=28855): stderr: | 20221209174012970 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174012970 DLGLOBAL DEBUG validating counter group 0x7fd442ecac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174012970 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174012970 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174012971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174012971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174012972 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174012973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174012973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174012973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:13.930506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28848): Terminating (SIGTERM) 17:40:13.970954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28851): Terminating (SIGTERM) 17:40:14.011172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28854): Terminating (SIGTERM) 17:40:14.051706 --- ParallelTerminationStrategy: PID 28848 died... 17:40:14.071338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28848): Terminated: ok {rc=0} 17:40:14.115709 --- ParallelTerminationStrategy: PID 28851 died... 17:40:14.134240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28851): Terminated: ok {rc=0} 17:40:14.178983 --- ParallelTerminationStrategy: PID 28854 died... 17:40:14.197365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28854): Terminated: ok {rc=0} 17:40:14.280650 bus /sierra_3: Setting Powered False 17:40:15.378778 bus /sierra_3: Setting Powered False 17:40:16.497265 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:40:17.761206 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:40:17.768267 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:40:17.802368 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:40:17.829306 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:40:17.882838 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:40:17.917514 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:40:17.944537 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:40:18.496690 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:40:18.547995 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:18.559822 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:40:18.631643 tst mo_mt_call.py: using LAC 22635 17:40:18.763923 tst mo_mt_call.py: using RAC 195 17:40:18.889438 tst mo_mt_call.py: using CellId 22635 17:40:19.015224 tst mo_mt_call.py: using BVCI 22636 17:40:19.131865 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:19.143558 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:19.155035 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:19.166549 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:19.178099 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:19.189682 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:19.309602 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:19.427786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:19.896012 run create_hlr_db(pid=28862): Launched 17:40:20.013239 bus /sierra_2: Setting Powered False 17:40:21.073557 run create_hlr_db(pid=28862): Terminated: ok {rc=0} 17:40:21.516085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28864): Launched 17:40:21.840893 run osmo-hlr_10.42.42.2(pid=28865): Launched 17:40:21.966741 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:22.523676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28867): Launched 17:40:22.846622 run osmo-stp_10.42.42.5(pid=28868): Launched 17:40:22.970289 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:23.560049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28870): Launched 17:40:23.883872 run osmo-msc_10.42.42.6(pid=28871): Launched 17:40:24.065662 run osmo-stp_10.42.42.5(pid=28868): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28868)] 17:40:24.202297 run osmo-stp_10.42.42.5(pid=28868): stdout: | (launched: 2022-12-09_17:40:22.787847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:24.339605 run osmo-stp_10.42.42.5(pid=28868): stderr: | 20221209174022980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174022980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174022980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174022980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174022981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174022981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174022981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:24.476329 run osmo-stp_10.42.42.5(pid=28868): stdout: | (launched: 2022-12-09_17:40:22.787847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:24.605157 run osmo-stp_10.42.42.5(pid=28868): stderr: | 20221209174022980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174022980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174022980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174022980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174022981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174022981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174022981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:24.759537 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28868): Process ended prematurely: osmo-stp_10.42.42.5(pid=28868) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28868)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:40:24.769367 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:40:24.797189 run osmo-hlr_10.42.42.2(pid=28865): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28865)] 17:40:24.847353 run osmo-hlr_10.42.42.2(pid=28865): stdout: | (launched: 2022-12-09_17:40:21.782222) 17:40:24.899236 run osmo-hlr_10.42.42.2(pid=28865): stderr: | 20221209174021980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174021980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174021980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174021980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174021980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174021981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174021993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174022002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174022002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174022002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:24.972148 run osmo-msc_10.42.42.6(pid=28871): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28871)] 17:40:25.022306 run osmo-msc_10.42.42.6(pid=28871): stdout: | (launched: 2022-12-09_17:40:23.825075) 17:40:25.074151 run osmo-msc_10.42.42.6(pid=28871): stderr: | 20221209174024149 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174024149 DLGLOBAL DEBUG validating counter group 0x7fe3d0724c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174024149 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174024149 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174024149 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174024149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174024151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174024151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174024152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174024152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:25.126159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28864): Terminating (SIGTERM) 17:40:25.167891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28867): Terminating (SIGTERM) 17:40:25.209921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28870): Terminating (SIGTERM) 17:40:25.251818 --- ParallelTerminationStrategy: PID 28864 died... 17:40:25.271831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28864): Terminated: ok {rc=0} 17:40:25.318467 --- ParallelTerminationStrategy: PID 28867 died... 17:40:25.337909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28867): Terminated: ok {rc=0} 17:40:25.383825 --- ParallelTerminationStrategy: PID 28870 died... 17:40:25.403327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28870): Terminated: ok {rc=0} 17:40:25.491938 bus /sierra_3: Setting Powered False 17:40:26.592751 bus /sierra_3: Setting Powered False 17:40:27.709300 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:40:28.858298 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:28.870750 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:40:28.943774 tst mo_mt_call_osmux.py: using LAC 22636 17:40:29.072591 tst mo_mt_call_osmux.py: using RAC 196 17:40:29.192003 tst mo_mt_call_osmux.py: using CellId 22636 17:40:29.312906 tst mo_mt_call_osmux.py: using BVCI 22637 17:40:29.422736 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:29.434054 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:29.445062 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:29.456528 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:29.467956 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:40:29.479131 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:29.598102 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:40:29.718044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:30.188863 run create_hlr_db(pid=28873): Launched 17:40:30.304494 bus /sierra_2: Setting Powered False 17:40:31.363692 run create_hlr_db(pid=28873): Terminated: ok {rc=0} 17:40:31.833779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28875): Launched 17:40:32.166808 run osmo-hlr_10.42.42.2(pid=28876): Launched 17:40:32.315208 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:32.874197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28878): Launched 17:40:33.198189 run osmo-stp_10.42.42.5(pid=28879): Launched 17:40:33.322868 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:33.910114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28881): Launched 17:40:34.237892 run osmo-msc_10.42.42.6(pid=28882): Launched 17:40:34.417321 run osmo-stp_10.42.42.5(pid=28879): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28879)] 17:40:34.553243 run osmo-stp_10.42.42.5(pid=28879): stdout: | (launched: 2022-12-09_17:40:33.139445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:34.689941 run osmo-stp_10.42.42.5(pid=28879): stderr: | 20221209174033334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174033334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174033334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174033335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174033335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174033335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174033335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:34.826436 run osmo-stp_10.42.42.5(pid=28879): stdout: | (launched: 2022-12-09_17:40:33.139445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:34.955156 run osmo-stp_10.42.42.5(pid=28879): stderr: | 20221209174033334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174033334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174033334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174033335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174033335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174033335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174033335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:35.109382 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28879): Process ended prematurely: osmo-stp_10.42.42.5(pid=28879) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28879)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:40:35.119083 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:40:35.146912 run osmo-hlr_10.42.42.2(pid=28876): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28876)] 17:40:35.196820 run osmo-hlr_10.42.42.2(pid=28876): stdout: | (launched: 2022-12-09_17:40:32.102647) 17:40:35.248726 run osmo-hlr_10.42.42.2(pid=28876): stderr: | 20221209174032310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174032310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174032310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174032310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174032310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174032310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174032322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174032330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174032330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174032330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:35.321126 run osmo-msc_10.42.42.6(pid=28882): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28882)] 17:40:35.371361 run osmo-msc_10.42.42.6(pid=28882): stdout: | (launched: 2022-12-09_17:40:34.178481) 17:40:35.423218 run osmo-msc_10.42.42.6(pid=28882): stderr: | 20221209174034501 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174034501 DLGLOBAL DEBUG validating counter group 0x7f4859ecfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174034501 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174034501 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174034501 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174034501 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174034503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174034503 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174034504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174034504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:35.475534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28875): Terminating (SIGTERM) 17:40:35.517542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28878): Terminating (SIGTERM) 17:40:35.559662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28881): Terminating (SIGTERM) 17:40:35.601938 --- ParallelTerminationStrategy: PID 28875 died... 17:40:35.621883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28875): Terminated: ok {rc=0} 17:40:35.668336 --- ParallelTerminationStrategy: PID 28878 died... 17:40:35.687961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28878): Terminated: ok {rc=0} 17:40:35.734455 --- ParallelTerminationStrategy: PID 28881 died... 17:40:35.753973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28881): Terminated: ok {rc=0} 17:40:35.842053 bus /sierra_3: Setting Powered False 17:40:36.940548 bus /sierra_3: Setting Powered False 17:40:38.056156 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:40:39.307901 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:40:39.313494 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:40:39.347007 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:40:39.373503 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:40:39.426915 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:40:39.461401 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:40:39.487773 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:40:40.035345 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:40:40.084363 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:40.095395 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:40:40.165783 tst mo_mt_call.py: using LAC 22637 17:40:40.286352 tst mo_mt_call.py: using RAC 197 17:40:40.410157 tst mo_mt_call.py: using CellId 22637 17:40:40.529523 tst mo_mt_call.py: using BVCI 22638 17:40:40.648062 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:40.659724 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:40.671179 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:40.683106 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:40.694663 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:40.706141 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:40.825382 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:40.942448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:41.443327 run create_hlr_db(pid=28888): Launched 17:40:41.574485 bus /sierra_2: Setting Powered False 17:40:42.638944 run create_hlr_db(pid=28888): Terminated: ok {rc=0} 17:40:43.090689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28890): Launched 17:40:43.416035 run osmo-hlr_10.42.42.2(pid=28891): Launched 17:40:43.539575 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:44.100055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28893): Launched 17:40:44.423852 run osmo-stp_10.42.42.5(pid=28894): Launched 17:40:44.547344 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:45.135860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28896): Launched 17:40:45.459833 run osmo-msc_10.42.42.6(pid=28897): Launched 17:40:45.639252 run osmo-stp_10.42.42.5(pid=28894): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28894)] 17:40:45.777268 run osmo-stp_10.42.42.5(pid=28894): stdout: | (launched: 2022-12-09_17:40:44.365250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:45.987979 run osmo-stp_10.42.42.5(pid=28894): stderr: | 20221209174044557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174044558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174044558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174044558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174044559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174044559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174044559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:46.158832 run osmo-stp_10.42.42.5(pid=28894): stdout: | (launched: 2022-12-09_17:40:44.365250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:46.290686 run osmo-stp_10.42.42.5(pid=28894): stderr: | 20221209174044557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174044558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174044558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174044558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174044559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174044559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174044559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:46.446880 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28894): Process ended prematurely: osmo-stp_10.42.42.5(pid=28894) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28894)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:40:46.457338 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:40:46.485987 run osmo-hlr_10.42.42.2(pid=28891): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28891)] 17:40:46.537565 run osmo-hlr_10.42.42.2(pid=28891): stdout: | (launched: 2022-12-09_17:40:43.357436) 17:40:46.591075 run osmo-hlr_10.42.42.2(pid=28891): stderr: | 20221209174043558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174043558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174043558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174043558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174043558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174043558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174043571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174043580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174043580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174043580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:46.665608 run osmo-msc_10.42.42.6(pid=28897): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28897)] 17:40:46.718410 run osmo-msc_10.42.42.6(pid=28897): stdout: | (launched: 2022-12-09_17:40:45.400903) 17:40:46.772674 run osmo-msc_10.42.42.6(pid=28897): stderr: | 20221209174045724 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174045724 DLGLOBAL DEBUG validating counter group 0x7fe6db457c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174045724 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174045724 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174045725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174045725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174045727 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174045727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174045727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174045727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:46.826453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28890): Terminating (SIGTERM) 17:40:46.869271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28893): Terminating (SIGTERM) 17:40:46.913700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28896): Terminating (SIGTERM) 17:40:46.958125 --- ParallelTerminationStrategy: PID 28890 died... 17:40:46.978429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28890): Terminated: ok {rc=0} 17:40:47.025541 --- ParallelTerminationStrategy: PID 28893 died... 17:40:47.045427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28893): Terminated: ok {rc=0} 17:40:47.092744 --- ParallelTerminationStrategy: PID 28896 died... 17:40:47.112852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28896): Terminated: ok {rc=0} 17:40:47.202460 bus /sierra_3: Setting Powered False 17:40:48.303341 bus /sierra_3: Setting Powered False 17:40:49.416862 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:40:50.566586 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:50.578839 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:40:50.653541 tst mo_mt_call_osmux.py: using LAC 22638 17:40:50.781624 tst mo_mt_call_osmux.py: using RAC 198 17:40:50.908806 tst mo_mt_call_osmux.py: using CellId 22638 17:40:51.036105 tst mo_mt_call_osmux.py: using BVCI 22639 17:40:51.155122 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:51.166669 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:51.178005 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:51.189372 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:51.200754 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:40:51.212069 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:51.329789 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:40:51.450131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:40:51.919303 run create_hlr_db(pid=28899): Launched 17:40:52.035312 bus /sierra_2: Setting Powered False 17:40:53.095371 run create_hlr_db(pid=28899): Terminated: ok {rc=0} 17:40:53.517628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28901): Launched 17:40:53.820452 run osmo-hlr_10.42.42.2(pid=28902): Launched 17:40:53.937006 run osmo-stp_10.42.42.5: Starting osmo-stp 17:40:54.458712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28904): Launched 17:40:54.761715 run osmo-stp_10.42.42.5(pid=28905): Launched 17:40:54.877577 run osmo-msc_10.42.42.6: Starting osmo-msc 17:40:55.426974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28907): Launched 17:40:55.730374 run osmo-msc_10.42.42.6(pid=28908): Launched 17:40:55.902319 run osmo-stp_10.42.42.5(pid=28905): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28905)] 17:40:56.031259 run osmo-stp_10.42.42.5(pid=28905): stdout: | (launched: 2022-12-09_17:40:54.706202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:56.160368 run osmo-stp_10.42.42.5(pid=28905): stderr: | 20221209174054877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174054877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174054878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174054878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174054878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174054878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174054879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:56.287364 run osmo-stp_10.42.42.5(pid=28905): stdout: | (launched: 2022-12-09_17:40:54.706202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:40:56.407636 run osmo-stp_10.42.42.5(pid=28905): stderr: | 20221209174054877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174054877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174054878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174054878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174054878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174054878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174054879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:40:56.551610 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28905): Process ended prematurely: osmo-stp_10.42.42.5(pid=28905) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28905)] [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:40:56.560593 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:40:56.587320 run osmo-hlr_10.42.42.2(pid=28902): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28902)] 17:40:56.635362 run osmo-hlr_10.42.42.2(pid=28902): stdout: | (launched: 2022-12-09_17:40:53.765175) 17:40:56.684826 run osmo-hlr_10.42.42.2(pid=28902): stderr: | 20221209174053943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174053943 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174053943 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174053943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174053943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174053943 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174053956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174053964 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174053964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174053964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:40:56.753681 run osmo-msc_10.42.42.6(pid=28908): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28908)] 17:40:56.801419 run osmo-msc_10.42.42.6(pid=28908): stdout: | (launched: 2022-12-09_17:40:55.674850) 17:40:56.851064 run osmo-msc_10.42.42.6(pid=28908): stderr: | 20221209174055947 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174055947 DLGLOBAL DEBUG validating counter group 0x7ff580b11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174055947 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174055947 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174055947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174055947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174055949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174055949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174055950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174055950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:40:56.900690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28901): Terminating (SIGTERM) 17:40:56.940200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28904): Terminating (SIGTERM) 17:40:56.979806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28907): Terminating (SIGTERM) 17:40:57.019542 --- ParallelTerminationStrategy: PID 28901 died... 17:40:57.038350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28901): Terminated: ok {rc=0} 17:40:57.082580 --- ParallelTerminationStrategy: PID 28904 died... 17:40:57.100829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28904): Terminated: ok {rc=0} 17:40:57.145201 --- ParallelTerminationStrategy: PID 28907 died... 17:40:57.163488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28907): Terminated: ok {rc=0} 17:40:57.248219 bus /sierra_3: Setting Powered False 17:40:58.346100 bus /sierra_3: Setting Powered False 17:40:59.458167 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 17:41:00.708222 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:41:00.712485 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:41:00.746529 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 17:41:00.772872 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 17:41:00.875540 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:41:00.940613 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 17:41:00.970212 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 17:41:01.548396 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2362 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 17:41:01.554279 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:01.568465 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:01.628269 tst emergency_mo_mt_call.py: using LAC 22639 17:41:01.796446 tst emergency_mo_mt_call.py: using RAC 199 17:41:01.920712 tst emergency_mo_mt_call.py: using CellId 22639 17:41:02.072381 tst emergency_mo_mt_call.py: using BVCI 22640 17:41:02.191544 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:02.203991 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:02.217286 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:02.229409 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:02.242267 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:02.254940 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:02.379337 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:02.497544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:02.990479 run create_hlr_db(pid=28913): Launched 17:41:03.122586 bus /sierra_2: Setting Powered False 17:41:04.185730 run create_hlr_db(pid=28913): Terminated: ok {rc=0} 17:41:04.613716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28915): Launched 17:41:04.910834 run osmo-hlr_10.42.42.2(pid=28916): Launched 17:41:05.023975 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:05.552508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28918): Launched 17:41:05.849729 run osmo-stp_10.42.42.5(pid=28919): Launched 17:41:05.972530 tst emergency_mo_mt_call.py: using MSISDN 7298 17:41:06.139064 run osmo-msc_10.42.42.6: Starting osmo-msc 17:41:06.673518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28921): Launched 17:41:06.969980 run osmo-msc_10.42.42.6(pid=28922): Launched 17:41:07.135577 run osmo-stp_10.42.42.5(pid=28919): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28919)] 17:41:07.261496 run osmo-stp_10.42.42.5(pid=28919): stdout: | (launched: 2022-12-09_17:41:05.795308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:07.387404 run osmo-stp_10.42.42.5(pid=28919): stderr: | 20221209174105965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174105966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174105966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174105966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174105967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174105967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174105967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:07.511319 run osmo-stp_10.42.42.5(pid=28919): stdout: | (launched: 2022-12-09_17:41:05.795308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:07.629288 run osmo-stp_10.42.42.5(pid=28919): stderr: | 20221209174105965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174105966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174105966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174105966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174105967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174105967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174105967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:07.770692 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28919): Process ended prematurely: osmo-stp_10.42.42.5(pid=28919) [trial-2362↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28919)] [trial-2362↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 17:41:07.779113 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 17:41:07.805651 run osmo-hlr_10.42.42.2(pid=28916): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28916)] 17:41:07.853685 run osmo-hlr_10.42.42.2(pid=28916): stdout: | (launched: 2022-12-09_17:41:04.856592) 17:41:07.903402 run osmo-hlr_10.42.42.2(pid=28916): stderr: | 20221209174105032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174105032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174105032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174105032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174105032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174105032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174105044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174105052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174105053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174105053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:07.972451 run osmo-msc_10.42.42.6(pid=28922): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28922)] 17:41:08.020342 run osmo-msc_10.42.42.6(pid=28922): stdout: | (launched: 2022-12-09_17:41:06.915565) 17:41:08.070171 run osmo-msc_10.42.42.6(pid=28922): stderr: | 20221209174107186 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174107186 DLGLOBAL DEBUG validating counter group 0x7fbb09572c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174107186 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174107187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174107187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174107187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174107189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174107189 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174107189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174107189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:41:08.120177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28915): Terminating (SIGTERM) 17:41:08.160225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28918): Terminating (SIGTERM) 17:41:08.200203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28921): Terminating (SIGTERM) 17:41:08.240298 --- ParallelTerminationStrategy: PID 28915 died... 17:41:08.259355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28915): Terminated: ok {rc=0} 17:41:08.303776 --- ParallelTerminationStrategy: PID 28918 died... 17:41:08.322394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28918): Terminated: ok {rc=0} 17:41:08.366565 --- ParallelTerminationStrategy: PID 28921 died... 17:41:08.385167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28921): Terminated: ok {rc=0} 17:41:08.471484 bus /sierra_3: Setting Powered False 17:41:09.571492 bus /sierra_3: Setting Powered False 17:41:10.687455 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 17:41:11.776010 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:11.787460 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:11.839097 tst emergency_preemptive_call.py: using LAC 22640 17:41:11.957145 tst emergency_preemptive_call.py: using RAC 200 17:41:12.082799 tst emergency_preemptive_call.py: using CellId 22640 17:41:12.206820 tst emergency_preemptive_call.py: using BVCI 22641 17:41:12.323535 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:12.335026 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:12.346237 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:12.357912 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:12.369689 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 17:41:12.381223 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:12.496510 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:12.615214 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:12.732424 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:12.850952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:13.345685 run create_hlr_db(pid=28924): Launched 17:41:13.475652 bus /sierra_2: Setting Powered False 17:41:14.538388 run create_hlr_db(pid=28924): Terminated: ok {rc=0} 17:41:14.963773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28926): Launched 17:41:15.260558 run osmo-hlr_10.42.42.2(pid=28927): Launched 17:41:15.373819 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:15.913861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28929): Launched 17:41:16.251896 run osmo-stp_10.42.42.5(pid=28930): Launched 17:41:16.437476 tst emergency_preemptive_call.py: using MSISDN 7299 17:41:16.819606 run osmo-msc_10.42.42.6: Starting osmo-msc 17:41:17.392699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28932): Launched 17:41:17.711265 run osmo-msc_10.42.42.6(pid=28933): Launched 17:41:17.890206 run osmo-stp_10.42.42.5(pid=28930): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28930)] 17:41:18.024014 run osmo-stp_10.42.42.5(pid=28930): stdout: | (launched: 2022-12-09_17:41:16.192903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:18.158196 run osmo-stp_10.42.42.5(pid=28930): stderr: | 20221209174116534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174116535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174116537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174116539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174116546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174116546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174116546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:18.291459 run osmo-stp_10.42.42.5(pid=28930): stdout: | (launched: 2022-12-09_17:41:16.192903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:18.418125 run osmo-stp_10.42.42.5(pid=28930): stderr: | 20221209174116534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174116535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174116537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174116539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174116546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174116546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174116546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:18.570299 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28930): Process ended prematurely: osmo-stp_10.42.42.5(pid=28930) [trial-2362↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28930)] [trial-2362↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 17:41:18.579613 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 17:41:18.607397 run osmo-hlr_10.42.42.2(pid=28927): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28927)] 17:41:18.657760 run osmo-hlr_10.42.42.2(pid=28927): stdout: | (launched: 2022-12-09_17:41:15.206312) 17:41:18.710069 run osmo-hlr_10.42.42.2(pid=28927): stderr: | 20221209174115382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174115383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174115383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174115383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174115383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174115383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174115395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174115405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174115405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174115406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:18.782647 run osmo-msc_10.42.42.6(pid=28933): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28933)] 17:41:18.832814 run osmo-msc_10.42.42.6(pid=28933): stdout: | (launched: 2022-12-09_17:41:17.653160) 17:41:18.885075 run osmo-msc_10.42.42.6(pid=28933): stderr: | 20221209174117977 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174117977 DLGLOBAL DEBUG validating counter group 0x7f660a9c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174117977 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174117977 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174117977 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174117978 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174117979 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174117980 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174117980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174117980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:41:18.937260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28926): Terminating (SIGTERM) 17:41:18.979352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28929): Terminating (SIGTERM) 17:41:19.021697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28932): Terminating (SIGTERM) 17:41:19.063925 --- ParallelTerminationStrategy: PID 28926 died... 17:41:19.083963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28926): Terminated: ok {rc=0} 17:41:19.130636 --- ParallelTerminationStrategy: PID 28929 died... 17:41:19.150273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28929): Terminated: ok {rc=0} 17:41:19.196185 --- ParallelTerminationStrategy: PID 28932 died... 17:41:19.215788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28932): Terminated: ok {rc=0} 17:41:19.304355 bus /sierra_9: Setting Powered False 17:41:20.404207 bus /sierra_9: Setting Powered False 17:41:21.519511 bus /sierra_8: Setting Powered False 17:41:22.617816 bus /sierra_8: Setting Powered False 17:41:23.733601 bus /sierra_3: Setting Powered False 17:41:24.831341 bus /sierra_3: Setting Powered False 17:41:25.948298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 17:41:27.228282 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:41:27.232603 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 17:41:27.267068 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 17:41:27.305047 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 17:41:27.390870 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 17:41:27.424027 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 17:41:27.462180 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 17:41:28.051950 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 17:41:28.101454 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:28.112496 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:28.161386 tst cs_paging_gprs_active.py: using LAC 22641 17:41:28.281454 tst cs_paging_gprs_active.py: using RAC 201 17:41:28.414204 tst cs_paging_gprs_active.py: using CellId 22641 17:41:28.541299 tst cs_paging_gprs_active.py: using BVCI 22642 17:41:28.661375 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:28.672739 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:28.683880 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:28.695165 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:28.706052 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:28.717070 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:28.728073 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:28.738914 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:28.750083 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:28.866418 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:28.981736 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:41:29.185692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:29.489829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28938): Launched 17:41:29.756165 run iperf3-srv_10.42.42.10(pid=28939): Launched 17:41:29.870673 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:41:30.074264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:30.379279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28940): Launched 17:41:30.644861 run iperf3-srv_10.42.42.10(pid=28941): Launched 17:41:30.759107 tst cs_paging_gprs_active.py:38: start network... 17:41:30.974384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:31.452474 run create_hlr_db(pid=28942): Launched 17:41:31.609373 bus /sierra_2: Setting Powered False 17:41:32.669579 run create_hlr_db(pid=28942): Terminated: ok {rc=0} 17:41:33.113549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28944): Launched 17:41:33.439781 run osmo-hlr_10.42.42.2(pid=28945): Launched 17:41:33.564796 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:34.126754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28947): Launched 17:41:34.452554 run osmo-stp_10.42.42.5(pid=28948): Launched 17:41:34.578320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:41:35.138397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28950): Launched 17:41:35.264552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:41:35.538812 run patchelf(pid=28951): Launched 17:41:35.709415 run osmo-stp_10.42.42.5(pid=28948): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28948)] 17:41:35.839151 run osmo-stp_10.42.42.5(pid=28948): stdout: | (launched: 2022-12-09_17:41:34.393834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:35.969963 run osmo-stp_10.42.42.5(pid=28948): stderr: | 20221209174134588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174134588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174134589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174134589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174134590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174134590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174134590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:36.100910 run osmo-stp_10.42.42.5(pid=28948): stdout: | (launched: 2022-12-09_17:41:34.393834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:36.226044 run osmo-stp_10.42.42.5(pid=28948): stderr: | 20221209174134588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174134588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174134589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174134589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174134590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174134590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174134590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:36.373911 run patchelf(pid=28951): Terminating (SIGINT) 17:41:36.545407 run patchelf(pid=28951): Terminated: ok {rc=0} 17:41:36.670327 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28948): Process ended prematurely: osmo-stp_10.42.42.5(pid=28948) [trial-2362↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28948)] [trial-2362↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 17:41:36.680168 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:41:36.708225 run osmo-hlr_10.42.42.2(pid=28945): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28945)] 17:41:36.756468 run osmo-hlr_10.42.42.2(pid=28945): stdout: | (launched: 2022-12-09_17:41:33.380626) 17:41:36.806673 run osmo-hlr_10.42.42.2(pid=28945): stderr: | 20221209174133577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174133577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174133577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174133577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174133577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174133577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174133589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174133598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174133598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174133598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:36.857321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28938): Terminating (SIGTERM) 17:41:36.897574 run iperf3-srv_10.42.42.10(pid=28939): Terminating (SIGTERM) 17:41:36.937687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28940): Terminating (SIGTERM) 17:41:36.977743 run iperf3-srv_10.42.42.10(pid=28941): Terminating (SIGTERM) 17:41:37.017561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28944): Terminating (SIGTERM) 17:41:37.057682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28947): Terminating (SIGTERM) 17:41:37.097667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28950): Terminating (SIGTERM) 17:41:37.137905 --- ParallelTerminationStrategy: PID 28938 died... 17:41:37.157189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28938): Terminated: ok {rc=0} 17:41:37.202324 --- ParallelTerminationStrategy: PID 28939 died... 17:41:37.220901 run iperf3-srv_10.42.42.10(pid=28939): Terminated {rc=256} 17:41:37.265610 --- ParallelTerminationStrategy: PID 28940 died... 17:41:37.284260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28940): Terminated: ok {rc=0} 17:41:37.329315 --- ParallelTerminationStrategy: PID 28941 died... 17:41:37.347817 run iperf3-srv_10.42.42.10(pid=28941): Terminated {rc=256} 17:41:37.392328 --- ParallelTerminationStrategy: PID 28944 died... 17:41:37.411030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28944): Terminated: ok {rc=0} 17:41:37.455664 --- ParallelTerminationStrategy: PID 28947 died... 17:41:37.474424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28947): Terminated: ok {rc=0} 17:41:37.519191 --- ParallelTerminationStrategy: PID 28950 died... 17:41:37.538085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28950): Terminated: ok {rc=0} 17:41:37.623444 bus /gobi_0: Setting Powered False 17:41:38.724348 bus /gobi_0: Setting Powered False 17:41:39.841358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 17:41:40.992512 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:41.004492 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:41.058376 tst iperf3.py: using LAC 22642 17:41:41.186713 tst iperf3.py: using RAC 202 17:41:41.315415 tst iperf3.py: using CellId 22642 17:41:41.442881 tst iperf3.py: using BVCI 22643 17:41:41.560525 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:41.571913 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:41.583009 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:41.594036 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:41.605013 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:41.615919 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:41.627129 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:41.638004 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:41.649082 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:41.767885 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:41:41.987977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:42.314270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28952): Launched 17:41:42.598761 run iperf3-srv_10.42.42.10(pid=28953): Launched 17:41:42.723283 tst iperf3.py:8: start network... 17:41:42.942541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:43.448238 run create_hlr_db(pid=28954): Launched 17:41:43.580573 bus /gobi_6: Setting Powered False 17:41:44.644862 run create_hlr_db(pid=28954): Terminated: ok {rc=0} 17:41:45.100040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28956): Launched 17:41:45.426068 run osmo-hlr_10.42.42.2(pid=28957): Launched 17:41:45.545874 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:46.111027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28959): Launched 17:41:46.435255 run osmo-stp_10.42.42.5(pid=28960): Launched 17:41:46.606590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:41:47.361751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28962): Launched 17:41:47.494386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:41:47.769611 run patchelf(pid=28963): Launched 17:41:47.951722 run osmo-stp_10.42.42.5(pid=28960): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28960)] 17:41:48.090520 run osmo-stp_10.42.42.5(pid=28960): stdout: | (launched: 2022-12-09_17:41:46.378357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:48.230049 run osmo-stp_10.42.42.5(pid=28960): stderr: | 20221209174146659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174146659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174146659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174146660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174146660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174146660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174146660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:48.369668 run osmo-stp_10.42.42.5(pid=28960): stdout: | (launched: 2022-12-09_17:41:46.378357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:41:48.502856 run osmo-stp_10.42.42.5(pid=28960): stderr: | 20221209174146659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174146659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174146659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174146660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174146660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174146660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174146660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:41:48.660659 run patchelf(pid=28963): Terminating (SIGINT) 17:41:48.844090 run patchelf(pid=28963): Terminated: ok {rc=0} 17:41:48.976412 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28960): Process ended prematurely: osmo-stp_10.42.42.5(pid=28960) [trial-2362↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28960)] [trial-2362↪gprs:trx-sysmocell5000↪iperf3.py:8] 17:41:48.986912 tst iperf3.py:8: Test FAILED (8.0 sec) 17:41:49.015808 run osmo-hlr_10.42.42.2(pid=28957): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28957)] 17:41:49.066276 run osmo-hlr_10.42.42.2(pid=28957): stdout: | (launched: 2022-12-09_17:41:45.366579) 17:41:49.118625 run osmo-hlr_10.42.42.2(pid=28957): stderr: | 20221209174145543 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174145543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174145543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174145543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174145543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174145543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174145555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174145564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174145564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174145564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:41:49.171523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28952): Terminating (SIGTERM) 17:41:49.214064 run iperf3-srv_10.42.42.10(pid=28953): Terminating (SIGTERM) 17:41:49.256572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28956): Terminating (SIGTERM) 17:41:49.299238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28959): Terminating (SIGTERM) 17:41:49.342018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28962): Terminating (SIGTERM) 17:41:49.384851 --- ParallelTerminationStrategy: PID 28952 died... 17:41:49.405156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28952): Terminated: ok {rc=0} 17:41:49.452370 --- ParallelTerminationStrategy: PID 28953 died... 17:41:49.472297 run iperf3-srv_10.42.42.10(pid=28953): Terminated {rc=256} 17:41:49.519132 --- ParallelTerminationStrategy: PID 28956 died... 17:41:49.539064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28956): Terminated: ok {rc=0} 17:41:49.586010 --- ParallelTerminationStrategy: PID 28959 died... 17:41:49.605856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28959): Terminated: ok {rc=0} 17:41:49.652902 --- ParallelTerminationStrategy: PID 28962 died... 17:41:49.672794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28962): Terminated: ok {rc=0} 17:41:49.762413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 17:41:50.914866 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:50.926899 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:41:50.978398 tst iperf3m4.py: using LAC 22643 17:41:51.105325 tst iperf3m4.py: using RAC 203 17:41:51.232204 tst iperf3m4.py: using CellId 22643 17:41:51.359489 tst iperf3m4.py: using BVCI 22644 17:41:51.477131 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:51.488349 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:51.499436 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:51.510495 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:51.521466 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:51.532336 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:51.543511 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:51.554462 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:41:51.565509 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:51.683827 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:51.800822 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:51.919230 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:41:52.034374 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:41:52.239101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:52.544669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28964): Launched 17:41:52.810661 run iperf3-srv_10.42.42.10(pid=28965): Launched 17:41:52.927031 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:41:53.131206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:53.436669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28966): Launched 17:41:53.701847 run iperf3-srv_10.42.42.10(pid=28967): Launched 17:41:53.816260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:41:54.019276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:54.324380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28968): Launched 17:41:54.589607 run iperf3-srv_10.42.42.10(pid=28969): Launched 17:41:54.704240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:41:54.908030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:41:55.213214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28970): Launched 17:41:55.477587 run iperf3-srv_10.42.42.10(pid=28971): Launched 17:41:55.591706 tst iperf3m4.py:8: start network... 17:41:55.795179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:41:56.264863 run create_hlr_db(pid=28972): Launched 17:41:56.382242 bus /gobi_6: Setting Powered False 17:41:57.442849 run create_hlr_db(pid=28972): Terminated: ok {rc=0} 17:41:57.866981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28974): Launched 17:41:58.171145 run osmo-hlr_10.42.42.2(pid=28975): Launched 17:41:58.287837 run osmo-stp_10.42.42.5: Starting osmo-stp 17:41:58.829497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28977): Launched 17:41:59.134392 run osmo-stp_10.42.42.5(pid=28978): Launched 17:41:59.250834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:41:59.774704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28980): Launched 17:41:59.892087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:00.148887 run patchelf(pid=28981): Launched 17:42:00.318658 run osmo-stp_10.42.42.5(pid=28978): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28978)] 17:42:00.447708 run osmo-stp_10.42.42.5(pid=28978): stdout: | (launched: 2022-12-09_17:41:59.078763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:00.578388 run osmo-stp_10.42.42.5(pid=28978): stderr: | 20221209174159247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174159247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174159248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174159248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174159249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174159249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174159249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:00.708826 run osmo-stp_10.42.42.5(pid=28978): stdout: | (launched: 2022-12-09_17:41:59.078763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:00.845065 run osmo-stp_10.42.42.5(pid=28978): stderr: | 20221209174159247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174159247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174159248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174159248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174159249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174159249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174159249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:01.082947 run patchelf(pid=28981): Terminating (SIGINT) 17:42:01.273526 run patchelf(pid=28981): Terminated: ok {rc=0} 17:42:01.410933 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28978): Process ended prematurely: osmo-stp_10.42.42.5(pid=28978) [trial-2362↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28978)] [trial-2362↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 17:42:01.422543 tst iperf3m4.py:8: Test FAILED (10.5 sec) 17:42:01.454929 run osmo-hlr_10.42.42.2(pid=28975): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28975)] 17:42:01.507931 run osmo-hlr_10.42.42.2(pid=28975): stdout: | (launched: 2022-12-09_17:41:58.115489) 17:42:01.563054 run osmo-hlr_10.42.42.2(pid=28975): stderr: | 20221209174158290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174158290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174158290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174158290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174158290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174158290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174158302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174158311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174158311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174158311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:01.618111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28964): Terminating (SIGTERM) 17:42:01.662879 run iperf3-srv_10.42.42.10(pid=28965): Terminating (SIGTERM) 17:42:01.710090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28966): Terminating (SIGTERM) 17:42:01.755540 run iperf3-srv_10.42.42.10(pid=28967): Terminating (SIGTERM) 17:42:01.801922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28968): Terminating (SIGTERM) 17:42:01.847642 run iperf3-srv_10.42.42.10(pid=28969): Terminating (SIGTERM) 17:42:01.893856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28970): Terminating (SIGTERM) 17:42:01.938322 run iperf3-srv_10.42.42.10(pid=28971): Terminating (SIGTERM) 17:42:01.984738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28974): Terminating (SIGTERM) 17:42:02.030201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28977): Terminating (SIGTERM) 17:42:02.074192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28980): Terminating (SIGTERM) 17:42:02.119357 --- ParallelTerminationStrategy: PID 28964 died... 17:42:02.139952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28964): Terminated: ok {rc=0} 17:42:02.189786 --- ParallelTerminationStrategy: PID 28965 died... 17:42:02.209659 run iperf3-srv_10.42.42.10(pid=28965): Terminated {rc=256} 17:42:02.254408 --- ParallelTerminationStrategy: PID 28966 died... 17:42:02.273088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28966): Terminated: ok {rc=0} 17:42:02.317671 --- ParallelTerminationStrategy: PID 28967 died... 17:42:02.336273 run iperf3-srv_10.42.42.10(pid=28967): Terminated {rc=256} 17:42:02.380856 --- ParallelTerminationStrategy: PID 28968 died... 17:42:02.399552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28968): Terminated: ok {rc=0} 17:42:02.444151 --- ParallelTerminationStrategy: PID 28969 died... 17:42:02.462792 run iperf3-srv_10.42.42.10(pid=28969): Terminated {rc=256} 17:42:02.507593 --- ParallelTerminationStrategy: PID 28970 died... 17:42:02.526312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28970): Terminated: ok {rc=0} 17:42:02.570943 --- ParallelTerminationStrategy: PID 28971 died... 17:42:02.589745 run iperf3-srv_10.42.42.10(pid=28971): Terminated {rc=256} 17:42:02.634413 --- ParallelTerminationStrategy: PID 28974 died... 17:42:02.653039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28974): Terminated: ok {rc=0} 17:42:02.697887 --- ParallelTerminationStrategy: PID 28977 died... 17:42:02.716511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28977): Terminated: ok {rc=0} 17:42:02.761796 --- ParallelTerminationStrategy: PID 28980 died... 17:42:02.780555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28980): Terminated: ok {rc=0} 17:42:02.867824 bus /gobi_4: Setting Powered False 17:42:03.968482 bus /gobi_4: Setting Powered False 17:42:05.086679 bus /gobi_1: Setting Powered False 17:42:06.186318 bus /gobi_1: Setting Powered False 17:42:07.300011 bus /gobi_0: Setting Powered False 17:42:08.398534 bus /gobi_0: Setting Powered False 17:42:09.515074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 17:42:10.618907 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:10.631032 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:42:10.681896 tst ping.py: using LAC 22644 17:42:10.808391 tst ping.py: using RAC 204 17:42:10.934660 tst ping.py: using CellId 22644 17:42:11.064401 tst ping.py: using BVCI 22645 17:42:11.180374 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:11.191642 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:11.202847 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:11.213915 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:11.224890 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:11.235885 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:11.247053 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:11.258148 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:11.373824 tst ping.py:19: start network... 17:42:11.574496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:12.035239 run create_hlr_db(pid=28992): Launched 17:42:12.150198 bus /gobi_6: Setting Powered False 17:42:13.210134 run create_hlr_db(pid=28992): Terminated: ok {rc=0} 17:42:13.646835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28994): Launched 17:42:13.966997 run osmo-hlr_10.42.42.2(pid=28995): Launched 17:42:14.090470 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:14.645458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28997): Launched 17:42:14.966846 run osmo-stp_10.42.42.5(pid=28998): Launched 17:42:15.089137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:15.642852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29000): Launched 17:42:15.764614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:16.069447 run patchelf(pid=29001): Launched 17:42:16.262182 run osmo-stp_10.42.42.5(pid=28998): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28998)] 17:42:16.412353 run osmo-stp_10.42.42.5(pid=28998): stdout: | (launched: 2022-12-09_17:42:14.908528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:16.571817 run osmo-stp_10.42.42.5(pid=28998): stderr: | 20221209174215102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174215102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174215102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174215102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174215103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174215103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174215103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:16.714868 run osmo-stp_10.42.42.5(pid=28998): stdout: | (launched: 2022-12-09_17:42:14.908528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:16.849191 run osmo-stp_10.42.42.5(pid=28998): stderr: | 20221209174215102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174215102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174215102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174215102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174215103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174215103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174215103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:17.007894 run patchelf(pid=29001): Terminating (SIGINT) 17:42:17.190808 run patchelf(pid=29001): Terminated: ok {rc=0} 17:42:17.321701 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28998): Process ended prematurely: osmo-stp_10.42.42.5(pid=28998) [trial-2362↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28998)] [trial-2362↪gprs:trx-sysmocell5000↪ping.py:22] 17:42:17.331467 tst ping.py:22: Test FAILED (6.7 sec) 17:42:17.360111 run osmo-hlr_10.42.42.2(pid=28995): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28995)] 17:42:17.411211 run osmo-hlr_10.42.42.2(pid=28995): stdout: | (launched: 2022-12-09_17:42:13.909034) 17:42:17.464079 run osmo-hlr_10.42.42.2(pid=28995): stderr: | 20221209174214108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174214108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174214108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174214108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174214109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174214109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174214121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174214129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174214129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174214129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:17.517533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28994): Terminating (SIGTERM) 17:42:17.560302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28997): Terminating (SIGTERM) 17:42:17.603058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29000): Terminating (SIGTERM) 17:42:17.645884 --- ParallelTerminationStrategy: PID 28994 died... 17:42:17.666350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28994): Terminated: ok {rc=0} 17:42:17.713501 --- ParallelTerminationStrategy: PID 28997 died... 17:42:17.733493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28997): Terminated: ok {rc=0} 17:42:17.780430 --- ParallelTerminationStrategy: PID 29000 died... 17:42:17.800293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29000): Terminated: ok {rc=0} 17:42:17.889028 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 17:42:18.978856 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:18.991396 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 17:42:19.044144 tst ping_idle_ping.py: using LAC 22645 17:42:19.169739 tst ping_idle_ping.py: using RAC 205 17:42:19.295101 tst ping_idle_ping.py: using CellId 22645 17:42:19.419700 tst ping_idle_ping.py: using BVCI 22646 17:42:19.536761 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:19.548125 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:19.559203 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:19.570228 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:19.581156 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:19.592140 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:19.603307 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 17:42:19.614323 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 17:42:19.729254 tst ping_idle_ping.py:24: start network... 17:42:19.930931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:20.397753 run create_hlr_db(pid=29002): Launched 17:42:20.513575 bus /gobi_6: Setting Powered False 17:42:21.574337 run create_hlr_db(pid=29002): Terminated: ok {rc=0} 17:42:22.014410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29004): Launched 17:42:22.337481 run osmo-hlr_10.42.42.2(pid=29005): Launched 17:42:22.459951 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:23.011317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29007): Launched 17:42:23.330784 run osmo-stp_10.42.42.5(pid=29008): Launched 17:42:23.452729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:24.005225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29010): Launched 17:42:24.127132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:24.395773 run patchelf(pid=29011): Launched 17:42:24.574630 run osmo-stp_10.42.42.5(pid=29008): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29008)] 17:42:24.709755 run osmo-stp_10.42.42.5(pid=29008): stdout: | (launched: 2022-12-09_17:42:23.272387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:24.847037 run osmo-stp_10.42.42.5(pid=29008): stderr: | 20221209174223465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174223465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174223465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174223465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174223466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174223466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174223466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:24.985544 run osmo-stp_10.42.42.5(pid=29008): stdout: | (launched: 2022-12-09_17:42:23.272387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:25.116603 run osmo-stp_10.42.42.5(pid=29008): stderr: | 20221209174223465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174223465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174223465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174223465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174223466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174223466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174223466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:25.271305 run patchelf(pid=29011): Terminating (SIGINT) 17:42:25.450754 run patchelf(pid=29011): Terminated: ok {rc=0} 17:42:25.579944 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29008): Process ended prematurely: osmo-stp_10.42.42.5(pid=29008) [trial-2362↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29008)] [trial-2362↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 17:42:25.589689 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:42:25.617899 run osmo-hlr_10.42.42.2(pid=29005): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29005)] 17:42:25.668255 run osmo-hlr_10.42.42.2(pid=29005): stdout: | (launched: 2022-12-09_17:42:22.279050) 17:42:25.720371 run osmo-hlr_10.42.42.2(pid=29005): stderr: | 20221209174222479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174222479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174222479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174222479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174222479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174222479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174222496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174222506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174222506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174222506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:25.773372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29004): Terminating (SIGTERM) 17:42:25.815512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29007): Terminating (SIGTERM) 17:42:25.858318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29010): Terminating (SIGTERM) 17:42:25.900830 --- ParallelTerminationStrategy: PID 29004 died... 17:42:25.920870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29004): Terminated: ok {rc=0} 17:42:25.967712 --- ParallelTerminationStrategy: PID 29007 died... 17:42:25.987753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29007): Terminated: ok {rc=0} 17:42:26.034679 --- ParallelTerminationStrategy: PID 29010 died... 17:42:26.054435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29010): Terminated: ok {rc=0} 17:42:26.143858 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 17:42:27.455227 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:42:27.460937 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:42:27.498556 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:42:27.537937 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:42:27.625658 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:42:27.659837 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:42:27.698682 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:42:28.295922 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:42:28.348002 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:28.359171 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:42:28.414283 tst cs_paging_gprs_active.py: using LAC 22646 17:42:28.534736 tst cs_paging_gprs_active.py: using RAC 206 17:42:28.655055 tst cs_paging_gprs_active.py: using CellId 22646 17:42:28.774402 tst cs_paging_gprs_active.py: using BVCI 22647 17:42:28.887015 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:28.898015 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:28.908752 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:28.920171 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:28.931529 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:28.943057 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:28.954938 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:28.966486 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:28.978160 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:29.101643 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:29.222671 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:42:29.443285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:29.770308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29015): Launched 17:42:30.055485 run iperf3-srv_10.42.42.10(pid=29016): Launched 17:42:30.177821 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:42:30.396516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:30.723417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29017): Launched 17:42:31.018307 run iperf3-srv_10.42.42.10(pid=29018): Launched 17:42:31.184270 tst cs_paging_gprs_active.py:38: start network... 17:42:31.425900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:31.962405 run create_hlr_db(pid=29019): Launched 17:42:32.130747 bus /gobi_6: Setting Powered False 17:42:33.194629 run create_hlr_db(pid=29019): Terminated: ok {rc=0} 17:42:33.647927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29021): Launched 17:42:33.973655 run osmo-hlr_10.42.42.2(pid=29022): Launched 17:42:34.098130 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:34.661471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29024): Launched 17:42:34.986780 run osmo-stp_10.42.42.5(pid=29025): Launched 17:42:35.113507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:35.676435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29027): Launched 17:42:35.801923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:36.078506 run patchelf(pid=29028): Launched 17:42:36.261217 run osmo-stp_10.42.42.5(pid=29025): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29025)] 17:42:36.399789 run osmo-stp_10.42.42.5(pid=29025): stdout: | (launched: 2022-12-09_17:42:34.927491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:36.539383 run osmo-stp_10.42.42.5(pid=29025): stderr: | 20221209174235121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174235121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174235122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174235122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174235123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174235123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174235123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:36.679746 run osmo-stp_10.42.42.5(pid=29025): stdout: | (launched: 2022-12-09_17:42:34.927491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:36.813174 run osmo-stp_10.42.42.5(pid=29025): stderr: | 20221209174235121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174235121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174235122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174235122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174235123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174235123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174235123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:36.972191 run patchelf(pid=29028): Terminating (SIGINT) 17:42:37.156589 run patchelf(pid=29028): Terminated: ok {rc=0} 17:42:37.289246 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29025): Process ended prematurely: osmo-stp_10.42.42.5(pid=29025) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29025)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:42:37.299597 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 17:42:37.328425 run osmo-hlr_10.42.42.2(pid=29022): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29022)] 17:42:37.378854 run osmo-hlr_10.42.42.2(pid=29022): stdout: | (launched: 2022-12-09_17:42:33.914117) 17:42:37.431430 run osmo-hlr_10.42.42.2(pid=29022): stderr: | 20221209174234116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174234116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174234116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174234116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174234116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174234117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174234129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174234137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174234138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174234138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:37.483993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29015): Terminating (SIGTERM) 17:42:37.526140 run iperf3-srv_10.42.42.10(pid=29016): Terminating (SIGTERM) 17:42:37.568018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29017): Terminating (SIGTERM) 17:42:37.610206 run iperf3-srv_10.42.42.10(pid=29018): Terminating (SIGTERM) 17:42:37.651977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29021): Terminating (SIGTERM) 17:42:37.694165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29024): Terminating (SIGTERM) 17:42:37.736139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29027): Terminating (SIGTERM) 17:42:37.778312 --- ParallelTerminationStrategy: PID 29015 died... 17:42:37.798407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29015): Terminated: ok {rc=0} 17:42:37.845120 --- ParallelTerminationStrategy: PID 29016 died... 17:42:37.864520 run iperf3-srv_10.42.42.10(pid=29016): Terminated {rc=256} 17:42:37.911080 --- ParallelTerminationStrategy: PID 29017 died... 17:42:37.930692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29017): Terminated: ok {rc=0} 17:42:37.977020 --- ParallelTerminationStrategy: PID 29018 died... 17:42:37.996914 run iperf3-srv_10.42.42.10(pid=29018): Terminated {rc=256} 17:42:38.043206 --- ParallelTerminationStrategy: PID 29021 died... 17:42:38.062826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29021): Terminated: ok {rc=0} 17:42:38.108898 --- ParallelTerminationStrategy: PID 29024 died... 17:42:38.128829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29024): Terminated: ok {rc=0} 17:42:38.175122 --- ParallelTerminationStrategy: PID 29027 died... 17:42:38.194802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29027): Terminated: ok {rc=0} 17:42:38.282909 bus /gobi_0: Setting Powered False 17:42:39.383685 bus /gobi_0: Setting Powered False 17:42:40.502432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:42:41.650388 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:41.662032 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:42:41.716260 tst iperf3.py: using LAC 22647 17:42:41.837362 tst iperf3.py: using RAC 207 17:42:41.956928 tst iperf3.py: using CellId 22647 17:42:42.076316 tst iperf3.py: using BVCI 22648 17:42:42.188181 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:42.199125 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:42.209909 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:42.220884 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:42.231815 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:42.242708 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:42.253849 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:42.264596 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:42.276282 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:42.394984 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:42:42.614557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:42.941109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29029): Launched 17:42:43.226325 run iperf3-srv_10.42.42.10(pid=29030): Launched 17:42:43.349824 tst iperf3.py:8: start network... 17:42:43.568934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:44.073672 run create_hlr_db(pid=29031): Launched 17:42:44.207184 bus /gobi_6: Setting Powered False 17:42:45.270591 run create_hlr_db(pid=29031): Terminated: ok {rc=0} 17:42:45.706623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29033): Launched 17:42:46.041711 run osmo-hlr_10.42.42.2(pid=29034): Launched 17:42:46.220989 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:46.924401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29036): Launched 17:42:47.268095 run osmo-stp_10.42.42.5(pid=29037): Launched 17:42:47.441993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:42:48.003588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29039): Launched 17:42:48.128916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:42:48.402831 run patchelf(pid=29040): Launched 17:42:48.585648 run osmo-stp_10.42.42.5(pid=29037): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29037)] 17:42:48.723353 run osmo-stp_10.42.42.5(pid=29037): stdout: | (launched: 2022-12-09_17:42:47.207838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:48.862689 run osmo-stp_10.42.42.5(pid=29037): stderr: | 20221209174247438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174247439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174247439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174247439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174247440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174247440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174247440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:49.002387 run osmo-stp_10.42.42.5(pid=29037): stdout: | (launched: 2022-12-09_17:42:47.207838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:42:49.136099 run osmo-stp_10.42.42.5(pid=29037): stderr: | 20221209174247438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174247439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174247439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174247439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174247440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174247440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174247440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:42:49.294449 run patchelf(pid=29040): Terminating (SIGINT) 17:42:49.476407 run patchelf(pid=29040): Terminated: ok {rc=0} 17:42:49.608063 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29037): Process ended prematurely: osmo-stp_10.42.42.5(pid=29037) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29037)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 17:42:49.618663 tst iperf3.py:8: Test FAILED (8.0 sec) 17:42:49.647176 run osmo-hlr_10.42.42.2(pid=29034): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29034)] 17:42:49.697255 run osmo-hlr_10.42.42.2(pid=29034): stdout: | (launched: 2022-12-09_17:42:45.977387) 17:42:49.749147 run osmo-hlr_10.42.42.2(pid=29034): stderr: | 20221209174246295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174246295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174246295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174246295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174246295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174246295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174246315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174246336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174246336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174246336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:42:49.801784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29029): Terminating (SIGTERM) 17:42:49.843930 run iperf3-srv_10.42.42.10(pid=29030): Terminating (SIGTERM) 17:42:49.886172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29033): Terminating (SIGTERM) 17:42:49.928354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29036): Terminating (SIGTERM) 17:42:49.970644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29039): Terminating (SIGTERM) 17:42:50.013345 --- ParallelTerminationStrategy: PID 29029 died... 17:42:50.033285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29029): Terminated: ok {rc=0} 17:42:50.079899 --- ParallelTerminationStrategy: PID 29030 died... 17:42:50.099484 run iperf3-srv_10.42.42.10(pid=29030): Terminated {rc=256} 17:42:50.145839 --- ParallelTerminationStrategy: PID 29033 died... 17:42:50.165725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29033): Terminated: ok {rc=0} 17:42:50.212255 --- ParallelTerminationStrategy: PID 29036 died... 17:42:50.231980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29036): Terminated: ok {rc=0} 17:42:50.278494 --- ParallelTerminationStrategy: PID 29039 died... 17:42:50.298211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29039): Terminated: ok {rc=0} 17:42:50.387910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:42:51.541538 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:51.553715 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:42:51.604702 tst iperf3m4.py: using LAC 22648 17:42:51.725096 tst iperf3m4.py: using RAC 208 17:42:51.844631 tst iperf3m4.py: using CellId 22648 17:42:51.964227 tst iperf3m4.py: using BVCI 22649 17:42:52.077326 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:52.088369 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:52.099204 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:52.111178 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:52.122857 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:52.134463 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:52.146069 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:52.157522 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:42:52.169084 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:52.286799 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:52.407230 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:52.528844 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:42:52.646487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:42:52.852574 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:53.160401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29041): Launched 17:42:53.427737 run iperf3-srv_10.42.42.10(pid=29042): Launched 17:42:53.542329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:42:53.746018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:54.051905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29043): Launched 17:42:54.318520 run iperf3-srv_10.42.42.10(pid=29044): Launched 17:42:54.434953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:42:54.639019 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:54.945206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29045): Launched 17:42:55.210642 run iperf3-srv_10.42.42.10(pid=29046): Launched 17:42:55.335155 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:42:55.554048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:42:55.880882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29047): Launched 17:42:56.165315 run iperf3-srv_10.42.42.10(pid=29048): Launched 17:42:56.288737 tst iperf3m4.py:8: start network... 17:42:56.507357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:42:57.010663 run create_hlr_db(pid=29049): Launched 17:42:57.145489 bus /gobi_6: Setting Powered False 17:42:58.209678 run create_hlr_db(pid=29049): Terminated: ok {rc=0} 17:42:58.662990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29051): Launched 17:42:58.988585 run osmo-hlr_10.42.42.2(pid=29052): Launched 17:42:59.113648 run osmo-stp_10.42.42.5: Starting osmo-stp 17:42:59.675257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29054): Launched 17:43:00.002814 run osmo-stp_10.42.42.5(pid=29055): Launched 17:43:00.129256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:00.690646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29057): Launched 17:43:00.816736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:01.121818 run patchelf(pid=29058): Launched 17:43:01.313712 run osmo-stp_10.42.42.5(pid=29055): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29055)] 17:43:01.454540 run osmo-stp_10.42.42.5(pid=29055): stdout: | (launched: 2022-12-09_17:42:59.943500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:01.596418 run osmo-stp_10.42.42.5(pid=29055): stderr: | 20221209174300135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174300135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174300135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174300136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174300136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174300136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174300137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:01.736135 run osmo-stp_10.42.42.5(pid=29055): stdout: | (launched: 2022-12-09_17:42:59.943500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:01.867231 run osmo-stp_10.42.42.5(pid=29055): stderr: | 20221209174300135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174300135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174300135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174300136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174300136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174300136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174300137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:02.020116 run patchelf(pid=29058): Terminating (SIGINT) 17:43:02.197930 run patchelf(pid=29058): Terminated: ok {rc=0} 17:43:02.325439 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29055): Process ended prematurely: osmo-stp_10.42.42.5(pid=29055) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29055)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 17:43:02.336241 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:43:02.368653 run osmo-hlr_10.42.42.2(pid=29052): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29052)] 17:43:02.418187 run osmo-hlr_10.42.42.2(pid=29052): stdout: | (launched: 2022-12-09_17:42:58.929377) 17:43:02.469742 run osmo-hlr_10.42.42.2(pid=29052): stderr: | 20221209174259127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174259127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174259127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174259127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174259127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174259127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174259139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174259147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174259148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174259148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:02.521663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29041): Terminating (SIGTERM) 17:43:02.562992 run iperf3-srv_10.42.42.10(pid=29042): Terminating (SIGTERM) 17:43:02.604158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29043): Terminating (SIGTERM) 17:43:02.645463 run iperf3-srv_10.42.42.10(pid=29044): Terminating (SIGTERM) 17:43:02.686659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29045): Terminating (SIGTERM) 17:43:02.727984 run iperf3-srv_10.42.42.10(pid=29046): Terminating (SIGTERM) 17:43:02.770318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29047): Terminating (SIGTERM) 17:43:02.811843 run iperf3-srv_10.42.42.10(pid=29048): Terminating (SIGTERM) 17:43:02.852687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29051): Terminating (SIGTERM) 17:43:02.893789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29054): Terminating (SIGTERM) 17:43:02.934807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29057): Terminating (SIGTERM) 17:43:02.976163 --- ParallelTerminationStrategy: PID 29041 died... 17:43:02.995304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29041): Terminated: ok {rc=0} 17:43:03.040782 --- ParallelTerminationStrategy: PID 29042 died... 17:43:03.059718 run iperf3-srv_10.42.42.10(pid=29042): Terminated {rc=256} 17:43:03.105127 --- ParallelTerminationStrategy: PID 29043 died... 17:43:03.124102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29043): Terminated: ok {rc=0} 17:43:03.169568 --- ParallelTerminationStrategy: PID 29044 died... 17:43:03.188527 run iperf3-srv_10.42.42.10(pid=29044): Terminated {rc=256} 17:43:03.234018 --- ParallelTerminationStrategy: PID 29045 died... 17:43:03.252899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29045): Terminated: ok {rc=0} 17:43:03.298797 --- ParallelTerminationStrategy: PID 29046 died... 17:43:03.317922 run iperf3-srv_10.42.42.10(pid=29046): Terminated {rc=256} 17:43:03.363245 --- ParallelTerminationStrategy: PID 29047 died... 17:43:03.382262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29047): Terminated: ok {rc=0} 17:43:03.427810 --- ParallelTerminationStrategy: PID 29048 died... 17:43:03.446937 run iperf3-srv_10.42.42.10(pid=29048): Terminated {rc=256} 17:43:03.492249 --- ParallelTerminationStrategy: PID 29051 died... 17:43:03.511325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29051): Terminated: ok {rc=0} 17:43:03.556738 --- ParallelTerminationStrategy: PID 29054 died... 17:43:03.575955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29054): Terminated: ok {rc=0} 17:43:03.621400 --- ParallelTerminationStrategy: PID 29057 died... 17:43:03.640219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29057): Terminated: ok {rc=0} 17:43:03.727210 bus /gobi_4: Setting Powered False 17:43:04.826983 bus /gobi_4: Setting Powered False 17:43:05.946128 bus /gobi_1: Setting Powered False 17:43:07.044075 bus /gobi_1: Setting Powered False 17:43:08.159440 bus /gobi_0: Setting Powered False 17:43:09.258555 bus /gobi_0: Setting Powered False 17:43:10.376472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 17:43:11.480261 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:11.492074 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:43:11.545218 tst ping.py: using LAC 22649 17:43:11.664751 tst ping.py: using RAC 209 17:43:11.782969 tst ping.py: using CellId 22649 17:43:11.908747 tst ping.py: using BVCI 22650 17:43:12.018504 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:12.029795 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:12.040683 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:12.052311 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:12.064150 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:12.075622 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:12.087318 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:12.098877 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:12.219451 tst ping.py:19: start network... 17:43:12.434767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:12.927886 run create_hlr_db(pid=29059): Launched 17:43:13.058944 bus /gobi_6: Setting Powered False 17:43:14.121400 run create_hlr_db(pid=29059): Terminated: ok {rc=0} 17:43:14.567421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29061): Launched 17:43:14.885980 run osmo-hlr_10.42.42.2(pid=29062): Launched 17:43:15.008879 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:15.566428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29064): Launched 17:43:15.905716 run osmo-stp_10.42.42.5(pid=29065): Launched 17:43:16.139457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:16.712452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29067): Launched 17:43:16.834932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:17.095629 run patchelf(pid=29068): Launched 17:43:17.282808 run osmo-stp_10.42.42.5(pid=29065): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29065)] 17:43:17.414188 run osmo-stp_10.42.42.5(pid=29065): stdout: | (launched: 2022-12-09_17:43:15.827118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:17.545587 run osmo-stp_10.42.42.5(pid=29065): stderr: | 20221209174316097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174316098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174316098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174316098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174316099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174316099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174316099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:17.676375 run osmo-stp_10.42.42.5(pid=29065): stdout: | (launched: 2022-12-09_17:43:15.827118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:17.799508 run osmo-stp_10.42.42.5(pid=29065): stderr: | 20221209174316097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174316098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174316098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174316098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174316099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174316099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174316099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:17.945925 run patchelf(pid=29068): Terminating (SIGINT) 17:43:18.114854 run patchelf(pid=29068): Terminated: ok {rc=0} 17:43:18.237225 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29065): Process ended prematurely: osmo-stp_10.42.42.5(pid=29065) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29065)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 17:43:18.246506 tst ping.py:22: Test FAILED (6.8 sec) 17:43:18.275296 run osmo-hlr_10.42.42.2(pid=29062): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29062)] 17:43:18.324236 run osmo-hlr_10.42.42.2(pid=29062): stdout: | (launched: 2022-12-09_17:43:14.828027) 17:43:18.375017 run osmo-hlr_10.42.42.2(pid=29062): stderr: | 20221209174315026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174315026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174315026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174315026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174315026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174315026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174315039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174315048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174315048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174315048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:18.427138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29061): Terminating (SIGTERM) 17:43:18.468761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29064): Terminating (SIGTERM) 17:43:18.509788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29067): Terminating (SIGTERM) 17:43:18.551512 --- ParallelTerminationStrategy: PID 29061 died... 17:43:18.571035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29061): Terminated: ok {rc=0} 17:43:18.617638 --- ParallelTerminationStrategy: PID 29064 died... 17:43:18.636443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29064): Terminated: ok {rc=0} 17:43:18.682991 --- ParallelTerminationStrategy: PID 29067 died... 17:43:18.701972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29067): Terminated: ok {rc=0} 17:43:18.790982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:43:19.880347 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:19.892572 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:43:19.951305 tst ping_idle_ping.py: using LAC 22650 17:43:20.068929 tst ping_idle_ping.py: using RAC 210 17:43:20.184785 tst ping_idle_ping.py: using CellId 22650 17:43:20.301833 tst ping_idle_ping.py: using BVCI 22651 17:43:20.412627 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:20.423981 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:20.434834 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:20.446419 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:20.457991 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:20.469544 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:20.481357 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:43:20.492757 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:43:20.612631 tst ping_idle_ping.py:24: start network... 17:43:20.829093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:21.326875 run create_hlr_db(pid=29070): Launched 17:43:21.460200 bus /gobi_6: Setting Powered False 17:43:22.524552 run create_hlr_db(pid=29070): Terminated: ok {rc=0} 17:43:22.955903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29072): Launched 17:43:23.257958 run osmo-hlr_10.42.42.2(pid=29073): Launched 17:43:23.373854 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:23.907109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29075): Launched 17:43:24.206255 run osmo-stp_10.42.42.5(pid=29076): Launched 17:43:24.320429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:24.837366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29078): Launched 17:43:24.952506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:25.206284 run patchelf(pid=29079): Launched 17:43:25.375652 run osmo-stp_10.42.42.5(pid=29076): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29076)] 17:43:25.503352 run osmo-stp_10.42.42.5(pid=29076): stdout: | (launched: 2022-12-09_17:43:24.151407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:25.632760 run osmo-stp_10.42.42.5(pid=29076): stderr: | 20221209174324322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174324322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174324323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174324323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174324324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174324324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174324324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:25.762224 run osmo-stp_10.42.42.5(pid=29076): stdout: | (launched: 2022-12-09_17:43:24.151407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:25.884711 run osmo-stp_10.42.42.5(pid=29076): stderr: | 20221209174324322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174324322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174324323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174324323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174324324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174324324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174324324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:26.030442 run patchelf(pid=29079): Terminating (SIGINT) 17:43:26.198635 run patchelf(pid=29079): Terminated: ok {rc=0} 17:43:26.320647 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29076): Process ended prematurely: osmo-stp_10.42.42.5(pid=29076) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29076)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 17:43:26.329727 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 17:43:26.356940 run osmo-hlr_10.42.42.2(pid=29073): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29073)] 17:43:26.405220 run osmo-hlr_10.42.42.2(pid=29073): stdout: | (launched: 2022-12-09_17:43:23.202972) 17:43:26.455111 run osmo-hlr_10.42.42.2(pid=29073): stderr: | 20221209174323377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174323377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174323377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174323377 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174323377 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174323377 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174323389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174323397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174323398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174323398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:26.505361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29072): Terminating (SIGTERM) 17:43:26.545460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29075): Terminating (SIGTERM) 17:43:26.585449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29078): Terminating (SIGTERM) 17:43:26.625789 --- ParallelTerminationStrategy: PID 29072 died... 17:43:26.644831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29072): Terminated: ok {rc=0} 17:43:26.689663 --- ParallelTerminationStrategy: PID 29075 died... 17:43:26.708115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29075): Terminated: ok {rc=0} 17:43:26.752643 --- ParallelTerminationStrategy: PID 29078 died... 17:43:26.771365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29078): Terminated: ok {rc=0} 17:43:26.857197 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:43:28.172126 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:43:28.178653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:43:28.212410 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:43:28.251057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:43:28.336039 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:43:28.371479 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:43:28.410929 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:43:29.008354 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:43:29.059733 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:29.070754 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:43:29.138430 tst cs_paging_gprs_active.py: using LAC 22651 17:43:29.254867 tst cs_paging_gprs_active.py: using RAC 211 17:43:29.371796 tst cs_paging_gprs_active.py: using CellId 22651 17:43:29.487509 tst cs_paging_gprs_active.py: using BVCI 22652 17:43:29.597269 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:29.608111 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:29.618869 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:29.630050 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:29.640883 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:29.651848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:29.662880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:29.674241 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:29.685464 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:29.806388 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:29.923463 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:43:30.127546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:30.433390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29083): Launched 17:43:30.698462 run iperf3-srv_10.42.42.10(pid=29084): Launched 17:43:30.812642 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:43:31.022306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:31.341742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29085): Launched 17:43:31.621751 run iperf3-srv_10.42.42.10(pid=29086): Launched 17:43:31.790841 tst cs_paging_gprs_active.py:38: start network... 17:43:32.056332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:32.539275 run create_hlr_db(pid=29087): Launched 17:43:32.656716 bus /gobi_6: Setting Powered False 17:43:33.717578 run create_hlr_db(pid=29087): Terminated: ok {rc=0} 17:43:34.162374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29089): Launched 17:43:34.489212 run osmo-hlr_10.42.42.2(pid=29090): Launched 17:43:34.615133 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:35.177512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29092): Launched 17:43:35.502064 run osmo-stp_10.42.42.5(pid=29093): Launched 17:43:35.626801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:36.186841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29095): Launched 17:43:36.313218 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:36.587959 run patchelf(pid=29096): Launched 17:43:36.769606 run osmo-stp_10.42.42.5(pid=29093): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29093)] 17:43:36.907771 run osmo-stp_10.42.42.5(pid=29093): stdout: | (launched: 2022-12-09_17:43:35.442922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:37.047501 run osmo-stp_10.42.42.5(pid=29093): stderr: | 20221209174335637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174335638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174335638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174335638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174335639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174335639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174335639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:37.187078 run osmo-stp_10.42.42.5(pid=29093): stdout: | (launched: 2022-12-09_17:43:35.442922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:37.320209 run osmo-stp_10.42.42.5(pid=29093): stderr: | 20221209174335637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174335638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174335638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174335638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174335639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174335639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174335639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:37.477914 run patchelf(pid=29096): Terminating (SIGINT) 17:43:37.660711 run patchelf(pid=29096): Terminated: ok {rc=0} 17:43:37.792745 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29093): Process ended prematurely: osmo-stp_10.42.42.5(pid=29093) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29093)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:43:37.803141 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:43:37.831931 run osmo-hlr_10.42.42.2(pid=29090): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29090)] 17:43:37.882058 run osmo-hlr_10.42.42.2(pid=29090): stdout: | (launched: 2022-12-09_17:43:34.430025) 17:43:37.934164 run osmo-hlr_10.42.42.2(pid=29090): stderr: | 20221209174334631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174334631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174334631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174334631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174334631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174334631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174334643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174334652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174334652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174334652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:37.986416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29083): Terminating (SIGTERM) 17:43:38.028682 run iperf3-srv_10.42.42.10(pid=29084): Terminating (SIGTERM) 17:43:38.070903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29085): Terminating (SIGTERM) 17:43:38.112903 run iperf3-srv_10.42.42.10(pid=29086): Terminating (SIGTERM) 17:43:38.154858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29089): Terminating (SIGTERM) 17:43:38.196689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29092): Terminating (SIGTERM) 17:43:38.238925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29095): Terminating (SIGTERM) 17:43:38.281161 --- ParallelTerminationStrategy: PID 29083 died... 17:43:38.301163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29083): Terminated: ok {rc=0} 17:43:38.347611 --- ParallelTerminationStrategy: PID 29084 died... 17:43:38.367248 run iperf3-srv_10.42.42.10(pid=29084): Terminated {rc=256} 17:43:38.413552 --- ParallelTerminationStrategy: PID 29085 died... 17:43:38.433087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29085): Terminated: ok {rc=0} 17:43:38.479028 --- ParallelTerminationStrategy: PID 29086 died... 17:43:38.498669 run iperf3-srv_10.42.42.10(pid=29086): Terminated {rc=256} 17:43:38.544665 --- ParallelTerminationStrategy: PID 29089 died... 17:43:38.564437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29089): Terminated: ok {rc=0} 17:43:38.610926 --- ParallelTerminationStrategy: PID 29092 died... 17:43:38.630508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29092): Terminated: ok {rc=0} 17:43:38.676756 --- ParallelTerminationStrategy: PID 29095 died... 17:43:38.696354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29095): Terminated: ok {rc=0} 17:43:38.783231 bus /gobi_0: Setting Powered False 17:43:39.883981 bus /gobi_0: Setting Powered False 17:43:40.999692 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:43:42.149342 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:42.161602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:43:42.236927 tst iperf3.py: using LAC 22652 17:43:42.368516 tst iperf3.py: using RAC 212 17:43:42.494455 tst iperf3.py: using CellId 22652 17:43:42.619550 tst iperf3.py: using BVCI 22653 17:43:42.738926 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:42.750402 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:42.761693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:42.772932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:42.784180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:42.795463 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:42.806895 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:42.818077 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:42.829505 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:42.945091 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:43:43.149038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:43.453431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29098): Launched 17:43:43.719938 run iperf3-srv_10.42.42.10(pid=29099): Launched 17:43:43.834365 tst iperf3.py:8: start network... 17:43:44.037290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:44.507895 run create_hlr_db(pid=29100): Launched 17:43:44.624178 bus /gobi_6: Setting Powered False 17:43:45.684223 run create_hlr_db(pid=29100): Terminated: ok {rc=0} 17:43:46.157765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29102): Launched 17:43:46.479273 run osmo-hlr_10.42.42.2(pid=29103): Launched 17:43:46.619956 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:47.350292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29105): Launched 17:43:47.678004 run osmo-stp_10.42.42.5(pid=29106): Launched 17:43:47.803223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:43:48.363481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29108): Launched 17:43:48.490955 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:43:48.765608 run patchelf(pid=29109): Launched 17:43:48.946566 run osmo-stp_10.42.42.5(pid=29106): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29106)] 17:43:49.084830 run osmo-stp_10.42.42.5(pid=29106): stdout: | (launched: 2022-12-09_17:43:47.618743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:49.223906 run osmo-stp_10.42.42.5(pid=29106): stderr: | 20221209174347811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174347812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174347812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174347812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174347813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174347813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174347813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:49.363774 run osmo-stp_10.42.42.5(pid=29106): stdout: | (launched: 2022-12-09_17:43:47.618743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:49.496792 run osmo-stp_10.42.42.5(pid=29106): stderr: | 20221209174347811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174347812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174347812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174347812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174347813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174347813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174347813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:49.655171 run patchelf(pid=29109): Terminating (SIGINT) 17:43:49.838473 run patchelf(pid=29109): Terminated: ok {rc=0} 17:43:49.970357 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29106): Process ended prematurely: osmo-stp_10.42.42.5(pid=29106) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29106)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 17:43:49.980721 tst iperf3.py:8: Test FAILED (7.9 sec) 17:43:50.009500 run osmo-hlr_10.42.42.2(pid=29103): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29103)] 17:43:50.060283 run osmo-hlr_10.42.42.2(pid=29103): stdout: | (launched: 2022-12-09_17:43:46.415942) 17:43:50.112489 run osmo-hlr_10.42.42.2(pid=29103): stderr: | 20221209174346784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174346784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174346784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174346784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174346784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174346784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174346806 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174346815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174346815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174346815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:50.165317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29098): Terminating (SIGTERM) 17:43:50.207536 run iperf3-srv_10.42.42.10(pid=29099): Terminating (SIGTERM) 17:43:50.249768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29102): Terminating (SIGTERM) 17:43:50.291995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29105): Terminating (SIGTERM) 17:43:50.334170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29108): Terminating (SIGTERM) 17:43:50.376436 --- ParallelTerminationStrategy: PID 29098 died... 17:43:50.396491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29098): Terminated: ok {rc=0} 17:43:50.443252 --- ParallelTerminationStrategy: PID 29099 died... 17:43:50.462809 run iperf3-srv_10.42.42.10(pid=29099): Terminated {rc=256} 17:43:50.509255 --- ParallelTerminationStrategy: PID 29102 died... 17:43:50.528700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29102): Terminated: ok {rc=0} 17:43:50.575177 --- ParallelTerminationStrategy: PID 29105 died... 17:43:50.594979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29105): Terminated: ok {rc=0} 17:43:50.641377 --- ParallelTerminationStrategy: PID 29108 died... 17:43:50.661094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29108): Terminated: ok {rc=0} 17:43:50.749439 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:43:51.895435 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:51.907358 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:43:51.978323 tst iperf3m4.py: using LAC 22653 17:43:52.097378 tst iperf3m4.py: using RAC 213 17:43:52.217215 tst iperf3m4.py: using CellId 22653 17:43:52.338211 tst iperf3m4.py: using BVCI 22654 17:43:52.451218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:52.462312 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:52.473055 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:52.484544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:52.496162 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:52.507632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:52.519251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:52.530885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:43:52.542795 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:52.661550 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:52.779874 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:52.898377 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:43:53.016547 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:43:53.222564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:53.529223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29110): Launched 17:43:53.796017 run iperf3-srv_10.42.42.10(pid=29111): Launched 17:43:53.911030 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:43:54.115755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:54.422213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29112): Launched 17:43:54.689803 run iperf3-srv_10.42.42.10(pid=29113): Launched 17:43:54.804040 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:43:55.007947 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:55.313803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29114): Launched 17:43:55.579312 run iperf3-srv_10.42.42.10(pid=29115): Launched 17:43:55.694300 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:43:55.898081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:43:56.203745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29116): Launched 17:43:56.469731 run iperf3-srv_10.42.42.10(pid=29117): Launched 17:43:56.584038 tst iperf3m4.py:8: start network... 17:43:56.787442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:57.257869 run create_hlr_db(pid=29118): Launched 17:43:57.373497 bus /gobi_6: Setting Powered False 17:43:58.433850 run create_hlr_db(pid=29118): Terminated: ok {rc=0} 17:43:58.878894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29120): Launched 17:43:59.206644 run osmo-hlr_10.42.42.2(pid=29121): Launched 17:43:59.330542 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:59.898245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29123): Launched 17:44:00.224819 run osmo-stp_10.42.42.5(pid=29124): Launched 17:44:00.350239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:00.929465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29126): Launched 17:44:01.068175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:01.335949 run patchelf(pid=29127): Launched 17:44:01.527474 run osmo-stp_10.42.42.5(pid=29124): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29124)] 17:44:01.671313 run osmo-stp_10.42.42.5(pid=29124): stdout: | (launched: 2022-12-09_17:44:00.165567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:01.844205 run osmo-stp_10.42.42.5(pid=29124): stderr: | 20221209174400358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174400359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174400359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174400359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174400360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174400360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174400360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:01.981636 run osmo-stp_10.42.42.5(pid=29124): stdout: | (launched: 2022-12-09_17:44:00.165567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:02.111530 run osmo-stp_10.42.42.5(pid=29124): stderr: | 20221209174400358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174400359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174400359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174400359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174400360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174400360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174400360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:02.264201 run patchelf(pid=29127): Terminating (SIGINT) 17:44:02.436366 run patchelf(pid=29127): Terminated: ok {rc=0} 17:44:02.560616 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29124): Process ended prematurely: osmo-stp_10.42.42.5(pid=29124) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29124)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:44:02.570501 tst iperf3m4.py:8: Test FAILED (10.7 sec) 17:44:02.600059 run osmo-hlr_10.42.42.2(pid=29121): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29121)] 17:44:02.649682 run osmo-hlr_10.42.42.2(pid=29121): stdout: | (launched: 2022-12-09_17:43:59.147274) 17:44:02.700828 run osmo-hlr_10.42.42.2(pid=29121): stderr: | 20221209174359348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174359348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174359348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174359348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174359348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174359348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174359360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174359368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174359368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174359368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:02.752462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29110): Terminating (SIGTERM) 17:44:02.793696 run iperf3-srv_10.42.42.10(pid=29111): Terminating (SIGTERM) 17:44:02.834908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29112): Terminating (SIGTERM) 17:44:02.875920 run iperf3-srv_10.42.42.10(pid=29113): Terminating (SIGTERM) 17:44:02.917059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29114): Terminating (SIGTERM) 17:44:02.958213 run iperf3-srv_10.42.42.10(pid=29115): Terminating (SIGTERM) 17:44:02.999330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29116): Terminating (SIGTERM) 17:44:03.040193 run iperf3-srv_10.42.42.10(pid=29117): Terminating (SIGTERM) 17:44:03.080752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29120): Terminating (SIGTERM) 17:44:03.121594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29123): Terminating (SIGTERM) 17:44:03.162198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29126): Terminating (SIGTERM) 17:44:03.202994 --- ParallelTerminationStrategy: PID 29110 died... 17:44:03.221871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29110): Terminated: ok {rc=0} 17:44:03.266870 --- ParallelTerminationStrategy: PID 29111 died... 17:44:03.285686 run iperf3-srv_10.42.42.10(pid=29111): Terminated {rc=256} 17:44:03.330162 --- ParallelTerminationStrategy: PID 29112 died... 17:44:03.348895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29112): Terminated: ok {rc=0} 17:44:03.393747 --- ParallelTerminationStrategy: PID 29113 died... 17:44:03.412460 run iperf3-srv_10.42.42.10(pid=29113): Terminated {rc=256} 17:44:03.456812 --- ParallelTerminationStrategy: PID 29114 died... 17:44:03.475673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29114): Terminated: ok {rc=0} 17:44:03.520670 --- ParallelTerminationStrategy: PID 29115 died... 17:44:03.539512 run iperf3-srv_10.42.42.10(pid=29115): Terminated {rc=256} 17:44:03.584011 --- ParallelTerminationStrategy: PID 29116 died... 17:44:03.602899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29116): Terminated: ok {rc=0} 17:44:03.647901 --- ParallelTerminationStrategy: PID 29117 died... 17:44:03.666739 run iperf3-srv_10.42.42.10(pid=29117): Terminated {rc=256} 17:44:03.711270 --- ParallelTerminationStrategy: PID 29120 died... 17:44:03.729978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29120): Terminated: ok {rc=0} 17:44:03.775001 --- ParallelTerminationStrategy: PID 29123 died... 17:44:03.793783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29123): Terminated: ok {rc=0} 17:44:03.838449 --- ParallelTerminationStrategy: PID 29126 died... 17:44:03.857239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29126): Terminated: ok {rc=0} 17:44:03.943846 bus /gobi_4: Setting Powered False 17:44:05.044093 bus /gobi_4: Setting Powered False 17:44:06.160897 bus /gobi_1: Setting Powered False 17:44:07.260869 bus /gobi_1: Setting Powered False 17:44:08.377143 bus /gobi_0: Setting Powered False 17:44:09.476101 bus /gobi_0: Setting Powered False 17:44:10.592646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:44:11.695690 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:11.707485 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:44:11.778148 tst ping.py: using LAC 22654 17:44:11.902495 tst ping.py: using RAC 214 17:44:12.019175 tst ping.py: using CellId 22654 17:44:12.135334 tst ping.py: using BVCI 22655 17:44:12.243829 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:12.254921 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:12.265840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:12.276937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:12.288005 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:12.299123 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:12.310320 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:12.321606 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:12.435517 tst ping.py:19: start network... 17:44:12.634267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:13.094430 run create_hlr_db(pid=29128): Launched 17:44:13.209474 bus /gobi_6: Setting Powered False 17:44:14.269169 run create_hlr_db(pid=29128): Terminated: ok {rc=0} 17:44:14.685832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Launched 17:44:14.983124 run osmo-hlr_10.42.42.2(pid=29131): Launched 17:44:15.096400 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:15.627737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Launched 17:44:15.949725 run osmo-stp_10.42.42.5(pid=29134): Launched 17:44:16.198975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:16.899387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Launched 17:44:17.028544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:17.285341 run patchelf(pid=29137): Launched 17:44:17.452812 run osmo-stp_10.42.42.5(pid=29134): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] 17:44:17.579610 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-09_17:44:15.871929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:17.708813 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221209174416247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174416248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174416249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174416251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174416253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174416253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174416253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:17.838081 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-09_17:44:15.871929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:17.960875 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221209174416247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174416248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174416249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174416251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174416253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174416253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174416253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:18.106389 run patchelf(pid=29137): Terminating (SIGINT) 17:44:18.274463 run patchelf(pid=29137): Terminated: ok {rc=0} 17:44:18.395826 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29134): Process ended prematurely: osmo-stp_10.42.42.5(pid=29134) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 17:44:18.404900 tst ping.py:22: Test FAILED (6.7 sec) 17:44:18.432379 run osmo-hlr_10.42.42.2(pid=29131): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29131)] 17:44:18.481395 run osmo-hlr_10.42.42.2(pid=29131): stdout: | (launched: 2022-12-09_17:44:14.928814) 17:44:18.532051 run osmo-hlr_10.42.42.2(pid=29131): stderr: | 20221209174415104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174415104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174415104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174415104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174415104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174415104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174415115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174415124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174415124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174415124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:18.582935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminating (SIGTERM) 17:44:18.623787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminating (SIGTERM) 17:44:18.664578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Terminating (SIGTERM) 17:44:18.705392 --- ParallelTerminationStrategy: PID 29130 died... 17:44:18.724859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminated: ok {rc=0} 17:44:18.770343 --- ParallelTerminationStrategy: PID 29133 died... 17:44:18.789504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminated: ok {rc=0} 17:44:18.834939 --- ParallelTerminationStrategy: PID 29136 died... 17:44:18.853969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Terminated: ok {rc=0} 17:44:18.941087 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:44:20.030666 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:20.043022 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:44:20.114860 tst ping_idle_ping.py: using LAC 22655 17:44:20.232878 tst ping_idle_ping.py: using RAC 215 17:44:20.349765 tst ping_idle_ping.py: using CellId 22655 17:44:20.466762 tst ping_idle_ping.py: using BVCI 22656 17:44:20.576921 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:20.588171 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:20.599008 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:20.610120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:20.621205 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:20.632206 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:20.643370 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:44:20.654397 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:44:20.773128 tst ping_idle_ping.py:24: start network... 17:44:20.991108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:21.494819 run create_hlr_db(pid=29138): Launched 17:44:21.626447 bus /gobi_6: Setting Powered False 17:44:22.690293 run create_hlr_db(pid=29138): Terminated: ok {rc=0} 17:44:23.119052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Launched 17:44:23.418956 run osmo-hlr_10.42.42.2(pid=29141): Launched 17:44:23.533575 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:24.063313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Launched 17:44:24.361508 run osmo-stp_10.42.42.5(pid=29144): Launched 17:44:24.475753 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:24.992391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Launched 17:44:25.107495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:25.360163 run patchelf(pid=29147): Launched 17:44:25.527440 run osmo-stp_10.42.42.5(pid=29144): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] 17:44:25.654719 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-09_17:44:24.306944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:25.783910 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221209174424477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174424478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174424478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174424478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174424479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174424479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174424479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:25.913416 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-09_17:44:24.306944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:26.036542 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221209174424477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174424478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174424478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174424478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174424479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174424479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174424479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:26.182012 run patchelf(pid=29147): Terminating (SIGINT) 17:44:26.349927 run patchelf(pid=29147): Terminated: ok {rc=0} 17:44:26.471197 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:44:26.480159 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 17:44:26.507368 run osmo-hlr_10.42.42.2(pid=29141): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29141)] 17:44:26.555604 run osmo-hlr_10.42.42.2(pid=29141): stdout: | (launched: 2022-12-09_17:44:23.364014) 17:44:26.605681 run osmo-hlr_10.42.42.2(pid=29141): stderr: | 20221209174423542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174423542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174423542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174423542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174423542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174423542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174423559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174423568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174423568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174423568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:26.656131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminating (SIGTERM) 17:44:26.696412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminating (SIGTERM) 17:44:26.736886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminating (SIGTERM) 17:44:26.777980 --- ParallelTerminationStrategy: PID 29140 died... 17:44:26.797135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminated: ok {rc=0} 17:44:26.842190 --- ParallelTerminationStrategy: PID 29143 died... 17:44:26.860774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminated: ok {rc=0} 17:44:26.905640 --- ParallelTerminationStrategy: PID 29146 died... 17:44:26.924267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminated: ok {rc=0} 17:44:27.011155 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:44:28.315747 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:44:28.323461 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:44:28.358387 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:44:28.397710 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:44:28.486321 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:44:28.520483 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:44:28.559381 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:44:29.158194 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:44:29.210177 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:29.221607 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:44:29.293851 tst cs_paging_gprs_active.py: using LAC 22656 17:44:29.422817 tst cs_paging_gprs_active.py: using RAC 216 17:44:29.549842 tst cs_paging_gprs_active.py: using CellId 22656 17:44:29.677064 tst cs_paging_gprs_active.py: using BVCI 22657 17:44:29.794981 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:29.806497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:29.817749 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:29.829190 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:29.840392 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:29.851671 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:29.863041 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:29.874229 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:29.885625 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:30.002109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:30.118425 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:44:30.325538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:30.633431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29151): Launched 17:44:30.933815 run iperf3-srv_10.42.42.10(pid=29152): Launched 17:44:31.059976 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:44:31.269649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:31.626385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29153): Launched 17:44:31.913393 run iperf3-srv_10.42.42.10(pid=29154): Launched 17:44:32.046609 tst cs_paging_gprs_active.py:38: start network... 17:44:32.255858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:32.730341 run create_hlr_db(pid=29155): Launched 17:44:32.850639 bus /gobi_6: Setting Powered False 17:44:33.911015 run create_hlr_db(pid=29155): Terminated: ok {rc=0} 17:44:34.335382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29157): Launched 17:44:34.640413 run osmo-hlr_10.42.42.2(pid=29158): Launched 17:44:34.757369 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:35.296897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29160): Launched 17:44:35.601826 run osmo-stp_10.42.42.5(pid=29161): Launched 17:44:35.718401 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:36.245416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29163): Launched 17:44:36.362608 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:36.620867 run patchelf(pid=29164): Launched 17:44:36.791236 run osmo-stp_10.42.42.5(pid=29161): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29161)] 17:44:36.920762 run osmo-stp_10.42.42.5(pid=29161): stdout: | (launched: 2022-12-09_17:44:35.546250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:37.051560 run osmo-stp_10.42.42.5(pid=29161): stderr: | 20221209174435717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174435718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174435718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174435718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174435719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174435719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174435719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:37.182481 run osmo-stp_10.42.42.5(pid=29161): stdout: | (launched: 2022-12-09_17:44:35.546250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:37.307305 run osmo-stp_10.42.42.5(pid=29161): stderr: | 20221209174435717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174435718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174435718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174435718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174435719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174435719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174435719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:37.455406 run patchelf(pid=29164): Terminating (SIGINT) 17:44:37.627105 run patchelf(pid=29164): Terminated: ok {rc=0} 17:44:37.751154 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29161): Process ended prematurely: osmo-stp_10.42.42.5(pid=29161) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29161)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:44:37.760748 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 17:44:37.788390 run osmo-hlr_10.42.42.2(pid=29158): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29158)] 17:44:37.837120 run osmo-hlr_10.42.42.2(pid=29158): stdout: | (launched: 2022-12-09_17:44:34.584362) 17:44:37.887083 run osmo-hlr_10.42.42.2(pid=29158): stderr: | 20221209174434758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174434758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174434758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174434758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174434758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174434758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174434771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174434782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174434782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174434782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:37.937474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29151): Terminating (SIGTERM) 17:44:37.978059 run iperf3-srv_10.42.42.10(pid=29152): Terminating (SIGTERM) 17:44:38.018272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29153): Terminating (SIGTERM) 17:44:38.058766 run iperf3-srv_10.42.42.10(pid=29154): Terminating (SIGTERM) 17:44:38.099152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29157): Terminating (SIGTERM) 17:44:38.139182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29160): Terminating (SIGTERM) 17:44:38.179776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29163): Terminating (SIGTERM) 17:44:38.220179 --- ParallelTerminationStrategy: PID 29151 died... 17:44:38.239356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29151): Terminated: ok {rc=0} 17:44:38.284299 --- ParallelTerminationStrategy: PID 29152 died... 17:44:38.302927 run iperf3-srv_10.42.42.10(pid=29152): Terminated {rc=256} 17:44:38.347357 --- ParallelTerminationStrategy: PID 29153 died... 17:44:38.366150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29153): Terminated: ok {rc=0} 17:44:38.410350 --- ParallelTerminationStrategy: PID 29154 died... 17:44:38.428984 run iperf3-srv_10.42.42.10(pid=29154): Terminated {rc=256} 17:44:38.473110 --- ParallelTerminationStrategy: PID 29157 died... 17:44:38.491611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29157): Terminated: ok {rc=0} 17:44:38.535922 --- ParallelTerminationStrategy: PID 29160 died... 17:44:38.554632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29160): Terminated: ok {rc=0} 17:44:38.599072 --- ParallelTerminationStrategy: PID 29163 died... 17:44:38.617726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29163): Terminated: ok {rc=0} 17:44:38.704046 bus /gobi_0: Setting Powered False 17:44:39.803907 bus /gobi_0: Setting Powered False 17:44:40.920787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:44:42.068897 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:42.081357 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:44:42.154397 tst iperf3.py: using LAC 22657 17:44:42.273369 tst iperf3.py: using RAC 217 17:44:42.392325 tst iperf3.py: using CellId 22657 17:44:42.510762 tst iperf3.py: using BVCI 22658 17:44:42.620656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:42.631855 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:42.642853 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:42.653897 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:42.664826 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:42.675983 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:42.687302 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:42.698285 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:42.709551 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:42.825232 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:44:43.030767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:43.337353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29165): Launched 17:44:43.604139 run iperf3-srv_10.42.42.10(pid=29166): Launched 17:44:43.719317 tst iperf3.py:8: start network... 17:44:43.923499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:44.396919 run create_hlr_db(pid=29167): Launched 17:44:44.513665 bus /gobi_6: Setting Powered False 17:44:45.574391 run create_hlr_db(pid=29167): Terminated: ok {rc=0} 17:44:46.002100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29169): Launched 17:44:46.359429 run osmo-hlr_10.42.42.2(pid=29170): Launched 17:44:46.616377 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:47.201690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29172): Launched 17:44:47.542498 run osmo-stp_10.42.42.5(pid=29173): Launched 17:44:47.667394 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:44:48.228219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29175): Launched 17:44:48.352739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:44:48.626877 run patchelf(pid=29176): Launched 17:44:48.809509 run osmo-stp_10.42.42.5(pid=29173): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29173)] 17:44:48.947295 run osmo-stp_10.42.42.5(pid=29173): stdout: | (launched: 2022-12-09_17:44:47.483184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:49.087637 run osmo-stp_10.42.42.5(pid=29173): stderr: | 20221209174447677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174447677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174447677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174447678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174447678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174447678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174447678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:49.227295 run osmo-stp_10.42.42.5(pid=29173): stdout: | (launched: 2022-12-09_17:44:47.483184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:49.360512 run osmo-stp_10.42.42.5(pid=29173): stderr: | 20221209174447677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174447677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174447677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174447678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174447678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174447678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174447678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:49.518255 run patchelf(pid=29176): Terminating (SIGINT) 17:44:49.700460 run patchelf(pid=29176): Terminated: ok {rc=0} 17:44:49.831884 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29173): Process ended prematurely: osmo-stp_10.42.42.5(pid=29173) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29173)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 17:44:49.842214 tst iperf3.py:8: Test FAILED (7.8 sec) 17:44:49.870957 run osmo-hlr_10.42.42.2(pid=29170): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29170)] 17:44:49.921257 run osmo-hlr_10.42.42.2(pid=29170): stdout: | (launched: 2022-12-09_17:44:46.294870) 17:44:49.973609 run osmo-hlr_10.42.42.2(pid=29170): stderr: | 20221209174446568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174446568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174446568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174446568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174446568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174446568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174446591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174446599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174446599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174446599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:50.026352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29165): Terminating (SIGTERM) 17:44:50.069318 run iperf3-srv_10.42.42.10(pid=29166): Terminating (SIGTERM) 17:44:50.111801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29169): Terminating (SIGTERM) 17:44:50.154795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29172): Terminating (SIGTERM) 17:44:50.197433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29175): Terminating (SIGTERM) 17:44:50.240181 --- ParallelTerminationStrategy: PID 29165 died... 17:44:50.260293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29165): Terminated: ok {rc=0} 17:44:50.307441 --- ParallelTerminationStrategy: PID 29166 died... 17:44:50.327316 run iperf3-srv_10.42.42.10(pid=29166): Terminated {rc=256} 17:44:50.374041 --- ParallelTerminationStrategy: PID 29169 died... 17:44:50.393642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29169): Terminated: ok {rc=0} 17:44:50.440469 --- ParallelTerminationStrategy: PID 29172 died... 17:44:50.460092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29172): Terminated: ok {rc=0} 17:44:50.506869 --- ParallelTerminationStrategy: PID 29175 died... 17:44:50.526681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29175): Terminated: ok {rc=0} 17:44:50.615311 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:44:51.766114 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:51.778320 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:44:51.851603 tst iperf3m4.py: using LAC 22658 17:44:51.981080 tst iperf3m4.py: using RAC 218 17:44:52.108468 tst iperf3m4.py: using CellId 22658 17:44:52.241353 tst iperf3m4.py: using BVCI 22659 17:44:52.359925 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:52.371484 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:52.382792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:52.394240 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:52.405581 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:52.416771 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:52.428209 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:52.439383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:44:52.450877 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:52.569167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:52.691623 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:52.814825 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:44:52.932158 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:44:53.137319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:53.444526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29177): Launched 17:44:53.710472 run iperf3-srv_10.42.42.10(pid=29178): Launched 17:44:53.825159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:44:54.029102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:54.336337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29179): Launched 17:44:54.602468 run iperf3-srv_10.42.42.10(pid=29180): Launched 17:44:54.717199 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:44:54.921289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:55.227433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29181): Launched 17:44:55.493454 run iperf3-srv_10.42.42.10(pid=29182): Launched 17:44:55.608329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:44:55.811708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:44:56.118205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29183): Launched 17:44:56.386288 run iperf3-srv_10.42.42.10(pid=29184): Launched 17:44:56.500592 tst iperf3m4.py:8: start network... 17:44:56.704307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:57.174561 run create_hlr_db(pid=29185): Launched 17:44:57.293250 bus /gobi_6: Setting Powered False 17:44:58.353864 run create_hlr_db(pid=29185): Terminated: ok {rc=0} 17:44:58.778553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29187): Launched 17:44:59.083199 run osmo-hlr_10.42.42.2(pid=29188): Launched 17:44:59.199927 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:59.737857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29190): Launched 17:45:00.043838 run osmo-stp_10.42.42.5(pid=29191): Launched 17:45:00.160271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:00.684327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29193): Launched 17:45:00.801958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:01.110126 run patchelf(pid=29194): Launched 17:45:01.309591 run osmo-stp_10.42.42.5(pid=29191): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29191)] 17:45:01.473980 run osmo-stp_10.42.42.5(pid=29191): stdout: | (launched: 2022-12-09_17:44:59.987275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:01.618974 run osmo-stp_10.42.42.5(pid=29191): stderr: | 20221209174500158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174500158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174500159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174500159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174500160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174500160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174500160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:01.765200 run osmo-stp_10.42.42.5(pid=29191): stdout: | (launched: 2022-12-09_17:44:59.987275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:01.905272 run osmo-stp_10.42.42.5(pid=29191): stderr: | 20221209174500158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174500158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174500159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174500159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174500160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174500160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174500160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:02.068573 run patchelf(pid=29194): Terminating (SIGINT) 17:45:02.259045 run patchelf(pid=29194): Terminated: ok {rc=0} 17:45:02.394217 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29191): Process ended prematurely: osmo-stp_10.42.42.5(pid=29191) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29191)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:45:02.405574 tst iperf3m4.py:8: Test FAILED (10.7 sec) 17:45:02.437357 run osmo-hlr_10.42.42.2(pid=29188): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29188)] 17:45:02.490749 run osmo-hlr_10.42.42.2(pid=29188): stdout: | (launched: 2022-12-09_17:44:59.027595) 17:45:02.546302 run osmo-hlr_10.42.42.2(pid=29188): stderr: | 20221209174459202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174459202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174459202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174459202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174459202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174459202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174459214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174459222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174459222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174459222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:02.601229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29177): Terminating (SIGTERM) 17:45:02.647498 run iperf3-srv_10.42.42.10(pid=29178): Terminating (SIGTERM) 17:45:02.695209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29179): Terminating (SIGTERM) 17:45:02.739473 run iperf3-srv_10.42.42.10(pid=29180): Terminating (SIGTERM) 17:45:02.784077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29181): Terminating (SIGTERM) 17:45:02.827056 run iperf3-srv_10.42.42.10(pid=29182): Terminating (SIGTERM) 17:45:02.873409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29183): Terminating (SIGTERM) 17:45:02.914832 run iperf3-srv_10.42.42.10(pid=29184): Terminating (SIGTERM) 17:45:02.955390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29187): Terminating (SIGTERM) 17:45:02.995978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29190): Terminating (SIGTERM) 17:45:03.036458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29193): Terminating (SIGTERM) 17:45:03.077094 --- ParallelTerminationStrategy: PID 29177 died... 17:45:03.096178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29177): Terminated: ok {rc=0} 17:45:03.141175 --- ParallelTerminationStrategy: PID 29178 died... 17:45:03.159738 run iperf3-srv_10.42.42.10(pid=29178): Terminated {rc=256} 17:45:03.204484 --- ParallelTerminationStrategy: PID 29179 died... 17:45:03.223133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29179): Terminated: ok {rc=0} 17:45:03.268074 --- ParallelTerminationStrategy: PID 29180 died... 17:45:03.286977 run iperf3-srv_10.42.42.10(pid=29180): Terminated {rc=256} 17:45:03.331563 --- ParallelTerminationStrategy: PID 29181 died... 17:45:03.350312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29181): Terminated: ok {rc=0} 17:45:03.395127 --- ParallelTerminationStrategy: PID 29182 died... 17:45:03.413793 run iperf3-srv_10.42.42.10(pid=29182): Terminated {rc=256} 17:45:03.458660 --- ParallelTerminationStrategy: PID 29183 died... 17:45:03.477412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29183): Terminated: ok {rc=0} 17:45:03.522476 --- ParallelTerminationStrategy: PID 29184 died... 17:45:03.541260 run iperf3-srv_10.42.42.10(pid=29184): Terminated {rc=256} 17:45:03.586482 --- ParallelTerminationStrategy: PID 29187 died... 17:45:03.605306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29187): Terminated: ok {rc=0} 17:45:03.649981 --- ParallelTerminationStrategy: PID 29190 died... 17:45:03.668732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29190): Terminated: ok {rc=0} 17:45:03.713641 --- ParallelTerminationStrategy: PID 29193 died... 17:45:03.732326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29193): Terminated: ok {rc=0} 17:45:03.819636 bus /gobi_4: Setting Powered False 17:45:04.921153 bus /gobi_4: Setting Powered False 17:45:06.038642 bus /gobi_1: Setting Powered False 17:45:07.139573 bus /gobi_1: Setting Powered False 17:45:08.255782 bus /gobi_0: Setting Powered False 17:45:09.359033 bus /gobi_0: Setting Powered False 17:45:10.475929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:45:11.577943 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:11.589832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:45:11.661951 tst ping.py: using LAC 22659 17:45:11.788911 tst ping.py: using RAC 219 17:45:11.914333 tst ping.py: using CellId 22659 17:45:12.040883 tst ping.py: using BVCI 22660 17:45:12.157564 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:12.169148 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:12.180383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:12.192175 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:12.203852 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:12.215628 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:12.227520 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:12.239231 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:12.359002 tst ping.py:19: start network... 17:45:12.574039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:13.072395 run create_hlr_db(pid=29221): Launched 17:45:13.221213 bus /gobi_6: Setting Powered False 17:45:14.284722 run create_hlr_db(pid=29221): Terminated: ok {rc=0} 17:45:14.733826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29498): Launched 17:45:15.053153 run osmo-hlr_10.42.42.2(pid=29559): Launched 17:45:15.168818 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:15.706718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29561): Launched 17:45:16.044254 run osmo-stp_10.42.42.5(pid=29562): Launched 17:45:16.244291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:16.857817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29564): Launched 17:45:16.995502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:17.275545 run patchelf(pid=29565): Launched 17:45:17.466178 run osmo-stp_10.42.42.5(pid=29562): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29562)] 17:45:17.602619 run osmo-stp_10.42.42.5(pid=29562): stdout: | (launched: 2022-12-09_17:45:15.977841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:17.741764 run osmo-stp_10.42.42.5(pid=29562): stderr: | 20221209174516339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174516339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174516339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174516340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174516340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174516340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174516340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:17.880491 run osmo-stp_10.42.42.5(pid=29562): stdout: | (launched: 2022-12-09_17:45:15.977841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:18.012533 run osmo-stp_10.42.42.5(pid=29562): stderr: | 20221209174516339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174516339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174516339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174516340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174516340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174516340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174516340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:18.169298 run patchelf(pid=29565): Terminating (SIGINT) 17:45:18.349818 run patchelf(pid=29565): Terminated: ok {rc=0} 17:45:18.480317 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29562): Process ended prematurely: osmo-stp_10.42.42.5(pid=29562) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29562)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 17:45:18.490466 tst ping.py:22: Test FAILED (6.9 sec) 17:45:18.519240 run osmo-hlr_10.42.42.2(pid=29559): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29559)] 17:45:18.570389 run osmo-hlr_10.42.42.2(pid=29559): stdout: | (launched: 2022-12-09_17:45:14.998238) 17:45:18.623559 run osmo-hlr_10.42.42.2(pid=29559): stderr: | 20221209174515174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174515174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174515174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174515174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174515174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174515174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174515187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174515196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174515196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174515196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:18.679634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29498): Terminating (SIGTERM) 17:45:18.722862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29561): Terminating (SIGTERM) 17:45:18.765907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29564): Terminating (SIGTERM) 17:45:18.809285 --- ParallelTerminationStrategy: PID 29498 died... 17:45:18.829836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29498): Terminated: ok {rc=0} 17:45:18.878192 --- ParallelTerminationStrategy: PID 29561 died... 17:45:18.898476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29561): Terminated: ok {rc=0} 17:45:18.946183 --- ParallelTerminationStrategy: PID 29564 died... 17:45:18.966238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29564): Terminated: ok {rc=0} 17:45:19.056857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:45:20.146882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:20.159349 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:45:20.234392 tst ping_idle_ping.py: using LAC 22660 17:45:20.361631 tst ping_idle_ping.py: using RAC 220 17:45:20.490441 tst ping_idle_ping.py: using CellId 22660 17:45:20.617049 tst ping_idle_ping.py: using BVCI 22661 17:45:20.733240 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:20.744840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:20.756387 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:20.768220 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:20.779852 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:20.791656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:20.803240 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:45:20.814875 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:45:20.933074 tst ping_idle_ping.py:24: start network... 17:45:21.135655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:21.604153 run create_hlr_db(pid=29566): Launched 17:45:21.720577 bus /gobi_6: Setting Powered False 17:45:22.781031 run create_hlr_db(pid=29566): Terminated: ok {rc=0} 17:45:23.227468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Launched 17:45:23.592591 run osmo-hlr_10.42.42.2(pid=29637): Launched 17:45:23.751597 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:24.353932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29746): Launched 17:45:24.665770 run osmo-stp_10.42.42.5(pid=29747): Launched 17:45:24.903419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:25.547969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29749): Launched 17:45:25.684352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:25.960993 run patchelf(pid=29750): Launched 17:45:26.155460 run osmo-stp_10.42.42.5(pid=29747): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29747)] 17:45:26.294395 run osmo-stp_10.42.42.5(pid=29747): stdout: | (launched: 2022-12-09_17:45:24.610112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:26.435596 run osmo-stp_10.42.42.5(pid=29747): stderr: | 20221209174524905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174524905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174524906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174524906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174524907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174524907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174524907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:26.577665 run osmo-stp_10.42.42.5(pid=29747): stdout: | (launched: 2022-12-09_17:45:24.610112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:26.711900 run osmo-stp_10.42.42.5(pid=29747): stderr: | 20221209174524905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174524905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174524906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174524906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174524907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174524907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174524907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:26.871185 run patchelf(pid=29750): Terminating (SIGINT) 17:45:27.054249 run patchelf(pid=29750): Terminated: ok {rc=0} 17:45:27.187008 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29747): Process ended prematurely: osmo-stp_10.42.42.5(pid=29747) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29747)] [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:45:27.197930 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 17:45:27.227812 run osmo-hlr_10.42.42.2(pid=29637): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29637)] 17:45:27.280649 run osmo-hlr_10.42.42.2(pid=29637): stdout: | (launched: 2022-12-09_17:45:23.535712) 17:45:27.334215 run osmo-hlr_10.42.42.2(pid=29637): stderr: | 20221209174523853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174523854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174523854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174523854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174523854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174523854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174523879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174523897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174523897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174523897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:27.388450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Terminating (SIGTERM) 17:45:27.432890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29746): Terminating (SIGTERM) 17:45:27.479462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29749): Terminating (SIGTERM) 17:45:27.525172 --- ParallelTerminationStrategy: PID 29573 died... 17:45:27.546265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Terminated: ok {rc=0} 17:45:27.596139 --- ParallelTerminationStrategy: PID 29746 died... 17:45:27.616906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29746): Terminated: ok {rc=0} 17:45:27.665690 --- ParallelTerminationStrategy: PID 29749 died... 17:45:27.686386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29749): Terminated: ok {rc=0} 17:45:27.777733 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:45:29.102172 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:29.110074 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:45:29.162434 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:45:29.199540 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:45:29.254593 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:45:29.290398 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:45:29.326580 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:45:29.884204 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:45:29.890054 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:29.901392 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:45:29.974765 tst switch_tch_pdch.py: using LAC 22661 17:45:30.092264 tst switch_tch_pdch.py: using RAC 221 17:45:30.207530 tst switch_tch_pdch.py: using CellId 22661 17:45:30.323097 tst switch_tch_pdch.py: using BVCI 22662 17:45:30.431253 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:30.442872 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:30.454100 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:30.465650 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:30.476925 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:30.488326 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:30.499810 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:45:30.511061 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:45:30.630861 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:45:30.751376 tst switch_tch_pdch.py:51: start network... 17:45:30.984209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:31.545739 run create_hlr_db(pid=29755): Launched 17:45:31.711739 bus /gobi_6: Setting Powered False 17:45:32.775116 run create_hlr_db(pid=29755): Terminated: ok {rc=0} 17:45:33.208490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29757): Launched 17:45:33.508913 run osmo-hlr_10.42.42.2(pid=29758): Launched 17:45:33.624736 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:34.146984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29760): Launched 17:45:34.445327 run osmo-stp_10.42.42.5(pid=29761): Launched 17:45:34.560050 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:35.074972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29763): Launched 17:45:35.188777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:35.439484 run patchelf(pid=29764): Launched 17:45:35.605471 run osmo-stp_10.42.42.5(pid=29761): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29761)] 17:45:35.731620 run osmo-stp_10.42.42.5(pid=29761): stdout: | (launched: 2022-12-09_17:45:34.390760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:35.860083 run osmo-stp_10.42.42.5(pid=29761): stderr: | 20221209174534561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174534561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174534561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174534562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174534562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174534562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174534562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:35.989161 run osmo-stp_10.42.42.5(pid=29761): stdout: | (launched: 2022-12-09_17:45:34.390760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:36.111472 run osmo-stp_10.42.42.5(pid=29761): stderr: | 20221209174534561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174534561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174534561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174534562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174534562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174534562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174534562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:36.255752 run patchelf(pid=29764): Terminating (SIGINT) 17:45:36.422811 run patchelf(pid=29764): Terminated: ok {rc=0} 17:45:36.543828 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29761): Process ended prematurely: osmo-stp_10.42.42.5(pid=29761) [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29761)] [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:45:36.552931 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 17:45:36.580196 run osmo-hlr_10.42.42.2(pid=29758): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29758)] 17:45:36.628375 run osmo-hlr_10.42.42.2(pid=29758): stdout: | (launched: 2022-12-09_17:45:33.454174) 17:45:36.677935 run osmo-hlr_10.42.42.2(pid=29758): stderr: | 20221209174533630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174533630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174533630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174533630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174533630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174533631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174533643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174533654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174533654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174533654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:36.728197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29757): Terminating (SIGTERM) 17:45:36.768180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29760): Terminating (SIGTERM) 17:45:36.808217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29763): Terminating (SIGTERM) 17:45:36.848853 --- ParallelTerminationStrategy: PID 29757 died... 17:45:36.868025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29757): Terminated: ok {rc=0} 17:45:36.912584 --- ParallelTerminationStrategy: PID 29760 died... 17:45:36.931347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29760): Terminated: ok {rc=0} 17:45:36.975750 --- ParallelTerminationStrategy: PID 29763 died... 17:45:36.994462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29763): Terminated: ok {rc=0} 17:45:37.079879 bus /gobi_0: Setting Powered False 17:45:38.179082 bus /gobi_0: Setting Powered False 17:45:39.292387 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:45:40.543465 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:40.549203 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:45:40.583554 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:45:40.617760 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:45:40.671505 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:45:40.706125 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:45:40.740210 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:45:41.299434 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:45:41.305164 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:41.316696 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:45:41.392867 tst switch_tch_pdch.py: using LAC 22662 17:45:41.519760 tst switch_tch_pdch.py: using RAC 222 17:45:41.643399 tst switch_tch_pdch.py: using CellId 22662 17:45:41.767229 tst switch_tch_pdch.py: using BVCI 22663 17:45:41.883029 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:41.894620 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:41.905916 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:41.917216 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:41.928528 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:41.939894 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:41.951322 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:45:41.962642 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:45:42.079317 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:45:42.198043 tst switch_tch_pdch.py:51: start network... 17:45:42.398526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:42.837309 run create_hlr_db(pid=29771): Launched 17:45:42.953647 bus /gobi_6: Setting Powered False 17:45:44.014249 run create_hlr_db(pid=29771): Terminated: ok {rc=0} 17:45:44.426156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29773): Launched 17:45:44.748627 run osmo-hlr_10.42.42.2(pid=29774): Launched 17:45:44.871707 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:45.393756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29776): Launched 17:45:45.713788 run osmo-stp_10.42.42.5(pid=29777): Launched 17:45:45.843217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:45:46.475890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29779): Launched 17:45:46.606817 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:45:46.879528 run patchelf(pid=29780): Launched 17:45:47.071518 run osmo-stp_10.42.42.5(pid=29777): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29777)] 17:45:47.208807 run osmo-stp_10.42.42.5(pid=29777): stdout: | (launched: 2022-12-09_17:45:45.655890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:47.346741 run osmo-stp_10.42.42.5(pid=29777): stderr: | 20221209174545867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174545867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174545867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174545868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174545868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174545868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174545868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:47.483891 run osmo-stp_10.42.42.5(pid=29777): stdout: | (launched: 2022-12-09_17:45:45.655890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:47.614964 run osmo-stp_10.42.42.5(pid=29777): stderr: | 20221209174545867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174545867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174545867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174545868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174545868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174545868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174545868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:47.769719 run patchelf(pid=29780): Terminating (SIGINT) 17:45:47.948852 run patchelf(pid=29780): Terminated: ok {rc=0} 17:45:48.078357 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29777): Process ended prematurely: osmo-stp_10.42.42.5(pid=29777) [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29777)] [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:45:48.088639 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 17:45:48.116893 run osmo-hlr_10.42.42.2(pid=29774): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29774)] 17:45:48.167294 run osmo-hlr_10.42.42.2(pid=29774): stdout: | (launched: 2022-12-09_17:45:44.690243) 17:45:48.219240 run osmo-hlr_10.42.42.2(pid=29774): stderr: | 20221209174544891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174544891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174544891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174544891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174544891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174544892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174544905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174544913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174544913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174544914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:48.271557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29773): Terminating (SIGTERM) 17:45:48.313821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29776): Terminating (SIGTERM) 17:45:48.356134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29779): Terminating (SIGTERM) 17:45:48.398908 --- ParallelTerminationStrategy: PID 29773 died... 17:45:48.419259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29773): Terminated: ok {rc=0} 17:45:48.466499 --- ParallelTerminationStrategy: PID 29776 died... 17:45:48.486397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29776): Terminated: ok {rc=0} 17:45:48.533264 --- ParallelTerminationStrategy: PID 29779 died... 17:45:48.553164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29779): Terminated: ok {rc=0} 17:45:48.642360 bus /gobi_0: Setting Powered False 17:45:49.743639 bus /gobi_0: Setting Powered False 17:45:50.861483 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_sms:trx-umtrx --------------------------------------------------------------------- 17:45:52.114117 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:52.119069 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:45:52.152646 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 17:45:52.159669 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 17:45:52.214004 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:45:52.247431 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 17:45:52.254424 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 17:45:52.790753 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 17:45:52.795807 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 17:45:52.806959 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 17:45:52.854756 tst mo_mt_sms.py: using LAC 22663 17:45:52.972438 tst mo_mt_sms.py: using RAC 223 17:45:53.089370 tst mo_mt_sms.py: using CellId 22663 17:45:53.206247 tst mo_mt_sms.py: using BVCI 22664 17:45:53.315947 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:45:53.428066 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:45:53.540162 tst mo_mt_sms.py:9: start nitb and bts... 17:45:53.742947 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:45:54.355188 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29784): Launched 17:45:54.655118 run osmo-nitb_10.42.42.2(pid=29785): Launched 17:45:54.821949 run osmo-nitb_10.42.42.2(pid=29785): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29785)] 17:45:54.956584 run osmo-nitb_10.42.42.2(pid=29785): stdout: | (launched: 2022-12-09_17:45:54.599973) 17:45:55.092907 run osmo-nitb_10.42.42.2(pid=29785): stderr: | (launched: 2022-12-09_17:45:54.644753) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:45:55.229452 run osmo-nitb_10.42.42.2(pid=29785): stdout: | (launched: 2022-12-09_17:45:54.599973) 17:45:55.359916 run osmo-nitb_10.42.42.2(pid=29785): stderr: | (launched: 2022-12-09_17:45:54.644753) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29785): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29785) [trial-2362↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29785)] 17:45:55.769051 tst osmo-nitb_10.42.42.2(pid=29785): stdout: | (launched: 2022-12-09_17:45:54.599973) 17:45:55.890254 tst osmo-nitb_10.42.42.2(pid=29785): stderr: | (launched: 2022-12-09_17:45:54.644753) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:45:56.032722 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29785): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29785) [trial-2362↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29785)] [trial-2362↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 17:45:56.041678 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 17:45:56.048488 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29784): Terminating (SIGTERM) 17:45:56.258178 --- ParallelTerminationStrategy: PID 29784 died... 17:45:56.279210 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29784): Terminated: ok {rc=0} 17:45:56.365928 bus /sierra_3: Setting Powered False 17:45:57.465261 bus /sierra_3: Setting Powered False 17:45:58.581141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 sms:trx-umtrx --------------------------------------------------------------------- 17:45:59.816529 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:59.820625 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:45:59.853216 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:45:59.879467 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 17:45:59.929952 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:45:59.961827 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:45:59.987732 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 17:46:00.535706 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 17:46:00.540590 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:00.551174 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 17:46:00.597211 tst mo_mt_sms.py: using LAC 22664 17:46:00.712162 tst mo_mt_sms.py: using RAC 224 17:46:00.827169 tst mo_mt_sms.py: using CellId 22664 17:46:00.974002 tst mo_mt_sms.py: using BVCI 22665 17:46:01.085513 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:01.096476 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:01.107506 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:01.118890 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:01.130047 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:01.141107 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:46:01.276901 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 17:46:01.414156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:01.912581 run create_hlr_db(pid=29790): Launched 17:46:02.063256 bus /sierra_2: Setting Powered False 17:46:03.126813 run create_hlr_db(pid=29790): Terminated: ok {rc=0} 17:46:03.556555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29792): Launched 17:46:03.856450 run osmo-hlr_10.42.42.2(pid=29793): Launched 17:46:03.970195 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:04.484227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29795): Launched 17:46:04.783612 run osmo-stp_10.42.42.5(pid=29796): Launched 17:46:04.898258 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:05.438515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29798): Launched 17:46:05.738035 run osmo-msc_10.42.42.6(pid=29799): Launched 17:46:05.904690 run osmo-stp_10.42.42.5(pid=29796): ERR: Terminated: ERROR {rc=1} [trial-2362↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29796)] 17:46:06.031787 run osmo-stp_10.42.42.5(pid=29796): stdout: | (launched: 2022-12-09_17:46:04.728775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:06.159452 run osmo-stp_10.42.42.5(pid=29796): stderr: | 20221209174604898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174604898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174604899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174604899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174604899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174604900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174604900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:06.284268 run osmo-stp_10.42.42.5(pid=29796): stdout: | (launched: 2022-12-09_17:46:04.728775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:06.403450 run osmo-stp_10.42.42.5(pid=29796): stderr: | 20221209174604898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174604898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174604899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174604899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174604899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174604900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174604900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:06.546410 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29796): Process ended prematurely: osmo-stp_10.42.42.5(pid=29796) [trial-2362↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29796)] [trial-2362↪sms:trx-umtrx↪mo_mt_sms.py:16] 17:46:06.554908 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 17:46:06.581407 run osmo-hlr_10.42.42.2(pid=29793): ERR: Terminated: ERROR {rc=237} [trial-2362↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29793)] 17:46:06.630196 run osmo-hlr_10.42.42.2(pid=29793): stdout: | (launched: 2022-12-09_17:46:03.801676) 17:46:06.680462 run osmo-hlr_10.42.42.2(pid=29793): stderr: | 20221209174603976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174603977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174603977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174603977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174603977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174603977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174603989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174603998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174603998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174603999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:06.750896 run osmo-msc_10.42.42.6(pid=29799): ERR: Terminated: ERROR {rc=2} [trial-2362↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29799)] 17:46:06.799201 run osmo-msc_10.42.42.6(pid=29799): stdout: | (launched: 2022-12-09_17:46:05.682531) 17:46:06.849206 run osmo-msc_10.42.42.6(pid=29799): stderr: | 20221209174605954 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174605954 DLGLOBAL DEBUG validating counter group 0x7f502b912c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174605954 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174605954 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174605954 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174605955 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174605956 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174605957 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174605957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174605957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:06.899569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29792): Terminating (SIGTERM) 17:46:06.939806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29795): Terminating (SIGTERM) 17:46:06.980313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29798): Terminating (SIGTERM) 17:46:07.021066 --- ParallelTerminationStrategy: PID 29792 died... 17:46:07.040174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29792): Terminated: ok {rc=0} 17:46:07.084894 --- ParallelTerminationStrategy: PID 29795 died... 17:46:07.103953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29795): Terminated: ok {rc=0} 17:46:07.149174 --- ParallelTerminationStrategy: PID 29798 died... 17:46:07.167826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29798): Terminated: ok {rc=0} 17:46:07.252588 bus /sierra_3: Setting Powered False 17:46:08.350468 bus /sierra_3: Setting Powered False 17:46:09.466791 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 17:46:10.694013 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:10.698839 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:46:10.732083 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 17:46:10.739049 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 17:46:10.776657 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:46:10.813184 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 17:46:10.820177 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 17:46:11.334571 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 17:46:11.339706 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 17:46:11.350915 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 17:46:11.399141 tst assert_extension.py: using LAC 22665 17:46:11.524762 tst assert_extension.py: using RAC 225 17:46:11.642900 tst assert_extension.py: using CellId 22665 17:46:11.761410 tst assert_extension.py: using BVCI 22666 17:46:11.877714 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 17:46:11.993864 tst assert_extension.py:10: start nitb and bts... 17:46:12.194102 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:46:12.806325 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29804): Launched 17:46:13.107124 run osmo-nitb_10.42.42.2(pid=29805): Launched 17:46:13.273359 run osmo-nitb_10.42.42.2(pid=29805): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29805)] 17:46:13.408124 run osmo-nitb_10.42.42.2(pid=29805): stdout: | (launched: 2022-12-09_17:46:13.052337) 17:46:13.543958 run osmo-nitb_10.42.42.2(pid=29805): stderr: | (launched: 2022-12-09_17:46:13.097125) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:46:13.680497 run osmo-nitb_10.42.42.2(pid=29805): stdout: | (launched: 2022-12-09_17:46:13.052337) 17:46:13.810848 run osmo-nitb_10.42.42.2(pid=29805): stderr: | (launched: 2022-12-09_17:46:13.097125) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29805): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29805) [trial-2362↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29805)] 17:46:14.220933 tst osmo-nitb_10.42.42.2(pid=29805): stdout: | (launched: 2022-12-09_17:46:13.052337) 17:46:14.342389 tst osmo-nitb_10.42.42.2(pid=29805): stderr: | (launched: 2022-12-09_17:46:13.097125) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:46:14.485262 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29805): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29805) [trial-2362↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29805)] [trial-2362↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 17:46:14.494055 tst assert_extension.py:12: Test FAILED (3.1 sec) 17:46:14.501081 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29804): Terminating (SIGTERM) 17:46:14.711652 --- ParallelTerminationStrategy: PID 29804 died... 17:46:14.733421 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29804): Terminated: ok {rc=0} 17:46:14.820506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 ussd:trx-umtrx --------------------------------------------------------------------- 17:46:16.025182 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:16.029662 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:46:16.065909 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:46:16.094667 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 17:46:16.131498 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:46:16.177252 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:46:16.213872 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 17:46:16.737100 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 17:46:16.746768 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:16.762057 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 17:46:16.821311 tst assert_extension.py: using LAC 22666 17:46:16.942363 tst assert_extension.py: using RAC 226 17:46:17.094135 tst assert_extension.py: using CellId 22666 17:46:17.261319 tst assert_extension.py: using BVCI 22667 17:46:17.383522 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:17.394634 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:17.405579 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:17.416321 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:17.427217 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:46:17.438161 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 17:46:17.557390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:18.049585 run create_hlr_db(pid=29809): Launched 17:46:18.180205 bus /sierra_2: Setting Powered False 17:46:19.243542 run create_hlr_db(pid=29809): Terminated: ok {rc=0} 17:46:19.672321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29811): Launched 17:46:19.970841 run osmo-hlr_10.42.42.2(pid=29812): Launched 17:46:20.084488 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:20.602116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29814): Launched 17:46:20.901077 run osmo-stp_10.42.42.5(pid=29815): Launched 17:46:21.015353 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:21.554427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29817): Launched 17:46:21.852146 run osmo-msc_10.42.42.6(pid=29818): Launched 17:46:22.019819 run osmo-stp_10.42.42.5(pid=29815): ERR: Terminated: ERROR {rc=1} [trial-2362↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29815)] 17:46:22.146726 run osmo-stp_10.42.42.5(pid=29815): stdout: | (launched: 2022-12-09_17:46:20.845441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:22.273551 run osmo-stp_10.42.42.5(pid=29815): stderr: | 20221209174621015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174621015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174621016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174621016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174621018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174621018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174621018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:22.397794 run osmo-stp_10.42.42.5(pid=29815): stdout: | (launched: 2022-12-09_17:46:20.845441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:22.516269 run osmo-stp_10.42.42.5(pid=29815): stderr: | 20221209174621015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174621015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174621016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174621016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174621018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174621018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174621018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:22.658302 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29815): Process ended prematurely: osmo-stp_10.42.42.5(pid=29815) [trial-2362↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29815)] [trial-2362↪ussd:trx-umtrx↪assert_extension.py:17] 17:46:22.666792 tst assert_extension.py:17: Test FAILED (5.9 sec) 17:46:22.693816 run osmo-hlr_10.42.42.2(pid=29812): ERR: Terminated: ERROR {rc=237} [trial-2362↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29812)] 17:46:22.742270 run osmo-hlr_10.42.42.2(pid=29812): stdout: | (launched: 2022-12-09_17:46:19.916294) 17:46:22.792148 run osmo-hlr_10.42.42.2(pid=29812): stderr: | 20221209174620094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174620094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174620094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174620094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174620094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174620094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174620133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174620142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174620142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174620142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:22.861735 run osmo-msc_10.42.42.6(pid=29818): ERR: Terminated: ERROR {rc=2} [trial-2362↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29818)] 17:46:22.909977 run osmo-msc_10.42.42.6(pid=29818): stdout: | (launched: 2022-12-09_17:46:21.797514) 17:46:22.960128 run osmo-msc_10.42.42.6(pid=29818): stderr: | 20221209174622070 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174622071 DLGLOBAL DEBUG validating counter group 0x7feb6146dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174622071 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174622071 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174622071 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174622071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174622075 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174622076 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174622076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174622076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:23.010458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29811): Terminating (SIGTERM) 17:46:23.050881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29814): Terminating (SIGTERM) 17:46:23.091219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29817): Terminating (SIGTERM) 17:46:23.132216 --- ParallelTerminationStrategy: PID 29811 died... 17:46:23.151526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29811): Terminated: ok {rc=0} 17:46:23.196217 --- ParallelTerminationStrategy: PID 29814 died... 17:46:23.214849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29814): Terminated: ok {rc=0} 17:46:23.259246 --- ParallelTerminationStrategy: PID 29817 died... 17:46:23.277892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29817): Terminated: ok {rc=0} 17:46:23.362092 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:46:24.576635 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:24.584307 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:46:24.619480 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:46:24.647350 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:46:24.702441 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:46:24.736246 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:46:24.763274 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:46:25.313901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:46:25.367331 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:25.378892 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:46:25.453573 tst mo_mt_call.py: using LAC 22667 17:46:25.582564 tst mo_mt_call.py: using RAC 227 17:46:25.711762 tst mo_mt_call.py: using CellId 22667 17:46:25.851593 tst mo_mt_call.py: using BVCI 22668 17:46:25.971334 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:25.983064 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:25.994421 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:26.006360 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:26.018245 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:26.030103 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:26.146786 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:26.260523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:26.732417 run create_hlr_db(pid=29823): Launched 17:46:26.850313 bus /sierra_2: Setting Powered False 17:46:27.910843 run create_hlr_db(pid=29823): Terminated: ok {rc=0} 17:46:28.336534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29825): Launched 17:46:28.645960 run osmo-hlr_10.42.42.2(pid=29826): Launched 17:46:28.764114 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:29.302956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29828): Launched 17:46:29.608636 run osmo-stp_10.42.42.5(pid=29829): Launched 17:46:29.725218 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:30.276928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29831): Launched 17:46:30.582270 run osmo-msc_10.42.42.6(pid=29832): Launched 17:46:30.754481 run osmo-stp_10.42.42.5(pid=29829): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29829)] 17:46:30.947740 run osmo-stp_10.42.42.5(pid=29829): stdout: | (launched: 2022-12-09_17:46:29.553113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:31.127453 run osmo-stp_10.42.42.5(pid=29829): stderr: | 20221209174629724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174629724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174629724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174629725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174629725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174629725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174629726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:31.258958 run osmo-stp_10.42.42.5(pid=29829): stdout: | (launched: 2022-12-09_17:46:29.553113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:31.384159 run osmo-stp_10.42.42.5(pid=29829): stderr: | 20221209174629724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174629724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174629724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174629725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174629725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174629725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174629726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:31.532694 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29829): Process ended prematurely: osmo-stp_10.42.42.5(pid=29829) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29829)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:46:31.543174 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:46:31.572170 run osmo-hlr_10.42.42.2(pid=29826): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29826)] 17:46:31.623801 run osmo-hlr_10.42.42.2(pid=29826): stdout: | (launched: 2022-12-09_17:46:28.586511) 17:46:31.676054 run osmo-hlr_10.42.42.2(pid=29826): stderr: | 20221209174628761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174628761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174628761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174628761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174628761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174628761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174628775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174628785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174628785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174628785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:31.748653 run osmo-msc_10.42.42.6(pid=29832): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29832)] 17:46:31.799156 run osmo-msc_10.42.42.6(pid=29832): stdout: | (launched: 2022-12-09_17:46:30.526405) 17:46:31.851391 run osmo-msc_10.42.42.6(pid=29832): stderr: | 20221209174630798 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174630798 DLGLOBAL DEBUG validating counter group 0x7fee1ea19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174630798 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174630799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174630799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174630799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174630801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174630801 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174630801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174630801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:31.904147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29825): Terminating (SIGTERM) 17:46:31.947257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29828): Terminating (SIGTERM) 17:46:31.991240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29831): Terminating (SIGTERM) 17:46:32.033914 --- ParallelTerminationStrategy: PID 29825 died... 17:46:32.053650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29825): Terminated: ok {rc=0} 17:46:32.101229 --- ParallelTerminationStrategy: PID 29828 died... 17:46:32.120725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29828): Terminated: ok {rc=0} 17:46:32.168142 --- ParallelTerminationStrategy: PID 29831 died... 17:46:32.187636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29831): Terminated: ok {rc=0} 17:46:32.277321 bus /sierra_3: Setting Powered False 17:46:33.377055 bus /sierra_3: Setting Powered False 17:46:34.493810 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:46:35.644659 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:35.657282 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:46:35.727284 tst mo_mt_call_osmux.py: using LAC 22668 17:46:35.854615 tst mo_mt_call_osmux.py: using RAC 228 17:46:35.981396 tst mo_mt_call_osmux.py: using CellId 22668 17:46:36.108773 tst mo_mt_call_osmux.py: using BVCI 22669 17:46:36.226935 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:36.238553 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:36.249954 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:36.261459 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:36.272761 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:46:36.284104 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:36.399166 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:46:36.518424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:37.020528 run create_hlr_db(pid=29834): Launched 17:46:37.144533 bus /sierra_2: Setting Powered False 17:46:38.205110 run create_hlr_db(pid=29834): Terminated: ok {rc=0} 17:46:38.649925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29836): Launched 17:46:38.976017 run osmo-hlr_10.42.42.2(pid=29837): Launched 17:46:39.100144 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:39.658153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29839): Launched 17:46:39.982113 run osmo-stp_10.42.42.5(pid=29840): Launched 17:46:40.107269 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:40.694606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29842): Launched 17:46:41.020843 run osmo-msc_10.42.42.6(pid=29843): Launched 17:46:41.203784 run osmo-stp_10.42.42.5(pid=29840): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29840)] 17:46:41.340257 run osmo-stp_10.42.42.5(pid=29840): stdout: | (launched: 2022-12-09_17:46:39.923389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:41.477533 run osmo-stp_10.42.42.5(pid=29840): stderr: | 20221209174640116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174640116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174640117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174640117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174640117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174640118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174640118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:41.614129 run osmo-stp_10.42.42.5(pid=29840): stdout: | (launched: 2022-12-09_17:46:39.923389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:41.742547 run osmo-stp_10.42.42.5(pid=29840): stderr: | 20221209174640116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174640116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174640117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174640117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174640117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174640118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174640118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:41.896588 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29840): Process ended prematurely: osmo-stp_10.42.42.5(pid=29840) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29840)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:46:41.906454 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:46:41.934482 run osmo-hlr_10.42.42.2(pid=29837): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29837)] 17:46:41.984399 run osmo-hlr_10.42.42.2(pid=29837): stdout: | (launched: 2022-12-09_17:46:38.916855) 17:46:42.036257 run osmo-hlr_10.42.42.2(pid=29837): stderr: | 20221209174639116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174639116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174639116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174639116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174639116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174639116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174639129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174639138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174639139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174639139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:42.108808 run osmo-msc_10.42.42.6(pid=29843): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29843)] 17:46:42.158844 run osmo-msc_10.42.42.6(pid=29843): stdout: | (launched: 2022-12-09_17:46:40.961595) 17:46:42.210702 run osmo-msc_10.42.42.6(pid=29843): stderr: | 20221209174641286 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174641286 DLGLOBAL DEBUG validating counter group 0x7f9acb8f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174641286 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174641286 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174641286 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174641286 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174641288 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174641288 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174641289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174641289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:42.262806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29836): Terminating (SIGTERM) 17:46:42.304507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29839): Terminating (SIGTERM) 17:46:42.346339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29842): Terminating (SIGTERM) 17:46:42.388423 --- ParallelTerminationStrategy: PID 29836 died... 17:46:42.408520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29836): Terminated: ok {rc=0} 17:46:42.455280 --- ParallelTerminationStrategy: PID 29839 died... 17:46:42.475072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29839): Terminated: ok {rc=0} 17:46:42.521995 --- ParallelTerminationStrategy: PID 29842 died... 17:46:42.541663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29842): Terminated: ok {rc=0} 17:46:42.630095 bus /sierra_3: Setting Powered False 17:46:43.728884 bus /sierra_3: Setting Powered False 17:46:44.845292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:46:46.127017 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:46.138362 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:46:46.181634 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:46:46.216798 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:46:46.281183 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:46:46.323295 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:46:46.359428 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:46:46.902865 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:46:46.975152 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:46.991520 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:46:47.076926 tst mo_mt_call.py: using LAC 22669 17:46:47.204790 tst mo_mt_call.py: using RAC 229 17:46:47.331101 tst mo_mt_call.py: using CellId 22669 17:46:47.459251 tst mo_mt_call.py: using BVCI 22670 17:46:47.577271 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:47.589009 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:47.600399 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:47.611845 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:47.623393 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:47.634734 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:46:47.756295 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:46:47.875325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:48.378487 run create_hlr_db(pid=29848): Launched 17:46:48.511695 bus /sierra_2: Setting Powered False 17:46:49.576208 run create_hlr_db(pid=29848): Terminated: ok {rc=0} 17:46:50.011003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29850): Launched 17:46:50.315871 run osmo-hlr_10.42.42.2(pid=29851): Launched 17:46:50.432611 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:50.956316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29853): Launched 17:46:51.261720 run osmo-stp_10.42.42.5(pid=29854): Launched 17:46:51.378980 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:51.931213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29856): Launched 17:46:52.236645 run osmo-msc_10.42.42.6(pid=29857): Launched 17:46:52.407142 run osmo-stp_10.42.42.5(pid=29854): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29854)] 17:46:52.536343 run osmo-stp_10.42.42.5(pid=29854): stdout: | (launched: 2022-12-09_17:46:51.206360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:52.665893 run osmo-stp_10.42.42.5(pid=29854): stderr: | 20221209174651374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174651374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174651374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174651374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174651377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174651377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174651377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:52.792631 run osmo-stp_10.42.42.5(pid=29854): stdout: | (launched: 2022-12-09_17:46:51.206360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:52.913408 run osmo-stp_10.42.42.5(pid=29854): stderr: | 20221209174651374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174651374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174651374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174651374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174651377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174651377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174651377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:53.058253 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29854): Process ended prematurely: osmo-stp_10.42.42.5(pid=29854) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29854)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:46:53.067292 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:46:53.094404 run osmo-hlr_10.42.42.2(pid=29851): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29851)] 17:46:53.143116 run osmo-hlr_10.42.42.2(pid=29851): stdout: | (launched: 2022-12-09_17:46:50.260413) 17:46:53.192927 run osmo-hlr_10.42.42.2(pid=29851): stderr: | 20221209174650438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174650438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174650438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174650438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174650438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174650438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174650464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174650474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174650474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174650474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:53.262168 run osmo-msc_10.42.42.6(pid=29857): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29857)] 17:46:53.310301 run osmo-msc_10.42.42.6(pid=29857): stdout: | (launched: 2022-12-09_17:46:52.180803) 17:46:53.360143 run osmo-msc_10.42.42.6(pid=29857): stderr: | 20221209174652453 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174652453 DLGLOBAL DEBUG validating counter group 0x7f9c56469c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174652454 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174652454 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174652454 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174652454 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174652457 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174652458 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174652458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174652458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:53.410262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29850): Terminating (SIGTERM) 17:46:53.450633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29853): Terminating (SIGTERM) 17:46:53.491069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29856): Terminating (SIGTERM) 17:46:53.531903 --- ParallelTerminationStrategy: PID 29850 died... 17:46:53.551108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29850): Terminated: ok {rc=0} 17:46:53.596028 --- ParallelTerminationStrategy: PID 29853 died... 17:46:53.614853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29853): Terminated: ok {rc=0} 17:46:53.659462 --- ParallelTerminationStrategy: PID 29856 died... 17:46:53.678236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29856): Terminated: ok {rc=0} 17:46:53.765297 bus /sierra_3: Setting Powered False 17:46:54.866092 bus /sierra_3: Setting Powered False 17:46:55.983703 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:46:57.132023 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:57.144245 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:46:57.214429 tst mo_mt_call_osmux.py: using LAC 22670 17:46:57.337133 tst mo_mt_call_osmux.py: using RAC 230 17:46:57.459311 tst mo_mt_call_osmux.py: using CellId 22670 17:46:57.587873 tst mo_mt_call_osmux.py: using BVCI 22671 17:46:57.701120 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:57.712438 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:57.723599 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:57.735116 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:57.746836 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:46:57.758398 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:46:57.881349 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:46:58.004640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:58.509232 run create_hlr_db(pid=29859): Launched 17:46:58.634369 bus /sierra_2: Setting Powered False 17:46:59.695111 run create_hlr_db(pid=29859): Terminated: ok {rc=0} 17:47:00.120811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29861): Launched 17:47:00.426845 run osmo-hlr_10.42.42.2(pid=29862): Launched 17:47:00.543499 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:01.130357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29864): Launched 17:47:01.481607 run osmo-stp_10.42.42.5(pid=29865): Launched 17:47:01.734165 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:02.414115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29867): Launched 17:47:02.745184 run osmo-msc_10.42.42.6(pid=29868): Launched 17:47:02.927873 run osmo-stp_10.42.42.5(pid=29865): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29865)] 17:47:03.065143 run osmo-stp_10.42.42.5(pid=29865): stdout: | (launched: 2022-12-09_17:47:01.417392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:03.203881 run osmo-stp_10.42.42.5(pid=29865): stderr: | 20221209174701712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174701721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174701721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174701722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174701722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174701722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174701722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:03.340627 run osmo-stp_10.42.42.5(pid=29865): stdout: | (launched: 2022-12-09_17:47:01.417392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:03.469985 run osmo-stp_10.42.42.5(pid=29865): stderr: | 20221209174701712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174701721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174701721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174701722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174701722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174701722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174701722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:03.624704 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29865): Process ended prematurely: osmo-stp_10.42.42.5(pid=29865) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29865)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:47:03.634741 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:47:03.662850 run osmo-hlr_10.42.42.2(pid=29862): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29862)] 17:47:03.713553 run osmo-hlr_10.42.42.2(pid=29862): stdout: | (launched: 2022-12-09_17:47:00.371142) 17:47:03.765543 run osmo-hlr_10.42.42.2(pid=29862): stderr: | 20221209174700547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174700547 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174700547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174700547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174700547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174700547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174700560 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174700568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174700568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174700568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:03.838023 run osmo-msc_10.42.42.6(pid=29868): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29868)] 17:47:03.888062 run osmo-msc_10.42.42.6(pid=29868): stdout: | (launched: 2022-12-09_17:47:02.685961) 17:47:03.939957 run osmo-msc_10.42.42.6(pid=29868): stderr: | 20221209174703010 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174703010 DLGLOBAL DEBUG validating counter group 0x7fa6c79d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174703010 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174703010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174703010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174703010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174703012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174703012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174703012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174703013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:03.992701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29861): Terminating (SIGTERM) 17:47:04.034484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29864): Terminating (SIGTERM) 17:47:04.076363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29867): Terminating (SIGTERM) 17:47:04.118643 --- ParallelTerminationStrategy: PID 29861 died... 17:47:04.138855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29861): Terminated: ok {rc=0} 17:47:04.185555 --- ParallelTerminationStrategy: PID 29864 died... 17:47:04.205340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29864): Terminated: ok {rc=0} 17:47:04.251450 --- ParallelTerminationStrategy: PID 29867 died... 17:47:04.270989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29867): Terminated: ok {rc=0} 17:47:04.359054 bus /sierra_3: Setting Powered False 17:47:05.458564 bus /sierra_3: Setting Powered False 17:47:06.574136 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:47:07.826304 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:47:07.833290 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:47:07.866563 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:47:07.893623 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:47:07.948021 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:47:07.981036 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:47:08.008124 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:47:08.558753 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:47:08.611107 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:08.622649 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:47:08.692780 tst mo_mt_call.py: using LAC 22671 17:47:08.820490 tst mo_mt_call.py: using RAC 231 17:47:08.947765 tst mo_mt_call.py: using CellId 22671 17:47:09.076269 tst mo_mt_call.py: using BVCI 22672 17:47:09.194875 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:09.206394 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:09.217752 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:09.229420 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:09.240929 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:09.252368 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:09.367672 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:09.487760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:09.993713 run create_hlr_db(pid=29873): Launched 17:47:10.128158 bus /sierra_2: Setting Powered False 17:47:11.192329 run create_hlr_db(pid=29873): Terminated: ok {rc=0} 17:47:11.628600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29875): Launched 17:47:11.935896 run osmo-hlr_10.42.42.2(pid=29876): Launched 17:47:12.052859 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:12.588500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29878): Launched 17:47:12.893600 run osmo-stp_10.42.42.5(pid=29879): Launched 17:47:13.010473 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:13.560795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29881): Launched 17:47:13.866429 run osmo-msc_10.42.42.6(pid=29882): Launched 17:47:14.039094 run osmo-stp_10.42.42.5(pid=29879): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29879)] 17:47:14.168735 run osmo-stp_10.42.42.5(pid=29879): stdout: | (launched: 2022-12-09_17:47:12.838137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:14.298907 run osmo-stp_10.42.42.5(pid=29879): stderr: | 20221209174713011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174713011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174713011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174713012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174713012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174713012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174713012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:14.427000 run osmo-stp_10.42.42.5(pid=29879): stdout: | (launched: 2022-12-09_17:47:12.838137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:14.548722 run osmo-stp_10.42.42.5(pid=29879): stderr: | 20221209174713011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174713011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174713011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174713012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174713012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174713012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174713012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:14.694330 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29879): Process ended prematurely: osmo-stp_10.42.42.5(pid=29879) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29879)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:47:14.703651 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:47:14.731567 run osmo-hlr_10.42.42.2(pid=29876): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29876)] 17:47:14.780663 run osmo-hlr_10.42.42.2(pid=29876): stdout: | (launched: 2022-12-09_17:47:11.880018) 17:47:14.831530 run osmo-hlr_10.42.42.2(pid=29876): stderr: | 20221209174712057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174712057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174712057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174712057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174712057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174712057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174712069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174712078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174712078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174712078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:14.901990 run osmo-msc_10.42.42.6(pid=29882): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29882)] 17:47:14.950583 run osmo-msc_10.42.42.6(pid=29882): stdout: | (launched: 2022-12-09_17:47:13.810378) 17:47:15.000851 run osmo-msc_10.42.42.6(pid=29882): stderr: | 20221209174714083 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174714083 DLGLOBAL DEBUG validating counter group 0x7fe53065fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174714084 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174714084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174714084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174714084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174714086 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174714086 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174714086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174714086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:15.051540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29875): Terminating (SIGTERM) 17:47:15.092458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29878): Terminating (SIGTERM) 17:47:15.133663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29881): Terminating (SIGTERM) 17:47:15.174689 --- ParallelTerminationStrategy: PID 29875 died... 17:47:15.194122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29875): Terminated: ok {rc=0} 17:47:15.239681 --- ParallelTerminationStrategy: PID 29878 died... 17:47:15.258695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29878): Terminated: ok {rc=0} 17:47:15.304256 --- ParallelTerminationStrategy: PID 29881 died... 17:47:15.323362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29881): Terminated: ok {rc=0} 17:47:15.411323 bus /sierra_3: Setting Powered False 17:47:16.524040 bus /sierra_3: Setting Powered False 17:47:17.655443 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:47:18.806905 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:18.819138 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:47:18.894196 tst mo_mt_call_osmux.py: using LAC 22672 17:47:19.021837 tst mo_mt_call_osmux.py: using RAC 232 17:47:19.150943 tst mo_mt_call_osmux.py: using CellId 22672 17:47:19.278931 tst mo_mt_call_osmux.py: using BVCI 22673 17:47:19.398093 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:19.409681 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:19.421016 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:19.432338 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:19.443936 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:47:19.455287 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:19.572311 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:47:19.693492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:20.199128 run create_hlr_db(pid=29884): Launched 17:47:20.333187 bus /sierra_2: Setting Powered False 17:47:21.398162 run create_hlr_db(pid=29884): Terminated: ok {rc=0} 17:47:21.853589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29886): Launched 17:47:22.181315 run osmo-hlr_10.42.42.2(pid=29887): Launched 17:47:22.307263 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:22.870730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29889): Launched 17:47:23.198900 run osmo-stp_10.42.42.5(pid=29890): Launched 17:47:23.324090 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:23.914103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29892): Launched 17:47:24.240844 run osmo-msc_10.42.42.6(pid=29893): Launched 17:47:24.421027 run osmo-stp_10.42.42.5(pid=29890): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29890)] 17:47:24.558056 run osmo-stp_10.42.42.5(pid=29890): stdout: | (launched: 2022-12-09_17:47:23.139473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:24.695810 run osmo-stp_10.42.42.5(pid=29890): stderr: | 20221209174723332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174723332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174723332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174723332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174723333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174723333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174723333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:24.832697 run osmo-stp_10.42.42.5(pid=29890): stdout: | (launched: 2022-12-09_17:47:23.139473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:24.961975 run osmo-stp_10.42.42.5(pid=29890): stderr: | 20221209174723332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174723332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174723332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174723332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174723333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174723333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174723333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:25.116919 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29890): Process ended prematurely: osmo-stp_10.42.42.5(pid=29890) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29890)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:47:25.126739 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:47:25.155376 run osmo-hlr_10.42.42.2(pid=29887): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29887)] 17:47:25.206298 run osmo-hlr_10.42.42.2(pid=29887): stdout: | (launched: 2022-12-09_17:47:22.121674) 17:47:25.258930 run osmo-hlr_10.42.42.2(pid=29887): stderr: | 20221209174722321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174722321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174722322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174722322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174722322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174722322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174722334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174722342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174722343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174722343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:25.332522 run osmo-msc_10.42.42.6(pid=29893): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29893)] 17:47:25.383745 run osmo-msc_10.42.42.6(pid=29893): stdout: | (launched: 2022-12-09_17:47:24.181634) 17:47:25.436323 run osmo-msc_10.42.42.6(pid=29893): stderr: | 20221209174724505 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174724505 DLGLOBAL DEBUG validating counter group 0x7ff6008cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174724505 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174724505 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174724505 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174724505 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174724507 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174724507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174724508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174724508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:25.489099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29886): Terminating (SIGTERM) 17:47:25.531466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29889): Terminating (SIGTERM) 17:47:25.573939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29892): Terminating (SIGTERM) 17:47:25.616734 --- ParallelTerminationStrategy: PID 29886 died... 17:47:25.637146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29886): Terminated: ok {rc=0} 17:47:25.683859 --- ParallelTerminationStrategy: PID 29889 died... 17:47:25.703594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29889): Terminated: ok {rc=0} 17:47:25.750303 --- ParallelTerminationStrategy: PID 29892 died... 17:47:25.770093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29892): Terminated: ok {rc=0} 17:47:25.859743 bus /sierra_3: Setting Powered False 17:47:26.959998 bus /sierra_3: Setting Powered False 17:47:28.079870 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:47:29.331706 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:47:29.339059 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:47:29.372140 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:47:29.399635 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:47:29.454019 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:47:29.487430 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:47:29.514575 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:47:30.065323 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:47:30.117076 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:30.128516 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:47:30.199076 tst mo_mt_call.py: using LAC 22673 17:47:30.328537 tst mo_mt_call.py: using RAC 233 17:47:30.455684 tst mo_mt_call.py: using CellId 22673 17:47:30.582841 tst mo_mt_call.py: using BVCI 22674 17:47:30.700779 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:30.712323 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:30.723788 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:30.735103 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:30.746594 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:30.757919 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:30.891763 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:31.043794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:31.536359 run create_hlr_db(pid=29900): Launched 17:47:31.695894 bus /sierra_2: Setting Powered False 17:47:32.757134 run create_hlr_db(pid=29900): Terminated: ok {rc=0} 17:47:33.203055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29902): Launched 17:47:33.530737 run osmo-hlr_10.42.42.2(pid=29903): Launched 17:47:33.656384 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:34.216420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29905): Launched 17:47:34.543089 run osmo-stp_10.42.42.5(pid=29906): Launched 17:47:34.669081 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:35.257880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29908): Launched 17:47:35.585241 run osmo-msc_10.42.42.6(pid=29909): Launched 17:47:35.767841 run osmo-stp_10.42.42.5(pid=29906): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29906)] 17:47:35.908210 run osmo-stp_10.42.42.5(pid=29906): stdout: | (launched: 2022-12-09_17:47:34.483757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:36.046083 run osmo-stp_10.42.42.5(pid=29906): stderr: | 20221209174734677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174734677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174734677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174734678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174734678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174734678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174734678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:36.183558 run osmo-stp_10.42.42.5(pid=29906): stdout: | (launched: 2022-12-09_17:47:34.483757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:36.312933 run osmo-stp_10.42.42.5(pid=29906): stderr: | 20221209174734677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174734677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174734677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174734678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174734678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174734678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174734678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:36.468318 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29906): Process ended prematurely: osmo-stp_10.42.42.5(pid=29906) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29906)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:47:36.478137 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:47:36.506264 run osmo-hlr_10.42.42.2(pid=29903): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29903)] 17:47:36.556364 run osmo-hlr_10.42.42.2(pid=29903): stdout: | (launched: 2022-12-09_17:47:33.471504) 17:47:36.608384 run osmo-hlr_10.42.42.2(pid=29903): stderr: | 20221209174733673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174733673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174733673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174733673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174733673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174733673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174733686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174733694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174733694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174733694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:36.680600 run osmo-msc_10.42.42.6(pid=29909): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29909)] 17:47:36.730854 run osmo-msc_10.42.42.6(pid=29909): stdout: | (launched: 2022-12-09_17:47:35.526058) 17:47:36.782730 run osmo-msc_10.42.42.6(pid=29909): stderr: | 20221209174735855 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174735855 DLGLOBAL DEBUG validating counter group 0x7f3b56bb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174735855 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174735856 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174735857 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174735857 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174735862 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174735862 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174735863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174735863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:36.835037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29902): Terminating (SIGTERM) 17:47:36.876630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29905): Terminating (SIGTERM) 17:47:36.918352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29908): Terminating (SIGTERM) 17:47:36.960354 --- ParallelTerminationStrategy: PID 29902 died... 17:47:36.980388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29902): Terminated: ok {rc=0} 17:47:37.027142 --- ParallelTerminationStrategy: PID 29905 died... 17:47:37.046848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29905): Terminated: ok {rc=0} 17:47:37.092884 --- ParallelTerminationStrategy: PID 29908 died... 17:47:37.112835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29908): Terminated: ok {rc=0} 17:47:37.201564 bus /sierra_3: Setting Powered False 17:47:38.300189 bus /sierra_3: Setting Powered False 17:47:39.416616 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:47:40.567369 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:40.579557 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:47:40.649748 tst mo_mt_call_osmux.py: using LAC 22674 17:47:40.778768 tst mo_mt_call_osmux.py: using RAC 234 17:47:40.907663 tst mo_mt_call_osmux.py: using CellId 22674 17:47:41.035514 tst mo_mt_call_osmux.py: using BVCI 22675 17:47:41.153932 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:41.165481 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:41.176861 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:41.188205 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:41.199767 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:47:41.211060 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:41.327318 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:47:41.445302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:41.916930 run create_hlr_db(pid=29911): Launched 17:47:42.034115 bus /sierra_2: Setting Powered False 17:47:43.095104 run create_hlr_db(pid=29911): Terminated: ok {rc=0} 17:47:43.520086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29913): Launched 17:47:43.826643 run osmo-hlr_10.42.42.2(pid=29914): Launched 17:47:43.943295 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:44.472403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29916): Launched 17:47:44.778925 run osmo-stp_10.42.42.5(pid=29917): Launched 17:47:44.898866 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:45.450838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29919): Launched 17:47:45.756372 run osmo-msc_10.42.42.6(pid=29920): Launched 17:47:46.066351 run osmo-stp_10.42.42.5(pid=29917): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29917)] 17:47:46.357902 run osmo-stp_10.42.42.5(pid=29917): stdout: | (launched: 2022-12-09_17:47:44.722965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:46.539134 run osmo-stp_10.42.42.5(pid=29917): stderr: | 20221209174744894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174744894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174744894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174744894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174744895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174744895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174744895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:46.680019 run osmo-stp_10.42.42.5(pid=29917): stdout: | (launched: 2022-12-09_17:47:44.722965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:46.833187 run osmo-stp_10.42.42.5(pid=29917): stderr: | 20221209174744894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174744894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174744894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174744894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174744895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174744895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174744895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:47.028332 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29917): Process ended prematurely: osmo-stp_10.42.42.5(pid=29917) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29917)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:47:47.042588 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:47:47.080772 run osmo-hlr_10.42.42.2(pid=29914): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29914)] 17:47:47.141400 run osmo-hlr_10.42.42.2(pid=29914): stdout: | (launched: 2022-12-09_17:47:43.770295) 17:47:47.205950 run osmo-hlr_10.42.42.2(pid=29914): stderr: | 20221209174743948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174743948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174743948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174743948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174743949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174743949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174743961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174743969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174743969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174743969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:47.284104 run osmo-msc_10.42.42.6(pid=29920): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29920)] 17:47:47.335219 run osmo-msc_10.42.42.6(pid=29920): stdout: | (launched: 2022-12-09_17:47:45.700256) 17:47:47.386332 run osmo-msc_10.42.42.6(pid=29920): stderr: | 20221209174746038 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174746038 DLGLOBAL DEBUG validating counter group 0x7fb4b48f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174746038 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174746038 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174746038 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174746039 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174746040 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174746041 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174746041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174746041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:47.437063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29913): Terminating (SIGTERM) 17:47:47.477701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29916): Terminating (SIGTERM) 17:47:47.518483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29919): Terminating (SIGTERM) 17:47:47.559648 --- ParallelTerminationStrategy: PID 29913 died... 17:47:47.579039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29913): Terminated: ok {rc=0} 17:47:47.624434 --- ParallelTerminationStrategy: PID 29916 died... 17:47:47.643559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29916): Terminated: ok {rc=0} 17:47:47.689189 --- ParallelTerminationStrategy: PID 29919 died... 17:47:47.708127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29919): Terminated: ok {rc=0} 17:47:47.796012 bus /sierra_3: Setting Powered False 17:47:48.896150 bus /sierra_3: Setting Powered False 17:47:50.012338 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:47:51.258614 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:47:51.265183 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:47:51.298170 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:47:51.324726 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:47:51.378378 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:47:51.411252 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:47:51.437831 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:47:51.991163 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:47:52.044119 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:52.055375 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:47:52.123893 tst mo_mt_call.py: using LAC 22675 17:47:52.242885 tst mo_mt_call.py: using RAC 235 17:47:52.363168 tst mo_mt_call.py: using CellId 22675 17:47:52.482311 tst mo_mt_call.py: using BVCI 22676 17:47:52.594692 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:52.605858 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:52.616790 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:52.627909 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:52.639001 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:47:52.650228 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:47:52.768559 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:47:52.885786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:53.354873 run create_hlr_db(pid=29925): Launched 17:47:53.470383 bus /sierra_2: Setting Powered False 17:47:54.530419 run create_hlr_db(pid=29925): Terminated: ok {rc=0} 17:47:54.954280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29927): Launched 17:47:55.260457 run osmo-hlr_10.42.42.2(pid=29928): Launched 17:47:55.377684 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:55.915639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29930): Launched 17:47:56.221639 run osmo-stp_10.42.42.5(pid=29931): Launched 17:47:56.339021 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:56.890550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29933): Launched 17:47:57.197700 run osmo-msc_10.42.42.6(pid=29934): Launched 17:47:57.368482 run osmo-stp_10.42.42.5(pid=29931): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29931)] 17:47:57.498224 run osmo-stp_10.42.42.5(pid=29931): stdout: | (launched: 2022-12-09_17:47:56.166006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:57.628230 run osmo-stp_10.42.42.5(pid=29931): stderr: | 20221209174756337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174756338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174756338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174756338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174756339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174756339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174756339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:57.755951 run osmo-stp_10.42.42.5(pid=29931): stdout: | (launched: 2022-12-09_17:47:56.166006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:57.877078 run osmo-stp_10.42.42.5(pid=29931): stderr: | 20221209174756337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174756338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174756338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174756338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174756339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174756339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174756339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:58.022251 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29931): Process ended prematurely: osmo-stp_10.42.42.5(pid=29931) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29931)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:47:58.031482 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:47:58.058884 run osmo-hlr_10.42.42.2(pid=29928): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29928)] 17:47:58.107693 run osmo-hlr_10.42.42.2(pid=29928): stdout: | (launched: 2022-12-09_17:47:55.204752) 17:47:58.158173 run osmo-hlr_10.42.42.2(pid=29928): stderr: | 20221209174755382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174755382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174755382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174755382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174755382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174755382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174755394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174755402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174755403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174755403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:58.228035 run osmo-msc_10.42.42.6(pid=29934): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29934)] 17:47:58.276592 run osmo-msc_10.42.42.6(pid=29934): stdout: | (launched: 2022-12-09_17:47:57.141924) 17:47:58.326844 run osmo-msc_10.42.42.6(pid=29934): stderr: | 20221209174757414 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174757414 DLGLOBAL DEBUG validating counter group 0x7fbb4a7a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174757414 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174757414 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174757415 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174757415 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174757416 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174757417 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174757417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174757417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:58.377444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29927): Terminating (SIGTERM) 17:47:58.418178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29930): Terminating (SIGTERM) 17:47:58.458901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29933): Terminating (SIGTERM) 17:47:58.499743 --- ParallelTerminationStrategy: PID 29927 died... 17:47:58.519140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29927): Terminated: ok {rc=0} 17:47:58.564481 --- ParallelTerminationStrategy: PID 29930 died... 17:47:58.583619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29930): Terminated: ok {rc=0} 17:47:58.628601 --- ParallelTerminationStrategy: PID 29933 died... 17:47:58.647520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29933): Terminated: ok {rc=0} 17:47:58.734417 bus /sierra_3: Setting Powered False 17:47:59.835769 bus /sierra_3: Setting Powered False 17:48:00.960412 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:48:02.114358 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:02.127253 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:48:02.203227 tst mo_mt_call_osmux.py: using LAC 22676 17:48:02.325731 tst mo_mt_call_osmux.py: using RAC 236 17:48:02.443177 tst mo_mt_call_osmux.py: using CellId 22676 17:48:02.561403 tst mo_mt_call_osmux.py: using BVCI 22677 17:48:02.674312 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:02.685627 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:02.696714 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:02.708306 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:02.719737 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:48:02.731037 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:48:02.847191 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:48:02.968356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:03.472225 run create_hlr_db(pid=29936): Launched 17:48:03.605259 bus /sierra_2: Setting Powered False 17:48:04.669821 run create_hlr_db(pid=29936): Terminated: ok {rc=0} 17:48:05.106077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29938): Launched 17:48:05.413704 run osmo-hlr_10.42.42.2(pid=29939): Launched 17:48:05.530242 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:06.071854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29941): Launched 17:48:06.377701 run osmo-stp_10.42.42.5(pid=29942): Launched 17:48:06.494296 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:07.045673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29944): Launched 17:48:07.351077 run osmo-msc_10.42.42.6(pid=29945): Launched 17:48:07.521529 run osmo-stp_10.42.42.5(pid=29942): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29942)] 17:48:07.651213 run osmo-stp_10.42.42.5(pid=29942): stdout: | (launched: 2022-12-09_17:48:06.322043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:07.780905 run osmo-stp_10.42.42.5(pid=29942): stderr: | 20221209174806493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174806493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174806493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174806494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174806494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174806494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174806494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:07.908594 run osmo-stp_10.42.42.5(pid=29942): stdout: | (launched: 2022-12-09_17:48:06.322043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:08.029389 run osmo-stp_10.42.42.5(pid=29942): stderr: | 20221209174806493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174806493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174806493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174806494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174806494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174806494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174806494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:08.174619 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29942): Process ended prematurely: osmo-stp_10.42.42.5(pid=29942) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29942)] [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:48:08.183702 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:48:08.210630 run osmo-hlr_10.42.42.2(pid=29939): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29939)] 17:48:08.259162 run osmo-hlr_10.42.42.2(pid=29939): stdout: | (launched: 2022-12-09_17:48:05.358048) 17:48:08.309534 run osmo-hlr_10.42.42.2(pid=29939): stderr: | 20221209174805535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174805535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174805535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174805535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174805535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174805535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174805546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174805555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174805555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174805555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:08.379288 run osmo-msc_10.42.42.6(pid=29945): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29945)] 17:48:08.427319 run osmo-msc_10.42.42.6(pid=29945): stdout: | (launched: 2022-12-09_17:48:07.295328) 17:48:08.477672 run osmo-msc_10.42.42.6(pid=29945): stderr: | 20221209174807566 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174807566 DLGLOBAL DEBUG validating counter group 0x7fd301679c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174807566 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174807566 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174807566 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174807567 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174807570 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174807571 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174807571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174807571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:08.527816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29938): Terminating (SIGTERM) 17:48:08.568080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29941): Terminating (SIGTERM) 17:48:08.608140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29944): Terminating (SIGTERM) 17:48:08.648625 --- ParallelTerminationStrategy: PID 29938 died... 17:48:08.667903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29938): Terminated: ok {rc=0} 17:48:08.713291 --- ParallelTerminationStrategy: PID 29941 died... 17:48:08.732028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29941): Terminated: ok {rc=0} 17:48:08.777082 --- ParallelTerminationStrategy: PID 29944 died... 17:48:08.795864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29944): Terminated: ok {rc=0} 17:48:08.883901 bus /sierra_3: Setting Powered False 17:48:09.984222 bus /sierra_3: Setting Powered False 17:48:11.100198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:48:12.357574 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:12.364555 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:48:12.397648 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:48:12.424599 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:48:12.478045 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:48:12.511429 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:48:12.538334 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:48:13.090321 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:48:13.142064 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:13.153674 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:48:13.224320 tst mo_mt_call.py: using LAC 22677 17:48:13.352218 tst mo_mt_call.py: using RAC 237 17:48:13.478402 tst mo_mt_call.py: using CellId 22677 17:48:13.613120 tst mo_mt_call.py: using BVCI 22678 17:48:13.732482 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:13.744411 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:13.756056 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:13.767764 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:13.779462 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:13.791403 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:13.908346 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:14.028434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:14.534143 run create_hlr_db(pid=29950): Launched 17:48:14.667025 bus /sierra_2: Setting Powered False 17:48:15.731576 run create_hlr_db(pid=29950): Terminated: ok {rc=0} 17:48:16.222942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29952): Launched 17:48:16.551054 run osmo-hlr_10.42.42.2(pid=29953): Launched 17:48:16.791774 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:17.467565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29955): Launched 17:48:17.773818 run osmo-stp_10.42.42.5(pid=29956): Launched 17:48:17.890673 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:18.455540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29958): Launched 17:48:18.760420 run osmo-msc_10.42.42.6(pid=29959): Launched 17:48:18.931404 run osmo-stp_10.42.42.5(pid=29956): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29956)] 17:48:19.061670 run osmo-stp_10.42.42.5(pid=29956): stdout: | (launched: 2022-12-09_17:48:17.718232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:19.191846 run osmo-stp_10.42.42.5(pid=29956): stderr: | 20221209174817891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174817891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174817891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174817891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174817892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174817892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174817892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:19.320076 run osmo-stp_10.42.42.5(pid=29956): stdout: | (launched: 2022-12-09_17:48:17.718232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:19.441095 run osmo-stp_10.42.42.5(pid=29956): stderr: | 20221209174817891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174817891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174817891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174817891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174817892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174817892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174817892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:19.586796 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29956): Process ended prematurely: osmo-stp_10.42.42.5(pid=29956) [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29956)] [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:48:19.595753 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:48:19.622884 run osmo-hlr_10.42.42.2(pid=29953): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29953)] 17:48:19.670865 run osmo-hlr_10.42.42.2(pid=29953): stdout: | (launched: 2022-12-09_17:48:16.493764) 17:48:19.720431 run osmo-hlr_10.42.42.2(pid=29953): stderr: | 20221209174816837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174816837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174816837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174816837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174816837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174816837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174816862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174816875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174816876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174816876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:19.789838 run osmo-msc_10.42.42.6(pid=29959): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29959)] 17:48:19.837902 run osmo-msc_10.42.42.6(pid=29959): stdout: | (launched: 2022-12-09_17:48:18.704484) 17:48:19.887363 run osmo-msc_10.42.42.6(pid=29959): stderr: | 20221209174818979 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174818979 DLGLOBAL DEBUG validating counter group 0x7fb4b56acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174818979 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174818979 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174818979 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174818979 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174818981 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174818982 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174818982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174818982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:19.937368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29952): Terminating (SIGTERM) 17:48:19.977664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29955): Terminating (SIGTERM) 17:48:20.017770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29958): Terminating (SIGTERM) 17:48:20.057700 --- ParallelTerminationStrategy: PID 29952 died... 17:48:20.077360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29952): Terminated: ok {rc=0} 17:48:20.122232 --- ParallelTerminationStrategy: PID 29955 died... 17:48:20.141033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29955): Terminated: ok {rc=0} 17:48:20.185661 --- ParallelTerminationStrategy: PID 29958 died... 17:48:20.204518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29958): Terminated: ok {rc=0} 17:48:20.291710 bus /sierra_3: Setting Powered False 17:48:21.390958 bus /sierra_3: Setting Powered False 17:48:22.507544 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:48:23.653679 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:23.665917 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:48:23.736773 tst mo_mt_call_osmux.py: using LAC 22678 17:48:23.858721 tst mo_mt_call_osmux.py: using RAC 238 17:48:23.983900 tst mo_mt_call_osmux.py: using CellId 22678 17:48:24.103484 tst mo_mt_call_osmux.py: using BVCI 22679 17:48:24.213895 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:24.225202 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:24.236130 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:24.247420 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:24.258785 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:48:24.270085 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:24.390297 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:48:24.508098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:24.982391 run create_hlr_db(pid=29961): Launched 17:48:25.100730 bus /sierra_2: Setting Powered False 17:48:26.161724 run create_hlr_db(pid=29961): Terminated: ok {rc=0} 17:48:26.587440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29963): Launched 17:48:26.893209 run osmo-hlr_10.42.42.2(pid=29964): Launched 17:48:27.010123 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:27.533391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29966): Launched 17:48:27.839113 run osmo-stp_10.42.42.5(pid=29967): Launched 17:48:27.956685 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:28.508614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29969): Launched 17:48:28.813953 run osmo-msc_10.42.42.6(pid=29970): Launched 17:48:28.985676 run osmo-stp_10.42.42.5(pid=29967): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29967)] 17:48:29.115115 run osmo-stp_10.42.42.5(pid=29967): stdout: | (launched: 2022-12-09_17:48:27.783255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:29.245174 run osmo-stp_10.42.42.5(pid=29967): stderr: | 20221209174827954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174827954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174827954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174827955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174827955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174827955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174827955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:29.373936 run osmo-stp_10.42.42.5(pid=29967): stdout: | (launched: 2022-12-09_17:48:27.783255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:29.495478 run osmo-stp_10.42.42.5(pid=29967): stderr: | 20221209174827954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174827954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174827954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174827955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174827955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174827955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174827955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:29.640518 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29967): Process ended prematurely: osmo-stp_10.42.42.5(pid=29967) [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29967)] [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:48:29.649799 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:48:29.677140 run osmo-hlr_10.42.42.2(pid=29964): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29964)] 17:48:29.725701 run osmo-hlr_10.42.42.2(pid=29964): stdout: | (launched: 2022-12-09_17:48:26.837535) 17:48:29.775714 run osmo-hlr_10.42.42.2(pid=29964): stderr: | 20221209174827013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174827013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174827013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174827013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174827013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174827013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174827157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174827166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174827166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174827166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:29.845746 run osmo-msc_10.42.42.6(pid=29970): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29970)] 17:48:29.894101 run osmo-msc_10.42.42.6(pid=29970): stdout: | (launched: 2022-12-09_17:48:28.758168) 17:48:29.943751 run osmo-msc_10.42.42.6(pid=29970): stderr: | 20221209174829030 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174829030 DLGLOBAL DEBUG validating counter group 0x7f74ebfc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174829031 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174829031 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174829031 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174829031 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174829033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174829033 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174829033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174829033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:29.993927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29963): Terminating (SIGTERM) 17:48:30.034392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29966): Terminating (SIGTERM) 17:48:30.074791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29969): Terminating (SIGTERM) 17:48:30.115481 --- ParallelTerminationStrategy: PID 29963 died... 17:48:30.134730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29963): Terminated: ok {rc=0} 17:48:30.179613 --- ParallelTerminationStrategy: PID 29966 died... 17:48:30.198495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29966): Terminated: ok {rc=0} 17:48:30.243172 --- ParallelTerminationStrategy: PID 29969 died... 17:48:30.261972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29969): Terminated: ok {rc=0} 17:48:30.348631 bus /sierra_3: Setting Powered False 17:48:31.450073 bus /sierra_3: Setting Powered False 17:48:32.567396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:48:33.820664 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:33.827006 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:48:33.860652 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:48:33.888016 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:48:33.939432 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:48:33.972555 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:48:33.999892 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:48:34.551439 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:48:34.603549 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:34.614899 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:48:34.687571 tst mo_mt_call.py: using LAC 22679 17:48:34.814505 tst mo_mt_call.py: using RAC 239 17:48:34.941840 tst mo_mt_call.py: using CellId 22679 17:48:35.067221 tst mo_mt_call.py: using BVCI 22680 17:48:35.178902 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.190015 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.200933 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.212575 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.223931 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:35.235393 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:35.351428 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:35.466495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:35.942542 run create_hlr_db(pid=29976): Launched 17:48:36.061973 bus /sierra_2: Setting Powered False 17:48:37.123027 run create_hlr_db(pid=29976): Terminated: ok {rc=0} 17:48:37.572434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29978): Launched 17:48:37.901217 run osmo-hlr_10.42.42.2(pid=29979): Launched 17:48:38.026833 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:38.591453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29981): Launched 17:48:38.917587 run osmo-stp_10.42.42.5(pid=29982): Launched 17:48:39.043753 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:39.633676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29984): Launched 17:48:39.961381 run osmo-msc_10.42.42.6(pid=29985): Launched 17:48:40.145618 run osmo-stp_10.42.42.5(pid=29982): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29982)] 17:48:40.283971 run osmo-stp_10.42.42.5(pid=29982): stdout: | (launched: 2022-12-09_17:48:38.858408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:40.422686 run osmo-stp_10.42.42.5(pid=29982): stderr: | 20221209174839051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174839051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174839051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174839052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174839052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174839052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174839052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:40.559407 run osmo-stp_10.42.42.5(pid=29982): stdout: | (launched: 2022-12-09_17:48:38.858408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:40.688461 run osmo-stp_10.42.42.5(pid=29982): stderr: | 20221209174839051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174839051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174839051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174839052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174839052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174839052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174839052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:40.843885 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29982): Process ended prematurely: osmo-stp_10.42.42.5(pid=29982) [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29982)] [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:48:40.853589 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:48:40.881549 run osmo-hlr_10.42.42.2(pid=29979): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29979)] 17:48:40.931999 run osmo-hlr_10.42.42.2(pid=29979): stdout: | (launched: 2022-12-09_17:48:37.841600) 17:48:40.984300 run osmo-hlr_10.42.42.2(pid=29979): stderr: | 20221209174838041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174838041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174838041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174838041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174838041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174838041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174838053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174838062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174838062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174838063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:41.057337 run osmo-msc_10.42.42.6(pid=29985): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29985)] 17:48:41.107890 run osmo-msc_10.42.42.6(pid=29985): stdout: | (launched: 2022-12-09_17:48:39.901526) 17:48:41.160005 run osmo-msc_10.42.42.6(pid=29985): stderr: | 20221209174840224 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174840225 DLGLOBAL DEBUG validating counter group 0x7febed186c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174840225 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174840225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174840225 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174840225 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174840227 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174840227 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174840227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174840227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:41.212766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29978): Terminating (SIGTERM) 17:48:41.254635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29981): Terminating (SIGTERM) 17:48:41.296392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29984): Terminating (SIGTERM) 17:48:41.338442 --- ParallelTerminationStrategy: PID 29978 died... 17:48:41.358521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29978): Terminated: ok {rc=0} 17:48:41.405106 --- ParallelTerminationStrategy: PID 29981 died... 17:48:41.424682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29981): Terminated: ok {rc=0} 17:48:41.470839 --- ParallelTerminationStrategy: PID 29984 died... 17:48:41.490580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29984): Terminated: ok {rc=0} 17:48:41.578968 bus /sierra_3: Setting Powered False 17:48:42.679517 bus /sierra_3: Setting Powered False 17:48:43.795497 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:48:44.942456 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:44.954407 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:48:45.025175 tst mo_mt_call_osmux.py: using LAC 22680 17:48:45.145609 tst mo_mt_call_osmux.py: using RAC 240 17:48:45.277657 tst mo_mt_call_osmux.py: using CellId 22680 17:48:45.405543 tst mo_mt_call_osmux.py: using BVCI 22681 17:48:45.523876 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:45.535498 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:45.546952 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:45.558337 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:45.569704 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:48:45.581130 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:45.699987 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:48:45.817451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:46.312562 run create_hlr_db(pid=29987): Launched 17:48:46.455013 bus /sierra_2: Setting Powered False 17:48:47.519775 run create_hlr_db(pid=29987): Terminated: ok {rc=0} 17:48:47.954959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29989): Launched 17:48:48.260346 run osmo-hlr_10.42.42.2(pid=29990): Launched 17:48:48.377083 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:48.902239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29992): Launched 17:48:49.207666 run osmo-stp_10.42.42.5(pid=29993): Launched 17:48:49.326859 run osmo-msc_10.42.42.6: Starting osmo-msc 17:48:49.885056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29995): Launched 17:48:50.192414 run osmo-msc_10.42.42.6(pid=29996): Launched 17:48:50.365112 run osmo-stp_10.42.42.5(pid=29993): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29993)] 17:48:50.494541 run osmo-stp_10.42.42.5(pid=29993): stdout: | (launched: 2022-12-09_17:48:49.151756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:50.624225 run osmo-stp_10.42.42.5(pid=29993): stderr: | 20221209174849325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174849325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174849325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174849326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174849326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174849326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174849326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:50.751477 run osmo-stp_10.42.42.5(pid=29993): stdout: | (launched: 2022-12-09_17:48:49.151756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:50.872499 run osmo-stp_10.42.42.5(pid=29993): stderr: | 20221209174849325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174849325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174849325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174849326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174849326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174849326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174849326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:51.017735 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29993): Process ended prematurely: osmo-stp_10.42.42.5(pid=29993) [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29993)] [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:48:51.026866 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:48:51.054419 run osmo-hlr_10.42.42.2(pid=29990): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29990)] 17:48:51.103415 run osmo-hlr_10.42.42.2(pid=29990): stdout: | (launched: 2022-12-09_17:48:48.204543) 17:48:51.153596 run osmo-hlr_10.42.42.2(pid=29990): stderr: | 20221209174848383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174848383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174848383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174848383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174848383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174848383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174848395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174848405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174848405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174848406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:51.223570 run osmo-msc_10.42.42.6(pid=29996): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29996)] 17:48:51.272217 run osmo-msc_10.42.42.6(pid=29996): stdout: | (launched: 2022-12-09_17:48:50.136332) 17:48:51.322325 run osmo-msc_10.42.42.6(pid=29996): stderr: | 20221209174850408 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174850408 DLGLOBAL DEBUG validating counter group 0x7f315e1d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174850408 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174850408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174850408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174850409 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174850410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174850411 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174850411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174850411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:48:51.373451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29989): Terminating (SIGTERM) 17:48:51.413937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29992): Terminating (SIGTERM) 17:48:51.454050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29995): Terminating (SIGTERM) 17:48:51.495070 --- ParallelTerminationStrategy: PID 29989 died... 17:48:51.514313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29989): Terminated: ok {rc=0} 17:48:51.559496 --- ParallelTerminationStrategy: PID 29992 died... 17:48:51.578413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29992): Terminated: ok {rc=0} 17:48:51.623349 --- ParallelTerminationStrategy: PID 29995 died... 17:48:51.642276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29995): Terminated: ok {rc=0} 17:48:51.729223 bus /sierra_3: Setting Powered False 17:48:52.831598 bus /sierra_3: Setting Powered False 17:48:53.946673 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:48:55.197463 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:55.203414 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:48:55.236157 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 17:48:55.262709 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 17:48:55.313574 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:48:55.347630 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 17:48:55.375206 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 17:48:55.924942 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 17:48:55.974265 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:55.985650 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:48:56.036243 tst mo_mt_call.py: using LAC 22681 17:48:56.155794 tst mo_mt_call.py: using RAC 241 17:48:56.273358 tst mo_mt_call.py: using CellId 22681 17:48:56.393803 tst mo_mt_call.py: using BVCI 22682 17:48:56.506138 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.517372 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.528438 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.539781 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.551049 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:48:56.562336 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:48:56.680580 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:48:56.796538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:57.301964 run create_hlr_db(pid=30001): Launched 17:48:57.435848 bus /sierra_2: Setting Powered False 17:48:58.500194 run create_hlr_db(pid=30001): Terminated: ok {rc=0} 17:48:58.935204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30003): Launched 17:48:59.240751 run osmo-hlr_10.42.42.2(pid=30004): Launched 17:48:59.357240 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:59.897110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30006): Launched 17:49:00.203476 run osmo-stp_10.42.42.5(pid=30007): Launched 17:49:00.320287 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:00.877799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30009): Launched 17:49:01.230875 run osmo-msc_10.42.42.6(pid=30010): Launched 17:49:01.598518 run osmo-stp_10.42.42.5(pid=30007): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30007)] 17:49:01.793399 run osmo-stp_10.42.42.5(pid=30007): stdout: | (launched: 2022-12-09_17:49:00.147455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:02.070299 run osmo-stp_10.42.42.5(pid=30007): stderr: | 20221209174900319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174900319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174900320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174900320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174900320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174900321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174900321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:02.211594 run osmo-stp_10.42.42.5(pid=30007): stdout: | (launched: 2022-12-09_17:49:00.147455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:02.338827 run osmo-stp_10.42.42.5(pid=30007): stderr: | 20221209174900319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174900319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174900320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174900320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174900320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174900321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174900321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:02.487663 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30007): Process ended prematurely: osmo-stp_10.42.42.5(pid=30007) [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30007)] [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 17:49:02.496942 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 17:49:02.524299 run osmo-hlr_10.42.42.2(pid=30004): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30004)] 17:49:02.573054 run osmo-hlr_10.42.42.2(pid=30004): stdout: | (launched: 2022-12-09_17:48:59.185069) 17:49:02.623189 run osmo-hlr_10.42.42.2(pid=30004): stderr: | 20221209174859364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174859364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174859364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174859364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174859364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174859364 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174859375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174859384 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174859385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174859385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:02.693520 run osmo-msc_10.42.42.6(pid=30010): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30010)] 17:49:02.741701 run osmo-msc_10.42.42.6(pid=30010): stdout: | (launched: 2022-12-09_17:49:01.170390) 17:49:02.791770 run osmo-msc_10.42.42.6(pid=30010): stderr: | 20221209174901743 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174901743 DLGLOBAL DEBUG validating counter group 0x7f8e60ed0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174901743 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174901743 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174901743 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174901744 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174901748 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174901749 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174901749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174901749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:02.842177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30003): Terminating (SIGTERM) 17:49:02.882493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30006): Terminating (SIGTERM) 17:49:02.922871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30009): Terminating (SIGTERM) 17:49:02.963644 --- ParallelTerminationStrategy: PID 30003 died... 17:49:02.982810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30003): Terminated: ok {rc=0} 17:49:03.028090 --- ParallelTerminationStrategy: PID 30006 died... 17:49:03.046889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30006): Terminated: ok {rc=0} 17:49:03.092201 --- ParallelTerminationStrategy: PID 30009 died... 17:49:03.111183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30009): Terminated: ok {rc=0} 17:49:03.199221 bus /sierra_3: Setting Powered False 17:49:04.298896 bus /sierra_3: Setting Powered False 17:49:05.415885 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 17:49:06.564479 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:06.576566 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:49:06.629068 tst mo_mt_call_osmux.py: using LAC 22682 17:49:06.750374 tst mo_mt_call_osmux.py: using RAC 242 17:49:06.871437 tst mo_mt_call_osmux.py: using CellId 22682 17:49:06.992681 tst mo_mt_call_osmux.py: using BVCI 22683 17:49:07.103002 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:07.114340 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:07.125425 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:07.136852 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:07.148391 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 17:49:07.159850 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:49:07.275094 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 17:49:07.394730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:07.901974 run create_hlr_db(pid=30012): Launched 17:49:08.036048 bus /sierra_2: Setting Powered False 17:49:09.099912 run create_hlr_db(pid=30012): Terminated: ok {rc=0} 17:49:09.537998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30014): Launched 17:49:09.844349 run osmo-hlr_10.42.42.2(pid=30015): Launched 17:49:09.961133 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:10.486776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30017): Launched 17:49:10.793628 run osmo-stp_10.42.42.5(pid=30018): Launched 17:49:10.911394 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:11.466140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30020): Launched 17:49:11.774015 run osmo-msc_10.42.42.6(pid=30021): Launched 17:49:11.993373 run osmo-stp_10.42.42.5(pid=30018): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30018)] 17:49:12.123809 run osmo-stp_10.42.42.5(pid=30018): stdout: | (launched: 2022-12-09_17:49:10.737670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:12.254021 run osmo-stp_10.42.42.5(pid=30018): stderr: | 20221209174910908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174910908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174910908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174910909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174910909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174910909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174910909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:12.382511 run osmo-stp_10.42.42.5(pid=30018): stdout: | (launched: 2022-12-09_17:49:10.737670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:12.504627 run osmo-stp_10.42.42.5(pid=30018): stderr: | 20221209174910908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174910908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174910908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174910909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174910909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174910909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174910909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:12.650841 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30018): Process ended prematurely: osmo-stp_10.42.42.5(pid=30018) [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30018)] [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 17:49:12.660146 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:49:12.687931 run osmo-hlr_10.42.42.2(pid=30015): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30015)] 17:49:12.737329 run osmo-hlr_10.42.42.2(pid=30015): stdout: | (launched: 2022-12-09_17:49:09.788441) 17:49:12.787937 run osmo-hlr_10.42.42.2(pid=30015): stderr: | 20221209174909967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174909967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174909967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174909967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174909967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174909967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174909980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174909990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174909990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174909991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:12.858417 run osmo-msc_10.42.42.6(pid=30021): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30021)] 17:49:12.907126 run osmo-msc_10.42.42.6(pid=30021): stdout: | (launched: 2022-12-09_17:49:11.718031) 17:49:12.957443 run osmo-msc_10.42.42.6(pid=30021): stderr: | 20221209174912017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174912017 DLGLOBAL DEBUG validating counter group 0x7fb72a143c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174912017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174912017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174912017 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174912018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174912019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174912020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174912020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174912020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:13.008185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30014): Terminating (SIGTERM) 17:49:13.048557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30017): Terminating (SIGTERM) 17:49:13.089299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30020): Terminating (SIGTERM) 17:49:13.130096 --- ParallelTerminationStrategy: PID 30014 died... 17:49:13.149391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30014): Terminated: ok {rc=0} 17:49:13.194642 --- ParallelTerminationStrategy: PID 30017 died... 17:49:13.213494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30017): Terminated: ok {rc=0} 17:49:13.258261 --- ParallelTerminationStrategy: PID 30020 died... 17:49:13.277163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30020): Terminated: ok {rc=0} 17:49:13.364049 bus /sierra_3: Setting Powered False 17:49:14.464015 bus /sierra_3: Setting Powered False 17:49:15.580731 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 emergency:trx-umtrx --------------------------------------------------------------------- 17:49:16.842966 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:49:16.847492 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:49:16.884317 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 17:49:16.919326 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 17:49:17.019645 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:49:17.070553 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 17:49:17.111255 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 17:49:17.665674 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2362 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 17:49:17.671137 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:17.682549 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:17.737512 tst emergency_mo_mt_call.py: using LAC 22683 17:49:17.862011 tst emergency_mo_mt_call.py: using RAC 243 17:49:17.980423 tst emergency_mo_mt_call.py: using CellId 22683 17:49:18.095957 tst emergency_mo_mt_call.py: using BVCI 22684 17:49:18.204390 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.215274 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.225755 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.236336 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.246975 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:18.257816 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:18.376288 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:18.497865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:18.994605 run create_hlr_db(pid=30026): Launched 17:49:19.125611 bus /sierra_2: Setting Powered False 17:49:20.189450 run create_hlr_db(pid=30026): Terminated: ok {rc=0} 17:49:20.622778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30028): Launched 17:49:20.925445 run osmo-hlr_10.42.42.2(pid=30029): Launched 17:49:21.040087 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:21.569722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30031): Launched 17:49:21.870470 run osmo-stp_10.42.42.5(pid=30032): Launched 17:49:21.993345 tst emergency_mo_mt_call.py: using MSISDN 7300 17:49:22.146427 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:22.686744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30034): Launched 17:49:22.989204 run osmo-msc_10.42.42.6(pid=30035): Launched 17:49:23.157880 run osmo-stp_10.42.42.5(pid=30032): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30032)] 17:49:23.285380 run osmo-stp_10.42.42.5(pid=30032): stdout: | (launched: 2022-12-09_17:49:21.815524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:23.412822 run osmo-stp_10.42.42.5(pid=30032): stderr: | 20221209174921984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174921984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174921984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174921985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174921985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174921985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174921985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:23.538295 run osmo-stp_10.42.42.5(pid=30032): stdout: | (launched: 2022-12-09_17:49:21.815524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:23.657925 run osmo-stp_10.42.42.5(pid=30032): stderr: | 20221209174921984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174921984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174921984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174921985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174921985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174921985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174921985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:23.801326 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30032): Process ended prematurely: osmo-stp_10.42.42.5(pid=30032) [trial-2362↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30032)] [trial-2362↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 17:49:23.809979 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 17:49:23.836678 run osmo-hlr_10.42.42.2(pid=30029): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30029)] 17:49:23.884883 run osmo-hlr_10.42.42.2(pid=30029): stdout: | (launched: 2022-12-09_17:49:20.869643) 17:49:23.934824 run osmo-hlr_10.42.42.2(pid=30029): stderr: | 20221209174921044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174921044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174921044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174921044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174921044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174921044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174921060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174921071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174921071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174921072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:24.004040 run osmo-msc_10.42.42.6(pid=30035): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30035)] 17:49:24.052155 run osmo-msc_10.42.42.6(pid=30035): stdout: | (launched: 2022-12-09_17:49:22.933945) 17:49:24.102621 run osmo-msc_10.42.42.6(pid=30035): stderr: | 20221209174923206 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174923206 DLGLOBAL DEBUG validating counter group 0x7f39996fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174923206 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174923207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174923207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174923207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174923209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174923210 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174923210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174923210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:24.153321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30028): Terminating (SIGTERM) 17:49:24.193612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30031): Terminating (SIGTERM) 17:49:24.233747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30034): Terminating (SIGTERM) 17:49:24.274350 --- ParallelTerminationStrategy: PID 30028 died... 17:49:24.293634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30028): Terminated: ok {rc=0} 17:49:24.338833 --- ParallelTerminationStrategy: PID 30031 died... 17:49:24.357752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30031): Terminated: ok {rc=0} 17:49:24.402285 --- ParallelTerminationStrategy: PID 30034 died... 17:49:24.421422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30034): Terminated: ok {rc=0} 17:49:24.505403 bus /sierra_3: Setting Powered False 17:49:25.604350 bus /sierra_3: Setting Powered False 17:49:26.720321 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 17:49:27.805197 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:27.816775 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:27.867612 tst emergency_preemptive_call.py: using LAC 22684 17:49:27.985665 tst emergency_preemptive_call.py: using RAC 244 17:49:28.102167 tst emergency_preemptive_call.py: using CellId 22684 17:49:28.223266 tst emergency_preemptive_call.py: using BVCI 22685 17:49:28.332665 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:28.343400 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:28.354629 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:28.365658 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:28.376440 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 17:49:28.387285 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:28.503774 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:28.623105 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:28.741348 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:28.858064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:29.356017 run create_hlr_db(pid=30037): Launched 17:49:29.481771 bus /sierra_2: Setting Powered False 17:49:30.542591 run create_hlr_db(pid=30037): Terminated: ok {rc=0} 17:49:31.011550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30039): Launched 17:49:31.361771 run osmo-hlr_10.42.42.2(pid=30040): Launched 17:49:31.639022 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:32.263292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30042): Launched 17:49:32.593812 run osmo-stp_10.42.42.5(pid=30043): Launched 17:49:32.726281 tst emergency_preemptive_call.py: using MSISDN 7301 17:49:32.890166 run osmo-msc_10.42.42.6: Starting osmo-msc 17:49:33.465978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30045): Launched 17:49:33.786982 run osmo-msc_10.42.42.6(pid=30046): Launched 17:49:33.966929 run osmo-stp_10.42.42.5(pid=30043): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30043)] 17:49:34.101518 run osmo-stp_10.42.42.5(pid=30043): stdout: | (launched: 2022-12-09_17:49:32.535547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:34.237327 run osmo-stp_10.42.42.5(pid=30043): stderr: | 20221209174932729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174932729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174932729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174932730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174932730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174932730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174932730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:34.372146 run osmo-stp_10.42.42.5(pid=30043): stdout: | (launched: 2022-12-09_17:49:32.535547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:34.500089 run osmo-stp_10.42.42.5(pid=30043): stderr: | 20221209174932729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174932729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174932729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174932730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174932730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174932730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174932730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:34.652674 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30043): Process ended prematurely: osmo-stp_10.42.42.5(pid=30043) [trial-2362↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30043)] [trial-2362↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 17:49:34.662111 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 17:49:34.690215 run osmo-hlr_10.42.42.2(pid=30040): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30040)] 17:49:34.740655 run osmo-hlr_10.42.42.2(pid=30040): stdout: | (launched: 2022-12-09_17:49:31.295268) 17:49:34.793169 run osmo-hlr_10.42.42.2(pid=30040): stderr: | 20221209174931559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174931559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174931559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174931559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174931559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174931559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174931583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174931599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174931600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174931600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:34.866183 run osmo-msc_10.42.42.6(pid=30046): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30046)] 17:49:34.916687 run osmo-msc_10.42.42.6(pid=30046): stdout: | (launched: 2022-12-09_17:49:33.728785) 17:49:34.968384 run osmo-msc_10.42.42.6(pid=30046): stderr: | 20221209174934051 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209174934051 DLGLOBAL DEBUG validating counter group 0x7faa7c29ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209174934051 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209174934051 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209174934052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209174934052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209174934054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209174934054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209174934054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209174934054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:49:35.020240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30039): Terminating (SIGTERM) 17:49:35.062047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30042): Terminating (SIGTERM) 17:49:35.103972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30045): Terminating (SIGTERM) 17:49:35.146122 --- ParallelTerminationStrategy: PID 30039 died... 17:49:35.166241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30039): Terminated: ok {rc=0} 17:49:35.213462 --- ParallelTerminationStrategy: PID 30042 died... 17:49:35.233374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30042): Terminated: ok {rc=0} 17:49:35.280219 --- ParallelTerminationStrategy: PID 30045 died... 17:49:35.299958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30045): Terminated: ok {rc=0} 17:49:35.388870 bus /sierra_9: Setting Powered False 17:49:36.489227 bus /sierra_9: Setting Powered False 17:49:37.605659 bus /sierra_8: Setting Powered False 17:49:38.705627 bus /sierra_8: Setting Powered False 17:49:39.820823 bus /sierra_3: Setting Powered False 17:49:40.916485 bus /sierra_3: Setting Powered False 17:49:42.032454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx --------------------------------------------------------------------- 17:49:43.309566 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:49:43.314015 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 17:49:43.346927 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 17:49:43.384846 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 17:49:43.470974 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 17:49:43.503136 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 17:49:43.541322 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 17:49:44.129106 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 17:49:44.178980 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:44.189925 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:44.237906 tst cs_paging_gprs_active.py: using LAC 22685 17:49:44.358152 tst cs_paging_gprs_active.py: using RAC 245 17:49:44.479139 tst cs_paging_gprs_active.py: using CellId 22685 17:49:44.600325 tst cs_paging_gprs_active.py: using BVCI 22686 17:49:44.712414 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:44.723165 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:44.733631 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:44.744342 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:44.754945 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:44.765551 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:44.776243 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:44.786766 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:44.797511 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:44.916051 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:45.035671 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:49:45.260171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:45.589666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30051): Launched 17:49:45.885850 run iperf3-srv_10.42.42.10(pid=30052): Launched 17:49:46.033266 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:49:46.260445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:46.596910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30053): Launched 17:49:46.896609 run iperf3-srv_10.42.42.10(pid=30054): Launched 17:49:47.029105 tst cs_paging_gprs_active.py:38: start network... 17:49:47.241649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:47.716818 run create_hlr_db(pid=30055): Launched 17:49:47.833678 bus /sierra_2: Setting Powered False 17:49:48.894465 run create_hlr_db(pid=30055): Terminated: ok {rc=0} 17:49:49.320346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30057): Launched 17:49:49.627264 run osmo-hlr_10.42.42.2(pid=30058): Launched 17:49:49.745049 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:50.286991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30060): Launched 17:49:50.593646 run osmo-stp_10.42.42.5(pid=30061): Launched 17:49:50.710431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:49:51.235897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30063): Launched 17:49:51.362813 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:49:51.638897 run patchelf(pid=30064): Launched 17:49:51.822877 run osmo-stp_10.42.42.5(pid=30061): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30061)] 17:49:51.962138 run osmo-stp_10.42.42.5(pid=30061): stdout: | (launched: 2022-12-09_17:49:50.537349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:52.102433 run osmo-stp_10.42.42.5(pid=30061): stderr: | 20221209174950710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174950710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174950711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174950711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174950712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174950712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174950712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:52.243355 run osmo-stp_10.42.42.5(pid=30061): stdout: | (launched: 2022-12-09_17:49:50.537349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:52.377472 run osmo-stp_10.42.42.5(pid=30061): stderr: | 20221209174950710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209174950710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209174950711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209174950711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209174950712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209174950712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209174950712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:52.537276 run patchelf(pid=30064): Terminating (SIGINT) 17:49:52.721097 run patchelf(pid=30064): Terminated: ok {rc=0} 17:49:52.854119 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30061): Process ended prematurely: osmo-stp_10.42.42.5(pid=30061) [trial-2362↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30061)] [trial-2362↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 17:49:52.864579 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:49:52.893393 run osmo-hlr_10.42.42.2(pid=30058): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30058)] 17:49:52.943393 run osmo-hlr_10.42.42.2(pid=30058): stdout: | (launched: 2022-12-09_17:49:49.570909) 17:49:52.995332 run osmo-hlr_10.42.42.2(pid=30058): stderr: | 20221209174949749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209174949749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209174949749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209174949749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209174949749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209174949749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209174949762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209174949770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209174949770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209174949770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:53.047673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30051): Terminating (SIGTERM) 17:49:53.089824 run iperf3-srv_10.42.42.10(pid=30052): Terminating (SIGTERM) 17:49:53.131678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30053): Terminating (SIGTERM) 17:49:53.173821 run iperf3-srv_10.42.42.10(pid=30054): Terminating (SIGTERM) 17:49:53.216046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30057): Terminating (SIGTERM) 17:49:53.258213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30060): Terminating (SIGTERM) 17:49:53.300293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30063): Terminating (SIGTERM) 17:49:53.342768 --- ParallelTerminationStrategy: PID 30051 died... 17:49:53.362690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30051): Terminated: ok {rc=0} 17:49:53.409577 --- ParallelTerminationStrategy: PID 30052 died... 17:49:53.429108 run iperf3-srv_10.42.42.10(pid=30052): Terminated {rc=256} 17:49:53.475481 --- ParallelTerminationStrategy: PID 30053 died... 17:49:53.495081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30053): Terminated: ok {rc=0} 17:49:53.542029 --- ParallelTerminationStrategy: PID 30054 died... 17:49:53.561754 run iperf3-srv_10.42.42.10(pid=30054): Terminated {rc=256} 17:49:53.608207 --- ParallelTerminationStrategy: PID 30057 died... 17:49:53.627921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30057): Terminated: ok {rc=0} 17:49:53.674587 --- ParallelTerminationStrategy: PID 30060 died... 17:49:53.694438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30060): Terminated: ok {rc=0} 17:49:53.741882 --- ParallelTerminationStrategy: PID 30063 died... 17:49:53.761620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30063): Terminated: ok {rc=0} 17:49:53.850686 bus /gobi_0: Setting Powered False 17:49:54.950661 bus /gobi_0: Setting Powered False 17:49:56.070820 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx iperf3.py ---------------------------------------------- 17:49:57.222488 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.234323 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:49:57.286410 tst iperf3.py: using LAC 22686 17:49:57.416469 tst iperf3.py: using RAC 246 17:49:57.544836 tst iperf3.py: using CellId 22686 17:49:57.675121 tst iperf3.py: using BVCI 22687 17:49:57.796359 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.807819 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.818755 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.829627 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.840333 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.851154 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.862202 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.874094 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:49:57.885257 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:49:58.007039 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:49:58.229345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:58.558296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30066): Launched 17:49:58.846071 run iperf3-srv_10.42.42.10(pid=30067): Launched 17:49:58.970595 tst iperf3.py:8: start network... 17:49:59.191267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:59.698223 run create_hlr_db(pid=30068): Launched 17:49:59.832359 bus /gobi_6: Setting Powered False 17:50:00.899885 run create_hlr_db(pid=30068): Terminated: ok {rc=0} 17:50:01.349808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30072): Launched 17:50:01.709711 run osmo-hlr_10.42.42.2(pid=30074): Launched 17:50:01.840028 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:02.666272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30076): Launched 17:50:02.995133 run osmo-stp_10.42.42.5(pid=30077): Launched 17:50:03.120268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:03.681909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30079): Launched 17:50:03.807317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:04.082844 run patchelf(pid=30080): Launched 17:50:04.266605 run osmo-stp_10.42.42.5(pid=30077): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30077)] 17:50:04.405945 run osmo-stp_10.42.42.5(pid=30077): stdout: | (launched: 2022-12-09_17:50:02.935336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:04.546819 run osmo-stp_10.42.42.5(pid=30077): stderr: | 20221209175003128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175003128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175003129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175003129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175003131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175003131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175003131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:04.688240 run osmo-stp_10.42.42.5(pid=30077): stdout: | (launched: 2022-12-09_17:50:02.935336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:04.822633 run osmo-stp_10.42.42.5(pid=30077): stderr: | 20221209175003128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175003128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175003129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175003129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175003131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175003131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175003131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:04.982170 run patchelf(pid=30080): Terminating (SIGINT) 17:50:05.166071 run patchelf(pid=30080): Terminated: ok {rc=0} 17:50:05.298826 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30077): Process ended prematurely: osmo-stp_10.42.42.5(pid=30077) [trial-2362↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30077)] [trial-2362↪gprs:trx-umtrx↪iperf3.py:8] 17:50:05.309065 tst iperf3.py:8: Test FAILED (8.1 sec) 17:50:05.337812 run osmo-hlr_10.42.42.2(pid=30074): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30074)] 17:50:05.387953 run osmo-hlr_10.42.42.2(pid=30074): stdout: | (launched: 2022-12-09_17:50:01.650478) 17:50:05.439655 run osmo-hlr_10.42.42.2(pid=30074): stderr: | 20221209175002027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175002028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175002028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175002028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175002028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175002029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175002046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175002056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175002056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175002056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:05.491588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30066): Terminating (SIGTERM) 17:50:05.533416 run iperf3-srv_10.42.42.10(pid=30067): Terminating (SIGTERM) 17:50:05.575183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30072): Terminating (SIGTERM) 17:50:05.618580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30076): Terminating (SIGTERM) 17:50:05.660382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30079): Terminating (SIGTERM) 17:50:05.702573 --- ParallelTerminationStrategy: PID 30066 died... 17:50:05.722536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30066): Terminated: ok {rc=0} 17:50:05.769098 --- ParallelTerminationStrategy: PID 30067 died... 17:50:05.788610 run iperf3-srv_10.42.42.10(pid=30067): Terminated {rc=256} 17:50:05.834650 --- ParallelTerminationStrategy: PID 30072 died... 17:50:05.854204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30072): Terminated: ok {rc=0} 17:50:05.900427 --- ParallelTerminationStrategy: PID 30076 died... 17:50:05.920103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30076): Terminated: ok {rc=0} 17:50:05.966382 --- ParallelTerminationStrategy: PID 30079 died... 17:50:05.985951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30079): Terminated: ok {rc=0} 17:50:06.074552 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 17:50:07.225788 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:07.237608 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:07.288051 tst iperf3m4.py: using LAC 22687 17:50:07.417603 tst iperf3m4.py: using RAC 247 17:50:07.545720 tst iperf3m4.py: using CellId 22687 17:50:07.673510 tst iperf3m4.py: using BVCI 22688 17:50:07.792565 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:07.803756 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:07.814733 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:07.825660 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:07.836407 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:07.847247 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:07.858304 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:07.869126 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:07.880428 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:07.997349 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:08.119312 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:08.239013 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:08.355484 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:50:08.561681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:08.869386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30081): Launched 17:50:09.136473 run iperf3-srv_10.42.42.10(pid=30082): Launched 17:50:09.252453 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:50:09.458101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:09.765818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30083): Launched 17:50:10.033346 run iperf3-srv_10.42.42.10(pid=30084): Launched 17:50:10.149183 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:50:10.355010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:10.663217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30085): Launched 17:50:10.932347 run iperf3-srv_10.42.42.10(pid=30086): Launched 17:50:11.047828 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:50:11.253423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:11.561782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Launched 17:50:11.829090 run iperf3-srv_10.42.42.10(pid=30088): Launched 17:50:11.944077 tst iperf3m4.py:8: start network... 17:50:12.148519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:12.622856 run create_hlr_db(pid=30089): Launched 17:50:12.741288 bus /gobi_6: Setting Powered False 17:50:13.802542 run create_hlr_db(pid=30089): Terminated: ok {rc=0} 17:50:14.229313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30091): Launched 17:50:14.536376 run osmo-hlr_10.42.42.2(pid=30092): Launched 17:50:14.653910 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:15.200591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30094): Launched 17:50:15.508002 run osmo-stp_10.42.42.5(pid=30095): Launched 17:50:15.625535 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:16.192070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30097): Launched 17:50:16.370166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:16.748346 run patchelf(pid=30098): Launched 17:50:16.935644 run osmo-stp_10.42.42.5(pid=30095): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30095)] 17:50:17.070670 run osmo-stp_10.42.42.5(pid=30095): stdout: | (launched: 2022-12-09_17:50:15.451737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:17.207001 run osmo-stp_10.42.42.5(pid=30095): stderr: | 20221209175015623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175015623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175015623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175015624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175015624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175015624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175015624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:17.343062 run osmo-stp_10.42.42.5(pid=30095): stdout: | (launched: 2022-12-09_17:50:15.451737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:17.469544 run osmo-stp_10.42.42.5(pid=30095): stderr: | 20221209175015623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175015623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175015623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175015624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175015624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175015624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175015624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:17.619513 run patchelf(pid=30098): Terminating (SIGINT) 17:50:17.792739 run patchelf(pid=30098): Terminated: ok {rc=0} 17:50:17.917919 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30095): Process ended prematurely: osmo-stp_10.42.42.5(pid=30095) [trial-2362↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30095)] [trial-2362↪gprs:trx-umtrx↪iperf3m4.py:8] 17:50:17.927570 tst iperf3m4.py:8: Test FAILED (10.7 sec) 17:50:17.956335 run osmo-hlr_10.42.42.2(pid=30092): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30092)] 17:50:18.005205 run osmo-hlr_10.42.42.2(pid=30092): stdout: | (launched: 2022-12-09_17:50:14.479990) 17:50:18.055647 run osmo-hlr_10.42.42.2(pid=30092): stderr: | 20221209175014656 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175014656 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175014656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175014656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175014656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175014656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175014668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175014677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175014677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175014677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:18.106485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30081): Terminating (SIGTERM) 17:50:18.147193 run iperf3-srv_10.42.42.10(pid=30082): Terminating (SIGTERM) 17:50:18.187678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30083): Terminating (SIGTERM) 17:50:18.228176 run iperf3-srv_10.42.42.10(pid=30084): Terminating (SIGTERM) 17:50:18.268387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30085): Terminating (SIGTERM) 17:50:18.309332 run iperf3-srv_10.42.42.10(pid=30086): Terminating (SIGTERM) 17:50:18.349471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Terminating (SIGTERM) 17:50:18.390317 run iperf3-srv_10.42.42.10(pid=30088): Terminating (SIGTERM) 17:50:18.430529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30091): Terminating (SIGTERM) 17:50:18.471178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30094): Terminating (SIGTERM) 17:50:18.511698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30097): Terminating (SIGTERM) 17:50:18.552467 --- ParallelTerminationStrategy: PID 30081 died... 17:50:18.571862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30081): Terminated: ok {rc=0} 17:50:18.617454 --- ParallelTerminationStrategy: PID 30082 died... 17:50:18.636246 run iperf3-srv_10.42.42.10(pid=30082): Terminated {rc=256} 17:50:18.680869 --- ParallelTerminationStrategy: PID 30083 died... 17:50:18.700041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30083): Terminated: ok {rc=0} 17:50:18.745838 --- ParallelTerminationStrategy: PID 30084 died... 17:50:18.764765 run iperf3-srv_10.42.42.10(pid=30084): Terminated {rc=256} 17:50:18.809478 --- ParallelTerminationStrategy: PID 30085 died... 17:50:18.828289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30085): Terminated: ok {rc=0} 17:50:18.873115 --- ParallelTerminationStrategy: PID 30086 died... 17:50:18.891920 run iperf3-srv_10.42.42.10(pid=30086): Terminated {rc=256} 17:50:18.936596 --- ParallelTerminationStrategy: PID 30087 died... 17:50:18.955486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Terminated: ok {rc=0} 17:50:19.000195 --- ParallelTerminationStrategy: PID 30088 died... 17:50:19.019055 run iperf3-srv_10.42.42.10(pid=30088): Terminated {rc=256} 17:50:19.063880 --- ParallelTerminationStrategy: PID 30091 died... 17:50:19.082812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30091): Terminated: ok {rc=0} 17:50:19.127836 --- ParallelTerminationStrategy: PID 30094 died... 17:50:19.146994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30094): Terminated: ok {rc=0} 17:50:19.192564 --- ParallelTerminationStrategy: PID 30097 died... 17:50:19.211471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30097): Terminated: ok {rc=0} 17:50:19.298075 bus /gobi_4: Setting Powered False 17:50:20.399573 bus /gobi_4: Setting Powered False 17:50:21.517760 bus /gobi_1: Setting Powered False 17:50:22.617985 bus /gobi_1: Setting Powered False 17:50:23.732515 bus /gobi_0: Setting Powered False 17:50:24.832840 bus /gobi_0: Setting Powered False 17:50:25.950537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx ping.py ---------------------------------------------- 17:50:27.054302 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.066146 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:27.120474 tst ping.py: using LAC 22688 17:50:27.246990 tst ping.py: using RAC 248 17:50:27.371877 tst ping.py: using CellId 22688 17:50:27.498456 tst ping.py: using BVCI 22689 17:50:27.615387 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.626637 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.637557 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.648824 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.660079 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.671792 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.683771 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:27.695193 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:27.815786 tst ping.py:19: start network... 17:50:28.034017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:28.532403 run create_hlr_db(pid=30099): Launched 17:50:28.662774 bus /gobi_6: Setting Powered False 17:50:29.726337 run create_hlr_db(pid=30099): Terminated: ok {rc=0} 17:50:30.174728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30101): Launched 17:50:30.497525 run osmo-hlr_10.42.42.2(pid=30102): Launched 17:50:30.621546 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:31.205708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30104): Launched 17:50:31.543486 run osmo-stp_10.42.42.5(pid=30105): Launched 17:50:31.781284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:32.485219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30107): Launched 17:50:32.609311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:32.882100 run patchelf(pid=30108): Launched 17:50:33.063693 run osmo-stp_10.42.42.5(pid=30105): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30105)] 17:50:33.200554 run osmo-stp_10.42.42.5(pid=30105): stdout: | (launched: 2022-12-09_17:50:31.484452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:33.340066 run osmo-stp_10.42.42.5(pid=30105): stderr: | 20221209175031680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175031680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175031681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175031682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175031684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175031684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175031684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:33.479140 run osmo-stp_10.42.42.5(pid=30105): stdout: | (launched: 2022-12-09_17:50:31.484452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:33.611481 run osmo-stp_10.42.42.5(pid=30105): stderr: | 20221209175031680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175031680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175031681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175031682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175031684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175031684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175031684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:33.768210 run patchelf(pid=30108): Terminating (SIGINT) 17:50:33.949213 run patchelf(pid=30108): Terminated: ok {rc=0} 17:50:34.080407 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30105): Process ended prematurely: osmo-stp_10.42.42.5(pid=30105) [trial-2362↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30105)] [trial-2362↪gprs:trx-umtrx↪ping.py:22] 17:50:34.090424 tst ping.py:22: Test FAILED (7.0 sec) 17:50:34.120065 run osmo-hlr_10.42.42.2(pid=30102): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30102)] 17:50:34.171139 run osmo-hlr_10.42.42.2(pid=30102): stdout: | (launched: 2022-12-09_17:50:30.439058) 17:50:34.224141 run osmo-hlr_10.42.42.2(pid=30102): stderr: | 20221209175030636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175030636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175030636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175030636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175030636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175030637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175030649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175030657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175030658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175030658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:34.277783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30101): Terminating (SIGTERM) 17:50:34.320669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30104): Terminating (SIGTERM) 17:50:34.363715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30107): Terminating (SIGTERM) 17:50:34.406759 --- ParallelTerminationStrategy: PID 30101 died... 17:50:34.426976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30101): Terminated: ok {rc=0} 17:50:34.474843 --- ParallelTerminationStrategy: PID 30104 died... 17:50:34.494819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30104): Terminated: ok {rc=0} 17:50:34.542511 --- ParallelTerminationStrategy: PID 30107 died... 17:50:34.562305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30107): Terminated: ok {rc=0} 17:50:34.651351 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 17:50:35.739431 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:35.751362 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 17:50:35.802233 tst ping_idle_ping.py: using LAC 22689 17:50:35.930063 tst ping_idle_ping.py: using RAC 249 17:50:36.058561 tst ping_idle_ping.py: using CellId 22689 17:50:36.186461 tst ping_idle_ping.py: using BVCI 22690 17:50:36.305357 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:36.316348 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:36.327354 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:36.338810 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:36.349736 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:36.360708 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:36.371771 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 17:50:36.382743 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 17:50:36.497599 tst ping_idle_ping.py:24: start network... 17:50:36.700681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:37.170460 run create_hlr_db(pid=30109): Launched 17:50:37.287446 bus /gobi_6: Setting Powered False 17:50:38.347486 run create_hlr_db(pid=30109): Terminated: ok {rc=0} 17:50:38.770004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30111): Launched 17:50:39.073754 run osmo-hlr_10.42.42.2(pid=30112): Launched 17:50:39.189824 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:39.722205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30114): Launched 17:50:40.025350 run osmo-stp_10.42.42.5(pid=30115): Launched 17:50:40.141951 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:40.663007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30117): Launched 17:50:40.779211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:41.034424 run patchelf(pid=30118): Launched 17:50:41.204080 run osmo-stp_10.42.42.5(pid=30115): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30115)] 17:50:41.331898 run osmo-stp_10.42.42.5(pid=30115): stdout: | (launched: 2022-12-09_17:50:39.969944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:41.462243 run osmo-stp_10.42.42.5(pid=30115): stderr: | 20221209175040141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175040141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175040142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175040142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175040142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175040143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175040143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:41.592464 run osmo-stp_10.42.42.5(pid=30115): stdout: | (launched: 2022-12-09_17:50:39.969944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:41.715769 run osmo-stp_10.42.42.5(pid=30115): stderr: | 20221209175040141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175040141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175040142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175040142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175040142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175040143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175040143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:41.862568 run patchelf(pid=30118): Terminating (SIGINT) 17:50:42.032202 run patchelf(pid=30118): Terminated: ok {rc=0} 17:50:42.154555 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30115): Process ended prematurely: osmo-stp_10.42.42.5(pid=30115) [trial-2362↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30115)] [trial-2362↪gprs:trx-umtrx↪ping_idle_ping.py:27] 17:50:42.163627 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 17:50:42.191293 run osmo-hlr_10.42.42.2(pid=30112): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30112)] 17:50:42.239905 run osmo-hlr_10.42.42.2(pid=30112): stdout: | (launched: 2022-12-09_17:50:39.017668) 17:50:42.290469 run osmo-hlr_10.42.42.2(pid=30112): stderr: | 20221209175039192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175039192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175039192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175039192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175039192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175039192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175039204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175039213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175039213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175039213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:42.341450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30111): Terminating (SIGTERM) 17:50:42.382180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30114): Terminating (SIGTERM) 17:50:42.422942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30117): Terminating (SIGTERM) 17:50:42.464385 --- ParallelTerminationStrategy: PID 30111 died... 17:50:42.483950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30111): Terminated: ok {rc=0} 17:50:42.529194 --- ParallelTerminationStrategy: PID 30114 died... 17:50:42.548041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30114): Terminated: ok {rc=0} 17:50:42.593045 --- ParallelTerminationStrategy: PID 30117 died... 17:50:42.611827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30117): Terminated: ok {rc=0} 17:50:42.698919 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 17:50:44.006728 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:50:44.012522 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:50:44.046922 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:50:44.086726 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:50:44.175956 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:50:44.210128 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:50:44.250366 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:50:44.842967 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:50:44.896560 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:44.907908 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:50:44.959827 tst cs_paging_gprs_active.py: using LAC 22690 17:50:45.089383 tst cs_paging_gprs_active.py: using RAC 250 17:50:45.217420 tst cs_paging_gprs_active.py: using CellId 22690 17:50:45.347732 tst cs_paging_gprs_active.py: using BVCI 22691 17:50:45.466827 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:45.478227 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:45.489320 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:45.500454 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:45.511919 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:45.523054 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:45.534368 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:45.545445 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:45.556684 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:45.673497 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:45.792810 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:50:46.032458 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:46.376468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30122): Launched 17:50:46.689186 run iperf3-srv_10.42.42.10(pid=30123): Launched 17:50:46.817471 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:50:47.030671 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:47.346308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30124): Launched 17:50:47.614449 run iperf3-srv_10.42.42.10(pid=30125): Launched 17:50:47.730054 tst cs_paging_gprs_active.py:38: start network... 17:50:47.935469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:48.410183 run create_hlr_db(pid=30126): Launched 17:50:48.527813 bus /gobi_6: Setting Powered False 17:50:49.588292 run create_hlr_db(pid=30126): Terminated: ok {rc=0} 17:50:50.036694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30128): Launched 17:50:50.365430 run osmo-hlr_10.42.42.2(pid=30129): Launched 17:50:50.491575 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:51.055166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30131): Launched 17:50:51.385065 run osmo-stp_10.42.42.5(pid=30132): Launched 17:50:51.511629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:52.076617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30134): Launched 17:50:52.201836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:52.478681 run patchelf(pid=30135): Launched 17:50:52.662179 run osmo-stp_10.42.42.5(pid=30132): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30132)] 17:50:52.800915 run osmo-stp_10.42.42.5(pid=30132): stdout: | (launched: 2022-12-09_17:50:51.325308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:52.940560 run osmo-stp_10.42.42.5(pid=30132): stderr: | 20221209175051518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175051518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175051518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175051519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175051519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175051519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175051519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:53.080677 run osmo-stp_10.42.42.5(pid=30132): stdout: | (launched: 2022-12-09_17:50:51.325308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:53.214493 run osmo-stp_10.42.42.5(pid=30132): stderr: | 20221209175051518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175051518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175051518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175051519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175051519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175051519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175051519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:53.373475 run patchelf(pid=30135): Terminating (SIGINT) 17:50:53.557425 run patchelf(pid=30135): Terminated: ok {rc=0} 17:50:53.690509 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30132): Process ended prematurely: osmo-stp_10.42.42.5(pid=30132) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30132)] [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:50:53.700780 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:50:53.729786 run osmo-hlr_10.42.42.2(pid=30129): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30129)] 17:50:53.779766 run osmo-hlr_10.42.42.2(pid=30129): stdout: | (launched: 2022-12-09_17:50:50.305739) 17:50:53.831683 run osmo-hlr_10.42.42.2(pid=30129): stderr: | 20221209175050504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175050504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175050504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175050505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175050505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175050505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175050518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175050527 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175050527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175050527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:53.883950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30122): Terminating (SIGTERM) 17:50:53.925898 run iperf3-srv_10.42.42.10(pid=30123): Terminating (SIGTERM) 17:50:53.967722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30124): Terminating (SIGTERM) 17:50:54.009735 run iperf3-srv_10.42.42.10(pid=30125): Terminating (SIGTERM) 17:50:54.051514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30128): Terminating (SIGTERM) 17:50:54.093636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30131): Terminating (SIGTERM) 17:50:54.135505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30134): Terminating (SIGTERM) 17:50:54.177637 --- ParallelTerminationStrategy: PID 30122 died... 17:50:54.197707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30122): Terminated: ok {rc=0} 17:50:54.244306 --- ParallelTerminationStrategy: PID 30123 died... 17:50:54.263965 run iperf3-srv_10.42.42.10(pid=30123): Terminated {rc=256} 17:50:54.310162 --- ParallelTerminationStrategy: PID 30124 died... 17:50:54.329772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30124): Terminated: ok {rc=0} 17:50:54.375597 --- ParallelTerminationStrategy: PID 30125 died... 17:50:54.395034 run iperf3-srv_10.42.42.10(pid=30125): Terminated {rc=256} 17:50:54.441040 --- ParallelTerminationStrategy: PID 30128 died... 17:50:54.460562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30128): Terminated: ok {rc=0} 17:50:54.506525 --- ParallelTerminationStrategy: PID 30131 died... 17:50:54.526109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30131): Terminated: ok {rc=0} 17:50:54.571919 --- ParallelTerminationStrategy: PID 30134 died... 17:50:54.591500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30134): Terminated: ok {rc=0} 17:50:54.678898 bus /gobi_0: Setting Powered False 17:50:55.777365 bus /gobi_0: Setting Powered False 17:50:56.893356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:50:58.040529 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:58.052329 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:50:58.109223 tst iperf3.py: using LAC 22691 17:50:58.232441 tst iperf3.py: using RAC 251 17:50:58.353677 tst iperf3.py: using CellId 22691 17:50:58.482679 tst iperf3.py: using BVCI 22692 17:50:58.602586 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:58.614014 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:58.625117 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:58.636174 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:58.647739 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:58.658834 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:58.670172 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:58.680938 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:50:58.692205 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:50:58.809728 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:50:59.015710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:59.324619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30136): Launched 17:50:59.593207 run iperf3-srv_10.42.42.10(pid=30137): Launched 17:50:59.708874 tst iperf3.py:8: start network... 17:50:59.914963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:00.389501 run create_hlr_db(pid=30138): Launched 17:51:00.507881 bus /gobi_6: Setting Powered False 17:51:01.570293 run create_hlr_db(pid=30138): Terminated: ok {rc=0} 17:51:02.011159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30140): Launched 17:51:02.335904 run osmo-hlr_10.42.42.2(pid=30141): Launched 17:51:02.453749 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:03.001698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30143): Launched 17:51:03.309481 run osmo-stp_10.42.42.5(pid=30144): Launched 17:51:03.427288 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:03.955738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30146): Launched 17:51:04.073663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:04.332292 run patchelf(pid=30147): Launched 17:51:04.503409 run osmo-stp_10.42.42.5(pid=30144): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30144)] 17:51:04.633077 run osmo-stp_10.42.42.5(pid=30144): stdout: | (launched: 2022-12-09_17:51:03.253351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:04.764249 run osmo-stp_10.42.42.5(pid=30144): stderr: | 20221209175103423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175103423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175103424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175103424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175103425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175103425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175103425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:04.895599 run osmo-stp_10.42.42.5(pid=30144): stdout: | (launched: 2022-12-09_17:51:03.253351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:05.020700 run osmo-stp_10.42.42.5(pid=30144): stderr: | 20221209175103423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175103423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175103424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175103424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175103425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175103425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175103425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:05.169340 run patchelf(pid=30147): Terminating (SIGINT) 17:51:05.341107 run patchelf(pid=30147): Terminated: ok {rc=0} 17:51:05.465301 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30144): Process ended prematurely: osmo-stp_10.42.42.5(pid=30144) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30144)] [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 17:51:05.474974 tst iperf3.py:8: Test FAILED (7.5 sec) 17:51:05.502927 run osmo-hlr_10.42.42.2(pid=30141): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30141)] 17:51:05.551558 run osmo-hlr_10.42.42.2(pid=30141): stdout: | (launched: 2022-12-09_17:51:02.279652) 17:51:05.602087 run osmo-hlr_10.42.42.2(pid=30141): stderr: | 20221209175102456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175102456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175102456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175102456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175102456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175102456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175102468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175102478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175102478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175102478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:05.652472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30136): Terminating (SIGTERM) 17:51:05.692696 run iperf3-srv_10.42.42.10(pid=30137): Terminating (SIGTERM) 17:51:05.732691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30140): Terminating (SIGTERM) 17:51:05.772768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30143): Terminating (SIGTERM) 17:51:05.812904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30146): Terminating (SIGTERM) 17:51:05.853331 --- ParallelTerminationStrategy: PID 30136 died... 17:51:05.872494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30136): Terminated: ok {rc=0} 17:51:05.917287 --- ParallelTerminationStrategy: PID 30137 died... 17:51:05.935911 run iperf3-srv_10.42.42.10(pid=30137): Terminated {rc=256} 17:51:05.981187 --- ParallelTerminationStrategy: PID 30140 died... 17:51:05.999939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30140): Terminated: ok {rc=0} 17:51:06.044756 --- ParallelTerminationStrategy: PID 30143 died... 17:51:06.063595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30143): Terminated: ok {rc=0} 17:51:06.108854 --- ParallelTerminationStrategy: PID 30146 died... 17:51:06.128054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30146): Terminated: ok {rc=0} 17:51:06.212615 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:51:07.363648 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:07.375681 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:07.427730 tst iperf3m4.py: using LAC 22692 17:51:07.556391 tst iperf3m4.py: using RAC 252 17:51:07.686591 tst iperf3m4.py: using CellId 22692 17:51:07.814081 tst iperf3m4.py: using BVCI 22693 17:51:07.925988 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:07.937257 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:07.947961 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:07.958927 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:07.969793 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:07.980545 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:07.991577 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:08.002753 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:08.013773 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:08.133744 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:08.252501 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:08.368692 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:08.484068 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:51:08.706892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:09.036810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30148): Launched 17:51:09.324555 run iperf3-srv_10.42.42.10(pid=30149): Launched 17:51:09.448027 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:51:09.669100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:09.998239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30150): Launched 17:51:10.286140 run iperf3-srv_10.42.42.10(pid=30151): Launched 17:51:10.410477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:51:10.631192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:10.961055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30152): Launched 17:51:11.248739 run iperf3-srv_10.42.42.10(pid=30153): Launched 17:51:11.372411 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:51:11.593149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:11.922254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30154): Launched 17:51:12.210112 run iperf3-srv_10.42.42.10(pid=30155): Launched 17:51:12.334187 tst iperf3m4.py:8: start network... 17:51:12.555291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:13.064107 run create_hlr_db(pid=30156): Launched 17:51:13.197796 bus /gobi_6: Setting Powered False 17:51:14.262689 run create_hlr_db(pid=30156): Terminated: ok {rc=0} 17:51:14.701427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30158): Launched 17:51:15.011784 run osmo-hlr_10.42.42.2(pid=30159): Launched 17:51:15.129780 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:15.660326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30161): Launched 17:51:15.977752 run osmo-stp_10.42.42.5(pid=30162): Launched 17:51:16.216115 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:16.989764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30164): Launched 17:51:17.140122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:17.423850 run patchelf(pid=30165): Launched 17:51:17.609282 run osmo-stp_10.42.42.5(pid=30162): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30162)] 17:51:17.748879 run osmo-stp_10.42.42.5(pid=30162): stdout: | (launched: 2022-12-09_17:51:15.920252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:17.890310 run osmo-stp_10.42.42.5(pid=30162): stderr: | 20221209175116340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175116340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175116340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175116344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175116346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175116347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175116347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:18.031035 run osmo-stp_10.42.42.5(pid=30162): stdout: | (launched: 2022-12-09_17:51:15.920252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:18.165980 run osmo-stp_10.42.42.5(pid=30162): stderr: | 20221209175116340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175116340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175116340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175116344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175116346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175116347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175116347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:18.326012 run patchelf(pid=30165): Terminating (SIGINT) 17:51:18.510553 run patchelf(pid=30165): Terminated: ok {rc=0} 17:51:18.643484 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30162): Process ended prematurely: osmo-stp_10.42.42.5(pid=30162) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30162)] [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 17:51:18.654014 tst iperf3m4.py:8: Test FAILED (11.3 sec) 17:51:18.683367 run osmo-hlr_10.42.42.2(pid=30159): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30159)] 17:51:18.734138 run osmo-hlr_10.42.42.2(pid=30159): stdout: | (launched: 2022-12-09_17:51:14.955041) 17:51:18.786560 run osmo-hlr_10.42.42.2(pid=30159): stderr: | 20221209175115136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175115136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175115136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175115136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175115136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175115136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175115147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175115157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175115157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175115158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:18.839986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30148): Terminating (SIGTERM) 17:51:18.882604 run iperf3-srv_10.42.42.10(pid=30149): Terminating (SIGTERM) 17:51:18.925004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30150): Terminating (SIGTERM) 17:51:18.967490 run iperf3-srv_10.42.42.10(pid=30151): Terminating (SIGTERM) 17:51:19.009978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30152): Terminating (SIGTERM) 17:51:19.052542 run iperf3-srv_10.42.42.10(pid=30153): Terminating (SIGTERM) 17:51:19.094907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30154): Terminating (SIGTERM) 17:51:19.137389 run iperf3-srv_10.42.42.10(pid=30155): Terminating (SIGTERM) 17:51:19.179662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30158): Terminating (SIGTERM) 17:51:19.222469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30161): Terminating (SIGTERM) 17:51:19.265400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30164): Terminating (SIGTERM) 17:51:19.308593 --- ParallelTerminationStrategy: PID 30148 died... 17:51:19.329019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30148): Terminated: ok {rc=0} 17:51:19.375986 --- ParallelTerminationStrategy: PID 30149 died... 17:51:19.395709 run iperf3-srv_10.42.42.10(pid=30149): Terminated {rc=256} 17:51:19.442301 --- ParallelTerminationStrategy: PID 30150 died... 17:51:19.462224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30150): Terminated: ok {rc=0} 17:51:19.508836 --- ParallelTerminationStrategy: PID 30151 died... 17:51:19.529040 run iperf3-srv_10.42.42.10(pid=30151): Terminated {rc=256} 17:51:19.575608 --- ParallelTerminationStrategy: PID 30152 died... 17:51:19.595486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30152): Terminated: ok {rc=0} 17:51:19.642238 --- ParallelTerminationStrategy: PID 30153 died... 17:51:19.662003 run iperf3-srv_10.42.42.10(pid=30153): Terminated {rc=256} 17:51:19.708487 --- ParallelTerminationStrategy: PID 30154 died... 17:51:19.728429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30154): Terminated: ok {rc=0} 17:51:19.775095 --- ParallelTerminationStrategy: PID 30155 died... 17:51:19.794985 run iperf3-srv_10.42.42.10(pid=30155): Terminated {rc=256} 17:51:19.841566 --- ParallelTerminationStrategy: PID 30158 died... 17:51:19.861432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30158): Terminated: ok {rc=0} 17:51:19.908293 --- ParallelTerminationStrategy: PID 30161 died... 17:51:19.928351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30161): Terminated: ok {rc=0} 17:51:19.975193 --- ParallelTerminationStrategy: PID 30164 died... 17:51:19.995139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30164): Terminated: ok {rc=0} 17:51:20.083790 bus /gobi_4: Setting Powered False 17:51:21.185856 bus /gobi_4: Setting Powered False 17:51:22.305384 bus /gobi_1: Setting Powered False 17:51:23.405112 bus /gobi_1: Setting Powered False 17:51:24.521904 bus /gobi_0: Setting Powered False 17:51:25.621052 bus /gobi_0: Setting Powered False 17:51:26.737452 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 17:51:27.840824 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:27.852347 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:27.902406 tst ping.py: using LAC 22693 17:51:28.021050 tst ping.py: using RAC 253 17:51:28.137499 tst ping.py: using CellId 22693 17:51:28.256406 tst ping.py: using BVCI 22694 17:51:28.364837 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:28.375817 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:28.386526 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:28.397515 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:28.408276 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:28.419154 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:28.430271 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:28.441178 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:28.561515 tst ping.py:19: start network... 17:51:28.778776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:29.277190 run create_hlr_db(pid=30166): Launched 17:51:29.409417 bus /gobi_6: Setting Powered False 17:51:30.473703 run create_hlr_db(pid=30166): Terminated: ok {rc=0} 17:51:30.937512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30168): Launched 17:51:31.257975 run osmo-hlr_10.42.42.2(pid=30169): Launched 17:51:31.491332 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:32.208636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30171): Launched 17:51:32.529696 run osmo-stp_10.42.42.5(pid=30172): Launched 17:51:32.652464 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:33.207900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30174): Launched 17:51:33.333265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:33.605678 run patchelf(pid=30175): Launched 17:51:33.786666 run osmo-stp_10.42.42.5(pid=30172): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30172)] 17:51:33.923281 run osmo-stp_10.42.42.5(pid=30172): stdout: | (launched: 2022-12-09_17:51:32.471310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:34.062198 run osmo-stp_10.42.42.5(pid=30172): stderr: | 20221209175132665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175132665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175132665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175132666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175132666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175132666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175132666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:34.201158 run osmo-stp_10.42.42.5(pid=30172): stdout: | (launched: 2022-12-09_17:51:32.471310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:34.333686 run osmo-stp_10.42.42.5(pid=30172): stderr: | 20221209175132665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175132665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175132665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175132666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175132666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175132666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175132666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:34.489987 run patchelf(pid=30175): Terminating (SIGINT) 17:51:34.670338 run patchelf(pid=30175): Terminated: ok {rc=0} 17:51:34.800281 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30172): Process ended prematurely: osmo-stp_10.42.42.5(pid=30172) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30172)] [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 17:51:34.810143 tst ping.py:22: Test FAILED (7.0 sec) 17:51:34.838675 run osmo-hlr_10.42.42.2(pid=30169): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30169)] 17:51:34.888882 run osmo-hlr_10.42.42.2(pid=30169): stdout: | (launched: 2022-12-09_17:51:31.201375) 17:51:34.941275 run osmo-hlr_10.42.42.2(pid=30169): stderr: | 20221209175131542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175131542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175131542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175131542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175131542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175131542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175131562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175131575 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175131575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175131575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:34.993926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30168): Terminating (SIGTERM) 17:51:35.036258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30171): Terminating (SIGTERM) 17:51:35.078776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30174): Terminating (SIGTERM) 17:51:35.121712 --- ParallelTerminationStrategy: PID 30168 died... 17:51:35.142046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30168): Terminated: ok {rc=0} 17:51:35.189487 --- ParallelTerminationStrategy: PID 30171 died... 17:51:35.209429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30171): Terminated: ok {rc=0} 17:51:35.256453 --- ParallelTerminationStrategy: PID 30174 died... 17:51:35.276761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30174): Terminated: ok {rc=0} 17:51:35.366435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:51:36.451965 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:36.463576 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:51:36.522133 tst ping_idle_ping.py: using LAC 22694 17:51:36.640751 tst ping_idle_ping.py: using RAC 254 17:51:36.766174 tst ping_idle_ping.py: using CellId 22694 17:51:36.890554 tst ping_idle_ping.py: using BVCI 22695 17:51:37.007389 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:37.018985 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:37.030435 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:37.042002 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:37.053378 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:37.064631 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:37.076127 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:51:37.087473 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:51:37.202081 tst ping_idle_ping.py:24: start network... 17:51:37.406988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:37.876462 run create_hlr_db(pid=30176): Launched 17:51:37.992877 bus /gobi_6: Setting Powered False 17:51:39.054252 run create_hlr_db(pid=30176): Terminated: ok {rc=0} 17:51:39.501130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30178): Launched 17:51:39.825996 run osmo-hlr_10.42.42.2(pid=30179): Launched 17:51:39.952025 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:40.509209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30181): Launched 17:51:40.831892 run osmo-stp_10.42.42.5(pid=30182): Launched 17:51:40.957354 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:41.517586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30184): Launched 17:51:41.641660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:41.915005 run patchelf(pid=30185): Launched 17:51:42.096464 run osmo-stp_10.42.42.5(pid=30182): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30182)] 17:51:42.233919 run osmo-stp_10.42.42.5(pid=30182): stdout: | (launched: 2022-12-09_17:51:40.772636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:42.373743 run osmo-stp_10.42.42.5(pid=30182): stderr: | 20221209175140965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175140965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175140965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175140966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175140966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175140966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175140966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:42.513339 run osmo-stp_10.42.42.5(pid=30182): stdout: | (launched: 2022-12-09_17:51:40.772636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:42.645907 run osmo-stp_10.42.42.5(pid=30182): stderr: | 20221209175140965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175140965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175140965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175140966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175140966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175140966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175140966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:42.803097 run patchelf(pid=30185): Terminating (SIGINT) 17:51:42.985114 run patchelf(pid=30185): Terminated: ok {rc=0} 17:51:43.116072 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30182): Process ended prematurely: osmo-stp_10.42.42.5(pid=30182) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30182)] [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 17:51:43.125991 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:51:43.154318 run osmo-hlr_10.42.42.2(pid=30179): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30179)] 17:51:43.204514 run osmo-hlr_10.42.42.2(pid=30179): stdout: | (launched: 2022-12-09_17:51:39.767047) 17:51:43.256756 run osmo-hlr_10.42.42.2(pid=30179): stderr: | 20221209175139966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175139966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175139966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175139966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175139966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175139966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175139978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175139986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175139986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175139987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:43.309562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30178): Terminating (SIGTERM) 17:51:43.351797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30181): Terminating (SIGTERM) 17:51:43.393929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30184): Terminating (SIGTERM) 17:51:43.437075 --- ParallelTerminationStrategy: PID 30178 died... 17:51:43.457335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30178): Terminated: ok {rc=0} 17:51:43.503853 --- ParallelTerminationStrategy: PID 30181 died... 17:51:43.523502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30181): Terminated: ok {rc=0} 17:51:43.569906 --- ParallelTerminationStrategy: PID 30184 died... 17:51:43.589801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30184): Terminated: ok {rc=0} 17:51:43.678512 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:51:44.986747 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:51:44.993734 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:51:45.026992 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:51:45.066110 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:51:45.154161 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:51:45.187392 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:51:45.226805 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:51:45.821832 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:51:45.894024 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:45.906133 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:51:45.982756 tst cs_paging_gprs_active.py: using LAC 22695 17:51:46.115475 tst cs_paging_gprs_active.py: using RAC 255 17:51:46.249414 tst cs_paging_gprs_active.py: using CellId 22695 17:51:46.382676 tst cs_paging_gprs_active.py: using BVCI 22696 17:51:46.503994 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.516041 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.527944 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.539766 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.551355 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.563177 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.574910 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.586523 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:46.598447 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:46.742107 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:46.893991 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:51:47.136167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:47.452609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30190): Launched 17:51:47.721791 run iperf3-srv_10.42.42.10(pid=30191): Launched 17:51:47.838118 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:51:48.045729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:51:48.354703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30192): Launched 17:51:48.623944 run iperf3-srv_10.42.42.10(pid=30193): Launched 17:51:48.739492 tst cs_paging_gprs_active.py:38: start network... 17:51:48.944593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:49.418898 run create_hlr_db(pid=30194): Launched 17:51:49.537926 bus /gobi_6: Setting Powered False 17:51:50.598539 run create_hlr_db(pid=30194): Terminated: ok {rc=0} 17:51:51.026468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30196): Launched 17:51:51.333930 run osmo-hlr_10.42.42.2(pid=30197): Launched 17:51:51.451423 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:51.995052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30199): Launched 17:51:52.302333 run osmo-stp_10.42.42.5(pid=30200): Launched 17:51:52.419602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:52.964283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30202): Launched 17:51:53.082678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:53.351157 run patchelf(pid=30203): Launched 17:51:53.524305 run osmo-stp_10.42.42.5(pid=30200): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30200)] 17:51:53.654908 run osmo-stp_10.42.42.5(pid=30200): stdout: | (launched: 2022-12-09_17:51:52.245760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:53.786855 run osmo-stp_10.42.42.5(pid=30200): stderr: | 20221209175152436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175152436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175152436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175152436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175152437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175152437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175152437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:53.918923 run osmo-stp_10.42.42.5(pid=30200): stdout: | (launched: 2022-12-09_17:51:52.245760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:54.045080 run osmo-stp_10.42.42.5(pid=30200): stderr: | 20221209175152436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175152436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175152436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175152436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175152437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175152437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175152437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:54.194940 run patchelf(pid=30203): Terminating (SIGINT) 17:51:54.367767 run patchelf(pid=30203): Terminated: ok {rc=0} 17:51:54.493130 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30200): Process ended prematurely: osmo-stp_10.42.42.5(pid=30200) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30200)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:51:54.502790 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:51:54.530465 run osmo-hlr_10.42.42.2(pid=30197): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30197)] 17:51:54.578345 run osmo-hlr_10.42.42.2(pid=30197): stdout: | (launched: 2022-12-09_17:51:51.277436) 17:51:54.627747 run osmo-hlr_10.42.42.2(pid=30197): stderr: | 20221209175151453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175151453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175151453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175151454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175151454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175151454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175151466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175151477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175151477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175151477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:54.677521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30190): Terminating (SIGTERM) 17:51:54.717361 run iperf3-srv_10.42.42.10(pid=30191): Terminating (SIGTERM) 17:51:54.756728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30192): Terminating (SIGTERM) 17:51:54.796636 run iperf3-srv_10.42.42.10(pid=30193): Terminating (SIGTERM) 17:51:54.836093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30196): Terminating (SIGTERM) 17:51:54.875763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30199): Terminating (SIGTERM) 17:51:54.915595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30202): Terminating (SIGTERM) 17:51:54.955618 --- ParallelTerminationStrategy: PID 30190 died... 17:51:54.974717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30190): Terminated: ok {rc=0} 17:51:55.019087 --- ParallelTerminationStrategy: PID 30191 died... 17:51:55.037669 run iperf3-srv_10.42.42.10(pid=30191): Terminated {rc=256} 17:51:55.081757 --- ParallelTerminationStrategy: PID 30192 died... 17:51:55.100629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30192): Terminated: ok {rc=0} 17:51:55.144903 --- ParallelTerminationStrategy: PID 30193 died... 17:51:55.163864 run iperf3-srv_10.42.42.10(pid=30193): Terminated {rc=256} 17:51:55.208188 --- ParallelTerminationStrategy: PID 30196 died... 17:51:55.226877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30196): Terminated: ok {rc=0} 17:51:55.271353 --- ParallelTerminationStrategy: PID 30199 died... 17:51:55.290097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30199): Terminated: ok {rc=0} 17:51:55.334496 --- ParallelTerminationStrategy: PID 30202 died... 17:51:55.353108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30202): Terminated: ok {rc=0} 17:51:55.439243 bus /gobi_0: Setting Powered False 17:51:56.539314 bus /gobi_0: Setting Powered False 17:51:57.654927 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:51:58.801701 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:58.813234 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:51:58.882020 tst iperf3.py: using LAC 22696 17:51:59.002239 tst iperf3.py: using RAC 1 17:51:59.127041 tst iperf3.py: using CellId 22696 17:51:59.245914 tst iperf3.py: using BVCI 22697 17:51:59.359130 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:59.370103 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:59.380825 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:59.391763 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:59.402607 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:59.413588 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:59.424465 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:59.435324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:51:59.446416 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:51:59.566188 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:51:59.772613 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:00.082490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30204): Launched 17:52:00.352701 run iperf3-srv_10.42.42.10(pid=30205): Launched 17:52:00.468259 tst iperf3.py:8: start network... 17:52:00.674068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:01.160412 run create_hlr_db(pid=30206): Launched 17:52:01.334949 bus /gobi_6: Setting Powered False 17:52:02.396225 run create_hlr_db(pid=30206): Terminated: ok {rc=0} 17:52:02.849740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30208): Launched 17:52:03.180451 run osmo-hlr_10.42.42.2(pid=30209): Launched 17:52:03.305107 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:03.964376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30211): Launched 17:52:04.284140 run osmo-stp_10.42.42.5(pid=30212): Launched 17:52:04.406307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:04.959574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30214): Launched 17:52:05.082849 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:05.354803 run patchelf(pid=30215): Launched 17:52:05.533043 run osmo-stp_10.42.42.5(pid=30212): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30212)] 17:52:05.669149 run osmo-stp_10.42.42.5(pid=30212): stdout: | (launched: 2022-12-09_17:52:04.226006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:05.806309 run osmo-stp_10.42.42.5(pid=30212): stderr: | 20221209175204418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175204418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175204418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175204419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175204419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175204419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175204419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:05.943108 run osmo-stp_10.42.42.5(pid=30212): stdout: | (launched: 2022-12-09_17:52:04.226006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:06.074327 run osmo-stp_10.42.42.5(pid=30212): stderr: | 20221209175204418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175204418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175204418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175204419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175204419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175204419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175204419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:06.229546 run patchelf(pid=30215): Terminating (SIGINT) 17:52:06.409221 run patchelf(pid=30215): Terminated: ok {rc=0} 17:52:06.538615 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30212): Process ended prematurely: osmo-stp_10.42.42.5(pid=30212) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30212)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 17:52:06.548888 tst iperf3.py:8: Test FAILED (7.8 sec) 17:52:06.577535 run osmo-hlr_10.42.42.2(pid=30209): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30209)] 17:52:06.627152 run osmo-hlr_10.42.42.2(pid=30209): stdout: | (launched: 2022-12-09_17:52:03.120461) 17:52:06.678715 run osmo-hlr_10.42.42.2(pid=30209): stderr: | 20221209175203324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175203324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175203324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175203324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175203324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175203324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175203336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175203344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175203344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175203345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:06.730723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30204): Terminating (SIGTERM) 17:52:06.772536 run iperf3-srv_10.42.42.10(pid=30205): Terminating (SIGTERM) 17:52:06.814245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30208): Terminating (SIGTERM) 17:52:06.855910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30211): Terminating (SIGTERM) 17:52:06.897764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30214): Terminating (SIGTERM) 17:52:06.939609 --- ParallelTerminationStrategy: PID 30204 died... 17:52:06.959631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30204): Terminated: ok {rc=0} 17:52:07.006370 --- ParallelTerminationStrategy: PID 30205 died... 17:52:07.025994 run iperf3-srv_10.42.42.10(pid=30205): Terminated {rc=256} 17:52:07.072391 --- ParallelTerminationStrategy: PID 30208 died... 17:52:07.092242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30208): Terminated: ok {rc=0} 17:52:07.138699 --- ParallelTerminationStrategy: PID 30211 died... 17:52:07.158293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30211): Terminated: ok {rc=0} 17:52:07.204672 --- ParallelTerminationStrategy: PID 30214 died... 17:52:07.224298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30214): Terminated: ok {rc=0} 17:52:07.313199 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:52:08.459741 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:08.471224 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:08.538114 tst iperf3m4.py: using LAC 22697 17:52:08.658237 tst iperf3m4.py: using RAC 2 17:52:08.775218 tst iperf3m4.py: using CellId 22697 17:52:08.898204 tst iperf3m4.py: using BVCI 22698 17:52:09.008292 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:09.019264 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:09.029958 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:09.040845 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:09.051775 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:09.062650 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:09.073610 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:09.084217 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:09.095181 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:09.210932 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:09.330177 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:09.444681 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:09.559242 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:52:09.760265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:10.062440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30216): Launched 17:52:10.325270 run iperf3-srv_10.42.42.10(pid=30217): Launched 17:52:10.438335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:52:10.638348 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:10.939532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30218): Launched 17:52:11.202108 run iperf3-srv_10.42.42.10(pid=30219): Launched 17:52:11.314785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:52:11.514569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:11.817224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30220): Launched 17:52:12.082427 run iperf3-srv_10.42.42.10(pid=30227): Launched 17:52:12.197400 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:52:12.398018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:12.699411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30228): Launched 17:52:12.961016 run iperf3-srv_10.42.42.10(pid=30229): Launched 17:52:13.073736 tst iperf3m4.py:8: start network... 17:52:13.273269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:13.740178 run create_hlr_db(pid=30230): Launched 17:52:13.855360 bus /gobi_6: Setting Powered False 17:52:14.914733 run create_hlr_db(pid=30230): Terminated: ok {rc=0} 17:52:15.357589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30232): Launched 17:52:15.681371 run osmo-hlr_10.42.42.2(pid=30233): Launched 17:52:15.803910 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:16.493840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30235): Launched 17:52:16.855185 run osmo-stp_10.42.42.5(pid=30236): Launched 17:52:17.167049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:17.726531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30238): Launched 17:52:17.850977 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:18.121429 run patchelf(pid=30239): Launched 17:52:18.301938 run osmo-stp_10.42.42.5(pid=30236): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30236)] 17:52:18.438901 run osmo-stp_10.42.42.5(pid=30236): stdout: | (launched: 2022-12-09_17:52:16.798477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:18.576910 run osmo-stp_10.42.42.5(pid=30236): stderr: | 20221209175216995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175216995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175216995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175216996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175216996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175216996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175216996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:18.714988 run osmo-stp_10.42.42.5(pid=30236): stdout: | (launched: 2022-12-09_17:52:16.798477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:18.847211 run osmo-stp_10.42.42.5(pid=30236): stderr: | 20221209175216995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175216995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175216995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175216996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175216996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175216996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175216996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:19.003395 run patchelf(pid=30239): Terminating (SIGINT) 17:52:19.184076 run patchelf(pid=30239): Terminated: ok {rc=0} 17:52:19.314906 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30236): Process ended prematurely: osmo-stp_10.42.42.5(pid=30236) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30236)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:52:19.325437 tst iperf3m4.py:8: Test FAILED (10.9 sec) 17:52:19.354939 run osmo-hlr_10.42.42.2(pid=30233): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30233)] 17:52:19.405634 run osmo-hlr_10.42.42.2(pid=30233): stdout: | (launched: 2022-12-09_17:52:15.621038) 17:52:19.458180 run osmo-hlr_10.42.42.2(pid=30233): stderr: | 20221209175215822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175215822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175215822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175215822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175215822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175215822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175215839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175215859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175215859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175215859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:19.511185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30216): Terminating (SIGTERM) 17:52:19.553541 run iperf3-srv_10.42.42.10(pid=30217): Terminating (SIGTERM) 17:52:19.595924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30218): Terminating (SIGTERM) 17:52:19.638139 run iperf3-srv_10.42.42.10(pid=30219): Terminating (SIGTERM) 17:52:19.680044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30220): Terminating (SIGTERM) 17:52:19.722673 run iperf3-srv_10.42.42.10(pid=30227): Terminating (SIGTERM) 17:52:19.764623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30228): Terminating (SIGTERM) 17:52:19.806777 run iperf3-srv_10.42.42.10(pid=30229): Terminating (SIGTERM) 17:52:19.848702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30232): Terminating (SIGTERM) 17:52:19.890929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30235): Terminating (SIGTERM) 17:52:19.932863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30238): Terminating (SIGTERM) 17:52:19.975304 --- ParallelTerminationStrategy: PID 30216 died... 17:52:19.995388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30216): Terminated: ok {rc=0} 17:52:20.041913 --- ParallelTerminationStrategy: PID 30217 died... 17:52:20.061442 run iperf3-srv_10.42.42.10(pid=30217): Terminated {rc=256} 17:52:20.108174 --- ParallelTerminationStrategy: PID 30218 died... 17:52:20.127705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30218): Terminated: ok {rc=0} 17:52:20.173894 --- ParallelTerminationStrategy: PID 30219 died... 17:52:20.193359 run iperf3-srv_10.42.42.10(pid=30219): Terminated {rc=256} 17:52:20.239594 --- ParallelTerminationStrategy: PID 30220 died... 17:52:20.259216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30220): Terminated: ok {rc=0} 17:52:20.306733 --- ParallelTerminationStrategy: PID 30227 died... 17:52:20.326353 run iperf3-srv_10.42.42.10(pid=30227): Terminated {rc=256} 17:52:20.372752 --- ParallelTerminationStrategy: PID 30228 died... 17:52:20.392358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30228): Terminated: ok {rc=0} 17:52:20.438803 --- ParallelTerminationStrategy: PID 30229 died... 17:52:20.458534 run iperf3-srv_10.42.42.10(pid=30229): Terminated {rc=256} 17:52:20.504755 --- ParallelTerminationStrategy: PID 30232 died... 17:52:20.524403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30232): Terminated: ok {rc=0} 17:52:20.570632 --- ParallelTerminationStrategy: PID 30235 died... 17:52:20.590210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30235): Terminated: ok {rc=0} 17:52:20.636780 --- ParallelTerminationStrategy: PID 30238 died... 17:52:20.656821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30238): Terminated: ok {rc=0} 17:52:20.745369 bus /gobi_4: Setting Powered False 17:52:21.844470 bus /gobi_4: Setting Powered False 17:52:22.962937 bus /gobi_1: Setting Powered False 17:52:24.063477 bus /gobi_1: Setting Powered False 17:52:25.180633 bus /gobi_0: Setting Powered False 17:52:26.281153 bus /gobi_0: Setting Powered False 17:52:27.398677 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:52:28.517723 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:28.529140 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:28.597606 tst ping.py: using LAC 22698 17:52:28.720325 tst ping.py: using RAC 3 17:52:28.839447 tst ping.py: using CellId 22698 17:52:28.958561 tst ping.py: using BVCI 22699 17:52:29.070104 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:29.081333 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:29.092330 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:29.103373 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:29.114315 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:29.125382 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:29.136427 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:29.147385 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:29.263749 tst ping.py:19: start network... 17:52:29.468866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:29.942872 run create_hlr_db(pid=30240): Launched 17:52:30.066646 bus /gobi_6: Setting Powered False 17:52:31.135488 run create_hlr_db(pid=30240): Terminated: ok {rc=0} 17:52:31.560379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30242): Launched 17:52:31.884130 run osmo-hlr_10.42.42.2(pid=30243): Launched 17:52:32.111506 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:32.666809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30245): Launched 17:52:32.952012 run osmo-stp_10.42.42.5(pid=30246): Launched 17:52:33.061279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:33.554656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30248): Launched 17:52:33.664745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:33.905973 run patchelf(pid=30249): Launched 17:52:34.064793 run osmo-stp_10.42.42.5(pid=30246): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30246)] 17:52:34.196233 run osmo-stp_10.42.42.5(pid=30246): stdout: | (launched: 2022-12-09_17:52:32.900044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:34.328223 run osmo-stp_10.42.42.5(pid=30246): stderr: | 20221209175233067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175233067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175233067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175233068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175233068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175233068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175233068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:34.460058 run osmo-stp_10.42.42.5(pid=30246): stdout: | (launched: 2022-12-09_17:52:32.900044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:34.585347 run osmo-stp_10.42.42.5(pid=30246): stderr: | 20221209175233067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175233067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175233067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175233068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175233068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175233068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175233068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:34.733573 run patchelf(pid=30249): Terminating (SIGINT) 17:52:34.904243 run patchelf(pid=30249): Terminated: ok {rc=0} 17:52:35.027995 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30246): Process ended prematurely: osmo-stp_10.42.42.5(pid=30246) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30246)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 17:52:35.037749 tst ping.py:22: Test FAILED (6.5 sec) 17:52:35.065463 run osmo-hlr_10.42.42.2(pid=30243): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30243)] 17:52:35.115714 run osmo-hlr_10.42.42.2(pid=30243): stdout: | (launched: 2022-12-09_17:52:31.810176) 17:52:35.167379 run osmo-hlr_10.42.42.2(pid=30243): stderr: | 20221209175232153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175232153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175232153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175232153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175232153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175232153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175232167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175232184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175232184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175232184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:35.219444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30242): Terminating (SIGTERM) 17:52:35.260880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30245): Terminating (SIGTERM) 17:52:35.302743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30248): Terminating (SIGTERM) 17:52:35.344675 --- ParallelTerminationStrategy: PID 30242 died... 17:52:35.364582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30242): Terminated: ok {rc=0} 17:52:35.410453 --- ParallelTerminationStrategy: PID 30245 died... 17:52:35.429916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30245): Terminated: ok {rc=0} 17:52:35.476238 --- ParallelTerminationStrategy: PID 30248 died... 17:52:35.496093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30248): Terminated: ok {rc=0} 17:52:35.583109 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:52:36.669646 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:36.681633 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:52:36.754620 tst ping_idle_ping.py: using LAC 22699 17:52:36.875495 tst ping_idle_ping.py: using RAC 4 17:52:36.994902 tst ping_idle_ping.py: using CellId 22699 17:52:37.117410 tst ping_idle_ping.py: using BVCI 22700 17:52:37.228155 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:37.239351 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:37.250368 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:37.261415 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:37.272425 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:37.283645 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:37.294924 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:52:37.306354 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:52:37.421871 tst ping_idle_ping.py:24: start network... 17:52:37.628234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:38.100919 run create_hlr_db(pid=30250): Launched 17:52:38.224881 bus /gobi_6: Setting Powered False 17:52:39.285936 run create_hlr_db(pid=30250): Terminated: ok {rc=0} 17:52:39.712661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30252): Launched 17:52:40.017885 run osmo-hlr_10.42.42.2(pid=30253): Launched 17:52:40.134434 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:40.658160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30255): Launched 17:52:40.964346 run osmo-stp_10.42.42.5(pid=30256): Launched 17:52:41.081510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:41.610241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30258): Launched 17:52:41.727582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:41.986304 run patchelf(pid=30259): Launched 17:52:42.156508 run osmo-stp_10.42.42.5(pid=30256): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30256)] 17:52:42.286759 run osmo-stp_10.42.42.5(pid=30256): stdout: | (launched: 2022-12-09_17:52:40.908651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:42.419373 run osmo-stp_10.42.42.5(pid=30256): stderr: | 20221209175241098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175241098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175241098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175241099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175241099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175241099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175241099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:42.551561 run osmo-stp_10.42.42.5(pid=30256): stdout: | (launched: 2022-12-09_17:52:40.908651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:42.677344 run osmo-stp_10.42.42.5(pid=30256): stderr: | 20221209175241098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175241098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175241098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175241099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175241099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175241099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175241099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:42.826595 run patchelf(pid=30259): Terminating (SIGINT) 17:52:42.999133 run patchelf(pid=30259): Terminated: ok {rc=0} 17:52:43.123514 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30256): Process ended prematurely: osmo-stp_10.42.42.5(pid=30256) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30256)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:52:43.132912 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:52:43.160735 run osmo-hlr_10.42.42.2(pid=30253): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30253)] 17:52:43.209791 run osmo-hlr_10.42.42.2(pid=30253): stdout: | (launched: 2022-12-09_17:52:39.962548) 17:52:43.260750 run osmo-hlr_10.42.42.2(pid=30253): stderr: | 20221209175240158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175240158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175240158 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175240158 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175240158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175240158 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175240172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175240182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175240182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175240182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:43.312525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30252): Terminating (SIGTERM) 17:52:43.353928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30255): Terminating (SIGTERM) 17:52:43.395019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30258): Terminating (SIGTERM) 17:52:43.436363 --- ParallelTerminationStrategy: PID 30252 died... 17:52:43.456089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30252): Terminated: ok {rc=0} 17:52:43.501975 --- ParallelTerminationStrategy: PID 30255 died... 17:52:43.521264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30255): Terminated: ok {rc=0} 17:52:43.566941 --- ParallelTerminationStrategy: PID 30258 died... 17:52:43.586225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30258): Terminated: ok {rc=0} 17:52:43.673459 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:52:44.980070 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:52:44.986904 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:52:45.019901 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:52:45.058953 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:52:45.148057 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:52:45.180168 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:52:45.218455 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:52:45.809930 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:52:45.858762 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:45.870104 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:52:45.940321 tst cs_paging_gprs_active.py: using LAC 22700 17:52:46.062369 tst cs_paging_gprs_active.py: using RAC 5 17:52:46.189340 tst cs_paging_gprs_active.py: using CellId 22700 17:52:46.346229 tst cs_paging_gprs_active.py: using BVCI 22701 17:52:46.457872 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:46.469914 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:46.482863 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:46.494986 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:46.507876 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:46.520807 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:46.535256 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:46.547140 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:46.560187 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:46.677695 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:46.797978 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:52:47.036279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:47.339332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30263): Launched 17:52:47.613757 run iperf3-srv_10.42.42.10(pid=30264): Launched 17:52:47.731106 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:52:47.941826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:48.256469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30265): Launched 17:52:48.529507 run iperf3-srv_10.42.42.10(pid=30266): Launched 17:52:48.646559 tst cs_paging_gprs_active.py:38: start network... 17:52:48.857523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:49.342304 run create_hlr_db(pid=30267): Launched 17:52:49.470657 bus /gobi_6: Setting Powered False 17:52:50.532222 run create_hlr_db(pid=30267): Terminated: ok {rc=0} 17:52:50.950221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30269): Launched 17:52:51.243856 run osmo-hlr_10.42.42.2(pid=30270): Launched 17:52:51.356098 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:51.869735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30272): Launched 17:52:52.161087 run osmo-stp_10.42.42.5(pid=30273): Launched 17:52:52.272263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:52:52.775411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30275): Launched 17:52:52.887505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:52:53.134974 run patchelf(pid=30276): Launched 17:52:53.297631 run osmo-stp_10.42.42.5(pid=30273): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30273)] 17:52:53.421650 run osmo-stp_10.42.42.5(pid=30273): stdout: | (launched: 2022-12-09_17:52:52.107845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:53.546630 run osmo-stp_10.42.42.5(pid=30273): stderr: | 20221209175252275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175252275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175252276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175252277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175252277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175252277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175252277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:53.671910 run osmo-stp_10.42.42.5(pid=30273): stdout: | (launched: 2022-12-09_17:52:52.107845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:53.791625 run osmo-stp_10.42.42.5(pid=30273): stderr: | 20221209175252275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175252275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175252276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175252277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175252277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175252277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175252277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:53.933645 run patchelf(pid=30276): Terminating (SIGINT) 17:52:54.098865 run patchelf(pid=30276): Terminated: ok {rc=0} 17:52:54.218036 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30273): Process ended prematurely: osmo-stp_10.42.42.5(pid=30273) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30273)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:52:54.227344 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 17:52:54.254359 run osmo-hlr_10.42.42.2(pid=30270): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30270)] 17:52:54.301856 run osmo-hlr_10.42.42.2(pid=30270): stdout: | (launched: 2022-12-09_17:52:51.190070) 17:52:54.350769 run osmo-hlr_10.42.42.2(pid=30270): stderr: | 20221209175251363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175251363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175251363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175251363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175251363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175251363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175251376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175251386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175251386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175251386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:54.400075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30263): Terminating (SIGTERM) 17:52:54.438937 run iperf3-srv_10.42.42.10(pid=30264): Terminating (SIGTERM) 17:52:54.478163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30265): Terminating (SIGTERM) 17:52:54.517816 run iperf3-srv_10.42.42.10(pid=30266): Terminating (SIGTERM) 17:52:54.556851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30269): Terminating (SIGTERM) 17:52:54.596149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30272): Terminating (SIGTERM) 17:52:54.635430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30275): Terminating (SIGTERM) 17:52:54.674846 --- ParallelTerminationStrategy: PID 30263 died... 17:52:54.693571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30263): Terminated: ok {rc=0} 17:52:54.737358 --- ParallelTerminationStrategy: PID 30264 died... 17:52:54.755630 run iperf3-srv_10.42.42.10(pid=30264): Terminated {rc=256} 17:52:54.799010 --- ParallelTerminationStrategy: PID 30265 died... 17:52:54.817167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30265): Terminated: ok {rc=0} 17:52:54.860403 --- ParallelTerminationStrategy: PID 30266 died... 17:52:54.878874 run iperf3-srv_10.42.42.10(pid=30266): Terminated {rc=256} 17:52:54.922140 --- ParallelTerminationStrategy: PID 30269 died... 17:52:54.940334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30269): Terminated: ok {rc=0} 17:52:54.983840 --- ParallelTerminationStrategy: PID 30272 died... 17:52:55.002182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30272): Terminated: ok {rc=0} 17:52:55.045597 --- ParallelTerminationStrategy: PID 30275 died... 17:52:55.063936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30275): Terminated: ok {rc=0} 17:52:55.147343 bus /gobi_0: Setting Powered False 17:52:56.244471 bus /gobi_0: Setting Powered False 17:52:57.362450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:52:58.505599 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:58.517109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:52:58.586204 tst iperf3.py: using LAC 22701 17:52:58.704720 tst iperf3.py: using RAC 6 17:52:58.828110 tst iperf3.py: using CellId 22701 17:52:58.943319 tst iperf3.py: using BVCI 22702 17:52:59.048830 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:59.059805 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:59.070385 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:59.081292 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:59.092138 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:59.103169 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:59.114152 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:59.124751 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:52:59.135632 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:52:59.251231 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:52:59.462628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:52:59.774690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30277): Launched 17:53:00.045811 run iperf3-srv_10.42.42.10(pid=30278): Launched 17:53:00.163369 tst iperf3.py:8: start network... 17:53:00.373198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:00.869109 run create_hlr_db(pid=30279): Launched 17:53:01.031959 bus /gobi_6: Setting Powered False 17:53:02.112539 run create_hlr_db(pid=30279): Terminated: ok {rc=0} 17:53:02.631088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30318): Launched 17:53:02.975876 run osmo-hlr_10.42.42.2(pid=30331): Launched 17:53:03.247203 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:04.077352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30460): Launched 17:53:04.473739 run osmo-stp_10.42.42.5(pid=30511): Launched 17:53:04.755150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:05.449739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30558): Launched 17:53:05.575227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:05.841736 run patchelf(pid=30559): Launched 17:53:06.020831 run osmo-stp_10.42.42.5(pid=30511): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30511)] 17:53:06.150493 run osmo-stp_10.42.42.5(pid=30511): stdout: | (launched: 2022-12-09_17:53:04.394802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:06.283045 run osmo-stp_10.42.42.5(pid=30511): stderr: | 20221209175304779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175304779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175304779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175304780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175304780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175304780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175304780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:06.413950 run osmo-stp_10.42.42.5(pid=30511): stdout: | (launched: 2022-12-09_17:53:04.394802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:06.538923 run osmo-stp_10.42.42.5(pid=30511): stderr: | 20221209175304779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175304779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175304779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175304780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175304780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175304780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175304780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:06.686185 run patchelf(pid=30559): Terminating (SIGINT) 17:53:06.855500 run patchelf(pid=30559): Terminated: ok {rc=0} 17:53:06.979017 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30511): Process ended prematurely: osmo-stp_10.42.42.5(pid=30511) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30511)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 17:53:06.989725 tst iperf3.py:8: Test FAILED (8.5 sec) 17:53:07.020114 run osmo-hlr_10.42.42.2(pid=30331): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30331)] 17:53:07.070337 run osmo-hlr_10.42.42.2(pid=30331): stdout: | (launched: 2022-12-09_17:53:02.909831) 17:53:07.123107 run osmo-hlr_10.42.42.2(pid=30331): stderr: | 20221209175303282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175303282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175303282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175303282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175303282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175303282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175303301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175303318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175303318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175303318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:07.175882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30277): Terminating (SIGTERM) 17:53:07.219543 run iperf3-srv_10.42.42.10(pid=30278): Terminating (SIGTERM) 17:53:07.266776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30318): Terminating (SIGTERM) 17:53:07.310675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30460): Terminating (SIGTERM) 17:53:07.354783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30558): Terminating (SIGTERM) 17:53:07.399431 --- ParallelTerminationStrategy: PID 30277 died... 17:53:07.419195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30277): Terminated: ok {rc=0} 17:53:07.467730 --- ParallelTerminationStrategy: PID 30278 died... 17:53:07.488155 run iperf3-srv_10.42.42.10(pid=30278): Terminated {rc=256} 17:53:07.535250 --- ParallelTerminationStrategy: PID 30318 died... 17:53:07.554633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30318): Terminated: ok {rc=0} 17:53:07.601638 --- ParallelTerminationStrategy: PID 30460 died... 17:53:07.621136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30460): Terminated: ok {rc=0} 17:53:07.668686 --- ParallelTerminationStrategy: PID 30558 died... 17:53:07.689366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30558): Terminated: ok {rc=0} 17:53:07.777100 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:53:08.925852 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:08.938329 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:09.010160 tst iperf3m4.py: using LAC 22702 17:53:09.130179 tst iperf3m4.py: using RAC 7 17:53:09.247935 tst iperf3m4.py: using CellId 22702 17:53:09.368375 tst iperf3m4.py: using BVCI 22703 17:53:09.479103 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:09.491325 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:09.503022 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:09.515944 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:09.528689 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:09.541590 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:09.555333 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:09.568177 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:09.580350 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:09.702025 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:09.821930 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:09.940785 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:10.058538 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:53:10.263536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:10.571887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30562): Launched 17:53:10.851054 run iperf3-srv_10.42.42.10(pid=30563): Launched 17:53:10.979312 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:53:11.181074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:11.493688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30564): Launched 17:53:11.793742 run iperf3-srv_10.42.42.10(pid=30565): Launched 17:53:11.918202 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:53:12.121927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:12.432576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30566): Launched 17:53:12.723575 run iperf3-srv_10.42.42.10(pid=30567): Launched 17:53:12.856502 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:53:13.072091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:13.397167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30568): Launched 17:53:13.690206 run iperf3-srv_10.42.42.10(pid=30569): Launched 17:53:13.823457 tst iperf3m4.py:8: start network... 17:53:14.038470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:14.535380 run create_hlr_db(pid=30570): Launched 17:53:14.695549 bus /gobi_6: Setting Powered False 17:53:15.756011 run create_hlr_db(pid=30570): Terminated: ok {rc=0} 17:53:16.237685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30572): Launched 17:53:16.615373 run osmo-hlr_10.42.42.2(pid=30573): Launched 17:53:16.774383 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:17.667277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30575): Launched 17:53:18.057977 run osmo-stp_10.42.42.5(pid=30576): Launched 17:53:18.335542 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:18.968603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30578): Launched 17:53:19.106774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:19.391851 run patchelf(pid=30579): Launched 17:53:19.593338 run osmo-stp_10.42.42.5(pid=30576): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30576)] 17:53:19.738202 run osmo-stp_10.42.42.5(pid=30576): stdout: | (launched: 2022-12-09_17:53:17.986252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:19.880897 run osmo-stp_10.42.42.5(pid=30576): stderr: | 20221209175318311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175318312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175318312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175318312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175318313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175318313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175318313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:20.023570 run osmo-stp_10.42.42.5(pid=30576): stdout: | (launched: 2022-12-09_17:53:17.986252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:20.159742 run osmo-stp_10.42.42.5(pid=30576): stderr: | 20221209175318311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175318312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175318312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175318312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175318313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175318313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175318313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:20.322921 run patchelf(pid=30579): Terminating (SIGINT) 17:53:20.518347 run patchelf(pid=30579): Terminated: ok {rc=0} 17:53:20.648561 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30576): Process ended prematurely: osmo-stp_10.42.42.5(pid=30576) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30576)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:53:20.659996 tst iperf3m4.py:8: Test FAILED (11.8 sec) 17:53:20.693350 run osmo-hlr_10.42.42.2(pid=30573): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30573)] 17:53:20.745247 run osmo-hlr_10.42.42.2(pid=30573): stdout: | (launched: 2022-12-09_17:53:16.551397) 17:53:20.798928 run osmo-hlr_10.42.42.2(pid=30573): stderr: | 20221209175316878 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175316878 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175316878 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175316878 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175316878 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175316878 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175316895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175316912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175316912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175316912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:20.854376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30562): Terminating (SIGTERM) 17:53:20.900128 run iperf3-srv_10.42.42.10(pid=30563): Terminating (SIGTERM) 17:53:20.947846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30564): Terminating (SIGTERM) 17:53:20.991804 run iperf3-srv_10.42.42.10(pid=30565): Terminating (SIGTERM) 17:53:21.038598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30566): Terminating (SIGTERM) 17:53:21.083757 run iperf3-srv_10.42.42.10(pid=30567): Terminating (SIGTERM) 17:53:21.130390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30568): Terminating (SIGTERM) 17:53:21.174822 run iperf3-srv_10.42.42.10(pid=30569): Terminating (SIGTERM) 17:53:21.221671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30572): Terminating (SIGTERM) 17:53:21.266122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30575): Terminating (SIGTERM) 17:53:21.313622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30578): Terminating (SIGTERM) 17:53:21.358803 --- ParallelTerminationStrategy: PID 30562 died... 17:53:21.379194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30562): Terminated: ok {rc=0} 17:53:21.428086 --- ParallelTerminationStrategy: PID 30563 died... 17:53:21.448150 run iperf3-srv_10.42.42.10(pid=30563): Terminated {rc=256} 17:53:21.497796 --- ParallelTerminationStrategy: PID 30564 died... 17:53:21.518303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30564): Terminated: ok {rc=0} 17:53:21.567493 --- ParallelTerminationStrategy: PID 30565 died... 17:53:21.587322 run iperf3-srv_10.42.42.10(pid=30565): Terminated {rc=256} 17:53:21.635647 --- ParallelTerminationStrategy: PID 30566 died... 17:53:21.655939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30566): Terminated: ok {rc=0} 17:53:21.705914 --- ParallelTerminationStrategy: PID 30567 died... 17:53:21.725763 run iperf3-srv_10.42.42.10(pid=30567): Terminated {rc=256} 17:53:21.774430 --- ParallelTerminationStrategy: PID 30568 died... 17:53:21.794606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30568): Terminated: ok {rc=0} 17:53:21.844432 --- ParallelTerminationStrategy: PID 30569 died... 17:53:21.864658 run iperf3-srv_10.42.42.10(pid=30569): Terminated {rc=256} 17:53:21.917555 --- ParallelTerminationStrategy: PID 30572 died... 17:53:21.937978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30572): Terminated: ok {rc=0} 17:53:21.986116 --- ParallelTerminationStrategy: PID 30575 died... 17:53:22.006189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30575): Terminated: ok {rc=0} 17:53:22.054603 --- ParallelTerminationStrategy: PID 30578 died... 17:53:22.074372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30578): Terminated: ok {rc=0} 17:53:22.166098 bus /gobi_4: Setting Powered False 17:53:23.269753 bus /gobi_4: Setting Powered False 17:53:24.389550 bus /gobi_1: Setting Powered False 17:53:25.486895 bus /gobi_1: Setting Powered False 17:53:26.603943 bus /gobi_0: Setting Powered False 17:53:27.703245 bus /gobi_0: Setting Powered False 17:53:28.822436 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:53:29.926781 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:29.938953 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:30.010001 tst ping.py: using LAC 22703 17:53:30.129387 tst ping.py: using RAC 8 17:53:30.248933 tst ping.py: using CellId 22703 17:53:30.366794 tst ping.py: using BVCI 22704 17:53:30.474774 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:30.485990 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:30.496738 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:30.507958 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:30.519069 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:30.530384 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:30.541832 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:30.553108 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:30.671565 tst ping.py:19: start network... 17:53:30.891256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:31.399417 run create_hlr_db(pid=30580): Launched 17:53:31.556845 bus /gobi_6: Setting Powered False 17:53:32.616433 run create_hlr_db(pid=30580): Terminated: ok {rc=0} 17:53:33.058572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30582): Launched 17:53:33.379180 run osmo-hlr_10.42.42.2(pid=30583): Launched 17:53:33.501478 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:34.049725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30585): Launched 17:53:34.369793 run osmo-stp_10.42.42.5(pid=30586): Launched 17:53:34.492298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:35.042627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30588): Launched 17:53:35.165522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:35.434289 run patchelf(pid=30589): Launched 17:53:35.612921 run osmo-stp_10.42.42.5(pid=30586): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30586)] 17:53:35.748130 run osmo-stp_10.42.42.5(pid=30586): stdout: | (launched: 2022-12-09_17:53:34.310711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:35.885506 run osmo-stp_10.42.42.5(pid=30586): stderr: | 20221209175334505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175334505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175334506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175334506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175334507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175334507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175334507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:36.022950 run osmo-stp_10.42.42.5(pid=30586): stdout: | (launched: 2022-12-09_17:53:34.310711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:36.153419 run osmo-stp_10.42.42.5(pid=30586): stderr: | 20221209175334505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175334505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175334506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175334506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175334507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175334507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175334507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:36.308479 run patchelf(pid=30589): Terminating (SIGINT) 17:53:36.488104 run patchelf(pid=30589): Terminated: ok {rc=0} 17:53:36.616826 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30586): Process ended prematurely: osmo-stp_10.42.42.5(pid=30586) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30586)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 17:53:36.626554 tst ping.py:22: Test FAILED (6.7 sec) 17:53:36.654800 run osmo-hlr_10.42.42.2(pid=30583): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30583)] 17:53:36.704816 run osmo-hlr_10.42.42.2(pid=30583): stdout: | (launched: 2022-12-09_17:53:33.320695) 17:53:36.756682 run osmo-hlr_10.42.42.2(pid=30583): stderr: | 20221209175333518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175333518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175333518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175333518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175333518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175333518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175333532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175333542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175333542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175333542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:36.809220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30582): Terminating (SIGTERM) 17:53:36.851320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30585): Terminating (SIGTERM) 17:53:36.893498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30588): Terminating (SIGTERM) 17:53:36.935890 --- ParallelTerminationStrategy: PID 30582 died... 17:53:36.955972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30582): Terminated: ok {rc=0} 17:53:37.003001 --- ParallelTerminationStrategy: PID 30585 died... 17:53:37.022704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30585): Terminated: ok {rc=0} 17:53:37.069411 --- ParallelTerminationStrategy: PID 30588 died... 17:53:37.089193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30588): Terminated: ok {rc=0} 17:53:37.178194 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:53:38.266250 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:38.278620 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:53:38.354237 tst ping_idle_ping.py: using LAC 22704 17:53:38.481291 tst ping_idle_ping.py: using RAC 9 17:53:38.605993 tst ping_idle_ping.py: using CellId 22704 17:53:38.730908 tst ping_idle_ping.py: using BVCI 22705 17:53:38.846632 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:38.858268 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:38.869751 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:38.881225 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:38.892416 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:38.903866 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:38.915346 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:53:38.926738 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:53:39.043235 tst ping_idle_ping.py:24: start network... 17:53:39.245330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:39.710491 run create_hlr_db(pid=30590): Launched 17:53:39.827549 bus /gobi_6: Setting Powered False 17:53:40.887430 run create_hlr_db(pid=30590): Terminated: ok {rc=0} 17:53:41.326466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30593): Launched 17:53:41.646596 run osmo-hlr_10.42.42.2(pid=30594): Launched 17:53:41.770543 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:42.320207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30596): Launched 17:53:42.642228 run osmo-stp_10.42.42.5(pid=30597): Launched 17:53:42.766108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:43.318047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30599): Launched 17:53:43.442756 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:43.712043 run patchelf(pid=30600): Launched 17:53:43.890025 run osmo-stp_10.42.42.5(pid=30597): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30597)] 17:53:44.025693 run osmo-stp_10.42.42.5(pid=30597): stdout: | (launched: 2022-12-09_17:53:42.583640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:44.163498 run osmo-stp_10.42.42.5(pid=30597): stderr: | 20221209175342778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175342778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175342778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175342779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175342779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175342779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175342779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:44.301685 run osmo-stp_10.42.42.5(pid=30597): stdout: | (launched: 2022-12-09_17:53:42.583640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:44.434065 run osmo-stp_10.42.42.5(pid=30597): stderr: | 20221209175342778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175342778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175342778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175342779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175342779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175342779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175342779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:44.589678 run patchelf(pid=30600): Terminating (SIGINT) 17:53:44.768867 run patchelf(pid=30600): Terminated: ok {rc=0} 17:53:44.898275 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30597): Process ended prematurely: osmo-stp_10.42.42.5(pid=30597) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30597)] [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:53:44.908019 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:53:44.936456 run osmo-hlr_10.42.42.2(pid=30594): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30594)] 17:53:44.986667 run osmo-hlr_10.42.42.2(pid=30594): stdout: | (launched: 2022-12-09_17:53:41.588005) 17:53:45.038789 run osmo-hlr_10.42.42.2(pid=30594): stderr: | 20221209175341787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175341787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175341787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175341787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175341787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175341787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175341799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175341808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175341808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175341808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:45.091168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30593): Terminating (SIGTERM) 17:53:45.133146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30596): Terminating (SIGTERM) 17:53:45.175202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30599): Terminating (SIGTERM) 17:53:45.217850 --- ParallelTerminationStrategy: PID 30593 died... 17:53:45.237971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30593): Terminated: ok {rc=0} 17:53:45.284341 --- ParallelTerminationStrategy: PID 30596 died... 17:53:45.303888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30596): Terminated: ok {rc=0} 17:53:45.350951 --- ParallelTerminationStrategy: PID 30599 died... 17:53:45.370765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30599): Terminated: ok {rc=0} 17:53:45.458671 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 17:53:46.765260 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:53:46.775758 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 17:53:46.818546 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 17:53:46.867298 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 17:53:46.958390 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 17:53:46.995105 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 17:53:47.034989 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 17:53:47.636309 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 17:53:47.686703 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:47.698332 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:53:47.750540 tst cs_paging_gprs_active.py: using LAC 22705 17:53:47.871882 tst cs_paging_gprs_active.py: using RAC 10 17:53:47.992080 tst cs_paging_gprs_active.py: using CellId 22705 17:53:48.113953 tst cs_paging_gprs_active.py: using BVCI 22706 17:53:48.224880 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:48.236183 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:48.247248 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:48.258791 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:48.270285 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:48.281754 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:48.293563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:48.304941 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:53:48.317343 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:53:48.438237 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:53:48.559745 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:53:48.779999 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:49.107452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30604): Launched 17:53:49.391792 run iperf3-srv_10.42.42.10(pid=30605): Launched 17:53:49.514338 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:53:49.734456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:53:50.062435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30606): Launched 17:53:50.348924 run iperf3-srv_10.42.42.10(pid=30607): Launched 17:53:50.472002 tst cs_paging_gprs_active.py:38: start network... 17:53:50.691993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:51.198358 run create_hlr_db(pid=30608): Launched 17:53:51.333227 bus /gobi_6: Setting Powered False 17:53:52.397149 run create_hlr_db(pid=30608): Terminated: ok {rc=0} 17:53:52.858081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30610): Launched 17:53:53.186789 run osmo-hlr_10.42.42.2(pid=30611): Launched 17:53:53.312288 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:53.872045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30613): Launched 17:53:54.197449 run osmo-stp_10.42.42.5(pid=30614): Launched 17:53:54.323181 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:53:54.885104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30616): Launched 17:53:55.009851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:53:55.285542 run patchelf(pid=30617): Launched 17:53:55.467660 run osmo-stp_10.42.42.5(pid=30614): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30614)] 17:53:55.606019 run osmo-stp_10.42.42.5(pid=30614): stdout: | (launched: 2022-12-09_17:53:54.137771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:55.745581 run osmo-stp_10.42.42.5(pid=30614): stderr: | 20221209175354333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175354333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175354334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175354334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175354334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175354335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175354335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:55.884904 run osmo-stp_10.42.42.5(pid=30614): stdout: | (launched: 2022-12-09_17:53:54.137771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:56.018841 run osmo-stp_10.42.42.5(pid=30614): stderr: | 20221209175354333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175354333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175354334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175354334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175354334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175354335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175354335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:56.176690 run patchelf(pid=30617): Terminating (SIGINT) 17:53:56.360117 run patchelf(pid=30617): Terminated: ok {rc=0} 17:53:56.493024 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30614): Process ended prematurely: osmo-stp_10.42.42.5(pid=30614) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30614)] [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 17:53:56.503293 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:53:56.532242 run osmo-hlr_10.42.42.2(pid=30611): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30611)] 17:53:56.582492 run osmo-hlr_10.42.42.2(pid=30611): stdout: | (launched: 2022-12-09_17:53:53.127066) 17:53:56.634877 run osmo-hlr_10.42.42.2(pid=30611): stderr: | 20221209175353328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175353329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175353329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175353329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175353329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175353329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175353340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175353349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175353349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175353349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:56.687775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30604): Terminating (SIGTERM) 17:53:56.730208 run iperf3-srv_10.42.42.10(pid=30605): Terminating (SIGTERM) 17:53:56.772418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30606): Terminating (SIGTERM) 17:53:56.814846 run iperf3-srv_10.42.42.10(pid=30607): Terminating (SIGTERM) 17:53:56.857217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30610): Terminating (SIGTERM) 17:53:56.899615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30613): Terminating (SIGTERM) 17:53:56.942065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30616): Terminating (SIGTERM) 17:53:56.984589 --- ParallelTerminationStrategy: PID 30604 died... 17:53:57.004746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30604): Terminated: ok {rc=0} 17:53:57.051940 --- ParallelTerminationStrategy: PID 30605 died... 17:53:57.071615 run iperf3-srv_10.42.42.10(pid=30605): Terminated {rc=256} 17:53:57.118111 --- ParallelTerminationStrategy: PID 30606 died... 17:53:57.137815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30606): Terminated: ok {rc=0} 17:53:57.184115 --- ParallelTerminationStrategy: PID 30607 died... 17:53:57.203723 run iperf3-srv_10.42.42.10(pid=30607): Terminated {rc=256} 17:53:57.249913 --- ParallelTerminationStrategy: PID 30610 died... 17:53:57.269558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30610): Terminated: ok {rc=0} 17:53:57.316098 --- ParallelTerminationStrategy: PID 30613 died... 17:53:57.336116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30613): Terminated: ok {rc=0} 17:53:57.382823 --- ParallelTerminationStrategy: PID 30616 died... 17:53:57.402531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30616): Terminated: ok {rc=0} 17:53:57.490839 bus /gobi_0: Setting Powered False 17:53:58.590332 bus /gobi_0: Setting Powered False 17:53:59.708456 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 17:54:00.866267 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:00.879773 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:00.940087 tst iperf3.py: using LAC 22706 17:54:01.070157 tst iperf3.py: using RAC 11 17:54:01.194495 tst iperf3.py: using CellId 22706 17:54:01.317159 tst iperf3.py: using BVCI 22707 17:54:01.438375 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:01.450742 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:01.462750 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:01.475171 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:01.487206 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:01.499437 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:01.511686 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:01.523868 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:01.536078 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:01.654823 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:54:01.883242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:02.246426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30618): Launched 17:54:02.525319 run iperf3-srv_10.42.42.10(pid=30619): Launched 17:54:02.640821 tst iperf3.py:8: start network... 17:54:02.845453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:03.318125 run create_hlr_db(pid=30620): Launched 17:54:03.436768 bus /gobi_6: Setting Powered False 17:54:04.500698 run create_hlr_db(pid=30620): Terminated: ok {rc=0} 17:54:04.954414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30622): Launched 17:54:05.280499 run osmo-hlr_10.42.42.2(pid=30623): Launched 17:54:05.404345 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:05.967383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30625): Launched 17:54:06.292744 run osmo-stp_10.42.42.5(pid=30626): Launched 17:54:06.417896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:06.978524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30628): Launched 17:54:07.104017 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:07.379277 run patchelf(pid=30629): Launched 17:54:07.562164 run osmo-stp_10.42.42.5(pid=30626): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30626)] 17:54:07.699771 run osmo-stp_10.42.42.5(pid=30626): stdout: | (launched: 2022-12-09_17:54:06.232586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:07.839265 run osmo-stp_10.42.42.5(pid=30626): stderr: | 20221209175406427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175406427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175406427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175406428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175406428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175406428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175406428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:07.978893 run osmo-stp_10.42.42.5(pid=30626): stdout: | (launched: 2022-12-09_17:54:06.232586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:08.111945 run osmo-stp_10.42.42.5(pid=30626): stderr: | 20221209175406427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175406427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175406427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175406428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175406428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175406428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175406428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:08.269867 run patchelf(pid=30629): Terminating (SIGINT) 17:54:08.452734 run patchelf(pid=30629): Terminated: ok {rc=0} 17:54:08.584911 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30626): Process ended prematurely: osmo-stp_10.42.42.5(pid=30626) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30626)] [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 17:54:08.595363 tst iperf3.py:8: Test FAILED (7.8 sec) 17:54:08.624281 run osmo-hlr_10.42.42.2(pid=30623): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30623)] 17:54:08.674419 run osmo-hlr_10.42.42.2(pid=30623): stdout: | (launched: 2022-12-09_17:54:05.221242) 17:54:08.726152 run osmo-hlr_10.42.42.2(pid=30623): stderr: | 20221209175405422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175405422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175405422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175405422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175405423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175405423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175405435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175405443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175405443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175405443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:08.778578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30618): Terminating (SIGTERM) 17:54:08.820539 run iperf3-srv_10.42.42.10(pid=30619): Terminating (SIGTERM) 17:54:08.862488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30622): Terminating (SIGTERM) 17:54:08.904576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30625): Terminating (SIGTERM) 17:54:08.946792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30628): Terminating (SIGTERM) 17:54:08.989068 --- ParallelTerminationStrategy: PID 30618 died... 17:54:09.009091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30618): Terminated: ok {rc=0} 17:54:09.055591 --- ParallelTerminationStrategy: PID 30619 died... 17:54:09.075036 run iperf3-srv_10.42.42.10(pid=30619): Terminated {rc=256} 17:54:09.121133 --- ParallelTerminationStrategy: PID 30622 died... 17:54:09.140604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30622): Terminated: ok {rc=0} 17:54:09.186984 --- ParallelTerminationStrategy: PID 30625 died... 17:54:09.206523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30625): Terminated: ok {rc=0} 17:54:09.253421 --- ParallelTerminationStrategy: PID 30628 died... 17:54:09.272895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30628): Terminated: ok {rc=0} 17:54:09.361941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 17:54:10.512730 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:10.525402 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:10.578082 tst iperf3m4.py: using LAC 22707 17:54:10.706944 tst iperf3m4.py: using RAC 12 17:54:10.835890 tst iperf3m4.py: using CellId 22707 17:54:10.962198 tst iperf3m4.py: using BVCI 22708 17:54:11.079912 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:11.091715 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:11.103196 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:11.114929 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:11.126577 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:11.138121 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:11.149795 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:11.161232 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:11.173007 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:11.290838 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:11.410181 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:11.529618 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:11.646644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:54:11.851639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:12.158560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30631): Launched 17:54:12.426891 run iperf3-srv_10.42.42.10(pid=30632): Launched 17:54:12.543773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:54:12.748085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:13.054753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30633): Launched 17:54:13.322982 run iperf3-srv_10.42.42.10(pid=30634): Launched 17:54:13.438073 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:54:13.642287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:13.949094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30635): Launched 17:54:14.215658 run iperf3-srv_10.42.42.10(pid=30636): Launched 17:54:14.330100 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:54:14.533941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:54:14.840438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30637): Launched 17:54:15.106652 run iperf3-srv_10.42.42.10(pid=30638): Launched 17:54:15.222945 tst iperf3m4.py:8: start network... 17:54:15.427041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:15.901902 run create_hlr_db(pid=30639): Launched 17:54:16.075800 bus /gobi_6: Setting Powered False 17:54:17.163811 run create_hlr_db(pid=30639): Terminated: ok {rc=0} 17:54:17.609298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30641): Launched 17:54:17.915955 run osmo-hlr_10.42.42.2(pid=30642): Launched 17:54:18.032658 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:18.563946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30644): Launched 17:54:18.870975 run osmo-stp_10.42.42.5(pid=30645): Launched 17:54:18.990199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:19.516662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30647): Launched 17:54:19.634891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:19.892862 run patchelf(pid=30648): Launched 17:54:20.062837 run osmo-stp_10.42.42.5(pid=30645): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30645)] 17:54:20.192305 run osmo-stp_10.42.42.5(pid=30645): stdout: | (launched: 2022-12-09_17:54:18.814647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:20.323561 run osmo-stp_10.42.42.5(pid=30645): stderr: | 20221209175418986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175418987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175418987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175418987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175418988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175418988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175418988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:20.455123 run osmo-stp_10.42.42.5(pid=30645): stdout: | (launched: 2022-12-09_17:54:18.814647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:20.580011 run osmo-stp_10.42.42.5(pid=30645): stderr: | 20221209175418986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175418987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175418987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175418987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175418988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175418988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175418988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:20.728702 run patchelf(pid=30648): Terminating (SIGINT) 17:54:20.900057 run patchelf(pid=30648): Terminated: ok {rc=0} 17:54:21.024116 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30645): Process ended prematurely: osmo-stp_10.42.42.5(pid=30645) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30645)] [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 17:54:21.033909 tst iperf3m4.py:8: Test FAILED (10.6 sec) 17:54:21.061897 run osmo-hlr_10.42.42.2(pid=30642): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30642)] 17:54:21.110844 run osmo-hlr_10.42.42.2(pid=30642): stdout: | (launched: 2022-12-09_17:54:17.859610) 17:54:21.161044 run osmo-hlr_10.42.42.2(pid=30642): stderr: | 20221209175418034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175418035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175418035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175418035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175418035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175418035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175418047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175418057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175418058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175418058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:21.211281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30631): Terminating (SIGTERM) 17:54:21.251795 run iperf3-srv_10.42.42.10(pid=30632): Terminating (SIGTERM) 17:54:21.291913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30633): Terminating (SIGTERM) 17:54:21.332077 run iperf3-srv_10.42.42.10(pid=30634): Terminating (SIGTERM) 17:54:21.371970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30635): Terminating (SIGTERM) 17:54:21.412013 run iperf3-srv_10.42.42.10(pid=30636): Terminating (SIGTERM) 17:54:21.451932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30637): Terminating (SIGTERM) 17:54:21.491944 run iperf3-srv_10.42.42.10(pid=30638): Terminating (SIGTERM) 17:54:21.531819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30641): Terminating (SIGTERM) 17:54:21.571872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30644): Terminating (SIGTERM) 17:54:21.611816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30647): Terminating (SIGTERM) 17:54:21.652137 --- ParallelTerminationStrategy: PID 30631 died... 17:54:21.671379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30631): Terminated: ok {rc=0} 17:54:21.715625 --- ParallelTerminationStrategy: PID 30632 died... 17:54:21.734121 run iperf3-srv_10.42.42.10(pid=30632): Terminated {rc=256} 17:54:21.779853 --- ParallelTerminationStrategy: PID 30633 died... 17:54:21.798484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30633): Terminated: ok {rc=0} 17:54:21.843110 --- ParallelTerminationStrategy: PID 30634 died... 17:54:21.861650 run iperf3-srv_10.42.42.10(pid=30634): Terminated {rc=256} 17:54:21.906218 --- ParallelTerminationStrategy: PID 30635 died... 17:54:21.924815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30635): Terminated: ok {rc=0} 17:54:21.969277 --- ParallelTerminationStrategy: PID 30636 died... 17:54:21.987694 run iperf3-srv_10.42.42.10(pid=30636): Terminated {rc=256} 17:54:22.032244 --- ParallelTerminationStrategy: PID 30637 died... 17:54:22.050991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30637): Terminated: ok {rc=0} 17:54:22.095398 --- ParallelTerminationStrategy: PID 30638 died... 17:54:22.113966 run iperf3-srv_10.42.42.10(pid=30638): Terminated {rc=256} 17:54:22.158296 --- ParallelTerminationStrategy: PID 30641 died... 17:54:22.177060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30641): Terminated: ok {rc=0} 17:54:22.221499 --- ParallelTerminationStrategy: PID 30644 died... 17:54:22.240165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30644): Terminated: ok {rc=0} 17:54:22.284598 --- ParallelTerminationStrategy: PID 30647 died... 17:54:22.303362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30647): Terminated: ok {rc=0} 17:54:22.387700 bus /gobi_4: Setting Powered False 17:54:23.483224 bus /gobi_4: Setting Powered False 17:54:24.597747 bus /gobi_1: Setting Powered False 17:54:25.696600 bus /gobi_1: Setting Powered False 17:54:26.814857 bus /gobi_0: Setting Powered False 17:54:27.913697 bus /gobi_0: Setting Powered False 17:54:29.031278 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 17:54:30.130871 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.142939 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:30.196051 tst ping.py: using LAC 22708 17:54:30.320681 tst ping.py: using RAC 13 17:54:30.449846 tst ping.py: using CellId 22708 17:54:30.569803 tst ping.py: using BVCI 22709 17:54:30.677517 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.688885 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.700069 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.711436 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.723071 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.734563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.746152 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:30.757536 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:30.893317 tst ping.py:19: start network... 17:54:31.146607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:31.621517 run create_hlr_db(pid=30650): Launched 17:54:31.774880 bus /gobi_6: Setting Powered False 17:54:32.837656 run create_hlr_db(pid=30650): Terminated: ok {rc=0} 17:54:33.286274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Launched 17:54:33.607211 run osmo-hlr_10.42.42.2(pid=30653): Launched 17:54:33.728690 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:34.284470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Launched 17:54:34.605234 run osmo-stp_10.42.42.5(pid=30656): Launched 17:54:34.726284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:35.275447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30658): Launched 17:54:35.400077 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:35.670089 run patchelf(pid=30659): Launched 17:54:35.848761 run osmo-stp_10.42.42.5(pid=30656): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] 17:54:35.983782 run osmo-stp_10.42.42.5(pid=30656): stdout: | (launched: 2022-12-09_17:54:34.546620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:36.121645 run osmo-stp_10.42.42.5(pid=30656): stderr: | 20221209175434739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175434739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175434740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175434740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175434740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175434741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175434741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:36.259727 run osmo-stp_10.42.42.5(pid=30656): stdout: | (launched: 2022-12-09_17:54:34.546620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:36.391262 run osmo-stp_10.42.42.5(pid=30656): stderr: | 20221209175434739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175434739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175434740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175434740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175434740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175434741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175434741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:36.547029 run patchelf(pid=30659): Terminating (SIGINT) 17:54:36.726026 run patchelf(pid=30659): Terminated: ok {rc=0} 17:54:36.855786 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30656): Process ended prematurely: osmo-stp_10.42.42.5(pid=30656) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 17:54:36.865817 tst ping.py:22: Test FAILED (6.7 sec) 17:54:36.894289 run osmo-hlr_10.42.42.2(pid=30653): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30653)] 17:54:36.944322 run osmo-hlr_10.42.42.2(pid=30653): stdout: | (launched: 2022-12-09_17:54:33.548740) 17:54:36.996570 run osmo-hlr_10.42.42.2(pid=30653): stderr: | 20221209175433749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175433749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175433749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175433749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175433749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175433749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175433763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175433772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175433773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175433773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:37.049249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Terminating (SIGTERM) 17:54:37.091141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Terminating (SIGTERM) 17:54:37.133283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30658): Terminating (SIGTERM) 17:54:37.175309 --- ParallelTerminationStrategy: PID 30652 died... 17:54:37.195248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Terminated: ok {rc=0} 17:54:37.241733 --- ParallelTerminationStrategy: PID 30655 died... 17:54:37.261444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Terminated: ok {rc=0} 17:54:37.307617 --- ParallelTerminationStrategy: PID 30658 died... 17:54:37.327371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30658): Terminated: ok {rc=0} 17:54:37.415335 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 17:54:38.504111 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:38.516819 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 17:54:38.570641 tst ping_idle_ping.py: using LAC 22709 17:54:38.689376 tst ping_idle_ping.py: using RAC 14 17:54:38.809396 tst ping_idle_ping.py: using CellId 22709 17:54:38.926279 tst ping_idle_ping.py: using BVCI 22710 17:54:39.036413 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:39.047904 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:39.059111 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:39.070594 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:39.081962 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:39.093369 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:39.104698 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 17:54:39.116101 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 17:54:39.236102 tst ping_idle_ping.py:24: start network... 17:54:39.452357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:39.949248 run create_hlr_db(pid=30660): Launched 17:54:40.079657 bus /gobi_6: Setting Powered False 17:54:41.142779 run create_hlr_db(pid=30660): Terminated: ok {rc=0} 17:54:41.590116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30662): Launched 17:54:41.911142 run osmo-hlr_10.42.42.2(pid=30663): Launched 17:54:42.034767 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:42.583789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30665): Launched 17:54:42.904357 run osmo-stp_10.42.42.5(pid=30666): Launched 17:54:43.027324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:43.579552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30668): Launched 17:54:43.703230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:43.972442 run patchelf(pid=30669): Launched 17:54:44.151312 run osmo-stp_10.42.42.5(pid=30666): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30666)] 17:54:44.286707 run osmo-stp_10.42.42.5(pid=30666): stdout: | (launched: 2022-12-09_17:54:42.845632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:44.425402 run osmo-stp_10.42.42.5(pid=30666): stderr: | 20221209175443039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175443040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175443040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175443040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175443041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175443041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175443041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:44.563084 run osmo-stp_10.42.42.5(pid=30666): stdout: | (launched: 2022-12-09_17:54:42.845632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:44.693810 run osmo-stp_10.42.42.5(pid=30666): stderr: | 20221209175443039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175443040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175443040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175443040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175443041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175443041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175443041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:44.849421 run patchelf(pid=30669): Terminating (SIGINT) 17:54:45.028787 run patchelf(pid=30669): Terminated: ok {rc=0} 17:54:45.158035 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30666): Process ended prematurely: osmo-stp_10.42.42.5(pid=30666) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30666)] [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 17:54:45.167908 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:54:45.196178 run osmo-hlr_10.42.42.2(pid=30663): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30663)] 17:54:45.246325 run osmo-hlr_10.42.42.2(pid=30663): stdout: | (launched: 2022-12-09_17:54:41.852176) 17:54:45.298308 run osmo-hlr_10.42.42.2(pid=30663): stderr: | 20221209175442051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175442051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175442051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175442051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175442051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175442051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175442063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175442071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175442071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175442071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:45.351002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30662): Terminating (SIGTERM) 17:54:45.393581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30665): Terminating (SIGTERM) 17:54:45.436003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30668): Terminating (SIGTERM) 17:54:45.478573 --- ParallelTerminationStrategy: PID 30662 died... 17:54:45.498702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30662): Terminated: ok {rc=0} 17:54:45.545738 --- ParallelTerminationStrategy: PID 30665 died... 17:54:45.565471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30665): Terminated: ok {rc=0} 17:54:45.611925 --- ParallelTerminationStrategy: PID 30668 died... 17:54:45.631542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30668): Terminated: ok {rc=0} 17:54:45.719798 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:54:47.036116 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:54:47.043655 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:54:47.078848 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:54:47.115711 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:54:47.170502 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:54:47.205133 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:54:47.241635 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:54:47.805082 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:54:47.810956 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:47.822694 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:54:47.891973 tst switch_tch_pdch.py: using LAC 22710 17:54:48.009441 tst switch_tch_pdch.py: using RAC 15 17:54:48.128743 tst switch_tch_pdch.py: using CellId 22710 17:54:48.245580 tst switch_tch_pdch.py: using BVCI 22711 17:54:48.362666 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:48.374553 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:48.386208 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:48.397943 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:48.409820 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:48.421509 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:48.433321 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:54:48.444819 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:54:48.563543 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:54:48.679677 tst switch_tch_pdch.py:51: start network... 17:54:48.879743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:49.342664 run create_hlr_db(pid=30674): Launched 17:54:49.457448 bus /gobi_6: Setting Powered False 17:54:50.517158 run create_hlr_db(pid=30674): Terminated: ok {rc=0} 17:54:50.935507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30676): Launched 17:54:51.234184 run osmo-hlr_10.42.42.2(pid=30677): Launched 17:54:51.348471 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:51.878211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30679): Launched 17:54:52.177924 run osmo-stp_10.42.42.5(pid=30680): Launched 17:54:52.292544 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:54:52.811347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30682): Launched 17:54:52.926210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:54:53.178303 run patchelf(pid=30683): Launched 17:54:53.344252 run osmo-stp_10.42.42.5(pid=30680): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30680)] 17:54:53.470968 run osmo-stp_10.42.42.5(pid=30680): stdout: | (launched: 2022-12-09_17:54:52.122187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:53.599692 run osmo-stp_10.42.42.5(pid=30680): stderr: | 20221209175452295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175452295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175452295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175452296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175452296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175452296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175452296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:53.728724 run osmo-stp_10.42.42.5(pid=30680): stdout: | (launched: 2022-12-09_17:54:52.122187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:53.851543 run osmo-stp_10.42.42.5(pid=30680): stderr: | 20221209175452295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175452295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175452295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175452296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175452296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175452296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175452296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:53.996941 run patchelf(pid=30683): Terminating (SIGINT) 17:54:54.164865 run patchelf(pid=30683): Terminated: ok {rc=0} 17:54:54.286263 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30680): Process ended prematurely: osmo-stp_10.42.42.5(pid=30680) [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30680)] [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:54:54.295238 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:54:54.322474 run osmo-hlr_10.42.42.2(pid=30677): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30677)] 17:54:54.370487 run osmo-hlr_10.42.42.2(pid=30677): stdout: | (launched: 2022-12-09_17:54:51.179310) 17:54:54.419955 run osmo-hlr_10.42.42.2(pid=30677): stderr: | 20221209175451358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175451358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175451358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175451358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175451358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175451358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175451371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175451381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175451381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175451381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:54.470194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30676): Terminating (SIGTERM) 17:54:54.510822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30679): Terminating (SIGTERM) 17:54:54.550830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30682): Terminating (SIGTERM) 17:54:54.591239 --- ParallelTerminationStrategy: PID 30676 died... 17:54:54.610221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30676): Terminated: ok {rc=0} 17:54:54.654514 --- ParallelTerminationStrategy: PID 30679 died... 17:54:54.672784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30679): Terminated: ok {rc=0} 17:54:54.717246 --- ParallelTerminationStrategy: PID 30682 died... 17:54:54.735581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30682): Terminated: ok {rc=0} 17:54:54.821722 bus /gobi_0: Setting Powered False 17:54:55.922528 bus /gobi_0: Setting Powered False 17:54:57.035862 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:54:58.291852 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:54:58.298354 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:54:58.331781 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:54:58.367400 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:54:58.421810 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:54:58.454846 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:54:58.489877 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:54:59.046736 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:54:59.052014 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:59.063441 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:54:59.138297 tst switch_tch_pdch.py: using LAC 22711 17:54:59.262783 tst switch_tch_pdch.py: using RAC 16 17:54:59.386414 tst switch_tch_pdch.py: using CellId 22711 17:54:59.511803 tst switch_tch_pdch.py: using BVCI 22712 17:54:59.626917 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:59.638612 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:59.649875 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:59.661146 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:59.672318 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:59.683606 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:59.694993 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:54:59.706196 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:54:59.820594 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:54:59.936123 tst switch_tch_pdch.py:51: start network... 17:55:00.134816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:00.571209 run create_hlr_db(pid=30687): Launched 17:55:00.687278 bus /gobi_6: Setting Powered False 17:55:01.762044 run create_hlr_db(pid=30687): Terminated: ok {rc=0} 17:55:02.257224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30692): Launched 17:55:02.569194 run osmo-hlr_10.42.42.2(pid=30693): Launched 17:55:02.683952 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:03.173766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30695): Launched 17:55:03.472728 run osmo-stp_10.42.42.5(pid=30696): Launched 17:55:03.586667 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:55:04.076153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30698): Launched 17:55:04.191885 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:55:04.443986 run patchelf(pid=30699): Launched 17:55:04.611108 run osmo-stp_10.42.42.5(pid=30696): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30696)] 17:55:04.737826 run osmo-stp_10.42.42.5(pid=30696): stdout: | (launched: 2022-12-09_17:55:03.417544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:04.866562 run osmo-stp_10.42.42.5(pid=30696): stderr: | 20221209175503588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175503588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175503588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175503588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175503589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175503589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175503589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:04.995681 run osmo-stp_10.42.42.5(pid=30696): stdout: | (launched: 2022-12-09_17:55:03.417544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:05.118778 run osmo-stp_10.42.42.5(pid=30696): stderr: | 20221209175503588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175503588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175503588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175503588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175503589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175503589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175503589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:05.263984 run patchelf(pid=30699): Terminating (SIGINT) 17:55:05.431292 run patchelf(pid=30699): Terminated: ok {rc=0} 17:55:05.552296 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30696): Process ended prematurely: osmo-stp_10.42.42.5(pid=30696) [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30696)] [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:55:05.561485 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 17:55:05.588700 run osmo-hlr_10.42.42.2(pid=30693): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30693)] 17:55:05.636458 run osmo-hlr_10.42.42.2(pid=30693): stdout: | (launched: 2022-12-09_17:55:02.514110) 17:55:05.686014 run osmo-hlr_10.42.42.2(pid=30693): stderr: | 20221209175502691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175502691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175502691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175502691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175502691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175502691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175502703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175502712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175502712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175502712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:05.736444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30692): Terminating (SIGTERM) 17:55:05.776651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30695): Terminating (SIGTERM) 17:55:05.816459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30698): Terminating (SIGTERM) 17:55:05.856885 --- ParallelTerminationStrategy: PID 30692 died... 17:55:05.875917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30692): Terminated: ok {rc=0} 17:55:05.920480 --- ParallelTerminationStrategy: PID 30695 died... 17:55:05.938979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30695): Terminated: ok {rc=0} 17:55:05.983526 --- ParallelTerminationStrategy: PID 30698 died... 17:55:06.001996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30698): Terminated: ok {rc=0} 17:55:06.086461 bus /gobi_0: Setting Powered False 17:55:07.185058 bus /gobi_0: Setting Powered False 17:55:08.300781 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_sms:trx-lms --------------------------------------------------------------------- 17:55:09.555185 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:09.559610 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:09.594732 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 17:55:09.601729 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 17:55:09.655205 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:09.689764 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 17:55:09.696667 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 17:55:10.235776 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 17:55:10.240920 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 17:55:10.252084 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 17:55:10.302646 tst mo_mt_sms.py: using LAC 22712 17:55:10.429438 tst mo_mt_sms.py: using RAC 17 17:55:10.553476 tst mo_mt_sms.py: using CellId 22712 17:55:10.673668 tst mo_mt_sms.py: using BVCI 22713 17:55:10.790552 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:10.904424 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:11.021669 tst mo_mt_sms.py:9: start nitb and bts... 17:55:11.238700 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:55:11.887125 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30703): Launched 17:55:12.207058 run osmo-nitb_10.42.42.2(pid=30704): Launched 17:55:12.383927 run osmo-nitb_10.42.42.2(pid=30704): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30704)] 17:55:12.527015 run osmo-nitb_10.42.42.2(pid=30704): stdout: | (launched: 2022-12-09_17:55:12.148669) 17:55:12.671678 run osmo-nitb_10.42.42.2(pid=30704): stderr: | (launched: 2022-12-09_17:55:12.196054) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:12.816443 run osmo-nitb_10.42.42.2(pid=30704): stdout: | (launched: 2022-12-09_17:55:12.148669) 17:55:12.955133 run osmo-nitb_10.42.42.2(pid=30704): stderr: | (launched: 2022-12-09_17:55:12.196054) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30704): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30704) [trial-2362↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30704)] 17:55:13.327633 tst osmo-nitb_10.42.42.2(pid=30704): stdout: | (launched: 2022-12-09_17:55:12.148669) 17:55:13.456186 tst osmo-nitb_10.42.42.2(pid=30704): stderr: | (launched: 2022-12-09_17:55:12.196054) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:13.607700 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30704): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30704) [trial-2362↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30704)] [trial-2362↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 17:55:13.616842 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 17:55:13.624263 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30703): Terminating (SIGTERM) 17:55:13.835126 --- ParallelTerminationStrategy: PID 30703 died... 17:55:13.856843 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30703): Terminated: ok {rc=0} 17:55:13.944904 bus /sierra_3: Setting Powered False 17:55:15.045808 bus /sierra_3: Setting Powered False 17:55:16.174823 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 sms:trx-lms --------------------------------------------------------------------- 17:55:17.388217 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:17.392284 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:17.425772 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 17:55:17.452131 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 17:55:17.504450 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:17.537269 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 17:55:17.563720 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 17:55:18.110484 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 17:55:18.115355 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:18.125921 tst sms:trx-lms: Using 1 x bts (candidates: 1) 17:55:18.177754 tst mo_mt_sms.py: using LAC 22713 17:55:18.294617 tst mo_mt_sms.py: using RAC 18 17:55:18.419991 tst mo_mt_sms.py: using CellId 22713 17:55:18.543245 tst mo_mt_sms.py: using BVCI 22714 17:55:18.660059 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:18.671276 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:18.682293 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:18.693425 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:18.704112 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:18.715043 tst sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:18.828323 tst sms:trx-lms: Using 1 x modem (candidates: 2) 17:55:18.947535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:19.410809 run create_hlr_db(pid=30709): Launched 17:55:19.527745 bus /sierra_2: Setting Powered False 17:55:20.588019 run create_hlr_db(pid=30709): Terminated: ok {rc=0} 17:55:21.025931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Launched 17:55:21.346683 run osmo-hlr_10.42.42.2(pid=30712): Launched 17:55:21.468900 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:22.021381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30714): Launched 17:55:22.339758 run osmo-stp_10.42.42.5(pid=30715): Launched 17:55:22.462734 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:23.039785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30717): Launched 17:55:23.359759 run osmo-msc_10.42.42.6(pid=30718): Launched 17:55:23.538187 run osmo-stp_10.42.42.5(pid=30715): ERR: Terminated: ERROR {rc=1} [trial-2362↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30715)] 17:55:23.672485 run osmo-stp_10.42.42.5(pid=30715): stdout: | (launched: 2022-12-09_17:55:22.281406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:23.807279 run osmo-stp_10.42.42.5(pid=30715): stderr: | 20221209175522474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175522474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175522475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175522475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175522475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175522476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175522476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:23.941171 run osmo-stp_10.42.42.5(pid=30715): stdout: | (launched: 2022-12-09_17:55:22.281406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:24.067671 run osmo-stp_10.42.42.5(pid=30715): stderr: | 20221209175522474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175522474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175522475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175522475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175522475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175522476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175522476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:24.219268 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30715): Process ended prematurely: osmo-stp_10.42.42.5(pid=30715) [trial-2362↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30715)] [trial-2362↪sms:trx-lms↪mo_mt_sms.py:16] 17:55:24.228436 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 17:55:24.256024 run osmo-hlr_10.42.42.2(pid=30712): ERR: Terminated: ERROR {rc=237} [trial-2362↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30712)] 17:55:24.306216 run osmo-hlr_10.42.42.2(pid=30712): stdout: | (launched: 2022-12-09_17:55:21.288300) 17:55:24.358017 run osmo-hlr_10.42.42.2(pid=30712): stderr: | 20221209175521487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175521487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175521487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175521487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175521487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175521487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175521499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175521507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175521507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175521508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:24.430462 run osmo-msc_10.42.42.6(pid=30718): ERR: Terminated: ERROR {rc=2} [trial-2362↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30718)] 17:55:24.480456 run osmo-msc_10.42.42.6(pid=30718): stdout: | (launched: 2022-12-09_17:55:23.301305) 17:55:24.532091 run osmo-msc_10.42.42.6(pid=30718): stderr: | 20221209175523622 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175523622 DLGLOBAL DEBUG validating counter group 0x7f45e8ce7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175523622 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175523622 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175523623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175523623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175523624 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175523625 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175523625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175523625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:24.584260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Terminating (SIGTERM) 17:55:24.626174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30714): Terminating (SIGTERM) 17:55:24.668045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30717): Terminating (SIGTERM) 17:55:24.710202 --- ParallelTerminationStrategy: PID 30711 died... 17:55:24.730263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Terminated: ok {rc=0} 17:55:24.776600 --- ParallelTerminationStrategy: PID 30714 died... 17:55:24.796147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30714): Terminated: ok {rc=0} 17:55:24.842187 --- ParallelTerminationStrategy: PID 30717 died... 17:55:24.861652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30717): Terminated: ok {rc=0} 17:55:24.949232 bus /sierra_3: Setting Powered False 17:55:26.049218 bus /sierra_3: Setting Powered False 17:55:27.164811 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-lms --------------------------------------------------------------------- 17:55:28.399589 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:28.403780 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:28.438185 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 17:55:28.445503 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 17:55:28.481555 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:28.516017 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 17:55:28.523159 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 17:55:29.039908 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 17:55:29.045893 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 17:55:29.057054 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 17:55:29.105915 tst assert_extension.py: using LAC 22714 17:55:29.222930 tst assert_extension.py: using RAC 19 17:55:29.353184 tst assert_extension.py: using CellId 22714 17:55:29.478503 tst assert_extension.py: using BVCI 22715 17:55:29.593779 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 17:55:29.708384 tst assert_extension.py:10: start nitb and bts... 17:55:29.909018 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:55:30.520837 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30723): Launched 17:55:30.822322 run osmo-nitb_10.42.42.2(pid=30724): Launched 17:55:31.005490 run osmo-nitb_10.42.42.2(pid=30724): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30724)] 17:55:31.143018 run osmo-nitb_10.42.42.2(pid=30724): stdout: | (launched: 2022-12-09_17:55:30.767149) 17:55:31.282885 run osmo-nitb_10.42.42.2(pid=30724): stderr: | (launched: 2022-12-09_17:55:30.811556) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:31.422478 run osmo-nitb_10.42.42.2(pid=30724): stdout: | (launched: 2022-12-09_17:55:30.767149) 17:55:31.555681 run osmo-nitb_10.42.42.2(pid=30724): stderr: | (launched: 2022-12-09_17:55:30.811556) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30724) [trial-2362↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30724)] 17:55:31.952169 tst osmo-nitb_10.42.42.2(pid=30724): stdout: | (launched: 2022-12-09_17:55:30.767149) 17:55:32.074657 tst osmo-nitb_10.42.42.2(pid=30724): stderr: | (launched: 2022-12-09_17:55:30.811556) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:55:32.221576 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30724) [trial-2362↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30724)] [trial-2362↪nitb_ussd:trx-lms↪assert_extension.py:12] 17:55:32.230690 tst assert_extension.py:12: Test FAILED (3.2 sec) 17:55:32.237916 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30723): Terminating (SIGTERM) 17:55:32.451024 --- ParallelTerminationStrategy: PID 30723 died... 17:55:32.471818 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30723): Terminated: ok {rc=0} 17:55:32.559528 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 ussd:trx-lms --------------------------------------------------------------------- 17:55:33.738123 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:33.742382 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 17:55:33.777270 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 17:55:33.804420 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 17:55:33.839664 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 17:55:33.873292 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 17:55:33.899315 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 17:55:34.426716 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 ussd:trx-lms assert_extension.py ---------------------------------------------- 17:55:34.431688 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:34.442276 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 17:55:34.491071 tst assert_extension.py: using LAC 22715 17:55:34.610022 tst assert_extension.py: using RAC 20 17:55:34.728882 tst assert_extension.py: using CellId 22715 17:55:34.845136 tst assert_extension.py: using BVCI 22716 17:55:34.953912 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:34.964360 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:34.974794 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:34.985429 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:34.995867 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 17:55:35.006811 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 17:55:35.125521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:35.620155 run create_hlr_db(pid=30728): Launched 17:55:35.750859 bus /sierra_2: Setting Powered False 17:55:36.813941 run create_hlr_db(pid=30728): Terminated: ok {rc=0} 17:55:37.259369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30730): Launched 17:55:37.581517 run osmo-hlr_10.42.42.2(pid=30731): Launched 17:55:37.703234 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:38.259466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30733): Launched 17:55:38.578220 run osmo-stp_10.42.42.5(pid=30734): Launched 17:55:38.701430 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:39.277712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30736): Launched 17:55:39.596928 run osmo-msc_10.42.42.6(pid=30737): Launched 17:55:39.774541 run osmo-stp_10.42.42.5(pid=30734): ERR: Terminated: ERROR {rc=1} [trial-2362↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30734)] 17:55:39.908719 run osmo-stp_10.42.42.5(pid=30734): stdout: | (launched: 2022-12-09_17:55:38.519970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:40.045175 run osmo-stp_10.42.42.5(pid=30734): stderr: | 20221209175538711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175538711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175538711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175538712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175538712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175538712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175538712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:40.179303 run osmo-stp_10.42.42.5(pid=30734): stdout: | (launched: 2022-12-09_17:55:38.519970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:40.306145 run osmo-stp_10.42.42.5(pid=30734): stderr: | 20221209175538711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175538711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175538711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175538712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175538712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175538712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175538712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:40.458607 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30734): Process ended prematurely: osmo-stp_10.42.42.5(pid=30734) [trial-2362↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30734)] [trial-2362↪ussd:trx-lms↪assert_extension.py:17] 17:55:40.467419 tst assert_extension.py:17: Test FAILED (6.0 sec) 17:55:40.494881 run osmo-hlr_10.42.42.2(pid=30731): ERR: Terminated: ERROR {rc=237} [trial-2362↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30731)] 17:55:40.545334 run osmo-hlr_10.42.42.2(pid=30731): stdout: | (launched: 2022-12-09_17:55:37.522729) 17:55:40.597286 run osmo-hlr_10.42.42.2(pid=30731): stderr: | 20221209175537722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175537722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175537722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175537722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175537722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175537722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175537735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175537743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175537743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175537743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:40.669771 run osmo-msc_10.42.42.6(pid=30737): ERR: Terminated: ERROR {rc=2} [trial-2362↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30737)] 17:55:40.719999 run osmo-msc_10.42.42.6(pid=30737): stdout: | (launched: 2022-12-09_17:55:39.538484) 17:55:40.771716 run osmo-msc_10.42.42.6(pid=30737): stderr: | 20221209175539860 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175539860 DLGLOBAL DEBUG validating counter group 0x7f78ccab1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175539861 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175539861 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175539861 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175539861 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175539863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175539863 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175539863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175539863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:40.823941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30730): Terminating (SIGTERM) 17:55:40.865807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30733): Terminating (SIGTERM) 17:55:40.907816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30736): Terminating (SIGTERM) 17:55:40.950289 --- ParallelTerminationStrategy: PID 30730 died... 17:55:40.970145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30730): Terminated: ok {rc=0} 17:55:41.016869 --- ParallelTerminationStrategy: PID 30733 died... 17:55:41.036602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30733): Terminated: ok {rc=0} 17:55:41.083153 --- ParallelTerminationStrategy: PID 30736 died... 17:55:41.102830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30736): Terminated: ok {rc=0} 17:55:41.191540 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:55:42.403780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:42.411074 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:55:42.445079 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:55:42.472461 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:55:42.526699 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:55:42.560931 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:55:42.588630 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:55:43.138832 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:55:43.191272 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:43.202911 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:55:43.273509 tst mo_mt_call.py: using LAC 22716 17:55:43.400759 tst mo_mt_call.py: using RAC 21 17:55:43.528812 tst mo_mt_call.py: using CellId 22716 17:55:43.655847 tst mo_mt_call.py: using BVCI 22717 17:55:43.773414 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:43.784860 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:43.796593 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:43.808056 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:43.819476 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:43.830855 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:55:43.951179 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:55:44.072790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:44.576002 run create_hlr_db(pid=30742): Launched 17:55:44.707554 bus /sierra_2: Setting Powered False 17:55:45.771484 run create_hlr_db(pid=30742): Terminated: ok {rc=0} 17:55:46.226921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30744): Launched 17:55:46.589020 run osmo-hlr_10.42.42.2(pid=30745): Launched 17:55:46.823940 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:47.536839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30747): Launched 17:55:47.841513 run osmo-stp_10.42.42.5(pid=30748): Launched 17:55:47.957940 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:48.508663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30750): Launched 17:55:48.812613 run osmo-msc_10.42.42.6(pid=30751): Launched 17:55:48.982742 run osmo-stp_10.42.42.5(pid=30748): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30748)] 17:55:49.111967 run osmo-stp_10.42.42.5(pid=30748): stdout: | (launched: 2022-12-09_17:55:47.785695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:49.240812 run osmo-stp_10.42.42.5(pid=30748): stderr: | 20221209175547957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175547957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175547957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175547958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175547958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175547958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175547958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:49.367940 run osmo-stp_10.42.42.5(pid=30748): stdout: | (launched: 2022-12-09_17:55:47.785695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:49.488377 run osmo-stp_10.42.42.5(pid=30748): stderr: | 20221209175547957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175547957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175547957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175547958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175547958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175547958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175547958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:49.632236 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30748): Process ended prematurely: osmo-stp_10.42.42.5(pid=30748) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30748)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:55:49.641455 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:55:49.668678 run osmo-hlr_10.42.42.2(pid=30745): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30745)] 17:55:49.716721 run osmo-hlr_10.42.42.2(pid=30745): stdout: | (launched: 2022-12-09_17:55:46.531519) 17:55:49.766404 run osmo-hlr_10.42.42.2(pid=30745): stderr: | 20221209175546875 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175546875 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175546875 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175546875 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175546876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175546876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175546895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175546904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175546904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175546905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:49.835595 run osmo-msc_10.42.42.6(pid=30751): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30751)] 17:55:49.883883 run osmo-msc_10.42.42.6(pid=30751): stdout: | (launched: 2022-12-09_17:55:48.756840) 17:55:49.933476 run osmo-msc_10.42.42.6(pid=30751): stderr: | 20221209175549027 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175549028 DLGLOBAL DEBUG validating counter group 0x7f2b1db59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175549028 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175549028 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175549028 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175549028 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175549030 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175549031 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175549031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175549031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:49.983292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30744): Terminating (SIGTERM) 17:55:50.023169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30747): Terminating (SIGTERM) 17:55:50.062942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30750): Terminating (SIGTERM) 17:55:50.103232 --- ParallelTerminationStrategy: PID 30744 died... 17:55:50.122173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30744): Terminated: ok {rc=0} 17:55:50.166920 --- ParallelTerminationStrategy: PID 30747 died... 17:55:50.185636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30747): Terminated: ok {rc=0} 17:55:50.229983 --- ParallelTerminationStrategy: PID 30750 died... 17:55:50.248792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30750): Terminated: ok {rc=0} 17:55:50.336363 bus /sierra_3: Setting Powered False 17:55:51.437293 bus /sierra_3: Setting Powered False 17:55:52.551912 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:55:53.697891 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:53.709897 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:55:53.780351 tst mo_mt_call_osmux.py: using LAC 22717 17:55:53.900817 tst mo_mt_call_osmux.py: using RAC 22 17:55:54.020160 tst mo_mt_call_osmux.py: using CellId 22717 17:55:54.144596 tst mo_mt_call_osmux.py: using BVCI 22718 17:55:54.255525 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:54.266782 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:54.277780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:54.289194 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:54.300438 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:55:54.311631 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:55:54.427571 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:55:54.547266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:55.016598 run create_hlr_db(pid=30753): Launched 17:55:55.135130 bus /sierra_2: Setting Powered False 17:55:56.194666 run create_hlr_db(pid=30753): Terminated: ok {rc=0} 17:55:56.640148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30755): Launched 17:55:56.965697 run osmo-hlr_10.42.42.2(pid=30756): Launched 17:55:57.091227 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:57.654526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30758): Launched 17:55:57.980562 run osmo-stp_10.42.42.5(pid=30759): Launched 17:55:58.106004 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:58.694643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30761): Launched 17:55:59.022153 run osmo-msc_10.42.42.6(pid=30762): Launched 17:55:59.204428 run osmo-stp_10.42.42.5(pid=30759): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30759)] 17:55:59.340922 run osmo-stp_10.42.42.5(pid=30759): stdout: | (launched: 2022-12-09_17:55:57.921274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:59.479278 run osmo-stp_10.42.42.5(pid=30759): stderr: | 20221209175558115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175558116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175558116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175558117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175558117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175558117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175558117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:59.615399 run osmo-stp_10.42.42.5(pid=30759): stdout: | (launched: 2022-12-09_17:55:57.921274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:59.744014 run osmo-stp_10.42.42.5(pid=30759): stderr: | 20221209175558115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175558116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175558116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175558117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175558117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175558117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175558117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:59.898400 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30759): Process ended prematurely: osmo-stp_10.42.42.5(pid=30759) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30759)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:55:59.908074 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:55:59.936159 run osmo-hlr_10.42.42.2(pid=30756): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30756)] 17:55:59.986490 run osmo-hlr_10.42.42.2(pid=30756): stdout: | (launched: 2022-12-09_17:55:56.906405) 17:56:00.038470 run osmo-hlr_10.42.42.2(pid=30756): stderr: | 20221209175557106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175557106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175557106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175557106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175557106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175557106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175557118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175557126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175557127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175557127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:00.111264 run osmo-msc_10.42.42.6(pid=30762): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30762)] 17:56:00.161526 run osmo-msc_10.42.42.6(pid=30762): stdout: | (launched: 2022-12-09_17:55:58.962967) 17:56:00.213609 run osmo-msc_10.42.42.6(pid=30762): stderr: | 20221209175559284 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175559284 DLGLOBAL DEBUG validating counter group 0x7f2e3342bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175559284 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175559285 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175559285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175559285 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175559287 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175559287 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175559287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175559287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:00.265917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30755): Terminating (SIGTERM) 17:56:00.307722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30758): Terminating (SIGTERM) 17:56:00.349902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30761): Terminating (SIGTERM) 17:56:00.392392 --- ParallelTerminationStrategy: PID 30755 died... 17:56:00.412496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30755): Terminated: ok {rc=0} 17:56:00.459442 --- ParallelTerminationStrategy: PID 30758 died... 17:56:00.478980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30758): Terminated: ok {rc=0} 17:56:00.525244 --- ParallelTerminationStrategy: PID 30761 died... 17:56:00.544791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30761): Terminated: ok {rc=0} 17:56:00.633553 bus /sierra_3: Setting Powered False 17:56:01.732027 bus /sierra_3: Setting Powered False 17:56:02.850698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:56:04.101468 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:04.108441 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:56:04.142547 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:56:04.168941 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:56:04.220393 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:56:04.253358 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:56:04.279715 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:56:04.831215 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:56:04.880139 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:04.891635 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:56:04.960197 tst mo_mt_call.py: using LAC 22718 17:56:05.078969 tst mo_mt_call.py: using RAC 23 17:56:05.200009 tst mo_mt_call.py: using CellId 22718 17:56:05.320214 tst mo_mt_call.py: using BVCI 22719 17:56:05.439558 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:05.451175 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:05.463014 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:05.474570 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:05.486255 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:05.497959 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:05.615622 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:05.734954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:06.239933 run create_hlr_db(pid=30767): Launched 17:56:06.371669 bus /sierra_2: Setting Powered False 17:56:07.433588 run create_hlr_db(pid=30767): Terminated: ok {rc=0} 17:56:07.868920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30769): Launched 17:56:08.176643 run osmo-hlr_10.42.42.2(pid=30770): Launched 17:56:08.293381 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:08.837154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30772): Launched 17:56:09.142350 run osmo-stp_10.42.42.5(pid=30773): Launched 17:56:09.258198 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:09.809753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30775): Launched 17:56:10.115473 run osmo-msc_10.42.42.6(pid=30776): Launched 17:56:10.286527 run osmo-stp_10.42.42.5(pid=30773): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30773)] 17:56:10.416160 run osmo-stp_10.42.42.5(pid=30773): stdout: | (launched: 2022-12-09_17:56:09.086252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:10.545912 run osmo-stp_10.42.42.5(pid=30773): stderr: | 20221209175609256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175609257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175609257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175609257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175609258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175609258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175609258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:10.672739 run osmo-stp_10.42.42.5(pid=30773): stdout: | (launched: 2022-12-09_17:56:09.086252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:10.793427 run osmo-stp_10.42.42.5(pid=30773): stderr: | 20221209175609256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175609257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175609257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175609257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175609258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175609258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175609258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:10.938402 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30773): Process ended prematurely: osmo-stp_10.42.42.5(pid=30773) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30773)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:56:10.947350 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:56:10.974569 run osmo-hlr_10.42.42.2(pid=30770): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30770)] 17:56:11.023018 run osmo-hlr_10.42.42.2(pid=30770): stdout: | (launched: 2022-12-09_17:56:08.120439) 17:56:11.073223 run osmo-hlr_10.42.42.2(pid=30770): stderr: | 20221209175608299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175608299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175608299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175608299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175608299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175608300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175608311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175608320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175608320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175608320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:11.142855 run osmo-msc_10.42.42.6(pid=30776): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30776)] 17:56:11.191087 run osmo-msc_10.42.42.6(pid=30776): stdout: | (launched: 2022-12-09_17:56:10.059344) 17:56:11.241114 run osmo-msc_10.42.42.6(pid=30776): stderr: | 20221209175610330 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175610331 DLGLOBAL DEBUG validating counter group 0x7fd880648c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175610331 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175610331 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175610331 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175610331 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175610333 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175610333 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175610333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175610334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:11.291360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30769): Terminating (SIGTERM) 17:56:11.331731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30772): Terminating (SIGTERM) 17:56:11.372072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30775): Terminating (SIGTERM) 17:56:11.412478 --- ParallelTerminationStrategy: PID 30769 died... 17:56:11.431702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30769): Terminated: ok {rc=0} 17:56:11.476317 --- ParallelTerminationStrategy: PID 30772 died... 17:56:11.495091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30772): Terminated: ok {rc=0} 17:56:11.539999 --- ParallelTerminationStrategy: PID 30775 died... 17:56:11.558748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30775): Terminated: ok {rc=0} 17:56:11.643799 bus /sierra_3: Setting Powered False 17:56:12.744054 bus /sierra_3: Setting Powered False 17:56:13.862078 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:56:15.012655 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:15.025190 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:56:15.097748 tst mo_mt_call_osmux.py: using LAC 22719 17:56:15.218752 tst mo_mt_call_osmux.py: using RAC 24 17:56:15.339752 tst mo_mt_call_osmux.py: using CellId 22719 17:56:15.468811 tst mo_mt_call_osmux.py: using BVCI 22720 17:56:15.587306 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:15.599074 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:15.610767 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:15.622420 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:15.634045 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:56:15.645444 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:15.766027 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:56:15.900510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:16.433436 run create_hlr_db(pid=30778): Launched 17:56:16.590591 bus /sierra_2: Setting Powered False 17:56:17.651241 run create_hlr_db(pid=30778): Terminated: ok {rc=0} 17:56:18.087697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30780): Launched 17:56:18.394247 run osmo-hlr_10.42.42.2(pid=30781): Launched 17:56:18.510320 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:19.034372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30783): Launched 17:56:19.340443 run osmo-stp_10.42.42.5(pid=30784): Launched 17:56:19.456906 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:20.010160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30786): Launched 17:56:20.315527 run osmo-msc_10.42.42.6(pid=30787): Launched 17:56:20.486186 run osmo-stp_10.42.42.5(pid=30784): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30784)] 17:56:20.615953 run osmo-stp_10.42.42.5(pid=30784): stdout: | (launched: 2022-12-09_17:56:19.284283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:20.745494 run osmo-stp_10.42.42.5(pid=30784): stderr: | 20221209175619458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175619459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175619459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175619459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175619460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175619460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175619460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:20.872521 run osmo-stp_10.42.42.5(pid=30784): stdout: | (launched: 2022-12-09_17:56:19.284283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:20.993416 run osmo-stp_10.42.42.5(pid=30784): stderr: | 20221209175619458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175619459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175619459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175619459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175619460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175619460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175619460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:21.138562 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30784): Process ended prematurely: osmo-stp_10.42.42.5(pid=30784) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30784)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:56:21.147560 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:56:21.174975 run osmo-hlr_10.42.42.2(pid=30781): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30781)] 17:56:21.223476 run osmo-hlr_10.42.42.2(pid=30781): stdout: | (launched: 2022-12-09_17:56:18.338004) 17:56:21.273864 run osmo-hlr_10.42.42.2(pid=30781): stderr: | 20221209175618518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175618518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175618518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175618518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175618518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175618518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175618539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175618549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175618549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175618549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:21.344051 run osmo-msc_10.42.42.6(pid=30787): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30787)] 17:56:21.392701 run osmo-msc_10.42.42.6(pid=30787): stdout: | (launched: 2022-12-09_17:56:20.259388) 17:56:21.442998 run osmo-msc_10.42.42.6(pid=30787): stderr: | 20221209175620531 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175620531 DLGLOBAL DEBUG validating counter group 0x7f3c592fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175620532 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175620532 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175620532 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175620532 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175620534 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175620534 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175620534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175620534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:21.494075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30780): Terminating (SIGTERM) 17:56:21.534718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30783): Terminating (SIGTERM) 17:56:21.575299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30786): Terminating (SIGTERM) 17:56:21.616641 --- ParallelTerminationStrategy: PID 30780 died... 17:56:21.636179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30780): Terminated: ok {rc=0} 17:56:21.681402 --- ParallelTerminationStrategy: PID 30783 died... 17:56:21.700064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30783): Terminated: ok {rc=0} 17:56:21.745254 --- ParallelTerminationStrategy: PID 30786 died... 17:56:21.764001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30786): Terminated: ok {rc=0} 17:56:21.849645 bus /sierra_3: Setting Powered False 17:56:22.950313 bus /sierra_3: Setting Powered False 17:56:24.068581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:56:25.329469 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:25.336765 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:56:25.371093 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:56:25.398442 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:56:25.450964 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:56:25.485229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:56:25.512711 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:56:26.066809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:56:26.118850 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:26.130491 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:56:26.199826 tst mo_mt_call.py: using LAC 22720 17:56:26.325472 tst mo_mt_call.py: using RAC 25 17:56:26.451528 tst mo_mt_call.py: using CellId 22720 17:56:26.579247 tst mo_mt_call.py: using BVCI 22721 17:56:26.698494 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:26.710116 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:26.721463 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:26.732873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:26.744303 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:26.755624 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:26.871726 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:26.995013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:27.501347 run create_hlr_db(pid=30792): Launched 17:56:27.634790 bus /sierra_2: Setting Powered False 17:56:28.699781 run create_hlr_db(pid=30792): Terminated: ok {rc=0} 17:56:29.155612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30794): Launched 17:56:29.486213 run osmo-hlr_10.42.42.2(pid=30795): Launched 17:56:29.613233 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:30.176685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30797): Launched 17:56:30.502803 run osmo-stp_10.42.42.5(pid=30798): Launched 17:56:30.627330 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:31.219513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30800): Launched 17:56:31.560165 run osmo-msc_10.42.42.6(pid=30801): Launched 17:56:31.792211 run osmo-stp_10.42.42.5(pid=30798): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30798)] 17:56:31.987056 run osmo-stp_10.42.42.5(pid=30798): stdout: | (launched: 2022-12-09_17:56:30.443215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:32.134056 run osmo-stp_10.42.42.5(pid=30798): stderr: | 20221209175630637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175630637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175630637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175630638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175630638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175630638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175630638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:32.319462 run osmo-stp_10.42.42.5(pid=30798): stdout: | (launched: 2022-12-09_17:56:30.443215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:32.482724 run osmo-stp_10.42.42.5(pid=30798): stderr: | 20221209175630637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175630637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175630637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175630638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175630638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175630638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175630638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:32.630018 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30798): Process ended prematurely: osmo-stp_10.42.42.5(pid=30798) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30798)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:56:32.639139 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 17:56:32.667555 run osmo-hlr_10.42.42.2(pid=30795): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30795)] 17:56:32.717127 run osmo-hlr_10.42.42.2(pid=30795): stdout: | (launched: 2022-12-09_17:56:29.425346) 17:56:32.768229 run osmo-hlr_10.42.42.2(pid=30795): stderr: | 20221209175629627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175629627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175629627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175629627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175629628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175629628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175629639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175629647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175629647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175629647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:32.839002 run osmo-msc_10.42.42.6(pid=30801): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30801)] 17:56:32.888153 run osmo-msc_10.42.42.6(pid=30801): stdout: | (launched: 2022-12-09_17:56:31.500495) 17:56:32.939036 run osmo-msc_10.42.42.6(pid=30801): stderr: | 20221209175632181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175632187 DLGLOBAL DEBUG validating counter group 0x7ff540f69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175632187 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175632187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175632187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175632187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175632197 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175632198 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175632198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175632198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:32.990317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30794): Terminating (SIGTERM) 17:56:33.031451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30797): Terminating (SIGTERM) 17:56:33.072882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30800): Terminating (SIGTERM) 17:56:33.114754 --- ParallelTerminationStrategy: PID 30794 died... 17:56:33.134024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30794): Terminated: ok {rc=0} 17:56:33.180147 --- ParallelTerminationStrategy: PID 30797 died... 17:56:33.199128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30797): Terminated: ok {rc=0} 17:56:33.245320 --- ParallelTerminationStrategy: PID 30800 died... 17:56:33.264307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30800): Terminated: ok {rc=0} 17:56:33.353971 bus /sierra_3: Setting Powered False 17:56:34.454456 bus /sierra_3: Setting Powered False 17:56:35.572167 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:56:36.720535 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:36.732437 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:56:36.802906 tst mo_mt_call_osmux.py: using LAC 22721 17:56:36.923912 tst mo_mt_call_osmux.py: using RAC 26 17:56:37.044823 tst mo_mt_call_osmux.py: using CellId 22721 17:56:37.168373 tst mo_mt_call_osmux.py: using BVCI 22722 17:56:37.280477 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:37.291637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:37.302641 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:37.313904 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:37.325105 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:56:37.336127 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:37.453213 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:56:37.574646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:38.080055 run create_hlr_db(pid=30803): Launched 17:56:38.213471 bus /sierra_2: Setting Powered False 17:56:39.277874 run create_hlr_db(pid=30803): Terminated: ok {rc=0} 17:56:39.733404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30805): Launched 17:56:40.061690 run osmo-hlr_10.42.42.2(pid=30806): Launched 17:56:40.187431 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:40.747225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30808): Launched 17:56:41.074557 run osmo-stp_10.42.42.5(pid=30809): Launched 17:56:41.200310 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:41.792253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30811): Launched 17:56:42.119383 run osmo-msc_10.42.42.6(pid=30812): Launched 17:56:42.301085 run osmo-stp_10.42.42.5(pid=30809): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30809)] 17:56:42.439735 run osmo-stp_10.42.42.5(pid=30809): stdout: | (launched: 2022-12-09_17:56:41.015045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:42.577968 run osmo-stp_10.42.42.5(pid=30809): stderr: | 20221209175641209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175641209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175641209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175641210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175641210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175641210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175641210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:42.714494 run osmo-stp_10.42.42.5(pid=30809): stdout: | (launched: 2022-12-09_17:56:41.015045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:42.843401 run osmo-stp_10.42.42.5(pid=30809): stderr: | 20221209175641209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175641209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175641209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175641210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175641210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175641210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175641210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:42.997888 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30809): Process ended prematurely: osmo-stp_10.42.42.5(pid=30809) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30809)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:56:43.007416 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:56:43.035719 run osmo-hlr_10.42.42.2(pid=30806): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30806)] 17:56:43.086607 run osmo-hlr_10.42.42.2(pid=30806): stdout: | (launched: 2022-12-09_17:56:40.001941) 17:56:43.139595 run osmo-hlr_10.42.42.2(pid=30806): stderr: | 20221209175640203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175640203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175640203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175640203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175640203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175640203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175640216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175640224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175640224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175640224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:43.212911 run osmo-msc_10.42.42.6(pid=30812): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30812)] 17:56:43.263614 run osmo-msc_10.42.42.6(pid=30812): stdout: | (launched: 2022-12-09_17:56:42.059456) 17:56:43.316251 run osmo-msc_10.42.42.6(pid=30812): stderr: | 20221209175642383 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175642383 DLGLOBAL DEBUG validating counter group 0x7fbefef47c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175642384 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175642384 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175642384 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175642384 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175642386 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175642386 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175642386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175642386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:43.369329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30805): Terminating (SIGTERM) 17:56:43.411836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30808): Terminating (SIGTERM) 17:56:43.454230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30811): Terminating (SIGTERM) 17:56:43.496844 --- ParallelTerminationStrategy: PID 30805 died... 17:56:43.517284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30805): Terminated: ok {rc=0} 17:56:43.564225 --- ParallelTerminationStrategy: PID 30808 died... 17:56:43.584066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30808): Terminated: ok {rc=0} 17:56:43.630718 --- ParallelTerminationStrategy: PID 30811 died... 17:56:43.650504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30811): Terminated: ok {rc=0} 17:56:43.739037 bus /sierra_3: Setting Powered False 17:56:44.837312 bus /sierra_3: Setting Powered False 17:56:45.960895 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:56:47.234305 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:47.244906 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:56:47.282005 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:56:47.309967 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:56:47.363660 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:56:47.398131 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:56:47.425775 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:56:47.977425 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:56:48.030312 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:48.041915 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:56:48.117104 tst mo_mt_call.py: using LAC 22722 17:56:48.237311 tst mo_mt_call.py: using RAC 27 17:56:48.355475 tst mo_mt_call.py: using CellId 22722 17:56:48.474060 tst mo_mt_call.py: using BVCI 22723 17:56:48.584805 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:48.596041 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:48.607162 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:48.618345 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:48.629693 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:48.640820 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:56:48.756283 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:56:48.871878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:49.344736 run create_hlr_db(pid=30817): Launched 17:56:49.462188 bus /sierra_2: Setting Powered False 17:56:50.523018 run create_hlr_db(pid=30817): Terminated: ok {rc=0} 17:56:50.950257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30819): Launched 17:56:51.257182 run osmo-hlr_10.42.42.2(pid=30820): Launched 17:56:51.374143 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:51.910411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30822): Launched 17:56:52.215194 run osmo-stp_10.42.42.5(pid=30823): Launched 17:56:52.332425 run osmo-msc_10.42.42.6: Starting osmo-msc 17:56:52.885727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30825): Launched 17:56:53.191833 run osmo-msc_10.42.42.6(pid=30826): Launched 17:56:53.362898 run osmo-stp_10.42.42.5(pid=30823): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30823)] 17:56:53.492021 run osmo-stp_10.42.42.5(pid=30823): stdout: | (launched: 2022-12-09_17:56:52.159193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:53.621688 run osmo-stp_10.42.42.5(pid=30823): stderr: | 20221209175652331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175652331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175652331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175652332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175652332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175652332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175652332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:53.748525 run osmo-stp_10.42.42.5(pid=30823): stdout: | (launched: 2022-12-09_17:56:52.159193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:53.869447 run osmo-stp_10.42.42.5(pid=30823): stderr: | 20221209175652331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175652331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175652331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175652332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175652332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175652332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175652332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:54.014549 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30823): Process ended prematurely: osmo-stp_10.42.42.5(pid=30823) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30823)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:56:54.023642 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 17:56:54.050973 run osmo-hlr_10.42.42.2(pid=30820): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30820)] 17:56:54.099765 run osmo-hlr_10.42.42.2(pid=30820): stdout: | (launched: 2022-12-09_17:56:51.201170) 17:56:54.150238 run osmo-hlr_10.42.42.2(pid=30820): stderr: | 20221209175651377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175651377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175651377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175651377 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175651377 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175651378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175651394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175651404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175651404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175651404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:54.220412 run osmo-msc_10.42.42.6(pid=30826): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30826)] 17:56:54.269026 run osmo-msc_10.42.42.6(pid=30826): stdout: | (launched: 2022-12-09_17:56:53.135436) 17:56:54.319270 run osmo-msc_10.42.42.6(pid=30826): stderr: | 20221209175653407 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175653407 DLGLOBAL DEBUG validating counter group 0x7fa9fe7f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175653407 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175653407 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175653408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175653408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175653409 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175653410 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175653410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175653410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:56:54.369976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30819): Terminating (SIGTERM) 17:56:54.410381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30822): Terminating (SIGTERM) 17:56:54.450916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30825): Terminating (SIGTERM) 17:56:54.491483 --- ParallelTerminationStrategy: PID 30819 died... 17:56:54.510604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30819): Terminated: ok {rc=0} 17:56:54.555355 --- ParallelTerminationStrategy: PID 30822 died... 17:56:54.574121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30822): Terminated: ok {rc=0} 17:56:54.619376 --- ParallelTerminationStrategy: PID 30825 died... 17:56:54.638258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30825): Terminated: ok {rc=0} 17:56:54.725766 bus /sierra_3: Setting Powered False 17:56:55.827361 bus /sierra_3: Setting Powered False 17:56:56.941506 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:56:58.092676 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:58.105403 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:56:58.178273 tst mo_mt_call_osmux.py: using LAC 22723 17:56:58.307035 tst mo_mt_call_osmux.py: using RAC 28 17:56:58.435150 tst mo_mt_call_osmux.py: using CellId 22723 17:56:58.563829 tst mo_mt_call_osmux.py: using BVCI 22724 17:56:58.682090 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:58.693971 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:58.705642 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:58.717381 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:58.729049 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:56:58.740510 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:56:58.858235 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:56:58.978523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:59.483599 run create_hlr_db(pid=30828): Launched 17:56:59.616023 bus /sierra_2: Setting Powered False 17:57:00.680871 run create_hlr_db(pid=30828): Terminated: ok {rc=0} 17:57:01.155030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30830): Launched 17:57:01.493765 run osmo-hlr_10.42.42.2(pid=30831): Launched 17:57:01.676353 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:02.447038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30833): Launched 17:57:02.754353 run osmo-stp_10.42.42.5(pid=30834): Launched 17:57:02.871033 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:03.424336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30836): Launched 17:57:03.732585 run osmo-msc_10.42.42.6(pid=30837): Launched 17:57:03.903698 run osmo-stp_10.42.42.5(pid=30834): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30834)] 17:57:04.034013 run osmo-stp_10.42.42.5(pid=30834): stdout: | (launched: 2022-12-09_17:57:02.698120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:04.164211 run osmo-stp_10.42.42.5(pid=30834): stderr: | 20221209175702869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175702869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175702870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175702870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175702871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175702871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175702871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:04.292491 run osmo-stp_10.42.42.5(pid=30834): stdout: | (launched: 2022-12-09_17:57:02.698120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:04.414158 run osmo-stp_10.42.42.5(pid=30834): stderr: | 20221209175702869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175702869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175702870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175702870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175702871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175702871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175702871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:04.560011 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30834): Process ended prematurely: osmo-stp_10.42.42.5(pid=30834) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30834)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:57:04.569307 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:57:04.596891 run osmo-hlr_10.42.42.2(pid=30831): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30831)] 17:57:04.646067 run osmo-hlr_10.42.42.2(pid=30831): stdout: | (launched: 2022-12-09_17:57:01.427866) 17:57:04.696565 run osmo-hlr_10.42.42.2(pid=30831): stderr: | 20221209175701858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175701859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175701859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175701859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175701859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175701859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175701884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175701903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175701903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175701903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:04.767123 run osmo-msc_10.42.42.6(pid=30837): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30837)] 17:57:04.815979 run osmo-msc_10.42.42.6(pid=30837): stdout: | (launched: 2022-12-09_17:57:03.676053) 17:57:04.866578 run osmo-msc_10.42.42.6(pid=30837): stderr: | 20221209175703951 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175703951 DLGLOBAL DEBUG validating counter group 0x7ff41e41fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175703951 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175703951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175703951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175703951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175703953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175703954 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175703954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175703954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:04.917585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30830): Terminating (SIGTERM) 17:57:04.958426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30833): Terminating (SIGTERM) 17:57:04.999185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30836): Terminating (SIGTERM) 17:57:05.040143 --- ParallelTerminationStrategy: PID 30830 died... 17:57:05.059736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30830): Terminated: ok {rc=0} 17:57:05.105606 --- ParallelTerminationStrategy: PID 30833 died... 17:57:05.124715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30833): Terminated: ok {rc=0} 17:57:05.170149 --- ParallelTerminationStrategy: PID 30836 died... 17:57:05.189191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30836): Terminated: ok {rc=0} 17:57:05.276670 bus /sierra_3: Setting Powered False 17:57:06.377427 bus /sierra_3: Setting Powered False 17:57:07.494895 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:57:08.752879 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:08.759780 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:57:08.793530 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:57:08.820057 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:57:08.871563 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:57:08.904150 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:57:08.930117 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:57:09.481550 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:57:09.530829 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:09.541902 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:57:09.610123 tst mo_mt_call.py: using LAC 22724 17:57:09.728663 tst mo_mt_call.py: using RAC 29 17:57:09.846638 tst mo_mt_call.py: using CellId 22724 17:57:09.969867 tst mo_mt_call.py: using BVCI 22725 17:57:10.082141 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:10.093241 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:10.104040 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:10.115183 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:10.126358 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:10.137456 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:10.255619 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:10.373526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:10.844821 run create_hlr_db(pid=30842): Launched 17:57:10.961101 bus /sierra_2: Setting Powered False 17:57:12.022356 run create_hlr_db(pid=30842): Terminated: ok {rc=0} 17:57:12.468295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30844): Launched 17:57:12.794922 run osmo-hlr_10.42.42.2(pid=30845): Launched 17:57:12.920385 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:13.481031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30847): Launched 17:57:13.806681 run osmo-stp_10.42.42.5(pid=30848): Launched 17:57:13.932040 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:14.521371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30850): Launched 17:57:14.847104 run osmo-msc_10.42.42.6(pid=30851): Launched 17:57:15.029214 run osmo-stp_10.42.42.5(pid=30848): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30848)] 17:57:15.165695 run osmo-stp_10.42.42.5(pid=30848): stdout: | (launched: 2022-12-09_17:57:13.747353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:15.303165 run osmo-stp_10.42.42.5(pid=30848): stderr: | 20221209175713940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175713940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175713940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175713940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175713943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175713943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175713943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:15.440366 run osmo-stp_10.42.42.5(pid=30848): stdout: | (launched: 2022-12-09_17:57:13.747353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:15.569718 run osmo-stp_10.42.42.5(pid=30848): stderr: | 20221209175713940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175713940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175713940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175713940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175713943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175713943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175713943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:15.724470 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30848): Process ended prematurely: osmo-stp_10.42.42.5(pid=30848) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30848)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:57:15.734386 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 17:57:15.762359 run osmo-hlr_10.42.42.2(pid=30845): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30845)] 17:57:15.812646 run osmo-hlr_10.42.42.2(pid=30845): stdout: | (launched: 2022-12-09_17:57:12.735579) 17:57:15.889674 run osmo-hlr_10.42.42.2(pid=30845): stderr: | 20221209175712935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175712935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175712935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175712935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175712935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175712935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175712947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175712956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175712956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175712956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:15.973301 run osmo-msc_10.42.42.6(pid=30851): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30851)] 17:57:16.030440 run osmo-msc_10.42.42.6(pid=30851): stdout: | (launched: 2022-12-09_17:57:14.787623) 17:57:16.083681 run osmo-msc_10.42.42.6(pid=30851): stderr: | 20221209175715112 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175715112 DLGLOBAL DEBUG validating counter group 0x7fa18550ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175715113 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175715113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175715113 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175715113 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175715115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175715115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175715115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175715115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:16.138888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30844): Terminating (SIGTERM) 17:57:16.182652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30847): Terminating (SIGTERM) 17:57:16.228222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30850): Terminating (SIGTERM) 17:57:16.273866 --- ParallelTerminationStrategy: PID 30844 died... 17:57:16.295276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30844): Terminated: ok {rc=0} 17:57:16.345469 --- ParallelTerminationStrategy: PID 30847 died... 17:57:16.365905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30847): Terminated: ok {rc=0} 17:57:16.414211 --- ParallelTerminationStrategy: PID 30850 died... 17:57:16.434089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30850): Terminated: ok {rc=0} 17:57:16.526043 bus /sierra_3: Setting Powered False 17:57:17.626352 bus /sierra_3: Setting Powered False 17:57:18.743891 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:57:19.892684 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:19.904515 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:57:19.973965 tst mo_mt_call_osmux.py: using LAC 22725 17:57:20.099353 tst mo_mt_call_osmux.py: using RAC 30 17:57:20.218486 tst mo_mt_call_osmux.py: using CellId 22725 17:57:20.336268 tst mo_mt_call_osmux.py: using BVCI 22726 17:57:20.446500 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:20.457579 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:20.468409 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:20.479506 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:20.490695 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:57:20.502298 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:20.622475 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:57:20.741135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:21.212527 run create_hlr_db(pid=30853): Launched 17:57:21.329136 bus /sierra_2: Setting Powered False 17:57:22.389831 run create_hlr_db(pid=30853): Terminated: ok {rc=0} 17:57:22.814929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30855): Launched 17:57:23.120654 run osmo-hlr_10.42.42.2(pid=30856): Launched 17:57:23.237133 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:23.763771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30858): Launched 17:57:24.068583 run osmo-stp_10.42.42.5(pid=30859): Launched 17:57:24.185708 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:24.738340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30861): Launched 17:57:25.044166 run osmo-msc_10.42.42.6(pid=30862): Launched 17:57:25.214954 run osmo-stp_10.42.42.5(pid=30859): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30859)] 17:57:25.344237 run osmo-stp_10.42.42.5(pid=30859): stdout: | (launched: 2022-12-09_17:57:24.012508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:25.474189 run osmo-stp_10.42.42.5(pid=30859): stderr: | 20221209175724185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175724185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175724186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175724186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175724187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175724187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175724187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:25.601401 run osmo-stp_10.42.42.5(pid=30859): stdout: | (launched: 2022-12-09_17:57:24.012508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:25.722351 run osmo-stp_10.42.42.5(pid=30859): stderr: | 20221209175724185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175724185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175724186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175724186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175724187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175724187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175724187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:25.867540 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30859): Process ended prematurely: osmo-stp_10.42.42.5(pid=30859) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30859)] [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:57:25.876630 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 17:57:25.904149 run osmo-hlr_10.42.42.2(pid=30856): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30856)] 17:57:25.952777 run osmo-hlr_10.42.42.2(pid=30856): stdout: | (launched: 2022-12-09_17:57:23.064566) 17:57:26.003513 run osmo-hlr_10.42.42.2(pid=30856): stderr: | 20221209175723240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175723240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175723240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175723240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175723240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175723240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175723252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175723261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175723261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175723261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:26.073844 run osmo-msc_10.42.42.6(pid=30862): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30862)] 17:57:26.122680 run osmo-msc_10.42.42.6(pid=30862): stdout: | (launched: 2022-12-09_17:57:24.988211) 17:57:26.173189 run osmo-msc_10.42.42.6(pid=30862): stderr: | 20221209175725262 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175725262 DLGLOBAL DEBUG validating counter group 0x7fd4035bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175725262 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175725262 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175725262 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175725262 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175725264 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175725265 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175725265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175725265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:26.223893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30855): Terminating (SIGTERM) 17:57:26.264240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30858): Terminating (SIGTERM) 17:57:26.304592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30861): Terminating (SIGTERM) 17:57:26.345425 --- ParallelTerminationStrategy: PID 30855 died... 17:57:26.364659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30855): Terminated: ok {rc=0} 17:57:26.409853 --- ParallelTerminationStrategy: PID 30858 died... 17:57:26.428478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30858): Terminated: ok {rc=0} 17:57:26.473407 --- ParallelTerminationStrategy: PID 30861 died... 17:57:26.492182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30861): Terminated: ok {rc=0} 17:57:26.579913 bus /sierra_3: Setting Powered False 17:57:27.680284 bus /sierra_3: Setting Powered False 17:57:28.798846 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:57:30.048836 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:30.055282 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:57:30.088784 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:57:30.115321 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:57:30.168744 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:57:30.203071 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:57:30.230367 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:57:30.777130 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:57:30.826736 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:30.842044 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:57:30.919529 tst mo_mt_call.py: using LAC 22726 17:57:31.047196 tst mo_mt_call.py: using RAC 31 17:57:31.167802 tst mo_mt_call.py: using CellId 22726 17:57:31.291213 tst mo_mt_call.py: using BVCI 22727 17:57:31.435934 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:31.448717 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:31.461768 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:31.474310 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:31.487167 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:31.501896 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:31.637597 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:31.768936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:32.309182 run create_hlr_db(pid=30868): Launched 17:57:32.437906 bus /sierra_2: Setting Powered False 17:57:33.498921 run create_hlr_db(pid=30868): Terminated: ok {rc=0} 17:57:33.946723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30870): Launched 17:57:34.276094 run osmo-hlr_10.42.42.2(pid=30871): Launched 17:57:34.400121 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:34.961531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30873): Launched 17:57:35.288427 run osmo-stp_10.42.42.5(pid=30874): Launched 17:57:35.412868 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:36.006268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30876): Launched 17:57:36.333912 run osmo-msc_10.42.42.6(pid=30877): Launched 17:57:36.517430 run osmo-stp_10.42.42.5(pid=30874): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30874)] 17:57:36.655034 run osmo-stp_10.42.42.5(pid=30874): stdout: | (launched: 2022-12-09_17:57:35.228698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:36.793128 run osmo-stp_10.42.42.5(pid=30874): stderr: | 20221209175735421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175735421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175735422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175735422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175735425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175735425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175735425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:36.930476 run osmo-stp_10.42.42.5(pid=30874): stdout: | (launched: 2022-12-09_17:57:35.228698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:37.059539 run osmo-stp_10.42.42.5(pid=30874): stderr: | 20221209175735421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175735421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175735422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175735422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175735425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175735425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175735425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:37.214326 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30874): Process ended prematurely: osmo-stp_10.42.42.5(pid=30874) [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30874)] [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:57:37.223870 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:57:37.252137 run osmo-hlr_10.42.42.2(pid=30871): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30871)] 17:57:37.302734 run osmo-hlr_10.42.42.2(pid=30871): stdout: | (launched: 2022-12-09_17:57:34.215901) 17:57:37.355792 run osmo-hlr_10.42.42.2(pid=30871): stderr: | 20221209175734415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175734415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175734415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175734415 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175734415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175734415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175734428 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175734437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175734437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175734437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:37.429247 run osmo-msc_10.42.42.6(pid=30877): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30877)] 17:57:37.480068 run osmo-msc_10.42.42.6(pid=30877): stdout: | (launched: 2022-12-09_17:57:36.274319) 17:57:37.533260 run osmo-msc_10.42.42.6(pid=30877): stderr: | 20221209175736598 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175736598 DLGLOBAL DEBUG validating counter group 0x7fc00f0a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175736598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175736598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175736598 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175736598 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175736600 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175736601 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175736601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175736601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:37.585979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30870): Terminating (SIGTERM) 17:57:37.628184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30873): Terminating (SIGTERM) 17:57:37.670363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30876): Terminating (SIGTERM) 17:57:37.712673 --- ParallelTerminationStrategy: PID 30870 died... 17:57:37.732857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30870): Terminated: ok {rc=0} 17:57:37.779610 --- ParallelTerminationStrategy: PID 30873 died... 17:57:37.799358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30873): Terminated: ok {rc=0} 17:57:37.845707 --- ParallelTerminationStrategy: PID 30876 died... 17:57:37.865292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30876): Terminated: ok {rc=0} 17:57:37.954078 bus /sierra_3: Setting Powered False 17:57:39.052935 bus /sierra_3: Setting Powered False 17:57:40.169837 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:57:41.322496 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:41.335163 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:57:41.408598 tst mo_mt_call_osmux.py: using LAC 22727 17:57:41.540392 tst mo_mt_call_osmux.py: using RAC 32 17:57:41.669673 tst mo_mt_call_osmux.py: using CellId 22727 17:57:41.799098 tst mo_mt_call_osmux.py: using BVCI 22728 17:57:41.919772 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:41.931646 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:41.943300 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:41.955038 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:41.966797 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:57:41.978299 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:42.097430 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:57:42.218588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:42.723704 run create_hlr_db(pid=30879): Launched 17:57:42.855124 bus /sierra_2: Setting Powered False 17:57:43.918942 run create_hlr_db(pid=30879): Terminated: ok {rc=0} 17:57:44.355758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30881): Launched 17:57:44.662546 run osmo-hlr_10.42.42.2(pid=30882): Launched 17:57:44.781099 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:45.310057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30884): Launched 17:57:45.615882 run osmo-stp_10.42.42.5(pid=30885): Launched 17:57:45.731547 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:46.317310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30887): Launched 17:57:46.670313 run osmo-msc_10.42.42.6(pid=30888): Launched 17:57:47.116305 run osmo-stp_10.42.42.5(pid=30885): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30885)] 17:57:47.366081 run osmo-stp_10.42.42.5(pid=30885): stdout: | (launched: 2022-12-09_17:57:45.559728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:47.497548 run osmo-stp_10.42.42.5(pid=30885): stderr: | 20221209175745732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175745732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175745732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175745733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175745735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175745735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175745735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:47.625912 run osmo-stp_10.42.42.5(pid=30885): stdout: | (launched: 2022-12-09_17:57:45.559728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:47.747934 run osmo-stp_10.42.42.5(pid=30885): stderr: | 20221209175745732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175745732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175745732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175745733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175745735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175745735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175745735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:47.894318 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30885): Process ended prematurely: osmo-stp_10.42.42.5(pid=30885) [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30885)] [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:57:47.903537 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:57:47.931287 run osmo-hlr_10.42.42.2(pid=30882): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30882)] 17:57:47.980217 run osmo-hlr_10.42.42.2(pid=30882): stdout: | (launched: 2022-12-09_17:57:44.606258) 17:57:48.030670 run osmo-hlr_10.42.42.2(pid=30882): stderr: | 20221209175744783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175744783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175744783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175744783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175744783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175744783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175744795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175744803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175744804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175744804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:48.101086 run osmo-msc_10.42.42.6(pid=30888): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30888)] 17:57:48.149706 run osmo-msc_10.42.42.6(pid=30888): stdout: | (launched: 2022-12-09_17:57:46.609557) 17:57:48.200191 run osmo-msc_10.42.42.6(pid=30888): stderr: | 20221209175747032 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175747032 DLGLOBAL DEBUG validating counter group 0x7f895d793c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175747033 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175747033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175747033 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175747033 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175747037 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175747038 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175747038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175747038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:48.250822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30881): Terminating (SIGTERM) 17:57:48.291545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30884): Terminating (SIGTERM) 17:57:48.332893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30887): Terminating (SIGTERM) 17:57:48.374034 --- ParallelTerminationStrategy: PID 30881 died... 17:57:48.393587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30881): Terminated: ok {rc=0} 17:57:48.439246 --- ParallelTerminationStrategy: PID 30884 died... 17:57:48.458331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30884): Terminated: ok {rc=0} 17:57:48.503594 --- ParallelTerminationStrategy: PID 30887 died... 17:57:48.522547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30887): Terminated: ok {rc=0} 17:57:48.610900 bus /sierra_3: Setting Powered False 17:57:49.710873 bus /sierra_3: Setting Powered False 17:57:50.827107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:57:52.101323 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:52.106982 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:57:52.140198 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:57:52.166690 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:57:52.219426 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:57:52.252739 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:57:52.278949 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:57:52.826251 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:57:52.875712 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:52.886674 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:57:52.955989 tst mo_mt_call.py: using LAC 22728 17:57:53.077547 tst mo_mt_call.py: using RAC 33 17:57:53.199881 tst mo_mt_call.py: using CellId 22728 17:57:53.317220 tst mo_mt_call.py: using BVCI 22729 17:57:53.427956 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:53.438880 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:53.449579 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:53.460455 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:53.471421 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:57:53.482321 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:57:53.601956 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:57:53.722444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:54.226613 run create_hlr_db(pid=30893): Launched 17:57:54.350699 bus /sierra_2: Setting Powered False 17:57:55.411476 run create_hlr_db(pid=30893): Terminated: ok {rc=0} 17:57:55.838428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30895): Launched 17:57:56.146932 run osmo-hlr_10.42.42.2(pid=30896): Launched 17:57:56.264031 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:56.790302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30898): Launched 17:57:57.096908 run osmo-stp_10.42.42.5(pid=30899): Launched 17:57:57.216425 run osmo-msc_10.42.42.6: Starting osmo-msc 17:57:57.772029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30901): Launched 17:57:58.078438 run osmo-msc_10.42.42.6(pid=30902): Launched 17:57:58.252766 run osmo-stp_10.42.42.5(pid=30899): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30899)] 17:57:58.383086 run osmo-stp_10.42.42.5(pid=30899): stdout: | (launched: 2022-12-09_17:57:57.040642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:58.512902 run osmo-stp_10.42.42.5(pid=30899): stderr: | 20221209175757213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175757213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175757213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175757213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175757214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175757214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175757214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:58.640405 run osmo-stp_10.42.42.5(pid=30899): stdout: | (launched: 2022-12-09_17:57:57.040642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:58.761603 run osmo-stp_10.42.42.5(pid=30899): stderr: | 20221209175757213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175757213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175757213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175757213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175757214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175757214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175757214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:58.906956 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30899): Process ended prematurely: osmo-stp_10.42.42.5(pid=30899) [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30899)] [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:57:58.915890 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:57:58.943108 run osmo-hlr_10.42.42.2(pid=30896): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30896)] 17:57:58.991395 run osmo-hlr_10.42.42.2(pid=30896): stdout: | (launched: 2022-12-09_17:57:56.090768) 17:57:59.041349 run osmo-hlr_10.42.42.2(pid=30896): stderr: | 20221209175756265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175756265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175756265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175756265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175756265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175756265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175756283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175756292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175756292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175756293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:59.111354 run osmo-msc_10.42.42.6(pid=30902): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30902)] 17:57:59.159294 run osmo-msc_10.42.42.6(pid=30902): stdout: | (launched: 2022-12-09_17:57:58.022083) 17:57:59.209284 run osmo-msc_10.42.42.6(pid=30902): stderr: | 20221209175758293 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175758294 DLGLOBAL DEBUG validating counter group 0x7fbae743dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175758294 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175758294 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175758295 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175758295 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175758297 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175758297 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175758297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175758297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:57:59.259623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30895): Terminating (SIGTERM) 17:57:59.299380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30898): Terminating (SIGTERM) 17:57:59.339466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30901): Terminating (SIGTERM) 17:57:59.379508 --- ParallelTerminationStrategy: PID 30895 died... 17:57:59.398677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30895): Terminated: ok {rc=0} 17:57:59.443271 --- ParallelTerminationStrategy: PID 30898 died... 17:57:59.461906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30898): Terminated: ok {rc=0} 17:57:59.506461 --- ParallelTerminationStrategy: PID 30901 died... 17:57:59.525150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30901): Terminated: ok {rc=0} 17:57:59.609345 bus /sierra_3: Setting Powered False 17:58:00.705538 bus /sierra_3: Setting Powered False 17:58:01.817514 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:58:02.963867 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:02.975480 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:58:03.056030 tst mo_mt_call_osmux.py: using LAC 22729 17:58:03.177331 tst mo_mt_call_osmux.py: using RAC 34 17:58:03.298086 tst mo_mt_call_osmux.py: using CellId 22729 17:58:03.417878 tst mo_mt_call_osmux.py: using BVCI 22730 17:58:03.530983 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:03.541922 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:03.552553 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:03.563580 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:03.574353 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:58:03.585583 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:58:03.705061 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:58:03.828033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:04.334193 run create_hlr_db(pid=30904): Launched 17:58:04.470941 bus /sierra_2: Setting Powered False 17:58:05.535659 run create_hlr_db(pid=30904): Terminated: ok {rc=0} 17:58:05.973293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30906): Launched 17:58:06.281817 run osmo-hlr_10.42.42.2(pid=30907): Launched 17:58:06.398612 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:06.937055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30909): Launched 17:58:07.242621 run osmo-stp_10.42.42.5(pid=30910): Launched 17:58:07.358779 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:07.911421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30912): Launched 17:58:08.218893 run osmo-msc_10.42.42.6(pid=30913): Launched 17:58:08.389843 run osmo-stp_10.42.42.5(pid=30910): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30910)] 17:58:08.520230 run osmo-stp_10.42.42.5(pid=30910): stdout: | (launched: 2022-12-09_17:58:07.186748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:08.650202 run osmo-stp_10.42.42.5(pid=30910): stderr: | 20221209175807358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175807358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175807358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175807359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175807359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175807359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175807359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:08.778084 run osmo-stp_10.42.42.5(pid=30910): stdout: | (launched: 2022-12-09_17:58:07.186748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:08.899702 run osmo-stp_10.42.42.5(pid=30910): stderr: | 20221209175807358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175807358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175807358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175807359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175807359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175807359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175807359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:09.045215 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30910): Process ended prematurely: osmo-stp_10.42.42.5(pid=30910) [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30910)] [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:58:09.054075 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:58:09.081452 run osmo-hlr_10.42.42.2(pid=30907): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30907)] 17:58:09.129904 run osmo-hlr_10.42.42.2(pid=30907): stdout: | (launched: 2022-12-09_17:58:06.224916) 17:58:09.180140 run osmo-hlr_10.42.42.2(pid=30907): stderr: | 20221209175806406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175806406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175806406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175806406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175806406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175806406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175806418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175806426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175806427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175806427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:09.249674 run osmo-msc_10.42.42.6(pid=30913): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30913)] 17:58:09.298099 run osmo-msc_10.42.42.6(pid=30913): stdout: | (launched: 2022-12-09_17:58:08.162558) 17:58:09.347804 run osmo-msc_10.42.42.6(pid=30913): stderr: | 20221209175808437 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175808437 DLGLOBAL DEBUG validating counter group 0x7f69194e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175808437 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175808437 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175808438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175808438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175808439 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175808440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175808440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175808440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:09.398079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30906): Terminating (SIGTERM) 17:58:09.438371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30909): Terminating (SIGTERM) 17:58:09.478466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30912): Terminating (SIGTERM) 17:58:09.518990 --- ParallelTerminationStrategy: PID 30906 died... 17:58:09.538187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30906): Terminated: ok {rc=0} 17:58:09.582734 --- ParallelTerminationStrategy: PID 30909 died... 17:58:09.601483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30909): Terminated: ok {rc=0} 17:58:09.646150 --- ParallelTerminationStrategy: PID 30912 died... 17:58:09.665139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30912): Terminated: ok {rc=0} 17:58:09.750119 bus /sierra_3: Setting Powered False 17:58:10.847335 bus /sierra_3: Setting Powered False 17:58:11.964162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 emergency:trx-lms --------------------------------------------------------------------- 17:58:13.224812 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:58:13.230207 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 17:58:13.263333 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 17:58:13.289647 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 17:58:13.373777 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 17:58:13.406728 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 17:58:13.433261 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 17:58:14.017609 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2362 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 17:58:14.022660 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:14.033302 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 17:58:14.082432 tst emergency_mo_mt_call.py: using LAC 22730 17:58:14.200181 tst emergency_mo_mt_call.py: using RAC 35 17:58:14.315726 tst emergency_mo_mt_call.py: using CellId 22730 17:58:14.431494 tst emergency_mo_mt_call.py: using BVCI 22731 17:58:14.551108 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:14.562509 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:14.573740 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:14.585750 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:14.597524 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:14.609123 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:14.723958 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:14.846692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:15.343575 run create_hlr_db(pid=30918): Launched 17:58:15.474573 bus /sierra_2: Setting Powered False 17:58:16.537249 run create_hlr_db(pid=30918): Terminated: ok {rc=0} 17:58:16.971272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30920): Launched 17:58:17.337227 run osmo-hlr_10.42.42.2(pid=30921): Launched 17:58:17.454041 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:17.981821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30923): Launched 17:58:18.281769 run osmo-stp_10.42.42.5(pid=30924): Launched 17:58:18.407322 tst emergency_mo_mt_call.py: using MSISDN 7302 17:58:18.560407 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:19.099161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30927): Launched 17:58:19.398387 run osmo-msc_10.42.42.6(pid=30928): Launched 17:58:19.567111 run osmo-stp_10.42.42.5(pid=30924): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30924)] 17:58:19.694391 run osmo-stp_10.42.42.5(pid=30924): stdout: | (launched: 2022-12-09_17:58:18.226479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:19.822060 run osmo-stp_10.42.42.5(pid=30924): stderr: | 20221209175818399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175818400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175818400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175818400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175818401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175818401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175818401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:19.946893 run osmo-stp_10.42.42.5(pid=30924): stdout: | (launched: 2022-12-09_17:58:18.226479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:20.065781 run osmo-stp_10.42.42.5(pid=30924): stderr: | 20221209175818399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175818400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175818400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175818400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175818401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175818401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175818401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:20.208376 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30924): Process ended prematurely: osmo-stp_10.42.42.5(pid=30924) [trial-2362↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30924)] [trial-2362↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 17:58:20.217036 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 17:58:20.243880 run osmo-hlr_10.42.42.2(pid=30921): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30921)] 17:58:20.292304 run osmo-hlr_10.42.42.2(pid=30921): stdout: | (launched: 2022-12-09_17:58:17.282053) 17:58:20.342488 run osmo-hlr_10.42.42.2(pid=30921): stderr: | 20221209175817458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175817458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175817458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175817458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175817458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175817459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175817471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175817482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175817483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175817483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:20.411752 run osmo-msc_10.42.42.6(pid=30928): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30928)] 17:58:20.460096 run osmo-msc_10.42.42.6(pid=30928): stdout: | (launched: 2022-12-09_17:58:19.343230) 17:58:20.509885 run osmo-msc_10.42.42.6(pid=30928): stderr: | 20221209175819619 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175819619 DLGLOBAL DEBUG validating counter group 0x7faa1f304c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175819619 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175819619 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175819619 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175819620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175819621 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175819622 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175819622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175819622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:20.560123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30920): Terminating (SIGTERM) 17:58:20.600481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30923): Terminating (SIGTERM) 17:58:20.640546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30927): Terminating (SIGTERM) 17:58:20.680760 --- ParallelTerminationStrategy: PID 30920 died... 17:58:20.699951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30920): Terminated: ok {rc=0} 17:58:20.744795 --- ParallelTerminationStrategy: PID 30923 died... 17:58:20.763455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30923): Terminated: ok {rc=0} 17:58:20.808323 --- ParallelTerminationStrategy: PID 30927 died... 17:58:20.827285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30927): Terminated: ok {rc=0} 17:58:20.912418 bus /sierra_3: Setting Powered False 17:58:22.011533 bus /sierra_3: Setting Powered False 17:58:23.129942 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 17:58:24.219915 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:24.231832 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 17:58:24.288854 tst emergency_preemptive_call.py: using LAC 22731 17:58:24.414734 tst emergency_preemptive_call.py: using RAC 36 17:58:24.539375 tst emergency_preemptive_call.py: using CellId 22731 17:58:24.664183 tst emergency_preemptive_call.py: using BVCI 22732 17:58:24.779915 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:24.791071 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:24.802048 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:24.813037 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:24.823943 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 17:58:24.834840 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:24.949148 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:25.068855 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:25.183418 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 17:58:25.299690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:25.796198 run create_hlr_db(pid=30930): Launched 17:58:25.925947 bus /sierra_2: Setting Powered False 17:58:26.989203 run create_hlr_db(pid=30930): Terminated: ok {rc=0} 17:58:27.418621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30932): Launched 17:58:27.719264 run osmo-hlr_10.42.42.2(pid=30933): Launched 17:58:27.834282 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:28.350741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30935): Launched 17:58:28.651408 run osmo-stp_10.42.42.5(pid=30936): Launched 17:58:28.775989 tst emergency_preemptive_call.py: using MSISDN 7303 17:58:28.929664 run osmo-msc_10.42.42.6: Starting osmo-msc 17:58:29.466752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30938): Launched 17:58:29.766583 run osmo-msc_10.42.42.6(pid=30939): Launched 17:58:29.936242 run osmo-stp_10.42.42.5(pid=30936): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30936)] 17:58:30.063645 run osmo-stp_10.42.42.5(pid=30936): stdout: | (launched: 2022-12-09_17:58:28.595726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:30.190452 run osmo-stp_10.42.42.5(pid=30936): stderr: | 20221209175828767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175828767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175828767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175828767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175828769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175828769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175828769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:30.315619 run osmo-stp_10.42.42.5(pid=30936): stdout: | (launched: 2022-12-09_17:58:28.595726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:30.434294 run osmo-stp_10.42.42.5(pid=30936): stderr: | 20221209175828767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175828767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175828767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175828767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175828769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175828769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175828769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:30.576903 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30936): Process ended prematurely: osmo-stp_10.42.42.5(pid=30936) [trial-2362↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30936)] [trial-2362↪emergency:trx-lms↪emergency_preemptive_call.py:32] 17:58:30.585344 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 17:58:30.612235 run osmo-hlr_10.42.42.2(pid=30933): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30933)] 17:58:30.661347 run osmo-hlr_10.42.42.2(pid=30933): stdout: | (launched: 2022-12-09_17:58:27.664039) 17:58:30.711929 run osmo-hlr_10.42.42.2(pid=30933): stderr: | 20221209175827838 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175827838 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175827838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175827838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175827838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175827838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175827850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175827859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175827859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175827860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:30.782099 run osmo-msc_10.42.42.6(pid=30939): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30939)] 17:58:30.831081 run osmo-msc_10.42.42.6(pid=30939): stdout: | (launched: 2022-12-09_17:58:29.711124) 17:58:30.893702 run osmo-msc_10.42.42.6(pid=30939): stderr: | 20221209175829981 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209175829981 DLGLOBAL DEBUG validating counter group 0x7ff6b3912c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209175829981 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209175829981 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209175829981 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209175829982 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209175829983 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209175829984 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209175829984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209175829984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:58:30.946937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30932): Terminating (SIGTERM) 17:58:31.000020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30935): Terminating (SIGTERM) 17:58:31.047686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30938): Terminating (SIGTERM) 17:58:31.095181 --- ParallelTerminationStrategy: PID 30932 died... 17:58:31.115951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30932): Terminated: ok {rc=0} 17:58:31.166774 --- ParallelTerminationStrategy: PID 30935 died... 17:58:31.187454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30935): Terminated: ok {rc=0} 17:58:31.236520 --- ParallelTerminationStrategy: PID 30938 died... 17:58:31.257045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30938): Terminated: ok {rc=0} 17:58:31.351567 bus /sierra_9: Setting Powered False 17:58:32.452625 bus /sierra_9: Setting Powered False 17:58:33.572787 bus /sierra_8: Setting Powered False 17:58:34.672703 bus /sierra_8: Setting Powered False 17:58:35.790289 bus /sierra_3: Setting Powered False 17:58:36.891907 bus /sierra_3: Setting Powered False 17:58:38.012609 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-lms --------------------------------------------------------------------- 17:58:39.290109 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:58:39.294737 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 17:58:39.328355 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 17:58:39.366897 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 17:58:39.456195 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 17:58:39.491056 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 17:58:39.530761 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 17:58:40.113553 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 17:58:40.164691 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:40.175353 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:58:40.225446 tst cs_paging_gprs_active.py: using LAC 22732 17:58:40.346351 tst cs_paging_gprs_active.py: using RAC 37 17:58:40.475866 tst cs_paging_gprs_active.py: using CellId 22732 17:58:40.605053 tst cs_paging_gprs_active.py: using BVCI 22733 17:58:40.723613 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:40.735071 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:40.745961 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:40.757089 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:40.767959 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:40.778887 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:40.789912 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:40.800581 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:40.811584 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:40.929827 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:41.048271 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:58:41.269374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:41.599544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30944): Launched 17:58:41.885375 run iperf3-srv_10.42.42.10(pid=30945): Launched 17:58:42.007695 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:58:42.226696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:42.555693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30946): Launched 17:58:42.843007 run iperf3-srv_10.42.42.10(pid=30947): Launched 17:58:42.967468 tst cs_paging_gprs_active.py:38: start network... 17:58:43.188923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:43.696512 run create_hlr_db(pid=30948): Launched 17:58:43.829848 bus /sierra_2: Setting Powered False 17:58:44.894431 run create_hlr_db(pid=30948): Terminated: ok {rc=0} 17:58:45.332230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30950): Launched 17:58:45.639082 run osmo-hlr_10.42.42.2(pid=30951): Launched 17:58:45.756687 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:46.389302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30953): Launched 17:58:46.741601 run osmo-stp_10.42.42.5(pid=30954): Launched 17:58:47.041371 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:47.609615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30956): Launched 17:58:47.727936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:47.987272 run patchelf(pid=30957): Launched 17:58:48.160129 run osmo-stp_10.42.42.5(pid=30954): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30954)] 17:58:48.290404 run osmo-stp_10.42.42.5(pid=30954): stdout: | (launched: 2022-12-09_17:58:46.679427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:48.421401 run osmo-stp_10.42.42.5(pid=30954): stderr: | 20221209175846937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175846937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175846938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175846939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175846941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175846941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175846941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:48.552813 run osmo-stp_10.42.42.5(pid=30954): stdout: | (launched: 2022-12-09_17:58:46.679427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:48.678248 run osmo-stp_10.42.42.5(pid=30954): stderr: | 20221209175846937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175846937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175846938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175846939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175846941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175846941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175846941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:48.827264 run patchelf(pid=30957): Terminating (SIGINT) 17:58:48.999503 run patchelf(pid=30957): Terminated: ok {rc=0} 17:58:49.124239 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30954): Process ended prematurely: osmo-stp_10.42.42.5(pid=30954) [trial-2362↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30954)] [trial-2362↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 17:58:49.133855 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 17:58:49.161917 run osmo-hlr_10.42.42.2(pid=30951): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30951)] 17:58:49.210043 run osmo-hlr_10.42.42.2(pid=30951): stdout: | (launched: 2022-12-09_17:58:45.582717) 17:58:49.260270 run osmo-hlr_10.42.42.2(pid=30951): stderr: | 20221209175845763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175845763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175845763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175845764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175845764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175845764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175845775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175845784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175845784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175845784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:49.310959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30944): Terminating (SIGTERM) 17:58:49.351500 run iperf3-srv_10.42.42.10(pid=30945): Terminating (SIGTERM) 17:58:49.392346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30946): Terminating (SIGTERM) 17:58:49.433011 run iperf3-srv_10.42.42.10(pid=30947): Terminating (SIGTERM) 17:58:49.473184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30950): Terminating (SIGTERM) 17:58:49.513996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30953): Terminating (SIGTERM) 17:58:49.554949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30956): Terminating (SIGTERM) 17:58:49.595622 --- ParallelTerminationStrategy: PID 30944 died... 17:58:49.614965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30944): Terminated: ok {rc=0} 17:58:49.659941 --- ParallelTerminationStrategy: PID 30945 died... 17:58:49.678531 run iperf3-srv_10.42.42.10(pid=30945): Terminated {rc=256} 17:58:49.723431 --- ParallelTerminationStrategy: PID 30946 died... 17:58:49.742282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30946): Terminated: ok {rc=0} 17:58:49.786892 --- ParallelTerminationStrategy: PID 30947 died... 17:58:49.805605 run iperf3-srv_10.42.42.10(pid=30947): Terminated {rc=256} 17:58:49.850096 --- ParallelTerminationStrategy: PID 30950 died... 17:58:49.868799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30950): Terminated: ok {rc=0} 17:58:49.913382 --- ParallelTerminationStrategy: PID 30953 died... 17:58:49.932038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30953): Terminated: ok {rc=0} 17:58:49.976516 --- ParallelTerminationStrategy: PID 30956 died... 17:58:49.995267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30956): Terminated: ok {rc=0} 17:58:50.082343 bus /gobi_0: Setting Powered False 17:58:51.183048 bus /gobi_0: Setting Powered False 17:58:52.299171 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms iperf3.py ---------------------------------------------- 17:58:53.447065 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:53.458447 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:58:53.510459 tst iperf3.py: using LAC 22733 17:58:53.630042 tst iperf3.py: using RAC 38 17:58:53.749840 tst iperf3.py: using CellId 22733 17:58:53.869168 tst iperf3.py: using BVCI 22734 17:58:53.979455 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:53.990162 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:54.000532 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:54.011225 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:54.021839 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:54.032430 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:54.043186 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:54.053803 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:58:54.064406 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:58:54.183266 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:58:54.404318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:54.732899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30959): Launched 17:58:55.018326 run iperf3-srv_10.42.42.10(pid=30960): Launched 17:58:55.142207 tst iperf3.py:8: start network... 17:58:55.361443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:55.866570 run create_hlr_db(pid=30961): Launched 17:58:56.000622 bus /gobi_6: Setting Powered False 17:58:57.065211 run create_hlr_db(pid=30961): Terminated: ok {rc=0} 17:58:57.519572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30963): Launched 17:58:57.848918 run osmo-hlr_10.42.42.2(pid=30964): Launched 17:58:57.973724 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:58.538079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30966): Launched 17:58:58.866375 run osmo-stp_10.42.42.5(pid=30967): Launched 17:58:58.992664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:59.555584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30969): Launched 17:58:59.682564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:59.958128 run patchelf(pid=30970): Launched 17:59:00.141411 run osmo-stp_10.42.42.5(pid=30967): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30967)] 17:59:00.279721 run osmo-stp_10.42.42.5(pid=30967): stdout: | (launched: 2022-12-09_17:58:58.806749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:00.419834 run osmo-stp_10.42.42.5(pid=30967): stderr: | 20221209175858999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175858999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175858999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175859000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175859000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175859000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175859000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:00.560442 run osmo-stp_10.42.42.5(pid=30967): stdout: | (launched: 2022-12-09_17:58:58.806749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:00.694320 run osmo-stp_10.42.42.5(pid=30967): stderr: | 20221209175858999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175858999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175858999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175859000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175859000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175859000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175859000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:00.857801 run patchelf(pid=30970): Terminating (SIGINT) 17:59:01.058247 run patchelf(pid=30970): Terminated: ok {rc=0} 17:59:01.191942 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30967): Process ended prematurely: osmo-stp_10.42.42.5(pid=30967) [trial-2362↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30967)] [trial-2362↪gprs:trx-lms↪iperf3.py:8] 17:59:01.202846 tst iperf3.py:8: Test FAILED (7.8 sec) 17:59:01.232650 run osmo-hlr_10.42.42.2(pid=30964): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30964)] 17:59:01.284252 run osmo-hlr_10.42.42.2(pid=30964): stdout: | (launched: 2022-12-09_17:58:57.788886) 17:59:01.337927 run osmo-hlr_10.42.42.2(pid=30964): stderr: | 20221209175857989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175857989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175857989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175857989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175857989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175857989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175858001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175858010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175858010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175858010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:01.391379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30959): Terminating (SIGTERM) 17:59:01.435428 run iperf3-srv_10.42.42.10(pid=30960): Terminating (SIGTERM) 17:59:01.481677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30963): Terminating (SIGTERM) 17:59:01.526014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30966): Terminating (SIGTERM) 17:59:01.570728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30969): Terminating (SIGTERM) 17:59:01.614086 --- ParallelTerminationStrategy: PID 30959 died... 17:59:01.634465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30959): Terminated: ok {rc=0} 17:59:01.681735 --- ParallelTerminationStrategy: PID 30960 died... 17:59:01.701755 run iperf3-srv_10.42.42.10(pid=30960): Terminated {rc=256} 17:59:01.748893 --- ParallelTerminationStrategy: PID 30963 died... 17:59:01.769196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30963): Terminated: ok {rc=0} 17:59:01.817317 --- ParallelTerminationStrategy: PID 30966 died... 17:59:01.837584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30966): Terminated: ok {rc=0} 17:59:01.886087 --- ParallelTerminationStrategy: PID 30969 died... 17:59:01.906298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30969): Terminated: ok {rc=0} 17:59:01.998156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms iperf3m4.py ---------------------------------------------- 17:59:03.146032 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.157424 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:03.206018 tst iperf3m4.py: using LAC 22734 17:59:03.328020 tst iperf3m4.py: using RAC 39 17:59:03.448573 tst iperf3m4.py: using CellId 22734 17:59:03.567987 tst iperf3m4.py: using BVCI 22735 17:59:03.680041 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.690798 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.701318 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.712004 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.723060 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.733755 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.744496 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.755198 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:03.766010 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:03.885406 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:04.009893 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:04.131025 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:04.253303 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:59:04.473672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:04.802018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30971): Launched 17:59:05.086116 run iperf3-srv_10.42.42.10(pid=30972): Launched 17:59:05.209425 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:59:05.427914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:05.755339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30973): Launched 17:59:06.040760 run iperf3-srv_10.42.42.10(pid=30974): Launched 17:59:06.163136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:59:06.382236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:06.710163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30975): Launched 17:59:06.995198 run iperf3-srv_10.42.42.10(pid=30976): Launched 17:59:07.118864 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:59:07.337459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:07.664330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30977): Launched 17:59:07.948155 run iperf3-srv_10.42.42.10(pid=30978): Launched 17:59:08.071703 tst iperf3m4.py:8: start network... 17:59:08.290715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:08.797130 run create_hlr_db(pid=30979): Launched 17:59:08.931439 bus /gobi_6: Setting Powered False 17:59:09.995386 run create_hlr_db(pid=30979): Terminated: ok {rc=0} 17:59:10.432408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30981): Launched 17:59:10.741526 run osmo-hlr_10.42.42.2(pid=30982): Launched 17:59:10.858203 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:11.401995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30984): Launched 17:59:11.708328 run osmo-stp_10.42.42.5(pid=30985): Launched 17:59:11.825075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:12.352830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30987): Launched 17:59:12.470804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:12.728235 run patchelf(pid=30988): Launched 17:59:12.898680 run osmo-stp_10.42.42.5(pid=30985): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30985)] 17:59:13.028584 run osmo-stp_10.42.42.5(pid=30985): stdout: | (launched: 2022-12-09_17:59:11.652247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:13.159829 run osmo-stp_10.42.42.5(pid=30985): stderr: | 20221209175911823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175911823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175911823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175911823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175911824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175911824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175911824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:13.290781 run osmo-stp_10.42.42.5(pid=30985): stdout: | (launched: 2022-12-09_17:59:11.652247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:13.415756 run osmo-stp_10.42.42.5(pid=30985): stderr: | 20221209175911823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175911823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175911823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175911823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175911824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175911824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175911824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:13.563717 run patchelf(pid=30988): Terminating (SIGINT) 17:59:13.735279 run patchelf(pid=30988): Terminated: ok {rc=0} 17:59:13.858930 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30985): Process ended prematurely: osmo-stp_10.42.42.5(pid=30985) [trial-2362↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30985)] [trial-2362↪gprs:trx-lms↪iperf3m4.py:8] 17:59:13.868392 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:59:13.896544 run osmo-hlr_10.42.42.2(pid=30982): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30982)] 17:59:13.944635 run osmo-hlr_10.42.42.2(pid=30982): stdout: | (launched: 2022-12-09_17:59:10.684774) 17:59:13.994459 run osmo-hlr_10.42.42.2(pid=30982): stderr: | 20221209175910862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175910862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175910862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175910862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175910862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175910862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175910874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175910883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175910883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175910883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:14.044543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30971): Terminating (SIGTERM) 17:59:14.084461 run iperf3-srv_10.42.42.10(pid=30972): Terminating (SIGTERM) 17:59:14.124171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30973): Terminating (SIGTERM) 17:59:14.163849 run iperf3-srv_10.42.42.10(pid=30974): Terminating (SIGTERM) 17:59:14.203362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30975): Terminating (SIGTERM) 17:59:14.243010 run iperf3-srv_10.42.42.10(pid=30976): Terminating (SIGTERM) 17:59:14.282684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30977): Terminating (SIGTERM) 17:59:14.322397 run iperf3-srv_10.42.42.10(pid=30978): Terminating (SIGTERM) 17:59:14.361868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30981): Terminating (SIGTERM) 17:59:14.401779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30984): Terminating (SIGTERM) 17:59:14.441833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30987): Terminating (SIGTERM) 17:59:14.482288 --- ParallelTerminationStrategy: PID 30971 died... 17:59:14.501493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30971): Terminated: ok {rc=0} 17:59:14.546341 --- ParallelTerminationStrategy: PID 30972 died... 17:59:14.565207 run iperf3-srv_10.42.42.10(pid=30972): Terminated {rc=256} 17:59:14.609861 --- ParallelTerminationStrategy: PID 30973 died... 17:59:14.628561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30973): Terminated: ok {rc=0} 17:59:14.673260 --- ParallelTerminationStrategy: PID 30974 died... 17:59:14.691893 run iperf3-srv_10.42.42.10(pid=30974): Terminated {rc=256} 17:59:14.736491 --- ParallelTerminationStrategy: PID 30975 died... 17:59:14.755189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30975): Terminated: ok {rc=0} 17:59:14.799888 --- ParallelTerminationStrategy: PID 30976 died... 17:59:14.818523 run iperf3-srv_10.42.42.10(pid=30976): Terminated {rc=256} 17:59:14.863131 --- ParallelTerminationStrategy: PID 30977 died... 17:59:14.881782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30977): Terminated: ok {rc=0} 17:59:14.926933 --- ParallelTerminationStrategy: PID 30978 died... 17:59:14.945621 run iperf3-srv_10.42.42.10(pid=30978): Terminated {rc=256} 17:59:14.990401 --- ParallelTerminationStrategy: PID 30981 died... 17:59:15.009357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30981): Terminated: ok {rc=0} 17:59:15.054025 --- ParallelTerminationStrategy: PID 30984 died... 17:59:15.072753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30984): Terminated: ok {rc=0} 17:59:15.117718 --- ParallelTerminationStrategy: PID 30987 died... 17:59:15.136452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30987): Terminated: ok {rc=0} 17:59:15.221939 bus /gobi_4: Setting Powered False 17:59:16.321232 bus /gobi_4: Setting Powered False 17:59:17.447010 bus /gobi_1: Setting Powered False 17:59:18.546285 bus /gobi_1: Setting Powered False 17:59:19.664354 bus /gobi_0: Setting Powered False 17:59:20.764014 bus /gobi_0: Setting Powered False 17:59:21.882236 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms ping.py ---------------------------------------------- 17:59:22.986894 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:22.998939 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:23.049904 tst ping.py: using LAC 22735 17:59:23.179611 tst ping.py: using RAC 40 17:59:23.303510 tst ping.py: using CellId 22735 17:59:23.420640 tst ping.py: using BVCI 22736 17:59:23.529116 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:23.539655 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:23.550184 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:23.560876 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:23.571562 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:23.582258 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:23.593133 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:23.603760 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:23.723944 tst ping.py:19: start network... 17:59:23.939389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:24.434526 run create_hlr_db(pid=30989): Launched 17:59:24.553803 bus /gobi_6: Setting Powered False 17:59:25.614233 run create_hlr_db(pid=30989): Terminated: ok {rc=0} 17:59:26.054219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30991): Launched 17:59:26.375561 run osmo-hlr_10.42.42.2(pid=30992): Launched 17:59:26.497409 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:27.054184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30994): Launched 17:59:27.377741 run osmo-stp_10.42.42.5(pid=30995): Launched 17:59:27.499924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:28.054635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30997): Launched 17:59:28.178844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:28.449472 run patchelf(pid=30998): Launched 17:59:28.629092 run osmo-stp_10.42.42.5(pid=30995): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30995)] 17:59:28.765161 run osmo-stp_10.42.42.5(pid=30995): stdout: | (launched: 2022-12-09_17:59:27.318692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:28.903880 run osmo-stp_10.42.42.5(pid=30995): stderr: | 20221209175927514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175927514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175927514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175927515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175927515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175927515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175927515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:29.042467 run osmo-stp_10.42.42.5(pid=30995): stdout: | (launched: 2022-12-09_17:59:27.318692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:29.174571 run osmo-stp_10.42.42.5(pid=30995): stderr: | 20221209175927514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175927514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175927514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175927515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175927515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175927515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175927515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:29.330374 run patchelf(pid=30998): Terminating (SIGINT) 17:59:29.510892 run patchelf(pid=30998): Terminated: ok {rc=0} 17:59:29.640889 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30995): Process ended prematurely: osmo-stp_10.42.42.5(pid=30995) [trial-2362↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30995)] [trial-2362↪gprs:trx-lms↪ping.py:22] 17:59:29.650739 tst ping.py:22: Test FAILED (6.7 sec) 17:59:29.679194 run osmo-hlr_10.42.42.2(pid=30992): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30992)] 17:59:29.729774 run osmo-hlr_10.42.42.2(pid=30992): stdout: | (launched: 2022-12-09_17:59:26.316917) 17:59:29.782215 run osmo-hlr_10.42.42.2(pid=30992): stderr: | 20221209175926518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175926518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175926518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175926518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175926518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175926518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175926530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175926539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175926540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175926540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:29.834960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30991): Terminating (SIGTERM) 17:59:29.877439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30994): Terminating (SIGTERM) 17:59:29.919855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30997): Terminating (SIGTERM) 17:59:29.962621 --- ParallelTerminationStrategy: PID 30991 died... 17:59:29.983103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30991): Terminated: ok {rc=0} 17:59:30.030248 --- ParallelTerminationStrategy: PID 30994 died... 17:59:30.050360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30994): Terminated: ok {rc=0} 17:59:30.096937 --- ParallelTerminationStrategy: PID 30997 died... 17:59:30.117141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30997): Terminated: ok {rc=0} 17:59:30.206711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 17:59:31.302349 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:31.318665 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 17:59:31.383655 tst ping_idle_ping.py: using LAC 22736 17:59:31.552157 tst ping_idle_ping.py: using RAC 41 17:59:31.679186 tst ping_idle_ping.py: using CellId 22736 17:59:31.802168 tst ping_idle_ping.py: using BVCI 22737 17:59:31.915398 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:31.927106 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:31.938657 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:31.950870 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:31.963411 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:31.975458 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:31.987623 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 17:59:31.999764 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 17:59:32.118987 tst ping_idle_ping.py:24: start network... 17:59:32.325936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:32.795689 run create_hlr_db(pid=30999): Launched 17:59:32.912212 bus /gobi_6: Setting Powered False 17:59:33.972197 run create_hlr_db(pid=30999): Terminated: ok {rc=0} 17:59:34.395783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31001): Launched 17:59:34.699948 run osmo-hlr_10.42.42.2(pid=31002): Launched 17:59:34.816490 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:35.341949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31004): Launched 17:59:35.643860 run osmo-stp_10.42.42.5(pid=31005): Launched 17:59:35.759640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:36.279916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31007): Launched 17:59:36.396060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:36.650558 run patchelf(pid=31008): Launched 17:59:36.818918 run osmo-stp_10.42.42.5(pid=31005): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31005)] 17:59:36.946382 run osmo-stp_10.42.42.5(pid=31005): stdout: | (launched: 2022-12-09_17:59:35.588481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:37.076018 run osmo-stp_10.42.42.5(pid=31005): stderr: | 20221209175935758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175935758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175935759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175935759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175935759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175935760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175935760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:37.206343 run osmo-stp_10.42.42.5(pid=31005): stdout: | (launched: 2022-12-09_17:59:35.588481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:37.329448 run osmo-stp_10.42.42.5(pid=31005): stderr: | 20221209175935758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175935758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175935759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175935759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175935759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175935760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175935760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:37.475183 run patchelf(pid=31008): Terminating (SIGINT) 17:59:37.643923 run patchelf(pid=31008): Terminated: ok {rc=0} 17:59:37.765942 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31005): Process ended prematurely: osmo-stp_10.42.42.5(pid=31005) [trial-2362↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31005)] [trial-2362↪gprs:trx-lms↪ping_idle_ping.py:27] 17:59:37.774918 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:59:37.802551 run osmo-hlr_10.42.42.2(pid=31002): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31002)] 17:59:37.850504 run osmo-hlr_10.42.42.2(pid=31002): stdout: | (launched: 2022-12-09_17:59:34.644108) 17:59:37.900168 run osmo-hlr_10.42.42.2(pid=31002): stderr: | 20221209175934821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175934821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175934821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175934821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175934822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175934822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175934833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175934842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175934842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175934842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:37.950278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31001): Terminating (SIGTERM) 17:59:37.990505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31004): Terminating (SIGTERM) 17:59:38.030611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31007): Terminating (SIGTERM) 17:59:38.071187 --- ParallelTerminationStrategy: PID 31001 died... 17:59:38.090444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31001): Terminated: ok {rc=0} 17:59:38.135718 --- ParallelTerminationStrategy: PID 31004 died... 17:59:38.154418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31004): Terminated: ok {rc=0} 17:59:38.199100 --- ParallelTerminationStrategy: PID 31007 died... 17:59:38.217736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31007): Terminated: ok {rc=0} 17:59:38.304456 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 17:59:39.606671 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:59:39.612325 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:59:39.646171 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:59:39.684517 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:59:39.770803 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:59:39.803820 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:59:39.842101 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:59:40.439301 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:59:40.493969 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:40.505461 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:59:40.558690 tst cs_paging_gprs_active.py: using LAC 22737 17:59:40.687212 tst cs_paging_gprs_active.py: using RAC 42 17:59:40.815996 tst cs_paging_gprs_active.py: using CellId 22737 17:59:40.937428 tst cs_paging_gprs_active.py: using BVCI 22738 17:59:41.051171 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:41.062175 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:41.072824 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:41.083909 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:41.094772 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:41.105752 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:41.116794 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:41.127593 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:41.138753 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:41.259012 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:41.376931 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:59:41.584600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:41.894354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31014): Launched 17:59:42.165634 run iperf3-srv_10.42.42.10(pid=31015): Launched 17:59:42.281282 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:59:42.486769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:42.796172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31016): Launched 17:59:43.064821 run iperf3-srv_10.42.42.10(pid=31017): Launched 17:59:43.181335 tst cs_paging_gprs_active.py:38: start network... 17:59:43.387702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:43.863209 run create_hlr_db(pid=31018): Launched 17:59:43.980441 bus /gobi_6: Setting Powered False 17:59:45.042261 run create_hlr_db(pid=31018): Terminated: ok {rc=0} 17:59:45.492408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31020): Launched 17:59:45.822924 run osmo-hlr_10.42.42.2(pid=31021): Launched 17:59:46.101631 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:46.715081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31023): Launched 17:59:47.047134 run osmo-stp_10.42.42.5(pid=31024): Launched 17:59:47.244023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:47.825770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31026): Launched 17:59:47.951330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:48.228573 run patchelf(pid=31027): Launched 17:59:48.415200 run osmo-stp_10.42.42.5(pid=31024): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31024)] 17:59:48.555522 run osmo-stp_10.42.42.5(pid=31024): stdout: | (launched: 2022-12-09_17:59:46.989143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:48.696297 run osmo-stp_10.42.42.5(pid=31024): stderr: | 20221209175947328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175947328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175947328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175947337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175947338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175947338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175947338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:48.836336 run osmo-stp_10.42.42.5(pid=31024): stdout: | (launched: 2022-12-09_17:59:46.989143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:48.971100 run osmo-stp_10.42.42.5(pid=31024): stderr: | 20221209175947328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175947328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175947328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175947337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175947338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175947338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175947338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:49.130577 run patchelf(pid=31027): Terminating (SIGINT) 17:59:49.315123 run patchelf(pid=31027): Terminated: ok {rc=0} 17:59:49.448648 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31024): Process ended prematurely: osmo-stp_10.42.42.5(pid=31024) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31024)] [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:59:49.459099 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 17:59:49.487959 run osmo-hlr_10.42.42.2(pid=31021): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31021)] 17:59:49.539261 run osmo-hlr_10.42.42.2(pid=31021): stdout: | (launched: 2022-12-09_17:59:45.763321) 17:59:49.591739 run osmo-hlr_10.42.42.2(pid=31021): stderr: | 20221209175946010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175946010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175946010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175946010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175946010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175946010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175946031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175946041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175946041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175946041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:49.644755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31014): Terminating (SIGTERM) 17:59:49.687046 run iperf3-srv_10.42.42.10(pid=31015): Terminating (SIGTERM) 17:59:49.730587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31016): Terminating (SIGTERM) 17:59:49.773422 run iperf3-srv_10.42.42.10(pid=31017): Terminating (SIGTERM) 17:59:49.815437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31020): Terminating (SIGTERM) 17:59:49.857581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31023): Terminating (SIGTERM) 17:59:49.899658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31026): Terminating (SIGTERM) 17:59:49.942021 --- ParallelTerminationStrategy: PID 31014 died... 17:59:49.962181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31014): Terminated: ok {rc=0} 17:59:50.009124 --- ParallelTerminationStrategy: PID 31015 died... 17:59:50.028895 run iperf3-srv_10.42.42.10(pid=31015): Terminated {rc=256} 17:59:50.075469 --- ParallelTerminationStrategy: PID 31016 died... 17:59:50.095305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31016): Terminated: ok {rc=0} 17:59:50.142028 --- ParallelTerminationStrategy: PID 31017 died... 17:59:50.161896 run iperf3-srv_10.42.42.10(pid=31017): Terminated {rc=256} 17:59:50.208637 --- ParallelTerminationStrategy: PID 31020 died... 17:59:50.228389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31020): Terminated: ok {rc=0} 17:59:50.275225 --- ParallelTerminationStrategy: PID 31023 died... 17:59:50.294924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31023): Terminated: ok {rc=0} 17:59:50.341365 --- ParallelTerminationStrategy: PID 31026 died... 17:59:50.360913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31026): Terminated: ok {rc=0} 17:59:50.449715 bus /gobi_0: Setting Powered False 17:59:51.549689 bus /gobi_0: Setting Powered False 17:59:52.666485 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:59:53.810707 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:53.822322 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:59:53.876158 tst iperf3.py: using LAC 22738 17:59:53.998490 tst iperf3.py: using RAC 43 17:59:54.119548 tst iperf3.py: using CellId 22738 17:59:54.240287 tst iperf3.py: using BVCI 22739 17:59:54.351442 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:54.362532 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:54.373200 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:54.384160 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:54.395085 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:54.406087 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:54.417233 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:54.427941 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:59:54.439071 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:59:54.557274 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:59:54.762875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:59:55.070369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31028): Launched 17:59:55.339849 run iperf3-srv_10.42.42.10(pid=31029): Launched 17:59:55.454758 tst iperf3.py:8: start network... 17:59:55.659131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:56.133414 run create_hlr_db(pid=31030): Launched 17:59:56.249799 bus /gobi_6: Setting Powered False 17:59:57.311129 run create_hlr_db(pid=31030): Terminated: ok {rc=0} 17:59:57.741352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31032): Launched 17:59:58.049929 run osmo-hlr_10.42.42.2(pid=31033): Launched 17:59:58.167758 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:58.709447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31035): Launched 17:59:59.016505 run osmo-stp_10.42.42.5(pid=31036): Launched 17:59:59.134130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:59.664146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31038): Launched 17:59:59.782547 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:00.041340 run patchelf(pid=31039): Launched 18:00:00.212361 run osmo-stp_10.42.42.5(pid=31036): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31036)] 18:00:00.342088 run osmo-stp_10.42.42.5(pid=31036): stdout: | (launched: 2022-12-09_17:59:58.960099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:00.473549 run osmo-stp_10.42.42.5(pid=31036): stderr: | 20221209175959132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175959132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175959132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175959132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175959133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175959133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175959133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:00.605807 run osmo-stp_10.42.42.5(pid=31036): stdout: | (launched: 2022-12-09_17:59:58.960099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:00.731428 run osmo-stp_10.42.42.5(pid=31036): stderr: | 20221209175959132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209175959132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209175959132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209175959132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209175959133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209175959133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209175959133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:00.887004 run patchelf(pid=31039): Terminating (SIGINT) 18:00:01.063143 run patchelf(pid=31039): Terminated: ok {rc=0} 18:00:01.190744 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31036): Process ended prematurely: osmo-stp_10.42.42.5(pid=31036) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31036)] [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 18:00:01.201497 tst iperf3.py:8: Test FAILED (7.4 sec) 18:00:01.231544 run osmo-hlr_10.42.42.2(pid=31033): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31033)] 18:00:01.281634 run osmo-hlr_10.42.42.2(pid=31033): stdout: | (launched: 2022-12-09_17:59:57.993319) 18:00:01.333485 run osmo-hlr_10.42.42.2(pid=31033): stderr: | 20221209175958173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209175958173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209175958173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209175958174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209175958174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209175958174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209175958186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209175958194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209175958194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209175958194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:01.386251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31028): Terminating (SIGTERM) 18:00:01.428155 run iperf3-srv_10.42.42.10(pid=31029): Terminating (SIGTERM) 18:00:01.474445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31032): Terminating (SIGTERM) 18:00:01.523348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31035): Terminating (SIGTERM) 18:00:01.565489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31038): Terminating (SIGTERM) 18:00:01.608011 --- ParallelTerminationStrategy: PID 31028 died... 18:00:01.627849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31028): Terminated: ok {rc=0} 18:00:01.675101 --- ParallelTerminationStrategy: PID 31029 died... 18:00:01.694732 run iperf3-srv_10.42.42.10(pid=31029): Terminated {rc=256} 18:00:01.742175 --- ParallelTerminationStrategy: PID 31032 died... 18:00:01.762124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31032): Terminated: ok {rc=0} 18:00:01.809368 --- ParallelTerminationStrategy: PID 31035 died... 18:00:01.829318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31035): Terminated: ok {rc=0} 18:00:01.877270 --- ParallelTerminationStrategy: PID 31038 died... 18:00:01.896937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31038): Terminated: ok {rc=0} 18:00:01.990805 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:00:03.158661 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:03.171389 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:03.229491 tst iperf3m4.py: using LAC 22739 18:00:03.360152 tst iperf3m4.py: using RAC 44 18:00:03.491094 tst iperf3m4.py: using CellId 22739 18:00:03.622465 tst iperf3m4.py: using BVCI 22740 18:00:03.742629 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:03.754032 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:03.765160 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:03.776296 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:03.787334 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:03.798452 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:03.809764 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:03.820676 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:03.831968 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:03.949597 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:04.072872 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:04.193565 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:04.314488 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:00:04.520686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:04.829731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31083): Launched 18:00:05.098324 run iperf3-srv_10.42.42.10(pid=31084): Launched 18:00:05.216091 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:00:05.421761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:05.730420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31085): Launched 18:00:05.998650 run iperf3-srv_10.42.42.10(pid=31086): Launched 18:00:06.114261 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:00:06.319464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:06.628142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31087): Launched 18:00:06.896296 run iperf3-srv_10.42.42.10(pid=31088): Launched 18:00:07.011616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:00:07.217306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:07.526841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31089): Launched 18:00:07.796192 run iperf3-srv_10.42.42.10(pid=31090): Launched 18:00:07.911613 tst iperf3m4.py:8: start network... 18:00:08.116486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:08.599168 run create_hlr_db(pid=31092): Launched 18:00:08.716562 bus /gobi_6: Setting Powered False 18:00:09.778027 run create_hlr_db(pid=31092): Terminated: ok {rc=0} 18:00:10.205635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31094): Launched 18:00:10.514071 run osmo-hlr_10.42.42.2(pid=31095): Launched 18:00:10.632062 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:11.175941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31097): Launched 18:00:11.507228 run osmo-stp_10.42.42.5(pid=31098): Launched 18:00:11.637376 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:12.202497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31100): Launched 18:00:12.329843 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:12.607083 run patchelf(pid=31101): Launched 18:00:12.791083 run osmo-stp_10.42.42.5(pid=31098): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31098)] 18:00:12.930125 run osmo-stp_10.42.42.5(pid=31098): stdout: | (launched: 2022-12-09_18:00:11.445897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:13.070503 run osmo-stp_10.42.42.5(pid=31098): stderr: | 20221209180011640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180011640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180011640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180011641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180011641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180011641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180011641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:13.211198 run osmo-stp_10.42.42.5(pid=31098): stdout: | (launched: 2022-12-09_18:00:11.445897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:13.345325 run osmo-stp_10.42.42.5(pid=31098): stderr: | 20221209180011640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180011640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180011640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180011641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180011641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180011641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180011641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:13.505424 run patchelf(pid=31101): Terminating (SIGINT) 18:00:13.689634 run patchelf(pid=31101): Terminated: ok {rc=0} 18:00:13.822526 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31098): Process ended prematurely: osmo-stp_10.42.42.5(pid=31098) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31098)] [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 18:00:13.832702 tst iperf3m4.py:8: Test FAILED (10.7 sec) 18:00:13.862041 run osmo-hlr_10.42.42.2(pid=31095): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31095)] 18:00:13.912635 run osmo-hlr_10.42.42.2(pid=31095): stdout: | (launched: 2022-12-09_18:00:10.457271) 18:00:13.965621 run osmo-hlr_10.42.42.2(pid=31095): stderr: | 20221209180010635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180010635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180010635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180010635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180010635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180010635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180010646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180010656 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180010656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180010656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:14.019836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31083): Terminating (SIGTERM) 18:00:14.063827 run iperf3-srv_10.42.42.10(pid=31084): Terminating (SIGTERM) 18:00:14.106557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31085): Terminating (SIGTERM) 18:00:14.149239 run iperf3-srv_10.42.42.10(pid=31086): Terminating (SIGTERM) 18:00:14.191557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31087): Terminating (SIGTERM) 18:00:14.233991 run iperf3-srv_10.42.42.10(pid=31088): Terminating (SIGTERM) 18:00:14.276273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31089): Terminating (SIGTERM) 18:00:14.319022 run iperf3-srv_10.42.42.10(pid=31090): Terminating (SIGTERM) 18:00:14.361313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31094): Terminating (SIGTERM) 18:00:14.403676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31097): Terminating (SIGTERM) 18:00:14.446016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31100): Terminating (SIGTERM) 18:00:14.488592 --- ParallelTerminationStrategy: PID 31083 died... 18:00:14.508916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31083): Terminated: ok {rc=0} 18:00:14.556335 --- ParallelTerminationStrategy: PID 31084 died... 18:00:14.576551 run iperf3-srv_10.42.42.10(pid=31084): Terminated {rc=256} 18:00:14.623197 --- ParallelTerminationStrategy: PID 31085 died... 18:00:14.643066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31085): Terminated: ok {rc=0} 18:00:14.690124 --- ParallelTerminationStrategy: PID 31086 died... 18:00:14.709925 run iperf3-srv_10.42.42.10(pid=31086): Terminated {rc=256} 18:00:14.756466 --- ParallelTerminationStrategy: PID 31087 died... 18:00:14.776163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31087): Terminated: ok {rc=0} 18:00:14.822839 --- ParallelTerminationStrategy: PID 31088 died... 18:00:14.842695 run iperf3-srv_10.42.42.10(pid=31088): Terminated {rc=256} 18:00:14.889220 --- ParallelTerminationStrategy: PID 31089 died... 18:00:14.908936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31089): Terminated: ok {rc=0} 18:00:14.955465 --- ParallelTerminationStrategy: PID 31090 died... 18:00:14.975116 run iperf3-srv_10.42.42.10(pid=31090): Terminated {rc=256} 18:00:15.021406 --- ParallelTerminationStrategy: PID 31094 died... 18:00:15.041299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31094): Terminated: ok {rc=0} 18:00:15.088019 --- ParallelTerminationStrategy: PID 31097 died... 18:00:15.107590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31097): Terminated: ok {rc=0} 18:00:15.154444 --- ParallelTerminationStrategy: PID 31100 died... 18:00:15.174119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31100): Terminated: ok {rc=0} 18:00:15.262992 bus /gobi_4: Setting Powered False 18:00:16.360504 bus /gobi_4: Setting Powered False 18:00:17.479396 bus /gobi_1: Setting Powered False 18:00:18.580788 bus /gobi_1: Setting Powered False 18:00:19.696726 bus /gobi_0: Setting Powered False 18:00:20.796764 bus /gobi_0: Setting Powered False 18:00:21.916872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 18:00:23.023958 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:23.036018 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:23.089253 tst ping.py: using LAC 22740 18:00:23.216416 tst ping.py: using RAC 45 18:00:23.343084 tst ping.py: using CellId 22740 18:00:23.473063 tst ping.py: using BVCI 22741 18:00:23.592002 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:23.603362 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:23.614438 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:23.625592 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:23.636640 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:23.647735 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:23.659079 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:23.670995 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:23.790125 tst ping.py:19: start network... 18:00:24.005432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:24.499440 run create_hlr_db(pid=31103): Launched 18:00:24.628736 bus /gobi_6: Setting Powered False 18:00:25.692508 run create_hlr_db(pid=31103): Terminated: ok {rc=0} 18:00:26.139639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31105): Launched 18:00:26.460828 run osmo-hlr_10.42.42.2(pid=31106): Launched 18:00:26.585533 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:27.138247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31108): Launched 18:00:27.458610 run osmo-stp_10.42.42.5(pid=31109): Launched 18:00:27.583881 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:28.137693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31111): Launched 18:00:28.260533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:28.531857 run patchelf(pid=31112): Launched 18:00:28.701064 run osmo-stp_10.42.42.5(pid=31109): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31109)] 18:00:28.829478 run osmo-stp_10.42.42.5(pid=31109): stdout: | (launched: 2022-12-09_18:00:27.399696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:28.960065 run osmo-stp_10.42.42.5(pid=31109): stderr: | 20221209180027595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180027595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180027595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180027596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180027596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180027596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180027596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:29.090528 run osmo-stp_10.42.42.5(pid=31109): stdout: | (launched: 2022-12-09_18:00:27.399696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:29.214157 run osmo-stp_10.42.42.5(pid=31109): stderr: | 20221209180027595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180027595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180027595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180027596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180027596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180027596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180027596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:29.361318 run patchelf(pid=31112): Terminating (SIGINT) 18:00:29.531422 run patchelf(pid=31112): Terminated: ok {rc=0} 18:00:29.654057 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31109): Process ended prematurely: osmo-stp_10.42.42.5(pid=31109) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31109)] [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 18:00:29.663153 tst ping.py:22: Test FAILED (6.6 sec) 18:00:29.691499 run osmo-hlr_10.42.42.2(pid=31106): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31106)] 18:00:29.740461 run osmo-hlr_10.42.42.2(pid=31106): stdout: | (launched: 2022-12-09_18:00:26.402156) 18:00:29.790726 run osmo-hlr_10.42.42.2(pid=31106): stderr: | 20221209180026602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180026602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180026602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180026602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180026602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180026602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180026620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180026630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180026630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180026630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:29.841637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31105): Terminating (SIGTERM) 18:00:29.882288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31108): Terminating (SIGTERM) 18:00:29.922771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31111): Terminating (SIGTERM) 18:00:29.963628 --- ParallelTerminationStrategy: PID 31105 died... 18:00:29.983161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31105): Terminated: ok {rc=0} 18:00:30.028577 --- ParallelTerminationStrategy: PID 31108 died... 18:00:30.047464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31108): Terminated: ok {rc=0} 18:00:30.092864 --- ParallelTerminationStrategy: PID 31111 died... 18:00:30.112284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31111): Terminated: ok {rc=0} 18:00:30.199411 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:00:31.295000 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:31.313313 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:00:31.380563 tst ping_idle_ping.py: using LAC 22741 18:00:31.503313 tst ping_idle_ping.py: using RAC 46 18:00:31.694773 tst ping_idle_ping.py: using CellId 22741 18:00:31.866231 tst ping_idle_ping.py: using BVCI 22742 18:00:31.979916 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:31.991723 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:32.003455 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:32.016293 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:32.029119 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:32.042188 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:32.055091 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:00:32.067850 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:00:32.189064 tst ping_idle_ping.py:24: start network... 18:00:32.410601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:32.881254 run create_hlr_db(pid=31113): Launched 18:00:32.997842 bus /gobi_6: Setting Powered False 18:00:34.058084 run create_hlr_db(pid=31113): Terminated: ok {rc=0} 18:00:34.480607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31115): Launched 18:00:34.784317 run osmo-hlr_10.42.42.2(pid=31116): Launched 18:00:34.899784 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:35.421726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31118): Launched 18:00:35.726579 run osmo-stp_10.42.42.5(pid=31119): Launched 18:00:35.844918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:36.366377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31121): Launched 18:00:36.481967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:36.737048 run patchelf(pid=31122): Launched 18:00:36.905375 run osmo-stp_10.42.42.5(pid=31119): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31119)] 18:00:37.033275 run osmo-stp_10.42.42.5(pid=31119): stdout: | (launched: 2022-12-09_18:00:35.670719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:37.164154 run osmo-stp_10.42.42.5(pid=31119): stderr: | 20221209180035841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180035841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180035841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180035842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180035842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180035842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180035842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:37.294485 run osmo-stp_10.42.42.5(pid=31119): stdout: | (launched: 2022-12-09_18:00:35.670719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:37.417809 run osmo-stp_10.42.42.5(pid=31119): stderr: | 20221209180035841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180035841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180035841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180035842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180035842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180035842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180035842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:37.564570 run patchelf(pid=31122): Terminating (SIGINT) 18:00:37.734342 run patchelf(pid=31122): Terminated: ok {rc=0} 18:00:37.856693 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31119): Process ended prematurely: osmo-stp_10.42.42.5(pid=31119) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31119)] [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 18:00:37.865796 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:00:37.893256 run osmo-hlr_10.42.42.2(pid=31116): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31116)] 18:00:37.941746 run osmo-hlr_10.42.42.2(pid=31116): stdout: | (launched: 2022-12-09_18:00:34.728543) 18:00:37.992111 run osmo-hlr_10.42.42.2(pid=31116): stderr: | 20221209180034905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180034905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180034905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180034905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180034905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180034905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180034918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180034927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180034927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180034927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:38.042628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31115): Terminating (SIGTERM) 18:00:38.083038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31118): Terminating (SIGTERM) 18:00:38.123728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31121): Terminating (SIGTERM) 18:00:38.164778 --- ParallelTerminationStrategy: PID 31115 died... 18:00:38.184056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31115): Terminated: ok {rc=0} 18:00:38.229775 --- ParallelTerminationStrategy: PID 31118 died... 18:00:38.248729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31118): Terminated: ok {rc=0} 18:00:38.294182 --- ParallelTerminationStrategy: PID 31121 died... 18:00:38.313140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31121): Terminated: ok {rc=0} 18:00:38.398467 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:00:39.708890 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:00:39.716617 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:00:39.750720 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:00:39.789171 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:00:39.875607 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:00:39.908940 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:00:39.947082 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:00:40.540444 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:00:40.590906 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:40.601884 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:00:40.671031 tst cs_paging_gprs_active.py: using LAC 22742 18:00:40.791085 tst cs_paging_gprs_active.py: using RAC 47 18:00:40.912530 tst cs_paging_gprs_active.py: using CellId 22742 18:00:41.032464 tst cs_paging_gprs_active.py: using BVCI 22743 18:00:41.145434 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:41.156416 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:41.167096 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:41.178018 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:41.188831 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:41.199822 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:41.210851 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:41.221681 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:41.232572 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:41.352197 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:41.473090 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:00:41.696182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:42.026060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31128): Launched 18:00:42.312070 run iperf3-srv_10.42.42.10(pid=31129): Launched 18:00:42.436587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:00:42.658473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:42.987769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31130): Launched 18:00:43.275085 run iperf3-srv_10.42.42.10(pid=31131): Launched 18:00:43.399360 tst cs_paging_gprs_active.py:38: start network... 18:00:43.620356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:44.127856 run create_hlr_db(pid=31132): Launched 18:00:44.263131 bus /gobi_6: Setting Powered False 18:00:45.327429 run create_hlr_db(pid=31132): Terminated: ok {rc=0} 18:00:45.765683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31134): Launched 18:00:46.085024 run osmo-hlr_10.42.42.2(pid=31135): Launched 18:00:46.292545 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:47.020704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31137): Launched 18:00:47.345383 run osmo-stp_10.42.42.5(pid=31138): Launched 18:00:47.480914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:48.025454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31140): Launched 18:00:48.143614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:00:48.410979 run patchelf(pid=31141): Launched 18:00:48.583003 run osmo-stp_10.42.42.5(pid=31138): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31138)] 18:00:48.714141 run osmo-stp_10.42.42.5(pid=31138): stdout: | (launched: 2022-12-09_18:00:47.288273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:48.845923 run osmo-stp_10.42.42.5(pid=31138): stderr: | 20221209180047536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180047536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180047536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180047536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180047537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180047537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180047537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:48.977773 run osmo-stp_10.42.42.5(pid=31138): stdout: | (launched: 2022-12-09_18:00:47.288273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:49.104207 run osmo-stp_10.42.42.5(pid=31138): stderr: | 20221209180047536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180047536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180047536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180047536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180047537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180047537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180047537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:49.253956 run patchelf(pid=31141): Terminating (SIGINT) 18:00:49.427638 run patchelf(pid=31141): Terminated: ok {rc=0} 18:00:49.553342 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31138): Process ended prematurely: osmo-stp_10.42.42.5(pid=31138) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31138)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:00:49.562880 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 18:00:49.591055 run osmo-hlr_10.42.42.2(pid=31135): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31135)] 18:00:49.639538 run osmo-hlr_10.42.42.2(pid=31135): stdout: | (launched: 2022-12-09_18:00:46.027551) 18:00:49.689806 run osmo-hlr_10.42.42.2(pid=31135): stderr: | 20221209180046437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180046437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180046437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180046437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180046437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180046437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180046460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180046470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180046470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180046470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:49.740657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31128): Terminating (SIGTERM) 18:00:49.781688 run iperf3-srv_10.42.42.10(pid=31129): Terminating (SIGTERM) 18:00:49.822437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31130): Terminating (SIGTERM) 18:00:49.863240 run iperf3-srv_10.42.42.10(pid=31131): Terminating (SIGTERM) 18:00:49.903629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31134): Terminating (SIGTERM) 18:00:49.944616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31137): Terminating (SIGTERM) 18:00:49.985400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31140): Terminating (SIGTERM) 18:00:50.026315 --- ParallelTerminationStrategy: PID 31128 died... 18:00:50.045727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31128): Terminated: ok {rc=0} 18:00:50.090913 --- ParallelTerminationStrategy: PID 31129 died... 18:00:50.109801 run iperf3-srv_10.42.42.10(pid=31129): Terminated {rc=256} 18:00:50.154687 --- ParallelTerminationStrategy: PID 31130 died... 18:00:50.173556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31130): Terminated: ok {rc=0} 18:00:50.218870 --- ParallelTerminationStrategy: PID 31131 died... 18:00:50.237742 run iperf3-srv_10.42.42.10(pid=31131): Terminated {rc=256} 18:00:50.282462 --- ParallelTerminationStrategy: PID 31134 died... 18:00:50.301357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31134): Terminated: ok {rc=0} 18:00:50.346809 --- ParallelTerminationStrategy: PID 31137 died... 18:00:50.365739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31137): Terminated: ok {rc=0} 18:00:50.410706 --- ParallelTerminationStrategy: PID 31140 died... 18:00:50.429539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31140): Terminated: ok {rc=0} 18:00:50.514182 bus /gobi_0: Setting Powered False 18:00:51.614139 bus /gobi_0: Setting Powered False 18:00:52.734423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:00:53.885834 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:53.898108 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:00:53.971459 tst iperf3.py: using LAC 22743 18:00:54.099786 tst iperf3.py: using RAC 48 18:00:54.227098 tst iperf3.py: using CellId 22743 18:00:54.355350 tst iperf3.py: using BVCI 22744 18:00:54.473800 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:54.485194 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:54.496343 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:54.507593 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:54.518766 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:54.530061 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:54.541349 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:54.552655 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:00:54.564010 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:00:54.683324 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:00:54.905231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:00:55.233769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31142): Launched 18:00:55.519866 run iperf3-srv_10.42.42.10(pid=31143): Launched 18:00:55.642985 tst iperf3.py:8: start network... 18:00:55.863468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:56.369045 run create_hlr_db(pid=31144): Launched 18:00:56.494100 bus /gobi_6: Setting Powered False 18:00:57.555531 run create_hlr_db(pid=31144): Terminated: ok {rc=0} 18:00:57.984028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31146): Launched 18:00:58.292006 run osmo-hlr_10.42.42.2(pid=31147): Launched 18:00:58.409686 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:58.953306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31149): Launched 18:00:59.261154 run osmo-stp_10.42.42.5(pid=31150): Launched 18:00:59.379451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:00:59.908629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31152): Launched 18:01:00.027173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:00.286068 run patchelf(pid=31153): Launched 18:01:00.457640 run osmo-stp_10.42.42.5(pid=31150): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31150)] 18:01:00.587751 run osmo-stp_10.42.42.5(pid=31150): stdout: | (launched: 2022-12-09_18:00:59.204431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:00.719472 run osmo-stp_10.42.42.5(pid=31150): stderr: | 20221209180059376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180059376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180059377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180059377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180059378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180059378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180059378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:00.851941 run osmo-stp_10.42.42.5(pid=31150): stdout: | (launched: 2022-12-09_18:00:59.204431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:00.981899 run osmo-stp_10.42.42.5(pid=31150): stderr: | 20221209180059376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180059376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180059377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180059377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180059378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180059378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180059378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:01.135196 run patchelf(pid=31153): Terminating (SIGINT) 18:01:01.312009 run patchelf(pid=31153): Terminated: ok {rc=0} 18:01:01.440425 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31150): Process ended prematurely: osmo-stp_10.42.42.5(pid=31150) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31150)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 18:01:01.451138 tst iperf3.py:8: Test FAILED (7.6 sec) 18:01:01.482267 run osmo-hlr_10.42.42.2(pid=31147): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31147)] 18:01:01.533114 run osmo-hlr_10.42.42.2(pid=31147): stdout: | (launched: 2022-12-09_18:00:58.235527) 18:01:01.585808 run osmo-hlr_10.42.42.2(pid=31147): stderr: | 20221209180058415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180058415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180058415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180058416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180058416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180058416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180058427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180058436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180058436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180058436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:01.638838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31142): Terminating (SIGTERM) 18:01:01.682248 run iperf3-srv_10.42.42.10(pid=31143): Terminating (SIGTERM) 18:01:01.726895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31146): Terminating (SIGTERM) 18:01:01.770740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31149): Terminating (SIGTERM) 18:01:01.814558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31152): Terminating (SIGTERM) 18:01:01.861148 --- ParallelTerminationStrategy: PID 31142 died... 18:01:01.881226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31142): Terminated: ok {rc=0} 18:01:01.929655 --- ParallelTerminationStrategy: PID 31143 died... 18:01:01.949492 run iperf3-srv_10.42.42.10(pid=31143): Terminated {rc=256} 18:01:01.997201 --- ParallelTerminationStrategy: PID 31146 died... 18:01:02.016887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31146): Terminated: ok {rc=0} 18:01:02.064993 --- ParallelTerminationStrategy: PID 31149 died... 18:01:02.084935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31149): Terminated: ok {rc=0} 18:01:02.132082 --- ParallelTerminationStrategy: PID 31152 died... 18:01:02.151987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31152): Terminated: ok {rc=0} 18:01:02.240739 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:01:03.386530 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:03.398316 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:03.469455 tst iperf3m4.py: using LAC 22744 18:01:03.591772 tst iperf3m4.py: using RAC 49 18:01:03.713563 tst iperf3m4.py: using CellId 22744 18:01:03.835639 tst iperf3m4.py: using BVCI 22745 18:01:03.949239 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:03.960070 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:03.970783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:03.981811 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:03.992688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:04.003654 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:04.014724 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:04.025555 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:04.036641 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:04.156788 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:04.279050 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:04.399403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:04.515912 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:01:04.739695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:05.069192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31154): Launched 18:01:05.356384 run iperf3-srv_10.42.42.10(pid=31155): Launched 18:01:05.479286 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:01:05.699670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:06.029273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31156): Launched 18:01:06.314544 run iperf3-srv_10.42.42.10(pid=31157): Launched 18:01:06.438774 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:01:06.658949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:06.987596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31158): Launched 18:01:07.275834 run iperf3-srv_10.42.42.10(pid=31159): Launched 18:01:07.398589 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:01:07.619104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:07.948004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31160): Launched 18:01:08.234319 run iperf3-srv_10.42.42.10(pid=31161): Launched 18:01:08.358245 tst iperf3m4.py:8: start network... 18:01:08.578197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:09.086062 run create_hlr_db(pid=31162): Launched 18:01:09.220527 bus /gobi_6: Setting Powered False 18:01:10.285516 run create_hlr_db(pid=31162): Terminated: ok {rc=0} 18:01:10.742256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31164): Launched 18:01:11.069364 run osmo-hlr_10.42.42.2(pid=31165): Launched 18:01:11.194831 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:11.760316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31167): Launched 18:01:12.088374 run osmo-stp_10.42.42.5(pid=31168): Launched 18:01:12.214248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:12.782058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31170): Launched 18:01:12.907203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:13.182835 run patchelf(pid=31171): Launched 18:01:13.365988 run osmo-stp_10.42.42.5(pid=31168): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31168)] 18:01:13.504326 run osmo-stp_10.42.42.5(pid=31168): stdout: | (launched: 2022-12-09_18:01:12.028044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:13.644316 run osmo-stp_10.42.42.5(pid=31168): stderr: | 20221209180112224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180112224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180112225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180112225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180112226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180112226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180112226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:13.784172 run osmo-stp_10.42.42.5(pid=31168): stdout: | (launched: 2022-12-09_18:01:12.028044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:13.917944 run osmo-stp_10.42.42.5(pid=31168): stderr: | 20221209180112224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180112224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180112225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180112225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180112226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180112226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180112226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:14.076640 run patchelf(pid=31171): Terminating (SIGINT) 18:01:14.260004 run patchelf(pid=31171): Terminated: ok {rc=0} 18:01:14.392346 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31168): Process ended prematurely: osmo-stp_10.42.42.5(pid=31168) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31168)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:01:14.402713 tst iperf3m4.py:8: Test FAILED (11.1 sec) 18:01:14.431812 run osmo-hlr_10.42.42.2(pid=31165): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31165)] 18:01:14.482305 run osmo-hlr_10.42.42.2(pid=31165): stdout: | (launched: 2022-12-09_18:01:11.009476) 18:01:14.534378 run osmo-hlr_10.42.42.2(pid=31165): stderr: | 20221209180111211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180111211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180111211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180111211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180111212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180111212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180111223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180111231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180111231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180111231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:14.587575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31154): Terminating (SIGTERM) 18:01:14.630452 run iperf3-srv_10.42.42.10(pid=31155): Terminating (SIGTERM) 18:01:14.672763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31156): Terminating (SIGTERM) 18:01:14.715420 run iperf3-srv_10.42.42.10(pid=31157): Terminating (SIGTERM) 18:01:14.757905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31158): Terminating (SIGTERM) 18:01:14.800406 run iperf3-srv_10.42.42.10(pid=31159): Terminating (SIGTERM) 18:01:14.842582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31160): Terminating (SIGTERM) 18:01:14.885076 run iperf3-srv_10.42.42.10(pid=31161): Terminating (SIGTERM) 18:01:14.927412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31164): Terminating (SIGTERM) 18:01:14.969976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31167): Terminating (SIGTERM) 18:01:15.012564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31170): Terminating (SIGTERM) 18:01:15.055342 --- ParallelTerminationStrategy: PID 31154 died... 18:01:15.075728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31154): Terminated: ok {rc=0} 18:01:15.122975 --- ParallelTerminationStrategy: PID 31155 died... 18:01:15.143047 run iperf3-srv_10.42.42.10(pid=31155): Terminated {rc=256} 18:01:15.190088 --- ParallelTerminationStrategy: PID 31156 died... 18:01:15.210140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31156): Terminated: ok {rc=0} 18:01:15.257190 --- ParallelTerminationStrategy: PID 31157 died... 18:01:15.277154 run iperf3-srv_10.42.42.10(pid=31157): Terminated {rc=256} 18:01:15.323907 --- ParallelTerminationStrategy: PID 31158 died... 18:01:15.343767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31158): Terminated: ok {rc=0} 18:01:15.391164 --- ParallelTerminationStrategy: PID 31159 died... 18:01:15.411115 run iperf3-srv_10.42.42.10(pid=31159): Terminated {rc=256} 18:01:15.457733 --- ParallelTerminationStrategy: PID 31160 died... 18:01:15.477592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31160): Terminated: ok {rc=0} 18:01:15.524383 --- ParallelTerminationStrategy: PID 31161 died... 18:01:15.544403 run iperf3-srv_10.42.42.10(pid=31161): Terminated {rc=256} 18:01:15.591538 --- ParallelTerminationStrategy: PID 31164 died... 18:01:15.611476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31164): Terminated: ok {rc=0} 18:01:15.658407 --- ParallelTerminationStrategy: PID 31167 died... 18:01:15.678407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31167): Terminated: ok {rc=0} 18:01:15.724798 --- ParallelTerminationStrategy: PID 31170 died... 18:01:15.744755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31170): Terminated: ok {rc=0} 18:01:15.834272 bus /gobi_4: Setting Powered False 18:01:16.934868 bus /gobi_4: Setting Powered False 18:01:18.053150 bus /gobi_1: Setting Powered False 18:01:19.151535 bus /gobi_1: Setting Powered False 18:01:20.267519 bus /gobi_0: Setting Powered False 18:01:21.366828 bus /gobi_0: Setting Powered False 18:01:22.484172 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:01:23.587295 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:23.599145 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:23.669103 tst ping.py: using LAC 22745 18:01:23.786695 tst ping.py: using RAC 50 18:01:23.905571 tst ping.py: using CellId 22745 18:01:24.033561 tst ping.py: using BVCI 22746 18:01:24.151876 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:24.163468 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:24.174825 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:24.186248 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:24.197355 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:24.208747 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:24.220079 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:24.231212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:24.345149 tst ping.py:19: start network... 18:01:24.546921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:25.013235 run create_hlr_db(pid=31173): Launched 18:01:25.129776 bus /gobi_6: Setting Powered False 18:01:26.190535 run create_hlr_db(pid=31173): Terminated: ok {rc=0} 18:01:26.612686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31175): Launched 18:01:26.914667 run osmo-hlr_10.42.42.2(pid=31176): Launched 18:01:27.029825 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:27.563973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31178): Launched 18:01:27.866139 run osmo-stp_10.42.42.5(pid=31179): Launched 18:01:27.981145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:28.500570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31181): Launched 18:01:28.616528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:28.870607 run patchelf(pid=31182): Launched 18:01:29.039927 run osmo-stp_10.42.42.5(pid=31179): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31179)] 18:01:29.167184 run osmo-stp_10.42.42.5(pid=31179): stdout: | (launched: 2022-12-09_18:01:27.810145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:29.296447 run osmo-stp_10.42.42.5(pid=31179): stderr: | 20221209180127979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180127979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180127979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180127980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180127980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180127980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180127980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:29.426268 run osmo-stp_10.42.42.5(pid=31179): stdout: | (launched: 2022-12-09_18:01:27.810145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:29.548804 run osmo-stp_10.42.42.5(pid=31179): stderr: | 20221209180127979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180127979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180127979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180127980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180127980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180127980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180127980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:29.694591 run patchelf(pid=31182): Terminating (SIGINT) 18:01:29.863084 run patchelf(pid=31182): Terminated: ok {rc=0} 18:01:29.984871 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31179): Process ended prematurely: osmo-stp_10.42.42.5(pid=31179) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31179)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 18:01:29.993971 tst ping.py:22: Test FAILED (6.4 sec) 18:01:30.021527 run osmo-hlr_10.42.42.2(pid=31176): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31176)] 18:01:30.070446 run osmo-hlr_10.42.42.2(pid=31176): stdout: | (launched: 2022-12-09_18:01:26.858954) 18:01:30.120728 run osmo-hlr_10.42.42.2(pid=31176): stderr: | 20221209180127033 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180127033 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180127033 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180127033 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180127033 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180127033 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180127045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180127054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180127054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180127054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:30.171379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31175): Terminating (SIGTERM) 18:01:30.211780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31178): Terminating (SIGTERM) 18:01:30.252505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31181): Terminating (SIGTERM) 18:01:30.293396 --- ParallelTerminationStrategy: PID 31175 died... 18:01:30.312450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31175): Terminated: ok {rc=0} 18:01:30.357729 --- ParallelTerminationStrategy: PID 31178 died... 18:01:30.376532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31178): Terminated: ok {rc=0} 18:01:30.421436 --- ParallelTerminationStrategy: PID 31181 died... 18:01:30.440243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31181): Terminated: ok {rc=0} 18:01:30.528310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:01:31.620002 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:31.633240 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:01:31.707674 tst ping_idle_ping.py: using LAC 22746 18:01:31.836001 tst ping_idle_ping.py: using RAC 51 18:01:31.958554 tst ping_idle_ping.py: using CellId 22746 18:01:32.081283 tst ping_idle_ping.py: using BVCI 22747 18:01:32.207650 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:32.219701 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:32.232355 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:32.245701 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:32.257870 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:32.269823 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:32.281423 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:01:32.292907 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:01:32.414993 tst ping_idle_ping.py:24: start network... 18:01:32.633915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:33.135768 run create_hlr_db(pid=31183): Launched 18:01:33.268234 bus /gobi_6: Setting Powered False 18:01:34.332815 run create_hlr_db(pid=31183): Terminated: ok {rc=0} 18:01:34.767636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31185): Launched 18:01:35.071292 run osmo-hlr_10.42.42.2(pid=31186): Launched 18:01:35.186843 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:35.709138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31188): Launched 18:01:36.032268 run osmo-stp_10.42.42.5(pid=31189): Launched 18:01:36.156839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:36.712651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31191): Launched 18:01:36.835802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:37.108040 run patchelf(pid=31192): Launched 18:01:37.289240 run osmo-stp_10.42.42.5(pid=31189): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31189)] 18:01:37.425891 run osmo-stp_10.42.42.5(pid=31189): stdout: | (launched: 2022-12-09_18:01:35.973406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:37.564630 run osmo-stp_10.42.42.5(pid=31189): stderr: | 20221209180136169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180136169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180136169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180136170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180136170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180136170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180136170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:37.704093 run osmo-stp_10.42.42.5(pid=31189): stdout: | (launched: 2022-12-09_18:01:35.973406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:37.836146 run osmo-stp_10.42.42.5(pid=31189): stderr: | 20221209180136169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180136169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180136169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180136170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180136170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180136170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180136170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:37.992196 run patchelf(pid=31192): Terminating (SIGINT) 18:01:38.173274 run patchelf(pid=31192): Terminated: ok {rc=0} 18:01:38.303197 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31189): Process ended prematurely: osmo-stp_10.42.42.5(pid=31189) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31189)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:01:38.312855 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:01:38.341433 run osmo-hlr_10.42.42.2(pid=31186): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31186)] 18:01:38.391697 run osmo-hlr_10.42.42.2(pid=31186): stdout: | (launched: 2022-12-09_18:01:35.015258) 18:01:38.443578 run osmo-hlr_10.42.42.2(pid=31186): stderr: | 20221209180135194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180135194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180135194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180135194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180135194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180135194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180135207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180135215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180135215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180135215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:38.495715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31185): Terminating (SIGTERM) 18:01:38.537824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31188): Terminating (SIGTERM) 18:01:38.580274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31191): Terminating (SIGTERM) 18:01:38.622928 --- ParallelTerminationStrategy: PID 31185 died... 18:01:38.643249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31185): Terminated: ok {rc=0} 18:01:38.690336 --- ParallelTerminationStrategy: PID 31188 died... 18:01:38.710404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31188): Terminated: ok {rc=0} 18:01:38.757299 --- ParallelTerminationStrategy: PID 31191 died... 18:01:38.777394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31191): Terminated: ok {rc=0} 18:01:38.866225 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:01:40.171331 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:01:40.177498 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:01:40.211458 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:01:40.250037 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:01:40.335120 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:01:40.368076 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:01:40.406423 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:01:41.006331 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:01:41.059390 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:41.071007 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:01:41.142313 tst cs_paging_gprs_active.py: using LAC 22747 18:01:41.270413 tst cs_paging_gprs_active.py: using RAC 52 18:01:41.400622 tst cs_paging_gprs_active.py: using CellId 22747 18:01:41.529136 tst cs_paging_gprs_active.py: using BVCI 22748 18:01:41.648753 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:41.660201 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:41.671420 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:41.682639 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:41.693889 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:41.705164 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:41.716453 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:41.727538 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:41.738800 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:41.856187 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:41.978674 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:01:42.185661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:42.495186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31197): Launched 18:01:42.764907 run iperf3-srv_10.42.42.10(pid=31198): Launched 18:01:42.880512 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:01:43.086436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:43.395881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31199): Launched 18:01:43.665186 run iperf3-srv_10.42.42.10(pid=31200): Launched 18:01:43.782543 tst cs_paging_gprs_active.py:38: start network... 18:01:43.987156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:44.462624 run create_hlr_db(pid=31201): Launched 18:01:44.582001 bus /gobi_6: Setting Powered False 18:01:45.643852 run create_hlr_db(pid=31201): Terminated: ok {rc=0} 18:01:46.107688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31203): Launched 18:01:46.431789 run osmo-hlr_10.42.42.2(pid=31204): Launched 18:01:46.702300 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:47.394466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31206): Launched 18:01:47.724893 run osmo-stp_10.42.42.5(pid=31207): Launched 18:01:47.850915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:01:48.419512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31209): Launched 18:01:48.546868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:01:48.825204 run patchelf(pid=31210): Launched 18:01:49.011033 run osmo-stp_10.42.42.5(pid=31207): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31207)] 18:01:49.150142 run osmo-stp_10.42.42.5(pid=31207): stdout: | (launched: 2022-12-09_18:01:47.663693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:49.290420 run osmo-stp_10.42.42.5(pid=31207): stderr: | 20221209180147856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180147856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180147856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180147857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180147857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180147857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180147858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:49.430604 run osmo-stp_10.42.42.5(pid=31207): stdout: | (launched: 2022-12-09_18:01:47.663693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:49.564932 run osmo-stp_10.42.42.5(pid=31207): stderr: | 20221209180147856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180147856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180147856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180147857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180147857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180147857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180147858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:49.724342 run patchelf(pid=31210): Terminating (SIGINT) 18:01:49.908050 run patchelf(pid=31210): Terminated: ok {rc=0} 18:01:50.041174 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31207): Process ended prematurely: osmo-stp_10.42.42.5(pid=31207) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31207)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:01:50.051527 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 18:01:50.080292 run osmo-hlr_10.42.42.2(pid=31204): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31204)] 18:01:50.130471 run osmo-hlr_10.42.42.2(pid=31204): stdout: | (launched: 2022-12-09_18:01:46.374164) 18:01:50.182449 run osmo-hlr_10.42.42.2(pid=31204): stderr: | 20221209180146634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180146634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180146634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180146634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180146634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180146634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180146651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180146670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180146670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180146670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:50.235244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31197): Terminating (SIGTERM) 18:01:50.277237 run iperf3-srv_10.42.42.10(pid=31198): Terminating (SIGTERM) 18:01:50.319123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31199): Terminating (SIGTERM) 18:01:50.360996 run iperf3-srv_10.42.42.10(pid=31200): Terminating (SIGTERM) 18:01:50.402725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31203): Terminating (SIGTERM) 18:01:50.444556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31206): Terminating (SIGTERM) 18:01:50.486523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31209): Terminating (SIGTERM) 18:01:50.528599 --- ParallelTerminationStrategy: PID 31197 died... 18:01:50.548746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31197): Terminated: ok {rc=0} 18:01:50.595923 --- ParallelTerminationStrategy: PID 31198 died... 18:01:50.615494 run iperf3-srv_10.42.42.10(pid=31198): Terminated {rc=256} 18:01:50.661831 --- ParallelTerminationStrategy: PID 31199 died... 18:01:50.681480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31199): Terminated: ok {rc=0} 18:01:50.727639 --- ParallelTerminationStrategy: PID 31200 died... 18:01:50.747163 run iperf3-srv_10.42.42.10(pid=31200): Terminated {rc=256} 18:01:50.793353 --- ParallelTerminationStrategy: PID 31203 died... 18:01:50.812878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31203): Terminated: ok {rc=0} 18:01:50.859077 --- ParallelTerminationStrategy: PID 31206 died... 18:01:50.878767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31206): Terminated: ok {rc=0} 18:01:50.925102 --- ParallelTerminationStrategy: PID 31209 died... 18:01:50.944611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31209): Terminated: ok {rc=0} 18:01:51.033519 bus /gobi_0: Setting Powered False 18:01:52.134939 bus /gobi_0: Setting Powered False 18:01:53.250361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:01:54.394993 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:54.406584 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:01:54.476938 tst iperf3.py: using LAC 22748 18:01:54.598700 tst iperf3.py: using RAC 53 18:01:54.718887 tst iperf3.py: using CellId 22748 18:01:54.838696 tst iperf3.py: using BVCI 22749 18:01:54.953084 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:54.963862 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:54.974580 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:54.985573 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:54.996290 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:55.007186 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:55.018315 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:55.029141 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:01:55.040130 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:01:55.159254 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:01:55.381145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:01:55.711502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31211): Launched 18:01:55.984844 run iperf3-srv_10.42.42.10(pid=31212): Launched 18:01:56.100478 tst iperf3.py:8: start network... 18:01:56.306662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:56.783635 run create_hlr_db(pid=31213): Launched 18:01:56.901647 bus /gobi_6: Setting Powered False 18:01:57.963460 run create_hlr_db(pid=31213): Terminated: ok {rc=0} 18:01:58.393928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31215): Launched 18:01:58.704868 run osmo-hlr_10.42.42.2(pid=31216): Launched 18:01:58.822855 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:59.353645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31218): Launched 18:01:59.662332 run osmo-stp_10.42.42.5(pid=31219): Launched 18:01:59.781520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:00.317137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31221): Launched 18:02:00.435610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:00.695624 run patchelf(pid=31222): Launched 18:02:00.889801 run osmo-stp_10.42.42.5(pid=31219): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31219)] 18:02:01.033776 run osmo-stp_10.42.42.5(pid=31219): stdout: | (launched: 2022-12-09_18:01:59.605475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:01.179981 run osmo-stp_10.42.42.5(pid=31219): stderr: | 20221209180159778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180159778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180159779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180159779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180159780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180159780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180159780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:01.325953 run osmo-stp_10.42.42.5(pid=31219): stdout: | (launched: 2022-12-09_18:01:59.605475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:01.465372 run osmo-stp_10.42.42.5(pid=31219): stderr: | 20221209180159778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180159778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180159779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180159779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180159780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180159780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180159780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:01.630680 run patchelf(pid=31222): Terminating (SIGINT) 18:02:01.821968 run patchelf(pid=31222): Terminated: ok {rc=0} 18:02:01.970399 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31219): Process ended prematurely: osmo-stp_10.42.42.5(pid=31219) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31219)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 18:02:01.983556 tst iperf3.py:8: Test FAILED (7.6 sec) 18:02:02.019498 run osmo-hlr_10.42.42.2(pid=31216): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31216)] 18:02:02.076585 run osmo-hlr_10.42.42.2(pid=31216): stdout: | (launched: 2022-12-09_18:01:58.647824) 18:02:02.133345 run osmo-hlr_10.42.42.2(pid=31216): stderr: | 20221209180158824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180158824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180158824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180158824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180158824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180158824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180158840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180158850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180158850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180158850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:02.189525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31211): Terminating (SIGTERM) 18:02:02.233527 run iperf3-srv_10.42.42.10(pid=31212): Terminating (SIGTERM) 18:02:02.276516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31215): Terminating (SIGTERM) 18:02:02.319974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31218): Terminating (SIGTERM) 18:02:02.363693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31221): Terminating (SIGTERM) 18:02:02.406939 --- ParallelTerminationStrategy: PID 31211 died... 18:02:02.427357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31211): Terminated: ok {rc=0} 18:02:02.475431 --- ParallelTerminationStrategy: PID 31212 died... 18:02:02.495210 run iperf3-srv_10.42.42.10(pid=31212): Terminated {rc=256} 18:02:02.543584 --- ParallelTerminationStrategy: PID 31215 died... 18:02:02.563610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31215): Terminated: ok {rc=0} 18:02:02.612251 --- ParallelTerminationStrategy: PID 31218 died... 18:02:02.632340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31218): Terminated: ok {rc=0} 18:02:02.680508 --- ParallelTerminationStrategy: PID 31221 died... 18:02:02.700547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31221): Terminated: ok {rc=0} 18:02:02.790964 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:02:03.940321 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:03.952558 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:04.023460 tst iperf3m4.py: using LAC 22749 18:02:04.145456 tst iperf3m4.py: using RAC 54 18:02:04.268250 tst iperf3m4.py: using CellId 22749 18:02:04.399789 tst iperf3m4.py: using BVCI 22750 18:02:04.519299 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:04.530852 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:04.542089 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:04.553856 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:04.565533 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:04.577222 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:04.589377 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:04.601539 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:04.612833 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:04.735643 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:04.861882 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:04.984723 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:05.106864 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:02:05.329478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:05.660411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31223): Launched 18:02:05.949172 run iperf3-srv_10.42.42.10(pid=31224): Launched 18:02:06.073765 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:02:06.294707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:06.625738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31225): Launched 18:02:06.912828 run iperf3-srv_10.42.42.10(pid=31226): Launched 18:02:07.038404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:02:07.259055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:07.590376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31227): Launched 18:02:07.878919 run iperf3-srv_10.42.42.10(pid=31228): Launched 18:02:08.003283 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:02:08.223586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:02:08.554169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31229): Launched 18:02:08.840492 run iperf3-srv_10.42.42.10(pid=31230): Launched 18:02:08.965435 tst iperf3m4.py:8: start network... 18:02:09.185688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:09.695404 run create_hlr_db(pid=31231): Launched 18:02:09.830311 bus /gobi_6: Setting Powered False 18:02:10.894997 run create_hlr_db(pid=31231): Terminated: ok {rc=0} 18:02:11.333728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31233): Launched 18:02:11.642460 run osmo-hlr_10.42.42.2(pid=31234): Launched 18:02:11.761180 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:12.306530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31236): Launched 18:02:12.616455 run osmo-stp_10.42.42.5(pid=31237): Launched 18:02:12.737794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:13.267192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31239): Launched 18:02:13.386552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:13.646177 run patchelf(pid=31240): Launched 18:02:13.818911 run osmo-stp_10.42.42.5(pid=31237): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31237)] 18:02:13.949484 run osmo-stp_10.42.42.5(pid=31237): stdout: | (launched: 2022-12-09_18:02:12.559494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:14.081676 run osmo-stp_10.42.42.5(pid=31237): stderr: | 20221209180212731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180212731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180212732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180212732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180212734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180212734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180212735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:14.214160 run osmo-stp_10.42.42.5(pid=31237): stdout: | (launched: 2022-12-09_18:02:12.559494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:14.340250 run osmo-stp_10.42.42.5(pid=31237): stderr: | 20221209180212731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180212731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180212732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180212732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180212734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180212734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180212735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:14.490621 run patchelf(pid=31240): Terminating (SIGINT) 18:02:14.663078 run patchelf(pid=31240): Terminated: ok {rc=0} 18:02:14.787544 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31237): Process ended prematurely: osmo-stp_10.42.42.5(pid=31237) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31237)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:02:14.797311 tst iperf3m4.py:8: Test FAILED (10.9 sec) 18:02:14.825775 run osmo-hlr_10.42.42.2(pid=31234): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31234)] 18:02:14.874622 run osmo-hlr_10.42.42.2(pid=31234): stdout: | (launched: 2022-12-09_18:02:11.585607) 18:02:14.924562 run osmo-hlr_10.42.42.2(pid=31234): stderr: | 20221209180211762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180211762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180211762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180211762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180211762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180211762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180211774 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180211782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180211782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180211783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:14.975145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31223): Terminating (SIGTERM) 18:02:15.015803 run iperf3-srv_10.42.42.10(pid=31224): Terminating (SIGTERM) 18:02:15.056278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31225): Terminating (SIGTERM) 18:02:15.097006 run iperf3-srv_10.42.42.10(pid=31226): Terminating (SIGTERM) 18:02:15.137521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31227): Terminating (SIGTERM) 18:02:15.178075 run iperf3-srv_10.42.42.10(pid=31228): Terminating (SIGTERM) 18:02:15.218338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31229): Terminating (SIGTERM) 18:02:15.258771 run iperf3-srv_10.42.42.10(pid=31230): Terminating (SIGTERM) 18:02:15.299026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31233): Terminating (SIGTERM) 18:02:15.339630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31236): Terminating (SIGTERM) 18:02:15.380183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31239): Terminating (SIGTERM) 18:02:15.421207 --- ParallelTerminationStrategy: PID 31223 died... 18:02:15.440502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31223): Terminated: ok {rc=0} 18:02:15.485502 --- ParallelTerminationStrategy: PID 31224 died... 18:02:15.504213 run iperf3-srv_10.42.42.10(pid=31224): Terminated {rc=256} 18:02:15.548940 --- ParallelTerminationStrategy: PID 31225 died... 18:02:15.568284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31225): Terminated: ok {rc=0} 18:02:15.613329 --- ParallelTerminationStrategy: PID 31226 died... 18:02:15.631977 run iperf3-srv_10.42.42.10(pid=31226): Terminated {rc=256} 18:02:15.677701 --- ParallelTerminationStrategy: PID 31227 died... 18:02:15.696498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31227): Terminated: ok {rc=0} 18:02:15.741850 --- ParallelTerminationStrategy: PID 31228 died... 18:02:15.760527 run iperf3-srv_10.42.42.10(pid=31228): Terminated {rc=256} 18:02:15.805231 --- ParallelTerminationStrategy: PID 31229 died... 18:02:15.823875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31229): Terminated: ok {rc=0} 18:02:15.874278 --- ParallelTerminationStrategy: PID 31230 died... 18:02:15.894551 run iperf3-srv_10.42.42.10(pid=31230): Terminated {rc=256} 18:02:15.943324 --- ParallelTerminationStrategy: PID 31233 died... 18:02:15.963384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31233): Terminated: ok {rc=0} 18:02:16.011392 --- ParallelTerminationStrategy: PID 31236 died... 18:02:16.032278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31236): Terminated: ok {rc=0} 18:02:16.080010 --- ParallelTerminationStrategy: PID 31239 died... 18:02:16.101171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31239): Terminated: ok {rc=0} 18:02:16.191840 bus /gobi_4: Setting Powered False 18:02:17.292730 bus /gobi_4: Setting Powered False 18:02:18.410158 bus /gobi_1: Setting Powered False 18:02:19.509923 bus /gobi_1: Setting Powered False 18:02:20.626739 bus /gobi_0: Setting Powered False 18:02:21.726775 bus /gobi_0: Setting Powered False 18:02:22.845015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:02:23.950659 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:23.962970 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:24.036192 tst ping.py: using LAC 22750 18:02:24.164467 tst ping.py: using RAC 55 18:02:24.290325 tst ping.py: using CellId 22750 18:02:24.418097 tst ping.py: using BVCI 22751 18:02:24.535642 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:24.547127 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:24.558383 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:24.569636 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:24.580704 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:24.592305 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:24.603724 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:24.615015 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:24.735815 tst ping.py:19: start network... 18:02:24.953306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:25.451661 run create_hlr_db(pid=31241): Launched 18:02:25.584179 bus /gobi_6: Setting Powered False 18:02:26.647934 run create_hlr_db(pid=31241): Terminated: ok {rc=0} 18:02:27.081438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31243): Launched 18:02:27.385127 run osmo-hlr_10.42.42.2(pid=31244): Launched 18:02:27.502370 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:28.036475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31246): Launched 18:02:28.339065 run osmo-stp_10.42.42.5(pid=31247): Launched 18:02:28.455097 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:28.978489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31249): Launched 18:02:29.094715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:29.349743 run patchelf(pid=31250): Launched 18:02:29.518149 run osmo-stp_10.42.42.5(pid=31247): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31247)] 18:02:29.646499 run osmo-stp_10.42.42.5(pid=31247): stdout: | (launched: 2022-12-09_18:02:28.283288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:29.776730 run osmo-stp_10.42.42.5(pid=31247): stderr: | 20221209180228453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180228453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180228453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180228454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180228454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180228454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180228454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:29.906990 run osmo-stp_10.42.42.5(pid=31247): stdout: | (launched: 2022-12-09_18:02:28.283288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:30.030675 run osmo-stp_10.42.42.5(pid=31247): stderr: | 20221209180228453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180228453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180228453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180228454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180228454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180228454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180228454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:30.177213 run patchelf(pid=31250): Terminating (SIGINT) 18:02:30.347290 run patchelf(pid=31250): Terminated: ok {rc=0} 18:02:30.469559 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31247): Process ended prematurely: osmo-stp_10.42.42.5(pid=31247) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31247)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 18:02:30.478511 tst ping.py:22: Test FAILED (6.5 sec) 18:02:30.506184 run osmo-hlr_10.42.42.2(pid=31244): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31244)] 18:02:30.554909 run osmo-hlr_10.42.42.2(pid=31244): stdout: | (launched: 2022-12-09_18:02:27.329092) 18:02:30.605160 run osmo-hlr_10.42.42.2(pid=31244): stderr: | 20221209180227506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180227506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180227506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180227506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180227506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180227506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180227522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180227532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180227532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180227532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:30.655715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31243): Terminating (SIGTERM) 18:02:30.696251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31246): Terminating (SIGTERM) 18:02:30.736652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31249): Terminating (SIGTERM) 18:02:30.777520 --- ParallelTerminationStrategy: PID 31243 died... 18:02:30.796720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31243): Terminated: ok {rc=0} 18:02:30.846192 --- ParallelTerminationStrategy: PID 31246 died... 18:02:30.873020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31246): Terminated: ok {rc=0} 18:02:30.935133 --- ParallelTerminationStrategy: PID 31249 died... 18:02:30.954862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31249): Terminated: ok {rc=0} 18:02:31.045891 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:02:32.134765 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:32.148023 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:32.224377 tst ping_idle_ping.py: using LAC 22751 18:02:32.351837 tst ping_idle_ping.py: using RAC 56 18:02:32.478337 tst ping_idle_ping.py: using CellId 22751 18:02:32.607959 tst ping_idle_ping.py: using BVCI 22752 18:02:32.719238 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:32.730252 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:32.741057 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:32.752529 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:32.763845 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:32.775367 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:32.786967 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:02:32.798729 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:02:32.920797 tst ping_idle_ping.py:24: start network... 18:02:33.138705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:33.642492 run create_hlr_db(pid=31251): Launched 18:02:33.777437 bus /gobi_6: Setting Powered False 18:02:34.842010 run create_hlr_db(pid=31251): Terminated: ok {rc=0} 18:02:35.278529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31253): Launched 18:02:35.582703 run osmo-hlr_10.42.42.2(pid=31254): Launched 18:02:35.700011 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:36.258212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31257): Launched 18:02:36.582555 run osmo-stp_10.42.42.5(pid=31258): Launched 18:02:36.708110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:37.237823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31260): Launched 18:02:37.354023 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:37.609389 run patchelf(pid=31261): Launched 18:02:37.777837 run osmo-stp_10.42.42.5(pid=31258): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31258)] 18:02:37.906028 run osmo-stp_10.42.42.5(pid=31258): stdout: | (launched: 2022-12-09_18:02:36.523252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:38.036278 run osmo-stp_10.42.42.5(pid=31258): stderr: | 20221209180236716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180236716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180236716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180236717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180236719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180236719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180236719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:38.166763 run osmo-stp_10.42.42.5(pid=31258): stdout: | (launched: 2022-12-09_18:02:36.523252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:38.290539 run osmo-stp_10.42.42.5(pid=31258): stderr: | 20221209180236716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180236716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180236716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180236717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180236719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180236719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180236719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:38.437619 run patchelf(pid=31261): Terminating (SIGINT) 18:02:38.607682 run patchelf(pid=31261): Terminated: ok {rc=0} 18:02:38.730350 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31258): Process ended prematurely: osmo-stp_10.42.42.5(pid=31258) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31258)] [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:02:38.739377 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:02:38.767261 run osmo-hlr_10.42.42.2(pid=31254): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31254)] 18:02:38.815779 run osmo-hlr_10.42.42.2(pid=31254): stdout: | (launched: 2022-12-09_18:02:35.526539) 18:02:38.866063 run osmo-hlr_10.42.42.2(pid=31254): stderr: | 20221209180235704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180235704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180235704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180235704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180235704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180235704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180235716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180235724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180235725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180235725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:38.916877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31253): Terminating (SIGTERM) 18:02:38.957748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31257): Terminating (SIGTERM) 18:02:38.998565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31260): Terminating (SIGTERM) 18:02:39.039681 --- ParallelTerminationStrategy: PID 31253 died... 18:02:39.058979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31253): Terminated: ok {rc=0} 18:02:39.104853 --- ParallelTerminationStrategy: PID 31257 died... 18:02:39.124466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31257): Terminated: ok {rc=0} 18:02:39.169896 --- ParallelTerminationStrategy: PID 31260 died... 18:02:39.188940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31260): Terminated: ok {rc=0} 18:02:39.275949 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:02:40.591838 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:40.599043 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:02:40.633288 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:02:40.667834 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:02:40.721357 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:02:40.754987 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:02:40.789434 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:02:41.345174 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:02:41.350313 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:41.361782 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:02:41.431966 tst switch_tch_pdch.py: using LAC 22752 18:02:41.553132 tst switch_tch_pdch.py: using RAC 57 18:02:41.672256 tst switch_tch_pdch.py: using CellId 22752 18:02:41.790277 tst switch_tch_pdch.py: using BVCI 22753 18:02:41.901671 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:41.912794 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:41.924220 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:41.935896 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:41.947330 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:41.958512 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:41.970027 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:02:41.981126 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:02:42.100583 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:02:42.228037 tst switch_tch_pdch.py:51: start network... 18:02:42.446154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:42.944394 run create_hlr_db(pid=31265): Launched 18:02:43.075896 bus /gobi_6: Setting Powered False 18:02:44.140489 run create_hlr_db(pid=31265): Terminated: ok {rc=0} 18:02:44.571491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31267): Launched 18:02:44.875218 run osmo-hlr_10.42.42.2(pid=31268): Launched 18:02:44.990990 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:45.524414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31270): Launched 18:02:45.826344 run osmo-stp_10.42.42.5(pid=31271): Launched 18:02:46.109476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:46.760268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31273): Launched 18:02:46.913922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:47.204513 run patchelf(pid=31274): Launched 18:02:47.393777 run osmo-stp_10.42.42.5(pid=31271): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31271)] 18:02:47.521563 run osmo-stp_10.42.42.5(pid=31271): stdout: | (launched: 2022-12-09_18:02:45.770441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:47.651670 run osmo-stp_10.42.42.5(pid=31271): stderr: | 20221209180245998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180245998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180245998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180245999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180246001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180246001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180246001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:47.781617 run osmo-stp_10.42.42.5(pid=31271): stdout: | (launched: 2022-12-09_18:02:45.770441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:47.904864 run osmo-stp_10.42.42.5(pid=31271): stderr: | 20221209180245998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180245998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180245998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180245999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180246001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180246001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180246001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:48.051203 run patchelf(pid=31274): Terminating (SIGINT) 18:02:48.220530 run patchelf(pid=31274): Terminated: ok {rc=0} 18:02:48.343021 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31271): Process ended prematurely: osmo-stp_10.42.42.5(pid=31271) [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31271)] [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:02:48.351980 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 18:02:48.379832 run osmo-hlr_10.42.42.2(pid=31268): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31268)] 18:02:48.428349 run osmo-hlr_10.42.42.2(pid=31268): stdout: | (launched: 2022-12-09_18:02:44.819113) 18:02:48.478545 run osmo-hlr_10.42.42.2(pid=31268): stderr: | 20221209180244997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180244997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180244997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180244997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180244997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180244997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180245009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180245017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180245018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180245018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:48.534781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31267): Terminating (SIGTERM) 18:02:48.577949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31270): Terminating (SIGTERM) 18:02:48.621553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31273): Terminating (SIGTERM) 18:02:48.665565 --- ParallelTerminationStrategy: PID 31267 died... 18:02:48.685915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31267): Terminated: ok {rc=0} 18:02:48.733973 --- ParallelTerminationStrategy: PID 31270 died... 18:02:48.753870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31270): Terminated: ok {rc=0} 18:02:48.801694 --- ParallelTerminationStrategy: PID 31273 died... 18:02:48.821441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31273): Terminated: ok {rc=0} 18:02:48.910615 bus /gobi_0: Setting Powered False 18:02:50.010061 bus /gobi_0: Setting Powered False 18:02:51.126781 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:02:52.383727 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:52.390001 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:02:52.423840 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:02:52.459338 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:02:52.513811 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:02:52.547669 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:02:52.582671 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:02:53.143262 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:02:53.149620 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:53.161699 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:02:53.231649 tst switch_tch_pdch.py: using LAC 22753 18:02:53.357393 tst switch_tch_pdch.py: using RAC 58 18:02:53.481811 tst switch_tch_pdch.py: using CellId 22753 18:02:53.605859 tst switch_tch_pdch.py: using BVCI 22754 18:02:53.723507 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:53.735016 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:53.746271 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:53.757555 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:53.768594 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:53.779907 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:53.791224 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:02:53.802425 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:02:53.919108 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:02:54.035503 tst switch_tch_pdch.py:51: start network... 18:02:54.238833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:54.680673 run create_hlr_db(pid=31278): Launched 18:02:54.796914 bus /gobi_6: Setting Powered False 18:02:55.857980 run create_hlr_db(pid=31278): Terminated: ok {rc=0} 18:02:56.271273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31280): Launched 18:02:56.593728 run osmo-hlr_10.42.42.2(pid=31281): Launched 18:02:56.717099 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:57.243721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31283): Launched 18:02:57.566886 run osmo-stp_10.42.42.5(pid=31284): Launched 18:02:57.692398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:02:58.221456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31286): Launched 18:02:58.345003 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:02:58.616769 run patchelf(pid=31287): Launched 18:02:58.798147 run osmo-stp_10.42.42.5(pid=31284): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31284)] 18:02:58.934087 run osmo-stp_10.42.42.5(pid=31284): stdout: | (launched: 2022-12-09_18:02:57.507803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:59.072240 run osmo-stp_10.42.42.5(pid=31284): stderr: | 20221209180257700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180257701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180257701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180257701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180257702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180257702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180257702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:59.210853 run osmo-stp_10.42.42.5(pid=31284): stdout: | (launched: 2022-12-09_18:02:57.507803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:59.342243 run osmo-stp_10.42.42.5(pid=31284): stderr: | 20221209180257700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180257701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180257701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180257701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180257702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180257702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180257702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:59.497858 run patchelf(pid=31287): Terminating (SIGINT) 18:02:59.678956 run patchelf(pid=31287): Terminated: ok {rc=0} 18:02:59.808319 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31284): Process ended prematurely: osmo-stp_10.42.42.5(pid=31284) [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31284)] [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:02:59.818004 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 18:02:59.846248 run osmo-hlr_10.42.42.2(pid=31281): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31281)] 18:02:59.896352 run osmo-hlr_10.42.42.2(pid=31281): stdout: | (launched: 2022-12-09_18:02:56.534640) 18:02:59.948349 run osmo-hlr_10.42.42.2(pid=31281): stderr: | 20221209180256733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180256733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180256733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180256733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180256733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180256733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180256745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180256755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180256756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180256756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:00.000756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31280): Terminating (SIGTERM) 18:03:00.042697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31283): Terminating (SIGTERM) 18:03:00.084729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31286): Terminating (SIGTERM) 18:03:00.127447 --- ParallelTerminationStrategy: PID 31280 died... 18:03:00.147603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31280): Terminated: ok {rc=0} 18:03:00.194342 --- ParallelTerminationStrategy: PID 31283 died... 18:03:00.214165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31283): Terminated: ok {rc=0} 18:03:00.260792 --- ParallelTerminationStrategy: PID 31286 died... 18:03:00.281169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31286): Terminated: ok {rc=0} 18:03:00.369809 bus /gobi_0: Setting Powered False 18:03:01.477185 bus /gobi_0: Setting Powered False 18:03:02.612724 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:03.862342 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:03.867220 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:03.897332 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 18:03:03.904355 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:03:03.956910 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:03.987001 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 18:03:03.994055 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:03:04.537237 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 18:03:04.542357 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 18:03:04.553777 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:04.598612 tst mo_mt_sms.py: using LAC 22754 18:03:04.724768 tst mo_mt_sms.py: using RAC 59 18:03:04.848820 tst mo_mt_sms.py: using CellId 22754 18:03:04.972760 tst mo_mt_sms.py: using BVCI 22755 18:03:05.088496 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:03:05.202465 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:03:05.314386 tst mo_mt_sms.py:9: start nitb and bts... 18:03:05.518935 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:03:06.134376 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31292): Launched 18:03:06.439123 run osmo-nitb_10.42.42.2(pid=31293): Launched 18:03:06.606856 run osmo-nitb_10.42.42.2(pid=31293): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31293)] 18:03:06.742823 run osmo-nitb_10.42.42.2(pid=31293): stdout: | (launched: 2022-12-09_18:03:06.383497) 18:03:06.880691 run osmo-nitb_10.42.42.2(pid=31293): stderr: | (launched: 2022-12-09_18:03:06.428094) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:07.018473 run osmo-nitb_10.42.42.2(pid=31293): stdout: | (launched: 2022-12-09_18:03:06.383497) 18:03:07.149678 run osmo-nitb_10.42.42.2(pid=31293): stderr: | (launched: 2022-12-09_18:03:06.428094) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31293): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31293) [trial-2362↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31293)] 18:03:07.554203 tst osmo-nitb_10.42.42.2(pid=31293): stdout: | (launched: 2022-12-09_18:03:06.383497) 18:03:07.676474 tst osmo-nitb_10.42.42.2(pid=31293): stderr: | (launched: 2022-12-09_18:03:06.428094) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:07.820074 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31293): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31293) [trial-2362↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31293)] [trial-2362↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 18:03:07.828688 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 18:03:07.835511 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31292): Terminating (SIGTERM) 18:03:08.047106 --- ParallelTerminationStrategy: PID 31292 died... 18:03:08.068166 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31292): Terminated: ok {rc=0} 18:03:08.156501 bus /sierra_3: Setting Powered False 18:03:09.258130 bus /sierra_3: Setting Powered False 18:03:10.373566 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:11.575920 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:11.580892 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:11.610883 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:03:11.637598 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:03:11.687478 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:11.718984 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:03:11.747054 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:03:12.292852 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 18:03:12.298228 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.309237 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:12.353639 tst mo_mt_sms.py: using LAC 22755 18:03:12.479943 tst mo_mt_sms.py: using RAC 60 18:03:12.604250 tst mo_mt_sms.py: using CellId 22755 18:03:12.728822 tst mo_mt_sms.py: using BVCI 22756 18:03:12.846638 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.858083 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.869421 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.880683 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.891915 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:12.902994 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:03:13.017398 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:03:13.136231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:13.602522 run create_hlr_db(pid=31297): Launched 18:03:13.737067 bus /sierra_2: Setting Powered False 18:03:14.800712 run create_hlr_db(pid=31297): Terminated: ok {rc=0} 18:03:15.249537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Launched 18:03:15.572353 run osmo-hlr_10.42.42.2(pid=31300): Launched 18:03:15.694881 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:16.281180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Launched 18:03:16.613069 run osmo-stp_10.42.42.5(pid=31303): Launched 18:03:16.857526 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:17.519388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31305): Launched 18:03:17.844184 run osmo-msc_10.42.42.6(pid=31306): Launched 18:03:18.025493 run osmo-stp_10.42.42.5(pid=31303): ERR: Terminated: ERROR {rc=1} [trial-2362↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] 18:03:18.161530 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-09_18:03:16.553734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:18.297590 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221209180316846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180316846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180316846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180316847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180316847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180316847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180316847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:18.433089 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-09_18:03:16.553734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:18.561207 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221209180316846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180316846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180316846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180316847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180316847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180316847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180316847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:18.715414 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2362↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] [trial-2362↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 18:03:18.724503 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 18:03:18.752835 run osmo-hlr_10.42.42.2(pid=31300): ERR: Terminated: ERROR {rc=237} [trial-2362↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31300)] 18:03:18.803911 run osmo-hlr_10.42.42.2(pid=31300): stdout: | (launched: 2022-12-09_18:03:15.513445) 18:03:18.856641 run osmo-hlr_10.42.42.2(pid=31300): stderr: | 20221209180315711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180315711 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180315711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180315712 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180315712 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180315712 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180315725 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180315734 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180315734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180315734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:18.930245 run osmo-msc_10.42.42.6(pid=31306): ERR: Terminated: ERROR {rc=2} [trial-2362↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31306)] 18:03:18.981437 run osmo-msc_10.42.42.6(pid=31306): stdout: | (launched: 2022-12-09_18:03:17.784668) 18:03:19.033997 run osmo-msc_10.42.42.6(pid=31306): stderr: | 20221209180318109 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180318109 DLGLOBAL DEBUG validating counter group 0x7f294a2f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180318109 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180318109 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180318109 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180318110 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180318111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180318112 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180318112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180318112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:19.087030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminating (SIGTERM) 18:03:19.129274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminating (SIGTERM) 18:03:19.171548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31305): Terminating (SIGTERM) 18:03:19.214563 --- ParallelTerminationStrategy: PID 31299 died... 18:03:19.234927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminated: ok {rc=0} 18:03:19.282307 --- ParallelTerminationStrategy: PID 31302 died... 18:03:19.302331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminated: ok {rc=0} 18:03:19.349152 --- ParallelTerminationStrategy: PID 31305 died... 18:03:19.369146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31305): Terminated: ok {rc=0} 18:03:19.458857 bus /sierra_3: Setting Powered False 18:03:20.559322 bus /sierra_3: Setting Powered False 18:03:21.678930 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:22.907112 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:22.911192 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:22.943999 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 18:03:22.951166 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 18:03:22.988692 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:23.019085 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 18:03:23.025992 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 18:03:23.543172 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 18:03:23.548424 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 18:03:23.559715 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:23.606056 tst assert_extension.py: using LAC 22756 18:03:23.726692 tst assert_extension.py: using RAC 61 18:03:23.844764 tst assert_extension.py: using CellId 22756 18:03:23.962652 tst assert_extension.py: using BVCI 22757 18:03:24.073980 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 18:03:24.193396 tst assert_extension.py:10: start nitb and bts... 18:03:24.410439 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:03:25.068770 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31311): Launched 18:03:25.393152 run osmo-nitb_10.42.42.2(pid=31312): Launched 18:03:25.573129 run osmo-nitb_10.42.42.2(pid=31312): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31312)] 18:03:25.718083 run osmo-nitb_10.42.42.2(pid=31312): stdout: | (launched: 2022-12-09_18:03:25.333899) 18:03:25.864238 run osmo-nitb_10.42.42.2(pid=31312): stderr: | (launched: 2022-12-09_18:03:25.381768) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:26.010295 run osmo-nitb_10.42.42.2(pid=31312): stdout: | (launched: 2022-12-09_18:03:25.333899) 18:03:26.150351 run osmo-nitb_10.42.42.2(pid=31312): stderr: | (launched: 2022-12-09_18:03:25.381768) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31312): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31312) [trial-2362↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31312)] 18:03:26.519510 tst osmo-nitb_10.42.42.2(pid=31312): stdout: | (launched: 2022-12-09_18:03:25.333899) 18:03:26.649555 tst osmo-nitb_10.42.42.2(pid=31312): stderr: | (launched: 2022-12-09_18:03:25.381768) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:03:26.803218 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31312): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31312) [trial-2362↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31312)] [trial-2362↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 18:03:26.812389 tst assert_extension.py:12: Test FAILED (3.3 sec) 18:03:26.819892 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31311): Terminating (SIGTERM) 18:03:27.031918 --- ParallelTerminationStrategy: PID 31311 died... 18:03:27.054012 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31311): Terminated: ok {rc=0} 18:03:27.144013 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 18:03:28.320442 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:28.324452 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:03:28.354242 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:03:28.380899 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 18:03:28.415900 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:03:28.445208 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:03:28.471698 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 18:03:29.002050 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 18:03:29.007049 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:29.018001 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:03:29.062094 tst assert_extension.py: using LAC 22757 18:03:29.181638 tst assert_extension.py: using RAC 62 18:03:29.309540 tst assert_extension.py: using CellId 22757 18:03:29.434104 tst assert_extension.py: using BVCI 22758 18:03:29.544225 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:29.555063 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:29.565866 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:29.576682 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:29.587685 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:03:29.598535 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 18:03:29.712481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:30.179384 run create_hlr_db(pid=31316): Launched 18:03:30.294437 bus /sierra_2: Setting Powered False 18:03:31.354999 run create_hlr_db(pid=31316): Terminated: ok {rc=0} 18:03:31.788239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31318): Launched 18:03:32.109244 run osmo-hlr_10.42.42.2(pid=31319): Launched 18:03:32.258657 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:32.824570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31321): Launched 18:03:33.149360 run osmo-stp_10.42.42.5(pid=31322): Launched 18:03:33.273575 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:33.857393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31324): Launched 18:03:34.180472 run osmo-msc_10.42.42.6(pid=31325): Launched 18:03:34.361831 run osmo-stp_10.42.42.5(pid=31322): ERR: Terminated: ERROR {rc=1} [trial-2362↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31322)] 18:03:34.497437 run osmo-stp_10.42.42.5(pid=31322): stdout: | (launched: 2022-12-09_18:03:33.090136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:34.635140 run osmo-stp_10.42.42.5(pid=31322): stderr: | 20221209180333281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180333281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180333281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180333281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180333282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180333282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180333282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:34.770405 run osmo-stp_10.42.42.5(pid=31322): stdout: | (launched: 2022-12-09_18:03:33.090136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:34.898569 run osmo-stp_10.42.42.5(pid=31322): stderr: | 20221209180333281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180333281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180333281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180333281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180333282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180333282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180333282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:35.051987 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31322): Process ended prematurely: osmo-stp_10.42.42.5(pid=31322) [trial-2362↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31322)] [trial-2362↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 18:03:35.061158 tst assert_extension.py:17: Test FAILED (6.0 sec) 18:03:35.089750 run osmo-hlr_10.42.42.2(pid=31319): ERR: Terminated: ERROR {rc=237} [trial-2362↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31319)] 18:03:35.140630 run osmo-hlr_10.42.42.2(pid=31319): stdout: | (launched: 2022-12-09_18:03:32.053331) 18:03:35.193282 run osmo-hlr_10.42.42.2(pid=31319): stderr: | 20221209180332290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180332290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180332290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180332290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180332290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180332290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180332302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180332311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180332311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180332311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:35.266511 run osmo-msc_10.42.42.6(pid=31325): ERR: Terminated: ERROR {rc=2} [trial-2362↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31325)] 18:03:35.317223 run osmo-msc_10.42.42.6(pid=31325): stdout: | (launched: 2022-12-09_18:03:34.121223) 18:03:35.369413 run osmo-msc_10.42.42.6(pid=31325): stderr: | 20221209180334445 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180334445 DLGLOBAL DEBUG validating counter group 0x7f98d5988c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180334445 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180334445 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180334445 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180334446 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180334447 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180334448 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180334448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180334448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:35.422220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31318): Terminating (SIGTERM) 18:03:35.464386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31321): Terminating (SIGTERM) 18:03:35.506670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31324): Terminating (SIGTERM) 18:03:35.549421 --- ParallelTerminationStrategy: PID 31318 died... 18:03:35.569860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31318): Terminated: ok {rc=0} 18:03:35.617234 --- ParallelTerminationStrategy: PID 31321 died... 18:03:35.637535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31321): Terminated: ok {rc=0} 18:03:35.684221 --- ParallelTerminationStrategy: PID 31324 died... 18:03:35.704203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31324): Terminated: ok {rc=0} 18:03:35.793170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:03:37.005192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:37.011855 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:03:37.043072 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:03:37.070407 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:03:37.122765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:03:37.152797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:03:37.179531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:03:37.729841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:03:37.781524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:37.792921 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:03:37.860905 tst mo_mt_call.py: using LAC 22758 18:03:37.992559 tst mo_mt_call.py: using RAC 63 18:03:38.122492 tst mo_mt_call.py: using CellId 22758 18:03:38.254391 tst mo_mt_call.py: using BVCI 22759 18:03:38.375338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:38.387380 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:38.399272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:38.411242 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:38.423291 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:38.435056 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:38.553748 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:38.676000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:39.186825 run create_hlr_db(pid=31330): Launched 18:03:39.322214 bus /sierra_2: Setting Powered False 18:03:40.387307 run create_hlr_db(pid=31330): Terminated: ok {rc=0} 18:03:40.846386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31332): Launched 18:03:41.176403 run osmo-hlr_10.42.42.2(pid=31333): Launched 18:03:41.302046 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:41.871016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31335): Launched 18:03:42.201940 run osmo-stp_10.42.42.5(pid=31336): Launched 18:03:42.327612 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:42.920791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31338): Launched 18:03:43.251517 run osmo-msc_10.42.42.6(pid=31339): Launched 18:03:43.435981 run osmo-stp_10.42.42.5(pid=31336): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31336)] 18:03:43.574250 run osmo-stp_10.42.42.5(pid=31336): stdout: | (launched: 2022-12-09_18:03:42.141714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:43.713576 run osmo-stp_10.42.42.5(pid=31336): stderr: | 20221209180342338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180342338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180342339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180342339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180342339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180342339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180342339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:43.850951 run osmo-stp_10.42.42.5(pid=31336): stdout: | (launched: 2022-12-09_18:03:42.141714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:43.981070 run osmo-stp_10.42.42.5(pid=31336): stderr: | 20221209180342338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180342338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180342339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180342339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180342339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180342339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180342339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:44.136645 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31336): Process ended prematurely: osmo-stp_10.42.42.5(pid=31336) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31336)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:03:44.146431 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:03:44.174981 run osmo-hlr_10.42.42.2(pid=31333): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31333)] 18:03:44.225954 run osmo-hlr_10.42.42.2(pid=31333): stdout: | (launched: 2022-12-09_18:03:41.115771) 18:03:44.278876 run osmo-hlr_10.42.42.2(pid=31333): stderr: | 20221209180341316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180341316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180341316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180341316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180341316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180341316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180341329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180341337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180341337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180341337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:44.352403 run osmo-msc_10.42.42.6(pid=31339): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31339)] 18:03:44.402873 run osmo-msc_10.42.42.6(pid=31339): stdout: | (launched: 2022-12-09_18:03:43.191081) 18:03:44.455349 run osmo-msc_10.42.42.6(pid=31339): stderr: | 20221209180343515 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180343515 DLGLOBAL DEBUG validating counter group 0x7f2880554c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180343515 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180343515 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180343515 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180343516 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180343517 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180343518 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180343518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180343518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:44.507864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31332): Terminating (SIGTERM) 18:03:44.549863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31335): Terminating (SIGTERM) 18:03:44.592324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31338): Terminating (SIGTERM) 18:03:44.635423 --- ParallelTerminationStrategy: PID 31332 died... 18:03:44.655703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31332): Terminated: ok {rc=0} 18:03:44.702963 --- ParallelTerminationStrategy: PID 31335 died... 18:03:44.722964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31335): Terminated: ok {rc=0} 18:03:44.769698 --- ParallelTerminationStrategy: PID 31338 died... 18:03:44.789685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31338): Terminated: ok {rc=0} 18:03:44.878877 bus /sierra_3: Setting Powered False 18:03:45.991956 bus /sierra_3: Setting Powered False 18:03:47.119686 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:03:48.267084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:48.279350 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:03:48.346778 tst mo_mt_call_osmux.py: using LAC 22759 18:03:48.468557 tst mo_mt_call_osmux.py: using RAC 64 18:03:48.600005 tst mo_mt_call_osmux.py: using CellId 22759 18:03:48.728679 tst mo_mt_call_osmux.py: using BVCI 22760 18:03:48.849857 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:48.861703 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:48.873552 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:48.885410 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:48.897160 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:03:48.908718 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:49.027328 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:03:49.146220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:49.626024 run create_hlr_db(pid=31341): Launched 18:03:49.747568 bus /sierra_2: Setting Powered False 18:03:50.808263 run create_hlr_db(pid=31341): Terminated: ok {rc=0} 18:03:51.239571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31343): Launched 18:03:51.549337 run osmo-hlr_10.42.42.2(pid=31344): Launched 18:03:51.667440 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:52.211654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31346): Launched 18:03:52.521334 run osmo-stp_10.42.42.5(pid=31347): Launched 18:03:52.639250 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:53.202376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31349): Launched 18:03:53.514799 run osmo-msc_10.42.42.6(pid=31350): Launched 18:03:53.687412 run osmo-stp_10.42.42.5(pid=31347): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31347)] 18:03:53.818509 run osmo-stp_10.42.42.5(pid=31347): stdout: | (launched: 2022-12-09_18:03:52.464216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:53.949912 run osmo-stp_10.42.42.5(pid=31347): stderr: | 20221209180352638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180352638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180352638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180352638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180352639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180352639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180352639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:54.078456 run osmo-stp_10.42.42.5(pid=31347): stdout: | (launched: 2022-12-09_18:03:52.464216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:54.201224 run osmo-stp_10.42.42.5(pid=31347): stderr: | 20221209180352638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180352638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180352638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180352638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180352639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180352639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180352639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:54.347735 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31347): Process ended prematurely: osmo-stp_10.42.42.5(pid=31347) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31347)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:03:54.356841 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:03:54.384677 run osmo-hlr_10.42.42.2(pid=31344): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31344)] 18:03:54.433379 run osmo-hlr_10.42.42.2(pid=31344): stdout: | (launched: 2022-12-09_18:03:51.492289) 18:03:54.483977 run osmo-hlr_10.42.42.2(pid=31344): stderr: | 20221209180351674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180351674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180351675 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180351675 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180351675 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180351675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180351687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180351695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180351695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180351695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:54.554719 run osmo-msc_10.42.42.6(pid=31350): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31350)] 18:03:54.603533 run osmo-msc_10.42.42.6(pid=31350): stdout: | (launched: 2022-12-09_18:03:53.457187) 18:03:54.653680 run osmo-msc_10.42.42.6(pid=31350): stderr: | 20221209180353733 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180353733 DLGLOBAL DEBUG validating counter group 0x7f40e370dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180353733 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180353733 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180353733 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180353733 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180353735 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180353735 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180353736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180353736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:54.704520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31343): Terminating (SIGTERM) 18:03:54.745310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31346): Terminating (SIGTERM) 18:03:54.786126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31349): Terminating (SIGTERM) 18:03:54.827408 --- ParallelTerminationStrategy: PID 31343 died... 18:03:54.846693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31343): Terminated: ok {rc=0} 18:03:54.892387 --- ParallelTerminationStrategy: PID 31346 died... 18:03:54.911461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31346): Terminated: ok {rc=0} 18:03:54.956811 --- ParallelTerminationStrategy: PID 31349 died... 18:03:54.976209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31349): Terminated: ok {rc=0} 18:03:55.064241 bus /sierra_3: Setting Powered False 18:03:56.166429 bus /sierra_3: Setting Powered False 18:03:57.283492 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:03:58.530769 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:58.537442 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:03:58.566985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:03:58.594219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:03:58.646597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:03:58.676076 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:03:58.702973 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:03:59.254635 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:03:59.304694 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:59.316235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:03:59.381929 tst mo_mt_call.py: using LAC 22760 18:03:59.505243 tst mo_mt_call.py: using RAC 65 18:03:59.625377 tst mo_mt_call.py: using CellId 22760 18:03:59.749245 tst mo_mt_call.py: using BVCI 22761 18:03:59.860354 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:59.871723 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:59.882873 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:59.894457 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:59.906257 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:03:59.917774 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:04:00.032515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:04:00.152308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:00.663572 run create_hlr_db(pid=31355): Launched 18:04:00.798013 bus /sierra_2: Setting Powered False 18:04:01.875925 run create_hlr_db(pid=31355): Terminated: ok {rc=0} 18:04:02.330423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31357): Launched 18:04:02.642566 run osmo-hlr_10.42.42.2(pid=31358): Launched 18:04:02.763444 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:03.307838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31360): Launched 18:04:03.618326 run osmo-stp_10.42.42.5(pid=31361): Launched 18:04:03.739153 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:04.310039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31363): Launched 18:04:04.621074 run osmo-msc_10.42.42.6(pid=31364): Launched 18:04:04.793940 run osmo-stp_10.42.42.5(pid=31361): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31361)] 18:04:04.927172 run osmo-stp_10.42.42.5(pid=31361): stdout: | (launched: 2022-12-09_18:04:03.561263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:05.057705 run osmo-stp_10.42.42.5(pid=31361): stderr: | 20221209180403734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180403734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180403734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180403734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180403736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180403737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180403737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:05.186154 run osmo-stp_10.42.42.5(pid=31361): stdout: | (launched: 2022-12-09_18:04:03.561263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:05.308782 run osmo-stp_10.42.42.5(pid=31361): stderr: | 20221209180403734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180403734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180403734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180403734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180403736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180403737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180403737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:05.455525 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31361): Process ended prematurely: osmo-stp_10.42.42.5(pid=31361) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31361)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:04:05.464537 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:04:05.491755 run osmo-hlr_10.42.42.2(pid=31358): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31358)] 18:04:05.540628 run osmo-hlr_10.42.42.2(pid=31358): stdout: | (launched: 2022-12-09_18:04:02.585459) 18:04:05.591190 run osmo-hlr_10.42.42.2(pid=31358): stderr: | 20221209180402765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180402765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180402765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180402765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180402765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180402766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180402777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180402785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180402786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180402786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:05.661682 run osmo-msc_10.42.42.6(pid=31364): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31364)] 18:04:05.710384 run osmo-msc_10.42.42.6(pid=31364): stdout: | (launched: 2022-12-09_18:04:04.563897) 18:04:05.760765 run osmo-msc_10.42.42.6(pid=31364): stderr: | 20221209180404838 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180404839 DLGLOBAL DEBUG validating counter group 0x7f592197ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180404839 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180404839 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180404839 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180404839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180404841 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180404841 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180404842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180404842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:05.811334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31357): Terminating (SIGTERM) 18:04:05.851776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31360): Terminating (SIGTERM) 18:04:05.892226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31363): Terminating (SIGTERM) 18:04:05.933075 --- ParallelTerminationStrategy: PID 31357 died... 18:04:05.952405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31357): Terminated: ok {rc=0} 18:04:05.997463 --- ParallelTerminationStrategy: PID 31360 died... 18:04:06.016343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31360): Terminated: ok {rc=0} 18:04:06.061279 --- ParallelTerminationStrategy: PID 31363 died... 18:04:06.079906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31363): Terminated: ok {rc=0} 18:04:06.167440 bus /sierra_3: Setting Powered False 18:04:07.268843 bus /sierra_3: Setting Powered False 18:04:08.384494 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:04:09.535750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:09.548585 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:04:09.617178 tst mo_mt_call_osmux.py: using LAC 22761 18:04:09.746512 tst mo_mt_call_osmux.py: using RAC 66 18:04:09.877103 tst mo_mt_call_osmux.py: using CellId 22761 18:04:10.005100 tst mo_mt_call_osmux.py: using BVCI 22762 18:04:10.124223 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:10.136084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:10.147795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:10.159443 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:10.171086 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:04:10.182656 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:04:10.303372 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:04:10.420447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:10.899883 run create_hlr_db(pid=31367): Launched 18:04:11.018891 bus /sierra_2: Setting Powered False 18:04:12.080133 run create_hlr_db(pid=31367): Terminated: ok {rc=0} 18:04:12.510551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31369): Launched 18:04:12.821568 run osmo-hlr_10.42.42.2(pid=31370): Launched 18:04:12.939477 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:13.469666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31372): Launched 18:04:13.779797 run osmo-stp_10.42.42.5(pid=31373): Launched 18:04:13.898549 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:14.457256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31375): Launched 18:04:14.767943 run osmo-msc_10.42.42.6(pid=31376): Launched 18:04:14.940667 run osmo-stp_10.42.42.5(pid=31373): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31373)] 18:04:15.071344 run osmo-stp_10.42.42.5(pid=31373): stdout: | (launched: 2022-12-09_18:04:13.722825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:15.201836 run osmo-stp_10.42.42.5(pid=31373): stderr: | 20221209180413895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180413895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180413895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180413896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180413896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180413896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180413896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:15.331166 run osmo-stp_10.42.42.5(pid=31373): stdout: | (launched: 2022-12-09_18:04:13.722825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:15.453986 run osmo-stp_10.42.42.5(pid=31373): stderr: | 20221209180413895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180413895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180413895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180413896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180413896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180413896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180413896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:15.600494 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31373): Process ended prematurely: osmo-stp_10.42.42.5(pid=31373) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31373)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:04:15.609825 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:04:15.637642 run osmo-hlr_10.42.42.2(pid=31370): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31370)] 18:04:15.686239 run osmo-hlr_10.42.42.2(pid=31370): stdout: | (launched: 2022-12-09_18:04:12.764464) 18:04:15.736637 run osmo-hlr_10.42.42.2(pid=31370): stderr: | 20221209180412944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180412944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180412944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180412944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180412944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180412944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180413000 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180413009 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180413009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180413009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:15.806757 run osmo-msc_10.42.42.6(pid=31376): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31376)] 18:04:15.867103 run osmo-msc_10.42.42.6(pid=31376): stdout: | (launched: 2022-12-09_18:04:14.710960) 18:04:15.928258 run osmo-msc_10.42.42.6(pid=31376): stderr: | 20221209180414987 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180414987 DLGLOBAL DEBUG validating counter group 0x7fa6907a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180414987 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180414987 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180414987 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180414988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180414989 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180414990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180414990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180414990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:15.982619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31369): Terminating (SIGTERM) 18:04:16.024609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31372): Terminating (SIGTERM) 18:04:16.067968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31375): Terminating (SIGTERM) 18:04:16.110022 --- ParallelTerminationStrategy: PID 31369 died... 18:04:16.129693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31369): Terminated: ok {rc=0} 18:04:16.176247 --- ParallelTerminationStrategy: PID 31372 died... 18:04:16.195891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31372): Terminated: ok {rc=0} 18:04:16.242068 --- ParallelTerminationStrategy: PID 31375 died... 18:04:16.261692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31375): Terminated: ok {rc=0} 18:04:16.349666 bus /sierra_3: Setting Powered False 18:04:17.450288 bus /sierra_3: Setting Powered False 18:04:18.567026 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:04:19.819475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:04:19.826791 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:04:19.857163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:04:19.884563 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:04:19.939937 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:04:19.970439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:04:19.998019 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:04:20.549012 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:04:20.601775 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:20.613866 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:04:20.680449 tst mo_mt_call.py: using LAC 22762 18:04:20.802352 tst mo_mt_call.py: using RAC 67 18:04:20.925803 tst mo_mt_call.py: using CellId 22762 18:04:21.046748 tst mo_mt_call.py: using BVCI 22763 18:04:21.160602 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:21.172593 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:21.183905 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:21.195596 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:21.207625 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:21.219370 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:21.338177 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:21.456870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:21.968585 run create_hlr_db(pid=31381): Launched 18:04:22.104536 bus /sierra_2: Setting Powered False 18:04:23.170192 run create_hlr_db(pid=31381): Terminated: ok {rc=0} 18:04:23.613210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31383): Launched 18:04:23.924027 run osmo-hlr_10.42.42.2(pid=31384): Launched 18:04:24.042083 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:24.577061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31386): Launched 18:04:24.885680 run osmo-stp_10.42.42.5(pid=31387): Launched 18:04:25.003791 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:25.568413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31389): Launched 18:04:25.879342 run osmo-msc_10.42.42.6(pid=31390): Launched 18:04:26.052324 run osmo-stp_10.42.42.5(pid=31387): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31387)] 18:04:26.183972 run osmo-stp_10.42.42.5(pid=31387): stdout: | (launched: 2022-12-09_18:04:24.828844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:26.315202 run osmo-stp_10.42.42.5(pid=31387): stderr: | 20221209180425000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180425000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180425000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180425001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180425001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180425001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180425001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:26.444107 run osmo-stp_10.42.42.5(pid=31387): stdout: | (launched: 2022-12-09_18:04:24.828844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:26.567089 run osmo-stp_10.42.42.5(pid=31387): stderr: | 20221209180425000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180425000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180425000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180425001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180425001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180425001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180425001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:26.714497 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31387): Process ended prematurely: osmo-stp_10.42.42.5(pid=31387) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31387)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:04:26.723785 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:04:26.751603 run osmo-hlr_10.42.42.2(pid=31384): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31384)] 18:04:26.800424 run osmo-hlr_10.42.42.2(pid=31384): stdout: | (launched: 2022-12-09_18:04:23.866952) 18:04:26.851145 run osmo-hlr_10.42.42.2(pid=31384): stderr: | 20221209180424045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180424045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180424045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180424045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180424045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180424045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180424057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180424066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180424067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180424067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:26.922143 run osmo-msc_10.42.42.6(pid=31390): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31390)] 18:04:26.970863 run osmo-msc_10.42.42.6(pid=31390): stdout: | (launched: 2022-12-09_18:04:25.822088) 18:04:27.021261 run osmo-msc_10.42.42.6(pid=31390): stderr: | 20221209180426098 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180426098 DLGLOBAL DEBUG validating counter group 0x7f467326fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180426098 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180426098 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180426098 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180426098 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180426100 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180426101 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180426101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180426101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:27.072025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31383): Terminating (SIGTERM) 18:04:27.112895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31386): Terminating (SIGTERM) 18:04:27.154123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31389): Terminating (SIGTERM) 18:04:27.195583 --- ParallelTerminationStrategy: PID 31383 died... 18:04:27.215091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31383): Terminated: ok {rc=0} 18:04:27.260939 --- ParallelTerminationStrategy: PID 31386 died... 18:04:27.280375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31386): Terminated: ok {rc=0} 18:04:27.326531 --- ParallelTerminationStrategy: PID 31389 died... 18:04:27.345536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31389): Terminated: ok {rc=0} 18:04:27.432826 bus /sierra_3: Setting Powered False 18:04:28.537409 bus /sierra_3: Setting Powered False 18:04:29.654672 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:04:30.805699 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:30.818534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:04:30.891724 tst mo_mt_call_osmux.py: using LAC 22763 18:04:31.036840 tst mo_mt_call_osmux.py: using RAC 68 18:04:31.167435 tst mo_mt_call_osmux.py: using CellId 22763 18:04:31.297508 tst mo_mt_call_osmux.py: using BVCI 22764 18:04:31.449857 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:31.462737 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:31.475746 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:31.488199 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:31.500598 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:04:31.513856 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:31.637640 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:04:31.784556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:32.278358 run create_hlr_db(pid=31392): Launched 18:04:32.427252 bus /sierra_2: Setting Powered False 18:04:33.492396 run create_hlr_db(pid=31392): Terminated: ok {rc=0} 18:04:33.933341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31394): Launched 18:04:34.242323 run osmo-hlr_10.42.42.2(pid=31395): Launched 18:04:34.359695 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:34.903413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31397): Launched 18:04:35.214300 run osmo-stp_10.42.42.5(pid=31398): Launched 18:04:35.333150 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:35.891874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31400): Launched 18:04:36.202133 run osmo-msc_10.42.42.6(pid=31401): Launched 18:04:36.376692 run osmo-stp_10.42.42.5(pid=31398): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31398)] 18:04:36.507350 run osmo-stp_10.42.42.5(pid=31398): stdout: | (launched: 2022-12-09_18:04:35.157401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:36.637661 run osmo-stp_10.42.42.5(pid=31398): stderr: | 20221209180435329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180435329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180435329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180435330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180435330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180435330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180435330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:36.766265 run osmo-stp_10.42.42.5(pid=31398): stdout: | (launched: 2022-12-09_18:04:35.157401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:36.888323 run osmo-stp_10.42.42.5(pid=31398): stderr: | 20221209180435329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180435329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180435329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180435330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180435330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180435330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180435330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:37.034796 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31398): Process ended prematurely: osmo-stp_10.42.42.5(pid=31398) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31398)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:04:37.043846 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:04:37.071318 run osmo-hlr_10.42.42.2(pid=31395): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31395)] 18:04:37.119527 run osmo-hlr_10.42.42.2(pid=31395): stdout: | (launched: 2022-12-09_18:04:34.185245) 18:04:37.169641 run osmo-hlr_10.42.42.2(pid=31395): stderr: | 20221209180434362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180434362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180434362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180434362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180434362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180434362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180434374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180434383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180434384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180434384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:37.239229 run osmo-msc_10.42.42.6(pid=31401): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31401)] 18:04:37.287488 run osmo-msc_10.42.42.6(pid=31401): stdout: | (launched: 2022-12-09_18:04:36.144868) 18:04:37.337602 run osmo-msc_10.42.42.6(pid=31401): stderr: | 20221209180436418 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180436418 DLGLOBAL DEBUG validating counter group 0x7ff2fe369c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180436419 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180436419 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180436419 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180436419 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180436421 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180436421 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180436421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180436421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:37.387985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31394): Terminating (SIGTERM) 18:04:37.427997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31397): Terminating (SIGTERM) 18:04:37.468159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31400): Terminating (SIGTERM) 18:04:37.508603 --- ParallelTerminationStrategy: PID 31394 died... 18:04:37.528006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31394): Terminated: ok {rc=0} 18:04:37.573340 --- ParallelTerminationStrategy: PID 31397 died... 18:04:37.592269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31397): Terminated: ok {rc=0} 18:04:37.636761 --- ParallelTerminationStrategy: PID 31400 died... 18:04:37.655599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31400): Terminated: ok {rc=0} 18:04:37.742375 bus /sierra_3: Setting Powered False 18:04:38.842873 bus /sierra_3: Setting Powered False 18:04:39.956514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:04:41.210826 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:04:41.218377 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:04:41.249374 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:04:41.276829 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:04:41.331344 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:04:41.361753 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:04:41.389337 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:04:41.942009 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:04:41.994468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:42.006276 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:04:42.073341 tst mo_mt_call.py: using LAC 22764 18:04:42.201797 tst mo_mt_call.py: using RAC 69 18:04:42.330589 tst mo_mt_call.py: using CellId 22764 18:04:42.462480 tst mo_mt_call.py: using BVCI 22765 18:04:42.584346 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:42.596123 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:42.607761 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:42.619262 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:42.631015 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:42.642583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:04:42.761802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:04:42.879875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:43.390955 run create_hlr_db(pid=31406): Launched 18:04:43.524458 bus /sierra_2: Setting Powered False 18:04:44.585347 run create_hlr_db(pid=31406): Terminated: ok {rc=0} 18:04:45.047525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31408): Launched 18:04:45.378116 run osmo-hlr_10.42.42.2(pid=31409): Launched 18:04:45.504761 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:46.089678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31411): Launched 18:04:46.457747 run osmo-stp_10.42.42.5(pid=31412): Launched 18:04:46.702280 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:47.422432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31414): Launched 18:04:47.735091 run osmo-msc_10.42.42.6(pid=31415): Launched 18:04:47.907019 run osmo-stp_10.42.42.5(pid=31412): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31412)] 18:04:48.037496 run osmo-stp_10.42.42.5(pid=31412): stdout: | (launched: 2022-12-09_18:04:46.399444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:48.168431 run osmo-stp_10.42.42.5(pid=31412): stderr: | 20221209180446729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180446729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180446730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180446730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180446730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180446730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180446731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:48.297258 run osmo-stp_10.42.42.5(pid=31412): stdout: | (launched: 2022-12-09_18:04:46.399444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:48.419683 run osmo-stp_10.42.42.5(pid=31412): stderr: | 20221209180446729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180446729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180446730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180446730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180446730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180446730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180446731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:48.566661 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31412): Process ended prematurely: osmo-stp_10.42.42.5(pid=31412) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31412)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:04:48.575725 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:04:48.603360 run osmo-hlr_10.42.42.2(pid=31409): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31409)] 18:04:48.652046 run osmo-hlr_10.42.42.2(pid=31409): stdout: | (launched: 2022-12-09_18:04:45.317401) 18:04:48.702474 run osmo-hlr_10.42.42.2(pid=31409): stderr: | 20221209180445519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180445519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180445519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180445519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180445519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180445519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180445533 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180445541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180445542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180445542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:48.772778 run osmo-msc_10.42.42.6(pid=31415): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31415)] 18:04:48.821544 run osmo-msc_10.42.42.6(pid=31415): stdout: | (launched: 2022-12-09_18:04:47.677526) 18:04:48.872028 run osmo-msc_10.42.42.6(pid=31415): stderr: | 20221209180447952 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180447952 DLGLOBAL DEBUG validating counter group 0x7efd33d68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180447952 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180447952 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180447952 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180447953 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180447954 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180447955 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180447955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180447955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:48.922758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31408): Terminating (SIGTERM) 18:04:48.963343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31411): Terminating (SIGTERM) 18:04:49.003951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31414): Terminating (SIGTERM) 18:04:49.045023 --- ParallelTerminationStrategy: PID 31408 died... 18:04:49.064447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31408): Terminated: ok {rc=0} 18:04:49.109760 --- ParallelTerminationStrategy: PID 31411 died... 18:04:49.128603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31411): Terminated: ok {rc=0} 18:04:49.174069 --- ParallelTerminationStrategy: PID 31414 died... 18:04:49.193121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31414): Terminated: ok {rc=0} 18:04:49.280703 bus /sierra_3: Setting Powered False 18:04:50.380928 bus /sierra_3: Setting Powered False 18:04:51.494764 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:04:52.646723 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:52.659463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:04:52.729721 tst mo_mt_call_osmux.py: using LAC 22765 18:04:52.857725 tst mo_mt_call_osmux.py: using RAC 70 18:04:52.986495 tst mo_mt_call_osmux.py: using CellId 22765 18:04:53.115618 tst mo_mt_call_osmux.py: using BVCI 22766 18:04:53.236879 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:53.248867 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:53.260474 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:53.272211 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:53.284133 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:04:53.295846 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:04:53.415905 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:04:53.534783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:54.014562 run create_hlr_db(pid=31417): Launched 18:04:54.133301 bus /sierra_2: Setting Powered False 18:04:55.194428 run create_hlr_db(pid=31417): Terminated: ok {rc=0} 18:04:55.645075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31419): Launched 18:04:55.976621 run osmo-hlr_10.42.42.2(pid=31420): Launched 18:04:56.102228 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:56.670020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31422): Launched 18:04:57.002443 run osmo-stp_10.42.42.5(pid=31423): Launched 18:04:57.127813 run osmo-msc_10.42.42.6: Starting osmo-msc 18:04:57.724862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31425): Launched 18:04:58.055628 run osmo-msc_10.42.42.6(pid=31426): Launched 18:04:58.238793 run osmo-stp_10.42.42.5(pid=31423): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31423)] 18:04:58.376669 run osmo-stp_10.42.42.5(pid=31423): stdout: | (launched: 2022-12-09_18:04:56.941729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:58.514774 run osmo-stp_10.42.42.5(pid=31423): stderr: | 20221209180457137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180457137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180457137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180457138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180457138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180457138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180457138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:58.652765 run osmo-stp_10.42.42.5(pid=31423): stdout: | (launched: 2022-12-09_18:04:56.941729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:58.783602 run osmo-stp_10.42.42.5(pid=31423): stderr: | 20221209180457137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180457137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180457137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180457138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180457138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180457138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180457138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:58.940092 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31423): Process ended prematurely: osmo-stp_10.42.42.5(pid=31423) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31423)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:04:58.950050 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:04:58.978825 run osmo-hlr_10.42.42.2(pid=31420): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31420)] 18:04:59.029398 run osmo-hlr_10.42.42.2(pid=31420): stdout: | (launched: 2022-12-09_18:04:55.915679) 18:04:59.081755 run osmo-hlr_10.42.42.2(pid=31420): stderr: | 20221209180456116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180456116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180456116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180456116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180456116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180456116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180456128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180456137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180456137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180456137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:59.154519 run osmo-msc_10.42.42.6(pid=31426): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31426)] 18:04:59.204897 run osmo-msc_10.42.42.6(pid=31426): stdout: | (launched: 2022-12-09_18:04:57.994428) 18:04:59.257120 run osmo-msc_10.42.42.6(pid=31426): stderr: | 20221209180458317 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180458318 DLGLOBAL DEBUG validating counter group 0x7fcbf623cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180458318 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180458318 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180458318 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180458318 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180458320 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180458320 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180458320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180458320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:04:59.309899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31419): Terminating (SIGTERM) 18:04:59.351991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31422): Terminating (SIGTERM) 18:04:59.394314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31425): Terminating (SIGTERM) 18:04:59.436834 --- ParallelTerminationStrategy: PID 31419 died... 18:04:59.456844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31419): Terminated: ok {rc=0} 18:04:59.503673 --- ParallelTerminationStrategy: PID 31422 died... 18:04:59.523568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31422): Terminated: ok {rc=0} 18:04:59.570224 --- ParallelTerminationStrategy: PID 31425 died... 18:04:59.590116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31425): Terminated: ok {rc=0} 18:04:59.679156 bus /sierra_3: Setting Powered False 18:05:00.778225 bus /sierra_3: Setting Powered False 18:05:01.908143 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:05:03.163208 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:03.170001 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:05:03.200299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:05:03.226940 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:05:03.278919 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:05:03.308161 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:05:03.334411 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:05:03.891127 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:05:03.940746 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:03.952189 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:05:04.017683 tst mo_mt_call.py: using LAC 22766 18:05:04.140136 tst mo_mt_call.py: using RAC 71 18:05:04.273554 tst mo_mt_call.py: using CellId 22766 18:05:04.402972 tst mo_mt_call.py: using BVCI 22767 18:05:04.522583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:04.534806 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:04.546609 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:04.558594 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:04.570561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:04.582551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:05:04.699808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:05:04.820228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:05.331936 run create_hlr_db(pid=31435): Launched 18:05:05.466159 bus /sierra_2: Setting Powered False 18:05:06.531484 run create_hlr_db(pid=31435): Terminated: ok {rc=0} 18:05:06.991637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31437): Launched 18:05:07.322351 run osmo-hlr_10.42.42.2(pid=31438): Launched 18:05:07.447542 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:08.021183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31440): Launched 18:05:08.351540 run osmo-stp_10.42.42.5(pid=31441): Launched 18:05:08.476210 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:09.072659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31443): Launched 18:05:09.403555 run osmo-msc_10.42.42.6(pid=31444): Launched 18:05:09.586573 run osmo-stp_10.42.42.5(pid=31441): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31441)] 18:05:09.725883 run osmo-stp_10.42.42.5(pid=31441): stdout: | (launched: 2022-12-09_18:05:08.290508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:09.865528 run osmo-stp_10.42.42.5(pid=31441): stderr: | 20221209180508485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180508485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180508485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180508485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180508486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180508486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180508486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:10.003034 run osmo-stp_10.42.42.5(pid=31441): stdout: | (launched: 2022-12-09_18:05:08.290508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:10.133181 run osmo-stp_10.42.42.5(pid=31441): stderr: | 20221209180508485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180508485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180508485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180508485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180508486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180508486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180508486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:10.289005 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31441): Process ended prematurely: osmo-stp_10.42.42.5(pid=31441) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31441)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:05:10.298796 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:05:10.327067 run osmo-hlr_10.42.42.2(pid=31438): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31438)] 18:05:10.377617 run osmo-hlr_10.42.42.2(pid=31438): stdout: | (launched: 2022-12-09_18:05:07.261465) 18:05:10.430047 run osmo-hlr_10.42.42.2(pid=31438): stderr: | 20221209180507460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180507460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180507460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180507460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180507460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180507460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180507472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180507481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180507482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180507482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:10.503325 run osmo-msc_10.42.42.6(pid=31444): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31444)] 18:05:10.553762 run osmo-msc_10.42.42.6(pid=31444): stdout: | (launched: 2022-12-09_18:05:09.342575) 18:05:10.606019 run osmo-msc_10.42.42.6(pid=31444): stderr: | 20221209180509666 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180509666 DLGLOBAL DEBUG validating counter group 0x7f67b1b1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180509666 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180509666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180509666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180509667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180509668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180509669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180509669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180509669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:10.658792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31437): Terminating (SIGTERM) 18:05:10.701485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31440): Terminating (SIGTERM) 18:05:10.743837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31443): Terminating (SIGTERM) 18:05:10.786611 --- ParallelTerminationStrategy: PID 31437 died... 18:05:10.806418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31437): Terminated: ok {rc=0} 18:05:10.853190 --- ParallelTerminationStrategy: PID 31440 died... 18:05:10.873041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31440): Terminated: ok {rc=0} 18:05:10.919532 --- ParallelTerminationStrategy: PID 31443 died... 18:05:10.939260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31443): Terminated: ok {rc=0} 18:05:11.027682 bus /sierra_3: Setting Powered False 18:05:12.128254 bus /sierra_3: Setting Powered False 18:05:13.245282 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:05:14.396057 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:14.408700 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:05:14.476864 tst mo_mt_call_osmux.py: using LAC 22767 18:05:14.605700 tst mo_mt_call_osmux.py: using RAC 72 18:05:14.734614 tst mo_mt_call_osmux.py: using CellId 22767 18:05:14.863876 tst mo_mt_call_osmux.py: using BVCI 22768 18:05:14.976757 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:14.988401 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:14.999862 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:15.011561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:15.023186 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:05:15.034731 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:05:15.150262 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:05:15.268591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:15.746961 run create_hlr_db(pid=31446): Launched 18:05:15.882893 bus /sierra_2: Setting Powered False 18:05:16.943091 run create_hlr_db(pid=31446): Terminated: ok {rc=0} 18:05:17.388748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31448): Launched 18:05:17.699256 run osmo-hlr_10.42.42.2(pid=31449): Launched 18:05:17.816803 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:18.364527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31451): Launched 18:05:18.674764 run osmo-stp_10.42.42.5(pid=31452): Launched 18:05:18.792126 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:19.350993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31454): Launched 18:05:19.661435 run osmo-msc_10.42.42.6(pid=31455): Launched 18:05:19.834829 run osmo-stp_10.42.42.5(pid=31452): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31452)] 18:05:19.966229 run osmo-stp_10.42.42.5(pid=31452): stdout: | (launched: 2022-12-09_18:05:18.617068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:20.097109 run osmo-stp_10.42.42.5(pid=31452): stderr: | 20221209180518789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180518789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180518789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180518790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180518790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180518790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180518790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:20.226355 run osmo-stp_10.42.42.5(pid=31452): stdout: | (launched: 2022-12-09_18:05:18.617068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:20.348460 run osmo-stp_10.42.42.5(pid=31452): stderr: | 20221209180518789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180518789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180518789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180518790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180518790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180518790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180518790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:20.495113 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31452): Process ended prematurely: osmo-stp_10.42.42.5(pid=31452) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31452)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:05:20.504294 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:05:20.531910 run osmo-hlr_10.42.42.2(pid=31449): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31449)] 18:05:20.580212 run osmo-hlr_10.42.42.2(pid=31449): stdout: | (launched: 2022-12-09_18:05:17.641677) 18:05:20.630147 run osmo-hlr_10.42.42.2(pid=31449): stderr: | 20221209180517822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180517822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180517822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180517822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180517822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180517822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180517834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180517844 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180517844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180517844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:20.700055 run osmo-msc_10.42.42.6(pid=31455): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31455)] 18:05:20.748118 run osmo-msc_10.42.42.6(pid=31455): stdout: | (launched: 2022-12-09_18:05:19.603563) 18:05:20.798004 run osmo-msc_10.42.42.6(pid=31455): stderr: | 20221209180519878 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180519878 DLGLOBAL DEBUG validating counter group 0x7f82612aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180519878 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180519878 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180519879 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180519879 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180519883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180519883 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180519884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180519884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:20.848343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31448): Terminating (SIGTERM) 18:05:20.888580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31451): Terminating (SIGTERM) 18:05:20.928902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31454): Terminating (SIGTERM) 18:05:20.969560 --- ParallelTerminationStrategy: PID 31448 died... 18:05:20.988861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31448): Terminated: ok {rc=0} 18:05:21.033603 --- ParallelTerminationStrategy: PID 31451 died... 18:05:21.052120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31451): Terminated: ok {rc=0} 18:05:21.096913 --- ParallelTerminationStrategy: PID 31454 died... 18:05:21.115890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31454): Terminated: ok {rc=0} 18:05:21.200348 bus /sierra_3: Setting Powered False 18:05:22.299073 bus /sierra_3: Setting Powered False 18:05:23.419059 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:05:24.666520 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:24.673149 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:05:24.702519 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:05:24.729769 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:05:24.782658 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:05:24.813202 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:05:24.840745 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:05:25.392723 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:05:25.445686 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:25.457741 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:05:25.525713 tst mo_mt_call.py: using LAC 22768 18:05:25.656455 tst mo_mt_call.py: using RAC 73 18:05:25.785883 tst mo_mt_call.py: using CellId 22768 18:05:25.914449 tst mo_mt_call.py: using BVCI 22769 18:05:26.035798 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:26.047668 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:26.059214 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:26.071137 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:26.083096 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:26.094994 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:26.211679 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:26.329297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:26.808233 run create_hlr_db(pid=31460): Launched 18:05:26.926231 bus /sierra_2: Setting Powered False 18:05:27.987926 run create_hlr_db(pid=31460): Terminated: ok {rc=0} 18:05:28.437903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31462): Launched 18:05:28.767636 run osmo-hlr_10.42.42.2(pid=31463): Launched 18:05:28.892798 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:29.463436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31465): Launched 18:05:29.794065 run osmo-stp_10.42.42.5(pid=31466): Launched 18:05:29.921031 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:30.517776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31468): Launched 18:05:30.853718 run osmo-msc_10.42.42.6(pid=31469): Launched 18:05:31.256851 run osmo-stp_10.42.42.5(pid=31466): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31466)] 18:05:31.623833 run osmo-stp_10.42.42.5(pid=31466): stdout: | (launched: 2022-12-09_18:05:29.733108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:31.759508 run osmo-stp_10.42.42.5(pid=31466): stderr: | 20221209180529928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180529928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180529928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180529929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180529931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180529931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180529931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:31.896238 run osmo-stp_10.42.42.5(pid=31466): stdout: | (launched: 2022-12-09_18:05:29.733108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:32.024845 run osmo-stp_10.42.42.5(pid=31466): stderr: | 20221209180529928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180529928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180529928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180529929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180529931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180529931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180529931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:32.179185 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31466): Process ended prematurely: osmo-stp_10.42.42.5(pid=31466) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31466)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:05:32.189436 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 18:05:32.220471 run osmo-hlr_10.42.42.2(pid=31463): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31463)] 18:05:32.272804 run osmo-hlr_10.42.42.2(pid=31463): stdout: | (launched: 2022-12-09_18:05:28.706886) 18:05:32.327812 run osmo-hlr_10.42.42.2(pid=31463): stderr: | 20221209180528905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180528906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180528906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180528906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180528906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180528906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180528919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180528930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180528930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180528930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:32.401169 run osmo-msc_10.42.42.6(pid=31469): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31469)] 18:05:32.450239 run osmo-msc_10.42.42.6(pid=31469): stdout: | (launched: 2022-12-09_18:05:30.787291) 18:05:32.500898 run osmo-msc_10.42.42.6(pid=31469): stderr: | 20221209180531310 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180531310 DLGLOBAL DEBUG validating counter group 0x7f911145cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180531310 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180531310 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180531310 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180531310 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180531312 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180531312 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180531313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180531313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:32.552195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31462): Terminating (SIGTERM) 18:05:32.593467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31465): Terminating (SIGTERM) 18:05:32.634363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31468): Terminating (SIGTERM) 18:05:32.675503 --- ParallelTerminationStrategy: PID 31462 died... 18:05:32.694764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31462): Terminated: ok {rc=0} 18:05:32.740006 --- ParallelTerminationStrategy: PID 31465 died... 18:05:32.758886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31465): Terminated: ok {rc=0} 18:05:32.804218 --- ParallelTerminationStrategy: PID 31468 died... 18:05:32.823380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31468): Terminated: ok {rc=0} 18:05:32.909078 bus /sierra_3: Setting Powered False 18:05:34.009192 bus /sierra_3: Setting Powered False 18:05:35.128494 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:05:36.276512 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:36.288743 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:05:36.355449 tst mo_mt_call_osmux.py: using LAC 22769 18:05:36.478476 tst mo_mt_call_osmux.py: using RAC 74 18:05:36.601227 tst mo_mt_call_osmux.py: using CellId 22769 18:05:36.722196 tst mo_mt_call_osmux.py: using BVCI 22770 18:05:36.834116 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:36.845614 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:36.856901 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:36.868408 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:36.880031 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:05:36.891426 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:37.012440 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:05:37.130092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:37.608586 run create_hlr_db(pid=31471): Launched 18:05:37.726603 bus /sierra_2: Setting Powered False 18:05:38.788203 run create_hlr_db(pid=31471): Terminated: ok {rc=0} 18:05:39.239495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Launched 18:05:39.570940 run osmo-hlr_10.42.42.2(pid=31474): Launched 18:05:39.697626 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:40.269943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Launched 18:05:40.601019 run osmo-stp_10.42.42.5(pid=31477): Launched 18:05:40.727066 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:41.323549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31479): Launched 18:05:41.653481 run osmo-msc_10.42.42.6(pid=31480): Launched 18:05:41.836344 run osmo-stp_10.42.42.5(pid=31477): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] 18:05:41.974573 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-09_18:05:40.539682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:42.114216 run osmo-stp_10.42.42.5(pid=31477): stderr: | 20221209180540737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180540737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180540737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180540738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180540738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180540738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180540738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:42.252430 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-09_18:05:40.539682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:42.383244 run osmo-stp_10.42.42.5(pid=31477): stderr: | 20221209180540737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180540737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180540737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180540738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180540738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180540738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180540738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:42.539622 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:05:42.549685 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:05:42.578943 run osmo-hlr_10.42.42.2(pid=31474): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31474)] 18:05:42.629954 run osmo-hlr_10.42.42.2(pid=31474): stdout: | (launched: 2022-12-09_18:05:39.509686) 18:05:42.682752 run osmo-hlr_10.42.42.2(pid=31474): stderr: | 20221209180539708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180539708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180539708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180539709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180539709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180539709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180539721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180539732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180539733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180539733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:42.756659 run osmo-msc_10.42.42.6(pid=31480): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31480)] 18:05:42.807707 run osmo-msc_10.42.42.6(pid=31480): stdout: | (launched: 2022-12-09_18:05:41.592400) 18:05:42.860078 run osmo-msc_10.42.42.6(pid=31480): stderr: | 20221209180541919 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180541919 DLGLOBAL DEBUG validating counter group 0x7f5b31751c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180541919 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180541920 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180541920 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180541920 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180541922 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180541922 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180541923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180541923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:42.912752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminating (SIGTERM) 18:05:42.955209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminating (SIGTERM) 18:05:42.997676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31479): Terminating (SIGTERM) 18:05:43.040653 --- ParallelTerminationStrategy: PID 31473 died... 18:05:43.060919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminated: ok {rc=0} 18:05:43.107774 --- ParallelTerminationStrategy: PID 31476 died... 18:05:43.127644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminated: ok {rc=0} 18:05:43.174138 --- ParallelTerminationStrategy: PID 31479 died... 18:05:43.193919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31479): Terminated: ok {rc=0} 18:05:43.282544 bus /sierra_3: Setting Powered False 18:05:44.382243 bus /sierra_3: Setting Powered False 18:05:45.498667 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:05:46.774222 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:46.785235 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:05:46.825982 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:05:46.862621 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:05:46.926376 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:05:46.959668 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:05:46.988514 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:05:47.536501 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:05:47.589961 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:47.601654 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:05:47.670292 tst mo_mt_call.py: using LAC 22770 18:05:47.803481 tst mo_mt_call.py: using RAC 75 18:05:47.934272 tst mo_mt_call.py: using CellId 22770 18:05:48.064608 tst mo_mt_call.py: using BVCI 22771 18:05:48.185233 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:48.196873 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:48.208323 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:48.220164 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:48.232074 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:48.243890 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:05:48.363073 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:05:48.484224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:48.997034 run create_hlr_db(pid=31485): Launched 18:05:49.130650 bus /sierra_2: Setting Powered False 18:05:50.195620 run create_hlr_db(pid=31485): Terminated: ok {rc=0} 18:05:50.637604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31487): Launched 18:05:50.948771 run osmo-hlr_10.42.42.2(pid=31488): Launched 18:05:51.066265 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:51.615191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31490): Launched 18:05:51.926676 run osmo-stp_10.42.42.5(pid=31491): Launched 18:05:52.044759 run osmo-msc_10.42.42.6: Starting osmo-msc 18:05:52.639177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31493): Launched 18:05:52.971441 run osmo-msc_10.42.42.6(pid=31494): Launched 18:05:53.155125 run osmo-stp_10.42.42.5(pid=31491): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31491)] 18:05:53.292791 run osmo-stp_10.42.42.5(pid=31491): stdout: | (launched: 2022-12-09_18:05:51.868931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:53.431871 run osmo-stp_10.42.42.5(pid=31491): stderr: | 20221209180552039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180552039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180552040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180552040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180552043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180552043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180552043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:53.570074 run osmo-stp_10.42.42.5(pid=31491): stdout: | (launched: 2022-12-09_18:05:51.868931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:53.701229 run osmo-stp_10.42.42.5(pid=31491): stderr: | 20221209180552039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180552039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180552040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180552040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180552043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180552043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180552043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:53.858186 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31491): Process ended prematurely: osmo-stp_10.42.42.5(pid=31491) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31491)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:05:53.868037 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:05:53.896358 run osmo-hlr_10.42.42.2(pid=31488): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31488)] 18:05:53.946944 run osmo-hlr_10.42.42.2(pid=31488): stdout: | (launched: 2022-12-09_18:05:50.891246) 18:05:53.999253 run osmo-hlr_10.42.42.2(pid=31488): stderr: | 20221209180551067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180551067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180551067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180551067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180551067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180551067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180551079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180551087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180551088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180551088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:54.072335 run osmo-msc_10.42.42.6(pid=31494): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31494)] 18:05:54.123735 run osmo-msc_10.42.42.6(pid=31494): stdout: | (launched: 2022-12-09_18:05:52.910131) 18:05:54.176625 run osmo-msc_10.42.42.6(pid=31494): stderr: | 20221209180553235 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180553235 DLGLOBAL DEBUG validating counter group 0x7fcde5995c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180553236 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180553236 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180553236 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180553236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180553238 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180553238 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180553238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180553238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:05:54.229496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31487): Terminating (SIGTERM) 18:05:54.271767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31490): Terminating (SIGTERM) 18:05:54.314276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31493): Terminating (SIGTERM) 18:05:54.356879 --- ParallelTerminationStrategy: PID 31487 died... 18:05:54.377326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31487): Terminated: ok {rc=0} 18:05:54.423907 --- ParallelTerminationStrategy: PID 31490 died... 18:05:54.443872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31490): Terminated: ok {rc=0} 18:05:54.490549 --- ParallelTerminationStrategy: PID 31493 died... 18:05:54.510574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31493): Terminated: ok {rc=0} 18:05:54.599686 bus /sierra_3: Setting Powered False 18:05:55.698736 bus /sierra_3: Setting Powered False 18:05:56.816745 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:05:57.971113 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:57.983815 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:05:58.052895 tst mo_mt_call_osmux.py: using LAC 22771 18:05:58.181574 tst mo_mt_call_osmux.py: using RAC 76 18:05:58.310820 tst mo_mt_call_osmux.py: using CellId 22771 18:05:58.439919 tst mo_mt_call_osmux.py: using BVCI 22772 18:05:58.560216 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:58.572058 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:58.583538 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:58.595017 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:58.606599 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:05:58.618045 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:05:58.739903 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:05:58.860592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:59.371778 run create_hlr_db(pid=31496): Launched 18:05:59.505392 bus /sierra_2: Setting Powered False 18:06:00.571031 run create_hlr_db(pid=31496): Terminated: ok {rc=0} 18:06:01.049475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31498): Launched 18:06:01.428230 run osmo-hlr_10.42.42.2(pid=31499): Launched 18:06:01.601249 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:02.445615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31501): Launched 18:06:02.779058 run osmo-stp_10.42.42.5(pid=31502): Launched 18:06:02.904375 run osmo-msc_10.42.42.6: Starting osmo-msc 18:06:03.500200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31504): Launched 18:06:03.831924 run osmo-msc_10.42.42.6(pid=31505): Launched 18:06:04.014940 run osmo-stp_10.42.42.5(pid=31502): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31502)] 18:06:04.152546 run osmo-stp_10.42.42.5(pid=31502): stdout: | (launched: 2022-12-09_18:06:02.717845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:04.291334 run osmo-stp_10.42.42.5(pid=31502): stderr: | 20221209180602912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180602912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180602912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180602913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180602913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180602913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180602913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:04.428909 run osmo-stp_10.42.42.5(pid=31502): stdout: | (launched: 2022-12-09_18:06:02.717845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:04.559696 run osmo-stp_10.42.42.5(pid=31502): stderr: | 20221209180602912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180602912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180602912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180602913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180602913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180602913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180602913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:04.716450 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31502): Process ended prematurely: osmo-stp_10.42.42.5(pid=31502) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31502)] [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:06:04.726466 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 18:06:04.754645 run osmo-hlr_10.42.42.2(pid=31499): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31499)] 18:06:04.804776 run osmo-hlr_10.42.42.2(pid=31499): stdout: | (launched: 2022-12-09_18:06:01.355828) 18:06:04.857078 run osmo-hlr_10.42.42.2(pid=31499): stderr: | 20221209180601778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180601778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180601778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180601778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180601778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180601778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180601792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180601814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180601815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180601815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:04.929557 run osmo-msc_10.42.42.6(pid=31505): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31505)] 18:06:04.979542 run osmo-msc_10.42.42.6(pid=31505): stdout: | (launched: 2022-12-09_18:06:03.771059) 18:06:05.031355 run osmo-msc_10.42.42.6(pid=31505): stderr: | 20221209180604098 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180604098 DLGLOBAL DEBUG validating counter group 0x7fdb37b91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180604098 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180604098 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180604098 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180604099 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180604100 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180604101 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180604101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180604101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:06:05.083619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31498): Terminating (SIGTERM) 18:06:05.125475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31501): Terminating (SIGTERM) 18:06:05.167495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31504): Terminating (SIGTERM) 18:06:05.210105 --- ParallelTerminationStrategy: PID 31498 died... 18:06:05.230393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31498): Terminated: ok {rc=0} 18:06:05.277262 --- ParallelTerminationStrategy: PID 31501 died... 18:06:05.296838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31501): Terminated: ok {rc=0} 18:06:05.343621 --- ParallelTerminationStrategy: PID 31504 died... 18:06:05.363403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31504): Terminated: ok {rc=0} 18:06:05.450769 bus /sierra_3: Setting Powered False 18:06:06.550630 bus /sierra_3: Setting Powered False 18:06:07.666526 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 18:06:08.915938 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:06:08.921473 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:06:08.952213 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:06:08.978930 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 18:06:09.063380 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:06:09.092518 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:06:09.118844 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 18:06:09.703100 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2362 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 18:06:09.708269 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:09.719353 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:09.767547 tst emergency_mo_mt_call.py: using LAC 22772 18:06:09.883973 tst emergency_mo_mt_call.py: using RAC 77 18:06:10.000204 tst emergency_mo_mt_call.py: using CellId 22772 18:06:10.116165 tst emergency_mo_mt_call.py: using BVCI 22773 18:06:10.224679 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:10.235651 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:10.246392 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:10.257348 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:10.268245 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:10.279068 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:10.397980 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:10.518952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:11.022473 run create_hlr_db(pid=31510): Launched 18:06:11.154817 bus /sierra_2: Setting Powered False 18:06:12.219269 run create_hlr_db(pid=31510): Terminated: ok {rc=0} 18:06:12.654288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31512): Launched 18:06:12.959273 run osmo-hlr_10.42.42.2(pid=31513): Launched 18:06:13.075373 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:13.601281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31515): Launched 18:06:13.903924 run osmo-stp_10.42.42.5(pid=31516): Launched 18:06:14.029163 tst emergency_mo_mt_call.py: using MSISDN 7304 18:06:14.200869 run osmo-msc_10.42.42.6: Starting osmo-msc 18:06:14.750066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31518): Launched 18:06:15.054144 run osmo-msc_10.42.42.6(pid=31519): Launched 18:06:15.223502 run osmo-stp_10.42.42.5(pid=31516): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31516)] 18:06:15.351508 run osmo-stp_10.42.42.5(pid=31516): stdout: | (launched: 2022-12-09_18:06:13.847209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:15.479314 run osmo-stp_10.42.42.5(pid=31516): stderr: | 20221209180614019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180614020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180614020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180614020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180614022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180614022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180614022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:15.604877 run osmo-stp_10.42.42.5(pid=31516): stdout: | (launched: 2022-12-09_18:06:13.847209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:15.724450 run osmo-stp_10.42.42.5(pid=31516): stderr: | 20221209180614019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180614020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180614020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180614020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180614022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180614022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180614022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:15.902001 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31516): Process ended prematurely: osmo-stp_10.42.42.5(pid=31516) [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31516)] [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 18:06:15.910870 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 18:06:15.939337 run osmo-hlr_10.42.42.2(pid=31513): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31513)] 18:06:15.997300 run osmo-hlr_10.42.42.2(pid=31513): stdout: | (launched: 2022-12-09_18:06:12.902283) 18:06:16.055108 run osmo-hlr_10.42.42.2(pid=31513): stderr: | 20221209180613080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180613080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180613080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180613080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180613080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180613080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180613091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180613101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180613101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180613101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:16.128518 run osmo-msc_10.42.42.6(pid=31519): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31519)] 18:06:16.179562 run osmo-msc_10.42.42.6(pid=31519): stdout: | (launched: 2022-12-09_18:06:14.997404) 18:06:16.231975 run osmo-msc_10.42.42.6(pid=31519): stderr: | 20221209180615271 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180615271 DLGLOBAL DEBUG validating counter group 0x7f12c3366c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180615271 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180615271 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180615272 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180615272 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180615274 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180615275 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180615275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180615275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:06:16.285242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31512): Terminating (SIGTERM) 18:06:16.328187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31515): Terminating (SIGTERM) 18:06:16.371259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31518): Terminating (SIGTERM) 18:06:16.414373 --- ParallelTerminationStrategy: PID 31512 died... 18:06:16.434404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31512): Terminated: ok {rc=0} 18:06:16.481946 --- ParallelTerminationStrategy: PID 31515 died... 18:06:16.502090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31515): Terminated: ok {rc=0} 18:06:16.549657 --- ParallelTerminationStrategy: PID 31518 died... 18:06:16.569794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31518): Terminated: ok {rc=0} 18:06:16.659487 bus /sierra_3: Setting Powered False 18:06:17.759078 bus /sierra_3: Setting Powered False 18:06:18.875438 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 18:06:19.965335 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:19.977793 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:20.026257 tst emergency_preemptive_call.py: using LAC 22773 18:06:20.145116 tst emergency_preemptive_call.py: using RAC 78 18:06:20.262634 tst emergency_preemptive_call.py: using CellId 22773 18:06:20.382544 tst emergency_preemptive_call.py: using BVCI 22774 18:06:20.493738 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:20.504701 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:20.515507 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:20.526535 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:20.537604 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:06:20.549285 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:20.669382 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:20.786192 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:20.905874 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:21.023123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:21.526590 run create_hlr_db(pid=31521): Launched 18:06:21.658806 bus /sierra_2: Setting Powered False 18:06:22.723409 run create_hlr_db(pid=31521): Terminated: ok {rc=0} 18:06:23.158617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31523): Launched 18:06:23.463835 run osmo-hlr_10.42.42.2(pid=31524): Launched 18:06:23.579255 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:24.114173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31526): Launched 18:06:24.417641 run osmo-stp_10.42.42.5(pid=31527): Launched 18:06:24.542830 tst emergency_preemptive_call.py: using MSISDN 7305 18:06:24.706898 run osmo-msc_10.42.42.6: Starting osmo-msc 18:06:25.289528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31529): Launched 18:06:25.613288 run osmo-msc_10.42.42.6(pid=31530): Launched 18:06:25.793855 run osmo-stp_10.42.42.5(pid=31527): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31527)] 18:06:25.929715 run osmo-stp_10.42.42.5(pid=31527): stdout: | (launched: 2022-12-09_18:06:24.360491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:26.066683 run osmo-stp_10.42.42.5(pid=31527): stderr: | 20221209180624533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180624533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180624533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180624533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180624534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180624534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180624534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:26.202421 run osmo-stp_10.42.42.5(pid=31527): stdout: | (launched: 2022-12-09_18:06:24.360491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:26.330772 run osmo-stp_10.42.42.5(pid=31527): stderr: | 20221209180624533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180624533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180624533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180624533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180624534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180624534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180624534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:26.485117 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31527): Process ended prematurely: osmo-stp_10.42.42.5(pid=31527) [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31527)] [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 18:06:26.494255 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 18:06:26.522202 run osmo-hlr_10.42.42.2(pid=31524): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31524)] 18:06:26.572466 run osmo-hlr_10.42.42.2(pid=31524): stdout: | (launched: 2022-12-09_18:06:23.406701) 18:06:26.624789 run osmo-hlr_10.42.42.2(pid=31524): stderr: | 20221209180623587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180623587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180623587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180623587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180623587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180623587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180623610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180623620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180623620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180623621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:26.697643 run osmo-msc_10.42.42.6(pid=31530): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31530)] 18:06:26.748136 run osmo-msc_10.42.42.6(pid=31530): stdout: | (launched: 2022-12-09_18:06:25.553299) 18:06:26.800395 run osmo-msc_10.42.42.6(pid=31530): stderr: | 20221209180625877 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209180625878 DLGLOBAL DEBUG validating counter group 0x7f8cf42c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209180625878 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209180625878 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209180625878 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209180625878 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209180625880 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209180625880 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209180625881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209180625881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:06:26.853046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31523): Terminating (SIGTERM) 18:06:26.895086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31526): Terminating (SIGTERM) 18:06:26.937396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31529): Terminating (SIGTERM) 18:06:26.979991 --- ParallelTerminationStrategy: PID 31523 died... 18:06:27.000314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31523): Terminated: ok {rc=0} 18:06:27.047206 --- ParallelTerminationStrategy: PID 31526 died... 18:06:27.067034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31526): Terminated: ok {rc=0} 18:06:27.113610 --- ParallelTerminationStrategy: PID 31529 died... 18:06:27.133302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31529): Terminated: ok {rc=0} 18:06:27.221427 bus /sierra_9: Setting Powered False 18:06:28.321221 bus /sierra_9: Setting Powered False 18:06:29.439626 bus /sierra_8: Setting Powered False 18:06:30.539250 bus /sierra_8: Setting Powered False 18:06:31.652258 bus /sierra_3: Setting Powered False 18:06:32.750882 bus /sierra_3: Setting Powered False 18:06:33.868592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 18:06:35.145755 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:06:35.150340 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:06:35.180525 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 18:06:35.219401 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 18:06:35.306117 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:06:35.335651 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 18:06:35.374139 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 18:06:35.964748 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 18:06:36.016051 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:36.027132 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:36.072165 tst cs_paging_gprs_active.py: using LAC 22774 18:06:36.194345 tst cs_paging_gprs_active.py: using RAC 79 18:06:36.314588 tst cs_paging_gprs_active.py: using CellId 22774 18:06:36.437183 tst cs_paging_gprs_active.py: using BVCI 22775 18:06:36.551086 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:36.562298 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:36.572932 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:36.584148 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:36.595305 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:36.606481 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:36.617861 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:36.628904 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:36.640128 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:36.760810 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:36.880066 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:06:37.089300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:37.401242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31536): Launched 18:06:37.671662 run iperf3-srv_10.42.42.10(pid=31537): Launched 18:06:37.788010 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:06:37.995327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:38.306848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31538): Launched 18:06:38.578002 run iperf3-srv_10.42.42.10(pid=31539): Launched 18:06:38.693998 tst cs_paging_gprs_active.py:38: start network... 18:06:38.901444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:39.380319 run create_hlr_db(pid=31540): Launched 18:06:39.498012 bus /sierra_2: Setting Powered False 18:06:40.560490 run create_hlr_db(pid=31540): Terminated: ok {rc=0} 18:06:40.990565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31542): Launched 18:06:41.299531 run osmo-hlr_10.42.42.2(pid=31543): Launched 18:06:41.417557 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:41.953260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31545): Launched 18:06:42.262727 run osmo-stp_10.42.42.5(pid=31546): Launched 18:06:42.380625 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:42.914660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31548): Launched 18:06:43.033978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:43.296090 run patchelf(pid=31549): Launched 18:06:43.469168 run osmo-stp_10.42.42.5(pid=31546): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31546)] 18:06:43.600727 run osmo-stp_10.42.42.5(pid=31546): stdout: | (launched: 2022-12-09_18:06:42.205262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:43.733294 run osmo-stp_10.42.42.5(pid=31546): stderr: | 20221209180642378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180642378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180642378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180642379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180642379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180642379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180642379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:43.868394 run osmo-stp_10.42.42.5(pid=31546): stdout: | (launched: 2022-12-09_18:06:42.205262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:43.994765 run osmo-stp_10.42.42.5(pid=31546): stderr: | 20221209180642378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180642378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180642378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180642379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180642379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180642379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180642379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:44.144887 run patchelf(pid=31549): Terminating (SIGINT) 18:06:44.319444 run patchelf(pid=31549): Terminated: ok {rc=0} 18:06:44.445449 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31546): Process ended prematurely: osmo-stp_10.42.42.5(pid=31546) [trial-2362↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31546)] [trial-2362↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 18:06:44.455220 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:06:44.483270 run osmo-hlr_10.42.42.2(pid=31543): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31543)] 18:06:44.531611 run osmo-hlr_10.42.42.2(pid=31543): stdout: | (launched: 2022-12-09_18:06:41.241906) 18:06:44.581667 run osmo-hlr_10.42.42.2(pid=31543): stderr: | 20221209180641419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180641419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180641419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180641419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180641419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180641419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180641431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180641440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180641440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180641440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:44.632080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31536): Terminating (SIGTERM) 18:06:44.672609 run iperf3-srv_10.42.42.10(pid=31537): Terminating (SIGTERM) 18:06:44.712870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31538): Terminating (SIGTERM) 18:06:44.753116 run iperf3-srv_10.42.42.10(pid=31539): Terminating (SIGTERM) 18:06:44.793286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31542): Terminating (SIGTERM) 18:06:44.833685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31545): Terminating (SIGTERM) 18:06:44.873873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31548): Terminating (SIGTERM) 18:06:44.914465 --- ParallelTerminationStrategy: PID 31536 died... 18:06:44.933570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31536): Terminated: ok {rc=0} 18:06:44.978553 --- ParallelTerminationStrategy: PID 31537 died... 18:06:44.997438 run iperf3-srv_10.42.42.10(pid=31537): Terminated {rc=256} 18:06:45.042166 --- ParallelTerminationStrategy: PID 31538 died... 18:06:45.061074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31538): Terminated: ok {rc=0} 18:06:45.105897 --- ParallelTerminationStrategy: PID 31539 died... 18:06:45.124751 run iperf3-srv_10.42.42.10(pid=31539): Terminated {rc=256} 18:06:45.170496 --- ParallelTerminationStrategy: PID 31542 died... 18:06:45.189194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31542): Terminated: ok {rc=0} 18:06:45.233722 --- ParallelTerminationStrategy: PID 31545 died... 18:06:45.252508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31545): Terminated: ok {rc=0} 18:06:45.297252 --- ParallelTerminationStrategy: PID 31548 died... 18:06:45.316019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31548): Terminated: ok {rc=0} 18:06:45.402837 bus /gobi_0: Setting Powered False 18:06:46.501788 bus /gobi_0: Setting Powered False 18:06:47.619125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 18:06:48.766896 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:48.778811 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:48.826641 tst iperf3.py: using LAC 22775 18:06:48.946861 tst iperf3.py: using RAC 80 18:06:49.066962 tst iperf3.py: using CellId 22775 18:06:49.187989 tst iperf3.py: using BVCI 22776 18:06:49.299386 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:49.310263 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:49.320827 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:49.331804 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:49.342548 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:49.353599 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:49.364176 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:49.375179 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:49.386340 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:49.505957 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:06:49.730092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:50.061439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31551): Launched 18:06:50.349404 run iperf3-srv_10.42.42.10(pid=31552): Launched 18:06:50.472617 tst iperf3.py:8: start network... 18:06:50.694715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:51.204428 run create_hlr_db(pid=31553): Launched 18:06:51.338815 bus /gobi_6: Setting Powered False 18:06:52.403150 run create_hlr_db(pid=31553): Terminated: ok {rc=0} 18:06:52.843461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31555): Launched 18:06:53.153943 run osmo-hlr_10.42.42.2(pid=31556): Launched 18:06:53.271723 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:53.819442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31558): Launched 18:06:54.129756 run osmo-stp_10.42.42.5(pid=31559): Launched 18:06:54.259430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:54.829864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31561): Launched 18:06:54.955849 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:55.234302 run patchelf(pid=31562): Launched 18:06:55.416715 run osmo-stp_10.42.42.5(pid=31559): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31559)] 18:06:55.555568 run osmo-stp_10.42.42.5(pid=31559): stdout: | (launched: 2022-12-09_18:06:54.071527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:55.696046 run osmo-stp_10.42.42.5(pid=31559): stderr: | 20221209180654260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180654260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180654261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180654261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180654263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180654263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180654263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:55.837364 run osmo-stp_10.42.42.5(pid=31559): stdout: | (launched: 2022-12-09_18:06:54.071527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:55.971955 run osmo-stp_10.42.42.5(pid=31559): stderr: | 20221209180654260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180654260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180654261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180654261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180654263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180654263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180654263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:56.131812 run patchelf(pid=31562): Terminating (SIGINT) 18:06:56.315454 run patchelf(pid=31562): Terminated: ok {rc=0} 18:06:56.448161 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31559): Process ended prematurely: osmo-stp_10.42.42.5(pid=31559) [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31559)] [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 18:06:56.458448 tst iperf3.py:8: Test FAILED (7.7 sec) 18:06:56.487150 run osmo-hlr_10.42.42.2(pid=31556): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31556)] 18:06:56.537189 run osmo-hlr_10.42.42.2(pid=31556): stdout: | (launched: 2022-12-09_18:06:53.096253) 18:06:56.588891 run osmo-hlr_10.42.42.2(pid=31556): stderr: | 20221209180653275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180653275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180653275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180653276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180653276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180653276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180653291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180653301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180653301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180653301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:56.641286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31551): Terminating (SIGTERM) 18:06:56.683797 run iperf3-srv_10.42.42.10(pid=31552): Terminating (SIGTERM) 18:06:56.725768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31555): Terminating (SIGTERM) 18:06:56.768116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31558): Terminating (SIGTERM) 18:06:56.810442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31561): Terminating (SIGTERM) 18:06:56.853191 --- ParallelTerminationStrategy: PID 31551 died... 18:06:56.873476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31551): Terminated: ok {rc=0} 18:06:56.920505 --- ParallelTerminationStrategy: PID 31552 died... 18:06:56.940427 run iperf3-srv_10.42.42.10(pid=31552): Terminated {rc=256} 18:06:56.986935 --- ParallelTerminationStrategy: PID 31555 died... 18:06:57.006865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31555): Terminated: ok {rc=0} 18:06:57.053679 --- ParallelTerminationStrategy: PID 31558 died... 18:06:57.073593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31558): Terminated: ok {rc=0} 18:06:57.120340 --- ParallelTerminationStrategy: PID 31561 died... 18:06:57.140337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31561): Terminated: ok {rc=0} 18:06:57.228262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 18:06:58.377450 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.389266 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:06:58.433367 tst iperf3m4.py: using LAC 22776 18:06:58.552225 tst iperf3m4.py: using RAC 81 18:06:58.670897 tst iperf3m4.py: using CellId 22776 18:06:58.790966 tst iperf3m4.py: using BVCI 22777 18:06:58.902541 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.913694 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.924603 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.935761 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.946664 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.958020 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.969220 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.979934 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:06:58.990993 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:59.108492 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:59.230642 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:59.347584 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:06:59.470785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:06:59.678304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:59.989585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31563): Launched 18:07:00.259892 run iperf3-srv_10.42.42.10(pid=31564): Launched 18:07:00.376168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:07:00.582575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:00.905442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31565): Launched 18:07:01.201120 run iperf3-srv_10.42.42.10(pid=31566): Launched 18:07:01.333835 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:07:01.544361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:01.863822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31567): Launched 18:07:02.172332 run iperf3-srv_10.42.42.10(pid=31568): Launched 18:07:02.297604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:07:02.520601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:02.854608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31569): Launched 18:07:03.142927 run iperf3-srv_10.42.42.10(pid=31570): Launched 18:07:03.266512 tst iperf3m4.py:8: start network... 18:07:03.487930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:04.002098 run create_hlr_db(pid=31571): Launched 18:07:04.135639 bus /gobi_6: Setting Powered False 18:07:05.200778 run create_hlr_db(pid=31571): Terminated: ok {rc=0} 18:07:05.660318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31573): Launched 18:07:05.991748 run osmo-hlr_10.42.42.2(pid=31574): Launched 18:07:06.116763 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:06.788355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31576): Launched 18:07:07.110924 run osmo-stp_10.42.42.5(pid=31577): Launched 18:07:07.233414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:07.791311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31579): Launched 18:07:07.915289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:08.188117 run patchelf(pid=31580): Launched 18:07:08.367146 run osmo-stp_10.42.42.5(pid=31577): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31577)] 18:07:08.503882 run osmo-stp_10.42.42.5(pid=31577): stdout: | (launched: 2022-12-09_18:07:07.051193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:08.641828 run osmo-stp_10.42.42.5(pid=31577): stderr: | 20221209180707246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180707246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180707246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180707247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180707247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180707247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180707247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:08.780746 run osmo-stp_10.42.42.5(pid=31577): stdout: | (launched: 2022-12-09_18:07:07.051193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:08.912645 run osmo-stp_10.42.42.5(pid=31577): stderr: | 20221209180707246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180707246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180707246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180707247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180707247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180707247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180707247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:09.068646 run patchelf(pid=31580): Terminating (SIGINT) 18:07:09.249935 run patchelf(pid=31580): Terminated: ok {rc=0} 18:07:09.380549 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31577): Process ended prematurely: osmo-stp_10.42.42.5(pid=31577) [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31577)] [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 18:07:09.390975 tst iperf3m4.py:8: Test FAILED (11.0 sec) 18:07:09.419853 run osmo-hlr_10.42.42.2(pid=31574): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31574)] 18:07:09.469922 run osmo-hlr_10.42.42.2(pid=31574): stdout: | (launched: 2022-12-09_18:07:05.930709) 18:07:09.521831 run osmo-hlr_10.42.42.2(pid=31574): stderr: | 20221209180706132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180706132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180706132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180706132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180706132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180706133 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180706149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180706159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180706159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180706159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:09.574030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31563): Terminating (SIGTERM) 18:07:09.616141 run iperf3-srv_10.42.42.10(pid=31564): Terminating (SIGTERM) 18:07:09.657932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31565): Terminating (SIGTERM) 18:07:09.699789 run iperf3-srv_10.42.42.10(pid=31566): Terminating (SIGTERM) 18:07:09.741715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31567): Terminating (SIGTERM) 18:07:09.783657 run iperf3-srv_10.42.42.10(pid=31568): Terminating (SIGTERM) 18:07:09.825454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31569): Terminating (SIGTERM) 18:07:09.867320 run iperf3-srv_10.42.42.10(pid=31570): Terminating (SIGTERM) 18:07:09.909074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31573): Terminating (SIGTERM) 18:07:09.950979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31576): Terminating (SIGTERM) 18:07:09.992804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31579): Terminating (SIGTERM) 18:07:10.035068 --- ParallelTerminationStrategy: PID 31563 died... 18:07:10.055269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31563): Terminated: ok {rc=0} 18:07:10.102249 --- ParallelTerminationStrategy: PID 31564 died... 18:07:10.121917 run iperf3-srv_10.42.42.10(pid=31564): Terminated {rc=256} 18:07:10.168488 --- ParallelTerminationStrategy: PID 31565 died... 18:07:10.188091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31565): Terminated: ok {rc=0} 18:07:10.234285 --- ParallelTerminationStrategy: PID 31566 died... 18:07:10.253927 run iperf3-srv_10.42.42.10(pid=31566): Terminated {rc=256} 18:07:10.299966 --- ParallelTerminationStrategy: PID 31567 died... 18:07:10.319765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31567): Terminated: ok {rc=0} 18:07:10.365936 --- ParallelTerminationStrategy: PID 31568 died... 18:07:10.385606 run iperf3-srv_10.42.42.10(pid=31568): Terminated {rc=256} 18:07:10.431811 --- ParallelTerminationStrategy: PID 31569 died... 18:07:10.451524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31569): Terminated: ok {rc=0} 18:07:10.497665 --- ParallelTerminationStrategy: PID 31570 died... 18:07:10.517501 run iperf3-srv_10.42.42.10(pid=31570): Terminated {rc=256} 18:07:10.563657 --- ParallelTerminationStrategy: PID 31573 died... 18:07:10.583267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31573): Terminated: ok {rc=0} 18:07:10.629486 --- ParallelTerminationStrategy: PID 31576 died... 18:07:10.649162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31576): Terminated: ok {rc=0} 18:07:10.695315 --- ParallelTerminationStrategy: PID 31579 died... 18:07:10.715037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31579): Terminated: ok {rc=0} 18:07:10.802936 bus /gobi_4: Setting Powered False 18:07:11.902027 bus /gobi_4: Setting Powered False 18:07:13.019752 bus /gobi_1: Setting Powered False 18:07:14.118750 bus /gobi_1: Setting Powered False 18:07:15.234171 bus /gobi_0: Setting Powered False 18:07:16.332859 bus /gobi_0: Setting Powered False 18:07:17.453574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 18:07:18.557005 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:18.568795 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:07:18.614641 tst ping.py: using LAC 22777 18:07:18.731419 tst ping.py: using RAC 82 18:07:18.850038 tst ping.py: using CellId 22777 18:07:18.967772 tst ping.py: using BVCI 22778 18:07:19.075572 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:19.086378 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:19.097035 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:19.107952 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:19.118712 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:19.129705 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:19.140671 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:19.151612 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:19.266066 tst ping.py:19: start network... 18:07:19.464613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:19.922952 run create_hlr_db(pid=31581): Launched 18:07:20.036141 bus /gobi_6: Setting Powered False 18:07:21.094934 run create_hlr_db(pid=31581): Terminated: ok {rc=0} 18:07:21.532344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31583): Launched 18:07:21.850992 run osmo-hlr_10.42.42.2(pid=31584): Launched 18:07:21.972139 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:22.519874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31586): Launched 18:07:22.839475 run osmo-stp_10.42.42.5(pid=31587): Launched 18:07:22.961491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:23.510748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31589): Launched 18:07:23.632708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:23.901876 run patchelf(pid=31590): Launched 18:07:24.078849 run osmo-stp_10.42.42.5(pid=31587): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31587)] 18:07:24.213332 run osmo-stp_10.42.42.5(pid=31587): stdout: | (launched: 2022-12-09_18:07:22.780385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:24.350219 run osmo-stp_10.42.42.5(pid=31587): stderr: | 20221209180722975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180722975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180722976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180722976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180722977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180722977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180722977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:24.487120 run osmo-stp_10.42.42.5(pid=31587): stdout: | (launched: 2022-12-09_18:07:22.780385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:24.617022 run osmo-stp_10.42.42.5(pid=31587): stderr: | 20221209180722975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180722975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180722976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180722976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180722977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180722977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180722977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:24.771735 run patchelf(pid=31590): Terminating (SIGINT) 18:07:24.950852 run patchelf(pid=31590): Terminated: ok {rc=0} 18:07:25.080143 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31587): Process ended prematurely: osmo-stp_10.42.42.5(pid=31587) [trial-2362↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31587)] [trial-2362↪gprs:trx-lms-limenet-micro↪ping.py:22] 18:07:25.089940 tst ping.py:22: Test FAILED (6.5 sec) 18:07:25.117939 run osmo-hlr_10.42.42.2(pid=31584): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31584)] 18:07:25.168116 run osmo-hlr_10.42.42.2(pid=31584): stdout: | (launched: 2022-12-09_18:07:21.792198) 18:07:25.220314 run osmo-hlr_10.42.42.2(pid=31584): stderr: | 20221209180721992 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180721992 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180721992 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180721992 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180721992 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180721992 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180722005 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180722013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180722014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180722014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:25.272646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31583): Terminating (SIGTERM) 18:07:25.314876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31586): Terminating (SIGTERM) 18:07:25.357109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31589): Terminating (SIGTERM) 18:07:25.399435 --- ParallelTerminationStrategy: PID 31583 died... 18:07:25.419507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31583): Terminated: ok {rc=0} 18:07:25.466115 --- ParallelTerminationStrategy: PID 31586 died... 18:07:25.485861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31586): Terminated: ok {rc=0} 18:07:25.532281 --- ParallelTerminationStrategy: PID 31589 died... 18:07:25.552002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31589): Terminated: ok {rc=0} 18:07:25.640664 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 18:07:26.729479 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:26.742150 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:07:26.790456 tst ping_idle_ping.py: using LAC 22778 18:07:26.917095 tst ping_idle_ping.py: using RAC 83 18:07:27.041759 tst ping_idle_ping.py: using CellId 22778 18:07:27.166827 tst ping_idle_ping.py: using BVCI 22779 18:07:27.282537 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:27.294072 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:27.305297 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:27.316306 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:27.327303 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:27.338443 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:27.349754 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:07:27.360743 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:07:27.479023 tst ping_idle_ping.py:24: start network... 18:07:27.694020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:28.191228 run create_hlr_db(pid=31591): Launched 18:07:28.319622 bus /gobi_6: Setting Powered False 18:07:29.379604 run create_hlr_db(pid=31591): Terminated: ok {rc=0} 18:07:29.820021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31593): Launched 18:07:30.141991 run osmo-hlr_10.42.42.2(pid=31594): Launched 18:07:30.263959 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:30.819381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31596): Launched 18:07:31.173683 run osmo-stp_10.42.42.5(pid=31597): Launched 18:07:31.394110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:32.041389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31599): Launched 18:07:32.177701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:32.450586 run patchelf(pid=31600): Launched 18:07:32.628201 run osmo-stp_10.42.42.5(pid=31597): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31597)] 18:07:32.763663 run osmo-stp_10.42.42.5(pid=31597): stdout: | (launched: 2022-12-09_18:07:31.107669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:32.901618 run osmo-stp_10.42.42.5(pid=31597): stderr: | 20221209180731378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180731378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180731378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180731379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180731389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180731389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180731389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:33.039675 run osmo-stp_10.42.42.5(pid=31597): stdout: | (launched: 2022-12-09_18:07:31.107669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:33.170524 run osmo-stp_10.42.42.5(pid=31597): stderr: | 20221209180731378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180731378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180731378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180731379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180731389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180731389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180731389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:33.325198 run patchelf(pid=31600): Terminating (SIGINT) 18:07:33.503742 run patchelf(pid=31600): Terminated: ok {rc=0} 18:07:33.632674 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31597): Process ended prematurely: osmo-stp_10.42.42.5(pid=31597) [trial-2362↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31597)] [trial-2362↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 18:07:33.642282 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 18:07:33.670181 run osmo-hlr_10.42.42.2(pid=31594): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31594)] 18:07:33.720299 run osmo-hlr_10.42.42.2(pid=31594): stdout: | (launched: 2022-12-09_18:07:30.081496) 18:07:33.772787 run osmo-hlr_10.42.42.2(pid=31594): stderr: | 20221209180730280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180730280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180730280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180730280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180730280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180730280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180730292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180730300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180730301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180730301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:33.825597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31593): Terminating (SIGTERM) 18:07:33.867638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31596): Terminating (SIGTERM) 18:07:33.909840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31599): Terminating (SIGTERM) 18:07:33.952022 --- ParallelTerminationStrategy: PID 31593 died... 18:07:33.972024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31593): Terminated: ok {rc=0} 18:07:34.018722 --- ParallelTerminationStrategy: PID 31596 died... 18:07:34.038424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31596): Terminated: ok {rc=0} 18:07:34.085039 --- ParallelTerminationStrategy: PID 31599 died... 18:07:34.104659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31599): Terminated: ok {rc=0} 18:07:34.193869 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 18:07:35.496668 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:07:35.502472 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:07:35.532302 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:07:35.571867 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:07:35.662382 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:07:35.692463 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:07:35.731564 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:07:36.327720 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:07:36.380883 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:36.392364 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:07:36.440178 tst cs_paging_gprs_active.py: using LAC 22779 18:07:36.570237 tst cs_paging_gprs_active.py: using RAC 84 18:07:36.696348 tst cs_paging_gprs_active.py: using CellId 22779 18:07:36.824253 tst cs_paging_gprs_active.py: using BVCI 22780 18:07:36.941762 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:36.953439 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:36.964641 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:36.976105 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:36.987521 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:36.998899 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:37.010443 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:37.021642 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:37.033109 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:37.149382 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:37.269450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:07:37.489540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:37.817979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31604): Launched 18:07:38.101066 run iperf3-srv_10.42.42.10(pid=31605): Launched 18:07:38.223207 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:07:38.441868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:38.769570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31606): Launched 18:07:39.053575 run iperf3-srv_10.42.42.10(pid=31607): Launched 18:07:39.175217 tst cs_paging_gprs_active.py:38: start network... 18:07:39.394376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:39.899397 run create_hlr_db(pid=31608): Launched 18:07:40.032289 bus /gobi_6: Setting Powered False 18:07:41.097061 run create_hlr_db(pid=31608): Terminated: ok {rc=0} 18:07:41.550856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31610): Launched 18:07:41.877620 run osmo-hlr_10.42.42.2(pid=31611): Launched 18:07:42.001906 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:42.565970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31613): Launched 18:07:42.891863 run osmo-stp_10.42.42.5(pid=31614): Launched 18:07:43.015500 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:43.579136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31616): Launched 18:07:43.704022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:43.981269 run patchelf(pid=31617): Launched 18:07:44.162783 run osmo-stp_10.42.42.5(pid=31614): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31614)] 18:07:44.300708 run osmo-stp_10.42.42.5(pid=31614): stdout: | (launched: 2022-12-09_18:07:42.831929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:44.440012 run osmo-stp_10.42.42.5(pid=31614): stderr: | 20221209180743026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180743026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180743027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180743027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180743029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180743030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180743030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:44.579101 run osmo-stp_10.42.42.5(pid=31614): stdout: | (launched: 2022-12-09_18:07:42.831929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:44.712589 run osmo-stp_10.42.42.5(pid=31614): stderr: | 20221209180743026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180743026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180743027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180743027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180743029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180743030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180743030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:44.870971 run patchelf(pid=31617): Terminating (SIGINT) 18:07:45.054326 run patchelf(pid=31617): Terminated: ok {rc=0} 18:07:45.187324 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31614): Process ended prematurely: osmo-stp_10.42.42.5(pid=31614) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31614)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:07:45.197711 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 18:07:45.226604 run osmo-hlr_10.42.42.2(pid=31611): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31611)] 18:07:45.277150 run osmo-hlr_10.42.42.2(pid=31611): stdout: | (launched: 2022-12-09_18:07:41.817497) 18:07:45.329474 run osmo-hlr_10.42.42.2(pid=31611): stderr: | 20221209180742020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180742020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180742020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180742020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180742020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180742020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180742033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180742041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180742042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180742042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:45.382256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31604): Terminating (SIGTERM) 18:07:45.424426 run iperf3-srv_10.42.42.10(pid=31605): Terminating (SIGTERM) 18:07:45.466896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31606): Terminating (SIGTERM) 18:07:45.509001 run iperf3-srv_10.42.42.10(pid=31607): Terminating (SIGTERM) 18:07:45.551099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31610): Terminating (SIGTERM) 18:07:45.593411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31613): Terminating (SIGTERM) 18:07:45.635558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31616): Terminating (SIGTERM) 18:07:45.677996 --- ParallelTerminationStrategy: PID 31604 died... 18:07:45.698105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31604): Terminated: ok {rc=0} 18:07:45.744797 --- ParallelTerminationStrategy: PID 31605 died... 18:07:45.764691 run iperf3-srv_10.42.42.10(pid=31605): Terminated {rc=256} 18:07:45.811081 --- ParallelTerminationStrategy: PID 31606 died... 18:07:45.830699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31606): Terminated: ok {rc=0} 18:07:45.877783 --- ParallelTerminationStrategy: PID 31607 died... 18:07:45.897885 run iperf3-srv_10.42.42.10(pid=31607): Terminated {rc=256} 18:07:45.945349 --- ParallelTerminationStrategy: PID 31610 died... 18:07:45.965414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31610): Terminated: ok {rc=0} 18:07:46.012746 --- ParallelTerminationStrategy: PID 31613 died... 18:07:46.033060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31613): Terminated: ok {rc=0} 18:07:46.080361 --- ParallelTerminationStrategy: PID 31616 died... 18:07:46.100764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31616): Terminated: ok {rc=0} 18:07:46.189703 bus /gobi_0: Setting Powered False 18:07:47.292410 bus /gobi_0: Setting Powered False 18:07:48.410272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:07:49.561097 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:49.573388 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:07:49.621658 tst iperf3.py: using LAC 22780 18:07:49.749373 tst iperf3.py: using RAC 85 18:07:49.876690 tst iperf3.py: using CellId 22780 18:07:50.004743 tst iperf3.py: using BVCI 22781 18:07:50.122142 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:50.133748 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:50.145048 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:50.156268 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:50.167428 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:50.178741 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:50.190232 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:50.201357 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:50.212764 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:50.333344 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:07:50.538303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:50.854268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31618): Launched 18:07:51.110062 run iperf3-srv_10.42.42.10(pid=31619): Launched 18:07:51.220073 tst iperf3.py:8: start network... 18:07:51.415052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:51.867290 run create_hlr_db(pid=31620): Launched 18:07:51.982332 bus /gobi_6: Setting Powered False 18:07:53.040935 run create_hlr_db(pid=31620): Terminated: ok {rc=0} 18:07:53.450464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31622): Launched 18:07:53.743372 run osmo-hlr_10.42.42.2(pid=31623): Launched 18:07:53.856122 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:54.372464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31625): Launched 18:07:54.666044 run osmo-stp_10.42.42.5(pid=31626): Launched 18:07:54.778104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:55.281846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31628): Launched 18:07:55.394652 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:55.641269 run patchelf(pid=31629): Launched 18:07:55.804041 run osmo-stp_10.42.42.5(pid=31626): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31626)] 18:07:55.927805 run osmo-stp_10.42.42.5(pid=31626): stdout: | (launched: 2022-12-09_18:07:54.611496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:56.053212 run osmo-stp_10.42.42.5(pid=31626): stderr: | 20221209180754782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180754782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180754782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180754783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180754783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180754783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180754783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:56.178872 run osmo-stp_10.42.42.5(pid=31626): stdout: | (launched: 2022-12-09_18:07:54.611496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:56.298716 run osmo-stp_10.42.42.5(pid=31626): stderr: | 20221209180754782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180754782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180754782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180754783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180754783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180754783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180754783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:56.440508 run patchelf(pid=31629): Terminating (SIGINT) 18:07:56.605319 run patchelf(pid=31629): Terminated: ok {rc=0} 18:07:56.723854 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31626): Process ended prematurely: osmo-stp_10.42.42.5(pid=31626) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31626)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 18:07:56.733298 tst iperf3.py:8: Test FAILED (7.2 sec) 18:07:56.760796 run osmo-hlr_10.42.42.2(pid=31623): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31623)] 18:07:56.807943 run osmo-hlr_10.42.42.2(pid=31623): stdout: | (launched: 2022-12-09_18:07:53.689729) 18:07:56.857085 run osmo-hlr_10.42.42.2(pid=31623): stderr: | 20221209180753864 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180753864 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180753864 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180753864 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180753864 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180753864 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180753875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180753884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180753884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180753884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:56.906477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31618): Terminating (SIGTERM) 18:07:56.946120 run iperf3-srv_10.42.42.10(pid=31619): Terminating (SIGTERM) 18:07:56.985300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31622): Terminating (SIGTERM) 18:07:57.024742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31625): Terminating (SIGTERM) 18:07:57.064070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31628): Terminating (SIGTERM) 18:07:57.104042 --- ParallelTerminationStrategy: PID 31618 died... 18:07:57.122769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31618): Terminated: ok {rc=0} 18:07:57.167160 --- ParallelTerminationStrategy: PID 31619 died... 18:07:57.185618 run iperf3-srv_10.42.42.10(pid=31619): Terminated {rc=256} 18:07:57.229468 --- ParallelTerminationStrategy: PID 31622 died... 18:07:57.247708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31622): Terminated: ok {rc=0} 18:07:57.291494 --- ParallelTerminationStrategy: PID 31625 died... 18:07:57.309854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31625): Terminated: ok {rc=0} 18:07:57.352936 --- ParallelTerminationStrategy: PID 31628 died... 18:07:57.371669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31628): Terminated: ok {rc=0} 18:07:57.458361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:07:58.602298 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:58.614091 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:07:58.667182 tst iperf3m4.py: using LAC 22781 18:07:58.782499 tst iperf3m4.py: using RAC 86 18:07:58.896338 tst iperf3m4.py: using CellId 22781 18:07:59.009421 tst iperf3m4.py: using BVCI 22782 18:07:59.123947 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.135814 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.147523 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.159111 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.170857 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.182452 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.194127 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.205489 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:07:59.216829 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:59.339486 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:59.455287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:59.567581 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:07:59.686197 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:07:59.898048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:00.213424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31630): Launched 18:08:00.486676 run iperf3-srv_10.42.42.10(pid=31631): Launched 18:08:00.604372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:08:00.816833 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:01.153701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31632): Launched 18:08:01.441788 run iperf3-srv_10.42.42.10(pid=31633): Launched 18:08:01.573138 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:08:01.786077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:02.145671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31645): Launched 18:08:02.483641 run iperf3-srv_10.42.42.10(pid=31667): Launched 18:08:02.613409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:08:02.846500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:03.199560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31700): Launched 18:08:03.574126 run iperf3-srv_10.42.42.10(pid=31742): Launched 18:08:03.727227 tst iperf3m4.py:8: start network... 18:08:03.975032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:04.559658 run create_hlr_db(pid=31878): Launched 18:08:04.750422 bus /gobi_6: Setting Powered False 18:08:05.810397 run create_hlr_db(pid=31878): Terminated: ok {rc=0} 18:08:06.274504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31909): Launched 18:08:06.589668 run osmo-hlr_10.42.42.2(pid=31911): Launched 18:08:06.819611 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:07.421215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31914): Launched 18:08:07.745680 run osmo-stp_10.42.42.5(pid=31915): Launched 18:08:07.973586 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:08.645541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31917): Launched 18:08:08.762923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:09.020551 run patchelf(pid=31918): Launched 18:08:09.203849 run osmo-stp_10.42.42.5(pid=31915): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31915)] 18:08:09.333885 run osmo-stp_10.42.42.5(pid=31915): stdout: | (launched: 2022-12-09_18:08:07.677614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:09.465792 run osmo-stp_10.42.42.5(pid=31915): stderr: | 20221209180808003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180808003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180808003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180808003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180808004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180808004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180808004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:09.601403 run osmo-stp_10.42.42.5(pid=31915): stdout: | (launched: 2022-12-09_18:08:07.677614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:09.727893 run osmo-stp_10.42.42.5(pid=31915): stderr: | 20221209180808003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180808003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180808003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180808003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180808004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180808004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180808004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:09.877341 run patchelf(pid=31918): Terminating (SIGINT) 18:08:10.051094 run patchelf(pid=31918): Terminated: ok {rc=0} 18:08:10.177252 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31915): Process ended prematurely: osmo-stp_10.42.42.5(pid=31915) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31915)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 18:08:10.188075 tst iperf3m4.py:8: Test FAILED (11.6 sec) 18:08:10.219659 run osmo-hlr_10.42.42.2(pid=31911): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31911)] 18:08:10.270806 run osmo-hlr_10.42.42.2(pid=31911): stdout: | (launched: 2022-12-09_18:08:06.524243) 18:08:10.322858 run osmo-hlr_10.42.42.2(pid=31911): stderr: | 20221209180806822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180806822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180806822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180806822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180806822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180806822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180806835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180806851 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180806851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180806851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:10.376445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31630): Terminating (SIGTERM) 18:08:10.419212 run iperf3-srv_10.42.42.10(pid=31631): Terminating (SIGTERM) 18:08:10.464779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31632): Terminating (SIGTERM) 18:08:10.507403 run iperf3-srv_10.42.42.10(pid=31633): Terminating (SIGTERM) 18:08:10.551617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31645): Terminating (SIGTERM) 18:08:10.594479 run iperf3-srv_10.42.42.10(pid=31667): Terminating (SIGTERM) 18:08:10.636552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31700): Terminating (SIGTERM) 18:08:10.679764 run iperf3-srv_10.42.42.10(pid=31742): Terminating (SIGTERM) 18:08:10.723669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31909): Terminating (SIGTERM) 18:08:10.767546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31914): Terminating (SIGTERM) 18:08:10.812330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31917): Terminating (SIGTERM) 18:08:10.856062 --- ParallelTerminationStrategy: PID 31630 died... 18:08:10.876469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31630): Terminated: ok {rc=0} 18:08:10.925623 --- ParallelTerminationStrategy: PID 31631 died... 18:08:10.946042 run iperf3-srv_10.42.42.10(pid=31631): Terminated {rc=256} 18:08:10.993101 --- ParallelTerminationStrategy: PID 31632 died... 18:08:11.014254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31632): Terminated: ok {rc=0} 18:08:11.063312 --- ParallelTerminationStrategy: PID 31633 died... 18:08:11.082762 run iperf3-srv_10.42.42.10(pid=31633): Terminated {rc=256} 18:08:11.129960 --- ParallelTerminationStrategy: PID 31645 died... 18:08:11.150540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31645): Terminated: ok {rc=0} 18:08:11.197835 --- ParallelTerminationStrategy: PID 31667 died... 18:08:11.217426 run iperf3-srv_10.42.42.10(pid=31667): Terminated {rc=256} 18:08:11.264694 --- ParallelTerminationStrategy: PID 31700 died... 18:08:11.284705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31700): Terminated: ok {rc=0} 18:08:11.332910 --- ParallelTerminationStrategy: PID 31742 died... 18:08:11.352592 run iperf3-srv_10.42.42.10(pid=31742): Terminated {rc=256} 18:08:11.399646 --- ParallelTerminationStrategy: PID 31909 died... 18:08:11.419342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31909): Terminated: ok {rc=0} 18:08:11.466726 --- ParallelTerminationStrategy: PID 31914 died... 18:08:11.486309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31914): Terminated: ok {rc=0} 18:08:11.535203 --- ParallelTerminationStrategy: PID 31917 died... 18:08:11.554662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31917): Terminated: ok {rc=0} 18:08:11.646624 bus /gobi_4: Setting Powered False 18:08:12.746615 bus /gobi_4: Setting Powered False 18:08:13.863537 bus /gobi_1: Setting Powered False 18:08:14.964406 bus /gobi_1: Setting Powered False 18:08:16.114906 bus /gobi_0: Setting Powered False 18:08:17.248682 bus /gobi_0: Setting Powered False 18:08:18.397133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 18:08:19.504561 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:19.517843 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:08:19.567413 tst ping.py: using LAC 22782 18:08:19.693412 tst ping.py: using RAC 87 18:08:19.818410 tst ping.py: using CellId 22782 18:08:19.944307 tst ping.py: using BVCI 22783 18:08:20.061601 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:20.073956 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:20.086026 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:20.098884 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:20.111368 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:20.123768 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:20.138323 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:20.151164 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:20.271557 tst ping.py:19: start network... 18:08:20.487175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:20.983801 run create_hlr_db(pid=31919): Launched 18:08:21.147274 bus /gobi_6: Setting Powered False 18:08:22.210120 run create_hlr_db(pid=31919): Terminated: ok {rc=0} 18:08:22.659062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31921): Launched 18:08:22.990935 run osmo-hlr_10.42.42.2(pid=31922): Launched 18:08:23.233706 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:23.899732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31924): Launched 18:08:24.229640 run osmo-stp_10.42.42.5(pid=31925): Launched 18:08:24.341198 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:24.848373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31928): Launched 18:08:24.959864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:25.204024 run patchelf(pid=31929): Launched 18:08:25.365574 run osmo-stp_10.42.42.5(pid=31925): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31925)] 18:08:25.489310 run osmo-stp_10.42.42.5(pid=31925): stdout: | (launched: 2022-12-09_18:08:24.173323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:25.614525 run osmo-stp_10.42.42.5(pid=31925): stderr: | 20221209180824347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180824347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180824348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180824348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180824348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180824349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180824349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:25.740205 run osmo-stp_10.42.42.5(pid=31925): stdout: | (launched: 2022-12-09_18:08:24.173323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:25.859639 run osmo-stp_10.42.42.5(pid=31925): stderr: | 20221209180824347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180824347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180824348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180824348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180824348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180824349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180824349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:26.000658 run patchelf(pid=31929): Terminating (SIGINT) 18:08:26.164438 run patchelf(pid=31929): Terminated: ok {rc=0} 18:08:26.282478 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31925): Process ended prematurely: osmo-stp_10.42.42.5(pid=31925) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31925)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 18:08:26.291472 tst ping.py:22: Test FAILED (6.8 sec) 18:08:26.318671 run osmo-hlr_10.42.42.2(pid=31922): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31922)] 18:08:26.366110 run osmo-hlr_10.42.42.2(pid=31922): stdout: | (launched: 2022-12-09_18:08:22.930905) 18:08:26.415518 run osmo-hlr_10.42.42.2(pid=31922): stderr: | 20221209180823250 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180823250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180823250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180823250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180823250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180823250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180823263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180823271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180823271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180823271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:26.465613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31921): Terminating (SIGTERM) 18:08:26.505498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31924): Terminating (SIGTERM) 18:08:26.545413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31928): Terminating (SIGTERM) 18:08:26.585567 --- ParallelTerminationStrategy: PID 31921 died... 18:08:26.604433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31921): Terminated: ok {rc=0} 18:08:26.648896 --- ParallelTerminationStrategy: PID 31924 died... 18:08:26.667487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31924): Terminated: ok {rc=0} 18:08:26.711786 --- ParallelTerminationStrategy: PID 31928 died... 18:08:26.730396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31928): Terminated: ok {rc=0} 18:08:26.816059 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:08:27.903424 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:27.915027 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:08:27.965697 tst ping_idle_ping.py: using LAC 22783 18:08:28.079932 tst ping_idle_ping.py: using RAC 88 18:08:28.192486 tst ping_idle_ping.py: using CellId 22783 18:08:28.305387 tst ping_idle_ping.py: using BVCI 22784 18:08:28.410570 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:28.421746 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:28.432285 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:28.443323 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:28.454272 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:28.465406 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:28.476616 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:08:28.487748 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:08:28.600351 tst ping_idle_ping.py:24: start network... 18:08:28.793464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:29.243306 run create_hlr_db(pid=31930): Launched 18:08:29.353879 bus /gobi_6: Setting Powered False 18:08:30.412495 run create_hlr_db(pid=31930): Terminated: ok {rc=0} 18:08:30.843941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31932): Launched 18:08:31.171170 run osmo-hlr_10.42.42.2(pid=31933): Launched 18:08:31.346753 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:32.019456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31935): Launched 18:08:32.345408 run osmo-stp_10.42.42.5(pid=31936): Launched 18:08:32.490004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:33.028873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31938): Launched 18:08:33.147426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:33.408099 run patchelf(pid=31939): Launched 18:08:33.581151 run osmo-stp_10.42.42.5(pid=31936): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31936)] 18:08:33.713140 run osmo-stp_10.42.42.5(pid=31936): stdout: | (launched: 2022-12-09_18:08:32.283779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:33.848074 run osmo-stp_10.42.42.5(pid=31936): stderr: | 20221209180832505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180832505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180832506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180832506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180832508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180832508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180832508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:33.982121 run osmo-stp_10.42.42.5(pid=31936): stdout: | (launched: 2022-12-09_18:08:32.283779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:34.109702 run osmo-stp_10.42.42.5(pid=31936): stderr: | 20221209180832505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180832505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180832506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180832506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180832508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180832508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180832508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:34.260775 run patchelf(pid=31939): Terminating (SIGINT) 18:08:34.435201 run patchelf(pid=31939): Terminated: ok {rc=0} 18:08:34.560628 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31936): Process ended prematurely: osmo-stp_10.42.42.5(pid=31936) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31936)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 18:08:34.570289 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:08:34.598317 run osmo-hlr_10.42.42.2(pid=31933): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31933)] 18:08:34.647837 run osmo-hlr_10.42.42.2(pid=31933): stdout: | (launched: 2022-12-09_18:08:31.102837) 18:08:34.699298 run osmo-hlr_10.42.42.2(pid=31933): stderr: | 20221209180831475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180831476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180831476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180831477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180831477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180831477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180831498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180831516 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180831516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180831517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:34.751042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31932): Terminating (SIGTERM) 18:08:34.793072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31935): Terminating (SIGTERM) 18:08:34.834915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31938): Terminating (SIGTERM) 18:08:34.876896 --- ParallelTerminationStrategy: PID 31932 died... 18:08:34.896730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31932): Terminated: ok {rc=0} 18:08:34.942677 --- ParallelTerminationStrategy: PID 31935 died... 18:08:34.962019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31935): Terminated: ok {rc=0} 18:08:35.007739 --- ParallelTerminationStrategy: PID 31938 died... 18:08:35.027132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31938): Terminated: ok {rc=0} 18:08:35.113538 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:08:36.416788 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:08:36.423470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:08:36.453085 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:08:36.491498 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:08:36.580830 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:08:36.611035 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:08:36.649875 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:08:37.243087 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:08:37.293468 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:37.304759 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:08:37.371132 tst cs_paging_gprs_active.py: using LAC 22784 18:08:37.495929 tst cs_paging_gprs_active.py: using RAC 89 18:08:37.619148 tst cs_paging_gprs_active.py: using CellId 22784 18:08:37.742443 tst cs_paging_gprs_active.py: using BVCI 22785 18:08:37.857674 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:37.869032 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:37.880157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:37.891445 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:37.902650 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:37.913764 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:37.925000 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:37.936072 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:37.947351 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:38.061577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:38.179270 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:08:38.393614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:38.711412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31944): Launched 18:08:38.986824 run iperf3-srv_10.42.42.10(pid=31945): Launched 18:08:39.105640 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:08:39.318502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:39.636727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31946): Launched 18:08:39.911658 run iperf3-srv_10.42.42.10(pid=31947): Launched 18:08:40.029979 tst cs_paging_gprs_active.py:38: start network... 18:08:40.242752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:40.731554 run create_hlr_db(pid=31948): Launched 18:08:40.860375 bus /gobi_6: Setting Powered False 18:08:41.923745 run create_hlr_db(pid=31948): Terminated: ok {rc=0} 18:08:42.362959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31950): Launched 18:08:42.679192 run osmo-hlr_10.42.42.2(pid=31951): Launched 18:08:42.799973 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:43.342367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31953): Launched 18:08:43.658187 run osmo-stp_10.42.42.5(pid=31954): Launched 18:08:43.778309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:44.323245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31956): Launched 18:08:44.444856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:44.712185 run patchelf(pid=31957): Launched 18:08:44.889652 run osmo-stp_10.42.42.5(pid=31954): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31954)] 18:08:45.024293 run osmo-stp_10.42.42.5(pid=31954): stdout: | (launched: 2022-12-09_18:08:43.600594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:45.160001 run osmo-stp_10.42.42.5(pid=31954): stderr: | 20221209180843791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180843791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180843792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180843792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180843793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180843793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180843793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:45.295576 run osmo-stp_10.42.42.5(pid=31954): stdout: | (launched: 2022-12-09_18:08:43.600594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:45.425331 run osmo-stp_10.42.42.5(pid=31954): stderr: | 20221209180843791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180843791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180843792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180843792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180843793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180843793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180843793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:45.579625 run patchelf(pid=31957): Terminating (SIGINT) 18:08:45.757376 run patchelf(pid=31957): Terminated: ok {rc=0} 18:08:45.888270 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31954): Process ended prematurely: osmo-stp_10.42.42.5(pid=31954) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31954)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:08:45.903563 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 18:08:45.933049 run osmo-hlr_10.42.42.2(pid=31951): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31951)] 18:08:45.983295 run osmo-hlr_10.42.42.2(pid=31951): stdout: | (launched: 2022-12-09_18:08:42.620851) 18:08:46.035454 run osmo-hlr_10.42.42.2(pid=31951): stderr: | 20221209180842820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180842820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180842820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180842820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180842820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180842820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180842833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180842841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180842841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180842841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:46.088017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31944): Terminating (SIGTERM) 18:08:46.130579 run iperf3-srv_10.42.42.10(pid=31945): Terminating (SIGTERM) 18:08:46.174239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31946): Terminating (SIGTERM) 18:08:46.217449 run iperf3-srv_10.42.42.10(pid=31947): Terminating (SIGTERM) 18:08:46.262508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31950): Terminating (SIGTERM) 18:08:46.305802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31953): Terminating (SIGTERM) 18:08:46.349906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31956): Terminating (SIGTERM) 18:08:46.393938 --- ParallelTerminationStrategy: PID 31944 died... 18:08:46.413850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31944): Terminated: ok {rc=0} 18:08:46.460470 --- ParallelTerminationStrategy: PID 31945 died... 18:08:46.480341 run iperf3-srv_10.42.42.10(pid=31945): Terminated {rc=256} 18:08:46.526900 --- ParallelTerminationStrategy: PID 31946 died... 18:08:46.546789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31946): Terminated: ok {rc=0} 18:08:46.593314 --- ParallelTerminationStrategy: PID 31947 died... 18:08:46.613144 run iperf3-srv_10.42.42.10(pid=31947): Terminated {rc=256} 18:08:46.659830 --- ParallelTerminationStrategy: PID 31950 died... 18:08:46.679887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31950): Terminated: ok {rc=0} 18:08:46.726496 --- ParallelTerminationStrategy: PID 31953 died... 18:08:46.746348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31953): Terminated: ok {rc=0} 18:08:46.793376 --- ParallelTerminationStrategy: PID 31956 died... 18:08:46.813110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31956): Terminated: ok {rc=0} 18:08:46.907005 bus /gobi_0: Setting Powered False 18:08:48.005151 bus /gobi_0: Setting Powered False 18:08:49.118718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:08:50.262067 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:50.273975 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:08:50.342189 tst iperf3.py: using LAC 22785 18:08:50.466201 tst iperf3.py: using RAC 90 18:08:50.592116 tst iperf3.py: using CellId 22785 18:08:50.721256 tst iperf3.py: using BVCI 22786 18:08:50.836727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:50.848033 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:50.859196 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:50.870438 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:50.881461 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:50.892495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:50.903806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:50.914875 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:50.926128 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:08:51.042715 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:08:51.240244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:51.538288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31958): Launched 18:08:51.796569 run iperf3-srv_10.42.42.10(pid=31959): Launched 18:08:51.907878 tst iperf3.py:8: start network... 18:08:52.104703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:52.560570 run create_hlr_db(pid=31960): Launched 18:08:52.675315 bus /gobi_6: Setting Powered False 18:08:53.734464 run create_hlr_db(pid=31960): Terminated: ok {rc=0} 18:08:54.146143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31962): Launched 18:08:54.440552 run osmo-hlr_10.42.42.2(pid=31963): Launched 18:08:54.552611 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:55.064412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31965): Launched 18:08:55.360702 run osmo-stp_10.42.42.5(pid=31966): Launched 18:08:55.473420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:55.983006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31968): Launched 18:08:56.096574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:56.346033 run patchelf(pid=31969): Launched 18:08:56.510126 run osmo-stp_10.42.42.5(pid=31966): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31966)] 18:08:56.635932 run osmo-stp_10.42.42.5(pid=31966): stdout: | (launched: 2022-12-09_18:08:55.306280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:56.763102 run osmo-stp_10.42.42.5(pid=31966): stderr: | 20221209180855476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180855476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180855476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180855476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180855477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180855477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180855477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:56.890706 run osmo-stp_10.42.42.5(pid=31966): stdout: | (launched: 2022-12-09_18:08:55.306280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:57.011794 run osmo-stp_10.42.42.5(pid=31966): stderr: | 20221209180855476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180855476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180855476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180855476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180855477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180855477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180855477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:57.155433 run patchelf(pid=31969): Terminating (SIGINT) 18:08:57.322391 run patchelf(pid=31969): Terminated: ok {rc=0} 18:08:57.443038 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31966): Process ended prematurely: osmo-stp_10.42.42.5(pid=31966) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31966)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 18:08:57.452432 tst iperf3.py:8: Test FAILED (7.2 sec) 18:08:57.479801 run osmo-hlr_10.42.42.2(pid=31963): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31963)] 18:08:57.527178 run osmo-hlr_10.42.42.2(pid=31963): stdout: | (launched: 2022-12-09_18:08:54.386428) 18:08:57.576525 run osmo-hlr_10.42.42.2(pid=31963): stderr: | 20221209180854560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180854560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180854560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180854560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180854561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180854561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180854584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180854593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180854593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180854593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:57.626724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31958): Terminating (SIGTERM) 18:08:57.666700 run iperf3-srv_10.42.42.10(pid=31959): Terminating (SIGTERM) 18:08:57.706543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31962): Terminating (SIGTERM) 18:08:57.746348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31965): Terminating (SIGTERM) 18:08:57.786027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31968): Terminating (SIGTERM) 18:08:57.825887 --- ParallelTerminationStrategy: PID 31958 died... 18:08:57.844635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31958): Terminated: ok {rc=0} 18:08:57.888917 --- ParallelTerminationStrategy: PID 31959 died... 18:08:57.907683 run iperf3-srv_10.42.42.10(pid=31959): Terminated {rc=256} 18:08:57.951829 --- ParallelTerminationStrategy: PID 31962 died... 18:08:57.970313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31962): Terminated: ok {rc=0} 18:08:58.014756 --- ParallelTerminationStrategy: PID 31965 died... 18:08:58.033136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31965): Terminated: ok {rc=0} 18:08:58.077211 --- ParallelTerminationStrategy: PID 31968 died... 18:08:58.095467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31968): Terminated: ok {rc=0} 18:08:58.179581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:08:59.320456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:59.331981 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:08:59.398381 tst iperf3m4.py: using LAC 22786 18:08:59.524367 tst iperf3m4.py: using RAC 91 18:08:59.649129 tst iperf3m4.py: using CellId 22786 18:08:59.774815 tst iperf3m4.py: using BVCI 22787 18:08:59.891602 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:59.902984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:59.914223 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:59.925365 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:59.936502 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:59.947619 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:59.958901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:59.970008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:08:59.981313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:00.094708 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:00.212514 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:00.330054 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:00.450215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:09:00.662698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:00.992443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31970): Launched 18:09:01.282408 run iperf3-srv_10.42.42.10(pid=31971): Launched 18:09:01.416397 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:09:01.634337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:01.961378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31972): Launched 18:09:02.250818 run iperf3-srv_10.42.42.10(pid=31973): Launched 18:09:02.370487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:09:02.582848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:02.901744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31974): Launched 18:09:03.178071 run iperf3-srv_10.42.42.10(pid=31975): Launched 18:09:03.296717 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:09:03.509569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:03.829689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31976): Launched 18:09:04.106476 run iperf3-srv_10.42.42.10(pid=31977): Launched 18:09:04.225161 tst iperf3m4.py:8: start network... 18:09:04.438643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:04.930340 run create_hlr_db(pid=31978): Launched 18:09:05.059672 bus /gobi_6: Setting Powered False 18:09:06.121803 run create_hlr_db(pid=31978): Terminated: ok {rc=0} 18:09:06.545049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31980): Launched 18:09:06.841770 run osmo-hlr_10.42.42.2(pid=31981): Launched 18:09:06.954736 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:07.462600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31983): Launched 18:09:07.759532 run osmo-stp_10.42.42.5(pid=31984): Launched 18:09:07.872048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:08.382208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31986): Launched 18:09:08.496080 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:08.746281 run patchelf(pid=31987): Launched 18:09:08.911719 run osmo-stp_10.42.42.5(pid=31984): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31984)] 18:09:09.037140 run osmo-stp_10.42.42.5(pid=31984): stdout: | (launched: 2022-12-09_18:09:07.704870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:09.164059 run osmo-stp_10.42.42.5(pid=31984): stderr: | 20221209180907875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180907876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180907876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180907876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180907877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180907877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180907877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:09.291123 run osmo-stp_10.42.42.5(pid=31984): stdout: | (launched: 2022-12-09_18:09:07.704870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:09.411964 run osmo-stp_10.42.42.5(pid=31984): stderr: | 20221209180907875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180907876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180907876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180907876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180907877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180907877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180907877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:09.555218 run patchelf(pid=31987): Terminating (SIGINT) 18:09:09.721701 run patchelf(pid=31987): Terminated: ok {rc=0} 18:09:09.842261 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31984): Process ended prematurely: osmo-stp_10.42.42.5(pid=31984) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31984)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:09:09.851701 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:09:09.879247 run osmo-hlr_10.42.42.2(pid=31981): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31981)] 18:09:09.926252 run osmo-hlr_10.42.42.2(pid=31981): stdout: | (launched: 2022-12-09_18:09:06.786856) 18:09:09.975059 run osmo-hlr_10.42.42.2(pid=31981): stderr: | 20221209180906964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180906964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180906964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180906964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180906965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180906965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180906977 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180906986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180906986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180906986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:10.024277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31970): Terminating (SIGTERM) 18:09:10.063388 run iperf3-srv_10.42.42.10(pid=31971): Terminating (SIGTERM) 18:09:10.103492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31972): Terminating (SIGTERM) 18:09:10.143095 run iperf3-srv_10.42.42.10(pid=31973): Terminating (SIGTERM) 18:09:10.182313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31974): Terminating (SIGTERM) 18:09:10.221645 run iperf3-srv_10.42.42.10(pid=31975): Terminating (SIGTERM) 18:09:10.260792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31976): Terminating (SIGTERM) 18:09:10.300097 run iperf3-srv_10.42.42.10(pid=31977): Terminating (SIGTERM) 18:09:10.339305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31980): Terminating (SIGTERM) 18:09:10.378270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31983): Terminating (SIGTERM) 18:09:10.417684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31986): Terminating (SIGTERM) 18:09:10.457154 --- ParallelTerminationStrategy: PID 31970 died... 18:09:10.475777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31970): Terminated: ok {rc=0} 18:09:10.519568 --- ParallelTerminationStrategy: PID 31971 died... 18:09:10.537850 run iperf3-srv_10.42.42.10(pid=31971): Terminated {rc=256} 18:09:10.581937 --- ParallelTerminationStrategy: PID 31972 died... 18:09:10.600179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31972): Terminated: ok {rc=0} 18:09:10.643852 --- ParallelTerminationStrategy: PID 31973 died... 18:09:10.662132 run iperf3-srv_10.42.42.10(pid=31973): Terminated {rc=256} 18:09:10.705637 --- ParallelTerminationStrategy: PID 31974 died... 18:09:10.723948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31974): Terminated: ok {rc=0} 18:09:10.768132 --- ParallelTerminationStrategy: PID 31975 died... 18:09:10.786374 run iperf3-srv_10.42.42.10(pid=31975): Terminated {rc=256} 18:09:10.830079 --- ParallelTerminationStrategy: PID 31976 died... 18:09:10.848403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31976): Terminated: ok {rc=0} 18:09:10.892110 --- ParallelTerminationStrategy: PID 31977 died... 18:09:10.910298 run iperf3-srv_10.42.42.10(pid=31977): Terminated {rc=256} 18:09:10.953767 --- ParallelTerminationStrategy: PID 31980 died... 18:09:10.972031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31980): Terminated: ok {rc=0} 18:09:11.015516 --- ParallelTerminationStrategy: PID 31983 died... 18:09:11.033801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31983): Terminated: ok {rc=0} 18:09:11.077499 --- ParallelTerminationStrategy: PID 31986 died... 18:09:11.095637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31986): Terminated: ok {rc=0} 18:09:11.180438 bus /gobi_4: Setting Powered False 18:09:12.280039 bus /gobi_4: Setting Powered False 18:09:13.393930 bus /gobi_1: Setting Powered False 18:09:14.491314 bus /gobi_1: Setting Powered False 18:09:15.605678 bus /gobi_0: Setting Powered False 18:09:16.704099 bus /gobi_0: Setting Powered False 18:09:17.819355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:09:18.922074 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:18.934251 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:09:19.001442 tst ping.py: using LAC 22787 18:09:19.118778 tst ping.py: using RAC 92 18:09:19.233990 tst ping.py: using CellId 22787 18:09:19.347051 tst ping.py: using BVCI 22788 18:09:19.451158 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:19.462187 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:19.472772 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:19.483786 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:19.494641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:19.505567 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:19.516468 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:19.527320 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:19.643814 tst ping.py:19: start network... 18:09:19.839232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:20.287920 run create_hlr_db(pid=31989): Launched 18:09:20.399132 bus /gobi_6: Setting Powered False 18:09:21.458337 run create_hlr_db(pid=31989): Terminated: ok {rc=0} 18:09:21.885908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31991): Launched 18:09:22.196016 run osmo-hlr_10.42.42.2(pid=31992): Launched 18:09:22.314248 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:22.851748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31994): Launched 18:09:23.161308 run osmo-stp_10.42.42.5(pid=31995): Launched 18:09:23.279267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:23.814166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31997): Launched 18:09:23.933242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:24.194312 run patchelf(pid=31998): Launched 18:09:24.366716 run osmo-stp_10.42.42.5(pid=31995): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31995)] 18:09:24.497439 run osmo-stp_10.42.42.5(pid=31995): stdout: | (launched: 2022-12-09_18:09:23.104575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:24.630753 run osmo-stp_10.42.42.5(pid=31995): stderr: | 20221209180923293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180923294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180923294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180923294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180923296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180923297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180923297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:24.764038 run osmo-stp_10.42.42.5(pid=31995): stdout: | (launched: 2022-12-09_18:09:23.104575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:24.891188 run osmo-stp_10.42.42.5(pid=31995): stderr: | 20221209180923293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180923294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180923294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180923294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180923296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180923297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180923297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:25.040926 run patchelf(pid=31998): Terminating (SIGINT) 18:09:25.214128 run patchelf(pid=31998): Terminated: ok {rc=0} 18:09:25.339274 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31995): Process ended prematurely: osmo-stp_10.42.42.5(pid=31995) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31995)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 18:09:25.348662 tst ping.py:22: Test FAILED (6.4 sec) 18:09:25.376392 run osmo-hlr_10.42.42.2(pid=31992): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31992)] 18:09:25.425689 run osmo-hlr_10.42.42.2(pid=31992): stdout: | (launched: 2022-12-09_18:09:22.139142) 18:09:25.476818 run osmo-hlr_10.42.42.2(pid=31992): stderr: | 20221209180922335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180922335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180922335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180922335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180922335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180922335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180922378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180922388 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180922389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180922389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:25.528440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31991): Terminating (SIGTERM) 18:09:25.569654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31994): Terminating (SIGTERM) 18:09:25.610737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31997): Terminating (SIGTERM) 18:09:25.652098 --- ParallelTerminationStrategy: PID 31991 died... 18:09:25.671792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31991): Terminated: ok {rc=0} 18:09:25.717401 --- ParallelTerminationStrategy: PID 31994 died... 18:09:25.736534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31994): Terminated: ok {rc=0} 18:09:25.781734 --- ParallelTerminationStrategy: PID 31997 died... 18:09:25.801228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31997): Terminated: ok {rc=0} 18:09:25.888659 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:09:26.974071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:26.986615 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:09:27.054826 tst ping_idle_ping.py: using LAC 22788 18:09:27.183350 tst ping_idle_ping.py: using RAC 93 18:09:27.304598 tst ping_idle_ping.py: using CellId 22788 18:09:27.425581 tst ping_idle_ping.py: using BVCI 22789 18:09:27.533724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:27.548390 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:27.559925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:27.571688 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:27.582932 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:27.594207 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:27.605440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:09:27.616411 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:09:27.733275 tst ping_idle_ping.py:24: start network... 18:09:27.943986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:28.425902 run create_hlr_db(pid=31999): Launched 18:09:28.552332 bus /gobi_6: Setting Powered False 18:09:29.614767 run create_hlr_db(pid=31999): Terminated: ok {rc=0} 18:09:30.049586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32001): Launched 18:09:30.359978 run osmo-hlr_10.42.42.2(pid=32002): Launched 18:09:30.478771 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:31.043909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32004): Launched 18:09:31.370180 run osmo-stp_10.42.42.5(pid=32005): Launched 18:09:31.678507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:32.261817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32007): Launched 18:09:32.385355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:32.647235 run patchelf(pid=32008): Launched 18:09:32.820615 run osmo-stp_10.42.42.5(pid=32005): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32005)] 18:09:32.952749 run osmo-stp_10.42.42.5(pid=32005): stdout: | (launched: 2022-12-09_18:09:31.308571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:33.087112 run osmo-stp_10.42.42.5(pid=32005): stderr: | 20221209180931579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180931580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180931580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180931582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180931583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180931583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180931583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:33.221786 run osmo-stp_10.42.42.5(pid=32005): stdout: | (launched: 2022-12-09_18:09:31.308571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:33.349391 run osmo-stp_10.42.42.5(pid=32005): stderr: | 20221209180931579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180931580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180931580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180931582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180931583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180931583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180931583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:33.500541 run patchelf(pid=32008): Terminating (SIGINT) 18:09:33.675229 run patchelf(pid=32008): Terminated: ok {rc=0} 18:09:33.800891 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32005): Process ended prematurely: osmo-stp_10.42.42.5(pid=32005) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32005)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:09:33.810762 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 18:09:33.838691 run osmo-hlr_10.42.42.2(pid=32002): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32002)] 18:09:33.888021 run osmo-hlr_10.42.42.2(pid=32002): stdout: | (launched: 2022-12-09_18:09:30.303109) 18:09:33.939545 run osmo-hlr_10.42.42.2(pid=32002): stderr: | 20221209180930499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180930499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180930499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180930499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180930499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180930500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180930512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180930520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180930520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180930520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:33.991103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32001): Terminating (SIGTERM) 18:09:34.032486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32004): Terminating (SIGTERM) 18:09:34.074056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32007): Terminating (SIGTERM) 18:09:34.115779 --- ParallelTerminationStrategy: PID 32001 died... 18:09:34.135540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32001): Terminated: ok {rc=0} 18:09:34.181334 --- ParallelTerminationStrategy: PID 32004 died... 18:09:34.200771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32004): Terminated: ok {rc=0} 18:09:34.246090 --- ParallelTerminationStrategy: PID 32007 died... 18:09:34.265491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32007): Terminated: ok {rc=0} 18:09:34.352862 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:09:35.659818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:09:35.666811 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:09:35.699015 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:09:35.737707 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:09:35.825086 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:09:35.854719 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:09:35.893728 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:09:36.490842 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:09:36.541504 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:36.553048 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:09:36.619638 tst cs_paging_gprs_active.py: using LAC 22789 18:09:36.738233 tst cs_paging_gprs_active.py: using RAC 94 18:09:36.863737 tst cs_paging_gprs_active.py: using CellId 22789 18:09:36.987955 tst cs_paging_gprs_active.py: using BVCI 22790 18:09:37.103887 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:37.115402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:37.126533 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:37.137719 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:37.148767 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:37.159981 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:37.171243 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:37.182298 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:37.193566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:37.310030 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:37.426257 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:09:37.626641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:37.930015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32012): Launched 18:09:38.209069 run iperf3-srv_10.42.42.10(pid=32013): Launched 18:09:38.328639 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:09:38.543501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:38.864043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32014): Launched 18:09:39.141700 run iperf3-srv_10.42.42.10(pid=32015): Launched 18:09:39.260888 tst cs_paging_gprs_active.py:38: start network... 18:09:39.474905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:39.966094 run create_hlr_db(pid=32016): Launched 18:09:40.094894 bus /gobi_6: Setting Powered False 18:09:41.158913 run create_hlr_db(pid=32016): Terminated: ok {rc=0} 18:09:41.599365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Launched 18:09:41.917669 run osmo-hlr_10.42.42.2(pid=32019): Launched 18:09:42.038857 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:42.587216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Launched 18:09:42.904256 run osmo-stp_10.42.42.5(pid=32022): Launched 18:09:43.025523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:43.571524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32024): Launched 18:09:43.692709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:43.967767 run patchelf(pid=32025): Launched 18:09:44.145844 run osmo-stp_10.42.42.5(pid=32022): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] 18:09:44.280503 run osmo-stp_10.42.42.5(pid=32022): stdout: | (launched: 2022-12-09_18:09:42.846300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:44.416343 run osmo-stp_10.42.42.5(pid=32022): stderr: | 20221209180943040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180943040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180943041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180943041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180943042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180943042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180943042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:44.552465 run osmo-stp_10.42.42.5(pid=32022): stdout: | (launched: 2022-12-09_18:09:42.846300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:44.682858 run osmo-stp_10.42.42.5(pid=32022): stderr: | 20221209180943040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180943040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180943041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180943041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180943042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180943042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180943042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:44.837323 run patchelf(pid=32025): Terminating (SIGINT) 18:09:45.015803 run patchelf(pid=32025): Terminated: ok {rc=0} 18:09:45.145366 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32022): Process ended prematurely: osmo-stp_10.42.42.5(pid=32022) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:09:45.155389 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:09:45.183814 run osmo-hlr_10.42.42.2(pid=32019): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32019)] 18:09:45.233423 run osmo-hlr_10.42.42.2(pid=32019): stdout: | (launched: 2022-12-09_18:09:41.858928) 18:09:45.284898 run osmo-hlr_10.42.42.2(pid=32019): stderr: | 20221209180942059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180942059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180942059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180942059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180942059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180942059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180942071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180942079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180942080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180942080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:45.336819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32012): Terminating (SIGTERM) 18:09:45.378177 run iperf3-srv_10.42.42.10(pid=32013): Terminating (SIGTERM) 18:09:45.419524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32014): Terminating (SIGTERM) 18:09:45.460938 run iperf3-srv_10.42.42.10(pid=32015): Terminating (SIGTERM) 18:09:45.502134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Terminating (SIGTERM) 18:09:45.543457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Terminating (SIGTERM) 18:09:45.584680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32024): Terminating (SIGTERM) 18:09:45.626240 --- ParallelTerminationStrategy: PID 32012 died... 18:09:45.646048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32012): Terminated: ok {rc=0} 18:09:45.691961 --- ParallelTerminationStrategy: PID 32013 died... 18:09:45.711164 run iperf3-srv_10.42.42.10(pid=32013): Terminated {rc=256} 18:09:45.756668 --- ParallelTerminationStrategy: PID 32014 died... 18:09:45.776111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32014): Terminated: ok {rc=0} 18:09:45.822069 --- ParallelTerminationStrategy: PID 32015 died... 18:09:45.841423 run iperf3-srv_10.42.42.10(pid=32015): Terminated {rc=256} 18:09:45.887687 --- ParallelTerminationStrategy: PID 32018 died... 18:09:45.907589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Terminated: ok {rc=0} 18:09:45.954069 --- ParallelTerminationStrategy: PID 32021 died... 18:09:45.973856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Terminated: ok {rc=0} 18:09:46.020550 --- ParallelTerminationStrategy: PID 32024 died... 18:09:46.040350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32024): Terminated: ok {rc=0} 18:09:46.127712 bus /gobi_0: Setting Powered False 18:09:47.226057 bus /gobi_0: Setting Powered False 18:09:48.339478 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:09:49.487166 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:49.499071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:09:49.566997 tst iperf3.py: using LAC 22790 18:09:49.692046 tst iperf3.py: using RAC 95 18:09:49.810654 tst iperf3.py: using CellId 22790 18:09:49.926695 tst iperf3.py: using BVCI 22791 18:09:50.036106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:50.047378 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:50.058370 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:50.069638 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:50.080498 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:50.091452 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:50.102530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:50.113249 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:50.124197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:50.242135 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:09:50.455991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:09:50.774606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32026): Launched 18:09:51.058227 run iperf3-srv_10.42.42.10(pid=32027): Launched 18:09:51.177489 tst iperf3.py:8: start network... 18:09:51.391337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:51.883451 run create_hlr_db(pid=32028): Launched 18:09:52.012268 bus /gobi_6: Setting Powered False 18:09:53.075703 run create_hlr_db(pid=32028): Terminated: ok {rc=0} 18:09:53.500294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32030): Launched 18:09:53.798973 run osmo-hlr_10.42.42.2(pid=32031): Launched 18:09:53.913298 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:54.439601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32033): Launched 18:09:54.758064 run osmo-stp_10.42.42.5(pid=32034): Launched 18:09:54.880773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:55.427694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32036): Launched 18:09:55.550009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:55.817207 run patchelf(pid=32037): Launched 18:09:55.993470 run osmo-stp_10.42.42.5(pid=32034): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32034)] 18:09:56.128377 run osmo-stp_10.42.42.5(pid=32034): stdout: | (launched: 2022-12-09_18:09:54.699927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:56.263993 run osmo-stp_10.42.42.5(pid=32034): stderr: | 20221209180954890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180954890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180954890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180954890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180954891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180954891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180954891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:56.400053 run osmo-stp_10.42.42.5(pid=32034): stdout: | (launched: 2022-12-09_18:09:54.699927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:56.529861 run osmo-stp_10.42.42.5(pid=32034): stderr: | 20221209180954890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209180954890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209180954890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209180954890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209180954891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209180954891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209180954891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:56.683711 run patchelf(pid=32037): Terminating (SIGINT) 18:09:56.861116 run patchelf(pid=32037): Terminated: ok {rc=0} 18:09:56.989579 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32034): Process ended prematurely: osmo-stp_10.42.42.5(pid=32034) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32034)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 18:09:56.999802 tst iperf3.py:8: Test FAILED (7.5 sec) 18:09:57.028634 run osmo-hlr_10.42.42.2(pid=32031): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32031)] 18:09:57.078328 run osmo-hlr_10.42.42.2(pid=32031): stdout: | (launched: 2022-12-09_18:09:53.744377) 18:09:57.129854 run osmo-hlr_10.42.42.2(pid=32031): stderr: | 20221209180953921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209180953921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209180953921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209180953921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209180953921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209180953921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209180953933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209180953943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209180953943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209180953943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:57.181613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32026): Terminating (SIGTERM) 18:09:57.223071 run iperf3-srv_10.42.42.10(pid=32027): Terminating (SIGTERM) 18:09:57.264932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32030): Terminating (SIGTERM) 18:09:57.306623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32033): Terminating (SIGTERM) 18:09:57.348327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32036): Terminating (SIGTERM) 18:09:57.390303 --- ParallelTerminationStrategy: PID 32026 died... 18:09:57.410143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32026): Terminated: ok {rc=0} 18:09:57.456214 --- ParallelTerminationStrategy: PID 32027 died... 18:09:57.475606 run iperf3-srv_10.42.42.10(pid=32027): Terminated {rc=256} 18:09:57.522128 --- ParallelTerminationStrategy: PID 32030 died... 18:09:57.541600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32030): Terminated: ok {rc=0} 18:09:57.587656 --- ParallelTerminationStrategy: PID 32033 died... 18:09:57.607144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32033): Terminated: ok {rc=0} 18:09:57.653166 --- ParallelTerminationStrategy: PID 32036 died... 18:09:57.672531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32036): Terminated: ok {rc=0} 18:09:57.759411 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:09:58.908926 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:58.921029 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:09:58.989646 tst iperf3m4.py: using LAC 22791 18:09:59.114707 tst iperf3m4.py: using RAC 96 18:09:59.238367 tst iperf3m4.py: using CellId 22791 18:09:59.361684 tst iperf3m4.py: using BVCI 22792 18:09:59.476064 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:59.487443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:59.498615 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:59.509781 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:59.520930 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:59.532079 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:59.543364 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:59.554439 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:09:59.565769 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:59.682582 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:59.802910 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:09:59.920557 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:00.035129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:10:00.234321 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:00.532524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32038): Launched 18:10:00.791666 run iperf3-srv_10.42.42.10(pid=32039): Launched 18:10:00.925511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:10:01.129919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:01.457878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32043): Launched 18:10:01.739154 run iperf3-srv_10.42.42.10(pid=32044): Launched 18:10:01.864732 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:10:02.070443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:02.373658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32045): Launched 18:10:02.632165 run iperf3-srv_10.42.42.10(pid=32046): Launched 18:10:02.743222 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:10:02.940558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:10:03.237914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32047): Launched 18:10:03.496245 run iperf3-srv_10.42.42.10(pid=32048): Launched 18:10:03.607878 tst iperf3m4.py:8: start network... 18:10:03.805579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:04.263765 run create_hlr_db(pid=32049): Launched 18:10:04.378636 bus /gobi_6: Setting Powered False 18:10:05.437558 run create_hlr_db(pid=32049): Terminated: ok {rc=0} 18:10:05.851589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32051): Launched 18:10:06.148695 run osmo-hlr_10.42.42.2(pid=32052): Launched 18:10:06.262650 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:06.788587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32054): Launched 18:10:07.087160 run osmo-stp_10.42.42.5(pid=32055): Launched 18:10:07.200020 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:07.710551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32057): Launched 18:10:07.824919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:08.075669 run patchelf(pid=32058): Launched 18:10:08.242266 run osmo-stp_10.42.42.5(pid=32055): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32055)] 18:10:08.367941 run osmo-stp_10.42.42.5(pid=32055): stdout: | (launched: 2022-12-09_18:10:07.031070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:08.495101 run osmo-stp_10.42.42.5(pid=32055): stderr: | 20221209181007201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181007201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181007202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181007202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181007202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181007203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181007203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:08.622279 run osmo-stp_10.42.42.5(pid=32055): stdout: | (launched: 2022-12-09_18:10:07.031070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:08.743585 run osmo-stp_10.42.42.5(pid=32055): stderr: | 20221209181007201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181007201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181007202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181007202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181007202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181007203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181007203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:08.887396 run patchelf(pid=32058): Terminating (SIGINT) 18:10:09.053951 run patchelf(pid=32058): Terminated: ok {rc=0} 18:10:09.174304 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32055): Process ended prematurely: osmo-stp_10.42.42.5(pid=32055) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32055)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:10:09.183917 tst iperf3m4.py:8: Test FAILED (10.3 sec) 18:10:09.211651 run osmo-hlr_10.42.42.2(pid=32052): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32052)] 18:10:09.259583 run osmo-hlr_10.42.42.2(pid=32052): stdout: | (launched: 2022-12-09_18:10:06.093931) 18:10:09.308912 run osmo-hlr_10.42.42.2(pid=32052): stderr: | 20221209181006270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181006270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181006270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181006270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181006270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181006270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181006282 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181006290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181006290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181006290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:09.358944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32038): Terminating (SIGTERM) 18:10:09.398816 run iperf3-srv_10.42.42.10(pid=32039): Terminating (SIGTERM) 18:10:09.438560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32043): Terminating (SIGTERM) 18:10:09.478326 run iperf3-srv_10.42.42.10(pid=32044): Terminating (SIGTERM) 18:10:09.517895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32045): Terminating (SIGTERM) 18:10:09.557404 run iperf3-srv_10.42.42.10(pid=32046): Terminating (SIGTERM) 18:10:09.596865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32047): Terminating (SIGTERM) 18:10:09.636370 run iperf3-srv_10.42.42.10(pid=32048): Terminating (SIGTERM) 18:10:09.676311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32051): Terminating (SIGTERM) 18:10:09.715981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32054): Terminating (SIGTERM) 18:10:09.755558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32057): Terminating (SIGTERM) 18:10:09.795240 --- ParallelTerminationStrategy: PID 32038 died... 18:10:09.814334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32038): Terminated: ok {rc=0} 18:10:09.858961 --- ParallelTerminationStrategy: PID 32039 died... 18:10:09.877362 run iperf3-srv_10.42.42.10(pid=32039): Terminated {rc=256} 18:10:09.921545 --- ParallelTerminationStrategy: PID 32043 died... 18:10:09.940030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32043): Terminated: ok {rc=0} 18:10:09.984304 --- ParallelTerminationStrategy: PID 32044 died... 18:10:10.002813 run iperf3-srv_10.42.42.10(pid=32044): Terminated {rc=256} 18:10:10.046710 --- ParallelTerminationStrategy: PID 32045 died... 18:10:10.064894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32045): Terminated: ok {rc=0} 18:10:10.109169 --- ParallelTerminationStrategy: PID 32046 died... 18:10:10.127666 run iperf3-srv_10.42.42.10(pid=32046): Terminated {rc=256} 18:10:10.172566 --- ParallelTerminationStrategy: PID 32047 died... 18:10:10.191295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32047): Terminated: ok {rc=0} 18:10:10.235512 --- ParallelTerminationStrategy: PID 32048 died... 18:10:10.253988 run iperf3-srv_10.42.42.10(pid=32048): Terminated {rc=256} 18:10:10.297927 --- ParallelTerminationStrategy: PID 32051 died... 18:10:10.316188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32051): Terminated: ok {rc=0} 18:10:10.360163 --- ParallelTerminationStrategy: PID 32054 died... 18:10:10.378650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32054): Terminated: ok {rc=0} 18:10:10.422591 --- ParallelTerminationStrategy: PID 32057 died... 18:10:10.441019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32057): Terminated: ok {rc=0} 18:10:10.527061 bus /gobi_4: Setting Powered False 18:10:11.625991 bus /gobi_4: Setting Powered False 18:10:12.740060 bus /gobi_1: Setting Powered False 18:10:13.837587 bus /gobi_1: Setting Powered False 18:10:14.951443 bus /gobi_0: Setting Powered False 18:10:16.073950 bus /gobi_0: Setting Powered False 18:10:17.191490 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:10:18.301388 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:18.313674 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:10:18.381308 tst ping.py: using LAC 22792 18:10:18.503081 tst ping.py: using RAC 97 18:10:18.626170 tst ping.py: using CellId 22792 18:10:18.742300 tst ping.py: using BVCI 22793 18:10:18.848033 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:18.859139 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:18.870090 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:18.881834 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:18.893540 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:18.905191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:18.916767 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:18.928335 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:19.041758 tst ping.py:19: start network... 18:10:19.235657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:19.684390 run create_hlr_db(pid=32060): Launched 18:10:19.795316 bus /gobi_6: Setting Powered False 18:10:20.853725 run create_hlr_db(pid=32060): Terminated: ok {rc=0} 18:10:21.279941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32062): Launched 18:10:21.591491 run osmo-hlr_10.42.42.2(pid=32063): Launched 18:10:21.709744 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:22.247981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32065): Launched 18:10:22.559627 run osmo-stp_10.42.42.5(pid=32066): Launched 18:10:22.677918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:23.213928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32068): Launched 18:10:23.333193 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:23.596204 run patchelf(pid=32069): Launched 18:10:23.769579 run osmo-stp_10.42.42.5(pid=32066): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32066)] 18:10:23.902350 run osmo-stp_10.42.42.5(pid=32066): stdout: | (launched: 2022-12-09_18:10:22.502497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:24.036374 run osmo-stp_10.42.42.5(pid=32066): stderr: | 20221209181022694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181022694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181022694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181022694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181022695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181022695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181022695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:24.170370 run osmo-stp_10.42.42.5(pid=32066): stdout: | (launched: 2022-12-09_18:10:22.502497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:24.298462 run osmo-stp_10.42.42.5(pid=32066): stderr: | 20221209181022694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181022694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181022694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181022694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181022695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181022695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181022695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:24.449961 run patchelf(pid=32069): Terminating (SIGINT) 18:10:24.623777 run patchelf(pid=32069): Terminated: ok {rc=0} 18:10:24.749653 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32066): Process ended prematurely: osmo-stp_10.42.42.5(pid=32066) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32066)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 18:10:24.759167 tst ping.py:22: Test FAILED (6.5 sec) 18:10:24.787190 run osmo-hlr_10.42.42.2(pid=32063): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32063)] 18:10:24.837554 run osmo-hlr_10.42.42.2(pid=32063): stdout: | (launched: 2022-12-09_18:10:21.534456) 18:10:24.889199 run osmo-hlr_10.42.42.2(pid=32063): stderr: | 20221209181021731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181021731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181021731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181021731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181021731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181021731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181021747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181021758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181021759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181021759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:24.941073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32062): Terminating (SIGTERM) 18:10:24.982483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32065): Terminating (SIGTERM) 18:10:25.024302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32068): Terminating (SIGTERM) 18:10:25.066714 --- ParallelTerminationStrategy: PID 32062 died... 18:10:25.086781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32062): Terminated: ok {rc=0} 18:10:25.133319 --- ParallelTerminationStrategy: PID 32065 died... 18:10:25.152655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32065): Terminated: ok {rc=0} 18:10:25.199376 --- ParallelTerminationStrategy: PID 32068 died... 18:10:25.218907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32068): Terminated: ok {rc=0} 18:10:25.306799 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:10:26.394214 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:26.406860 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:10:26.475606 tst ping_idle_ping.py: using LAC 22793 18:10:26.597480 tst ping_idle_ping.py: using RAC 98 18:10:26.715306 tst ping_idle_ping.py: using CellId 22793 18:10:26.835232 tst ping_idle_ping.py: using BVCI 22794 18:10:26.943020 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:26.954283 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:26.965347 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:26.976621 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:26.988020 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:26.999531 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:27.011471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:10:27.022654 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:10:27.139396 tst ping_idle_ping.py:24: start network... 18:10:27.350367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:27.836024 run create_hlr_db(pid=32070): Launched 18:10:27.963087 bus /gobi_6: Setting Powered False 18:10:29.026165 run create_hlr_db(pid=32070): Terminated: ok {rc=0} 18:10:29.443818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32072): Launched 18:10:29.737241 run osmo-hlr_10.42.42.2(pid=32073): Launched 18:10:29.849807 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:30.364348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32075): Launched 18:10:30.657279 run osmo-stp_10.42.42.5(pid=32076): Launched 18:10:30.769214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:31.305645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32078): Launched 18:10:31.432430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:31.689777 run patchelf(pid=32079): Launched 18:10:31.924574 run osmo-stp_10.42.42.5(pid=32076): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32076)] 18:10:32.063423 run osmo-stp_10.42.42.5(pid=32076): stdout: | (launched: 2022-12-09_18:10:30.603095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:32.192566 run osmo-stp_10.42.42.5(pid=32076): stderr: | 20221209181030771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181030771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181030771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181030772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181030772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181030772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181030772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:32.321803 run osmo-stp_10.42.42.5(pid=32076): stdout: | (launched: 2022-12-09_18:10:30.603095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:32.442575 run osmo-stp_10.42.42.5(pid=32076): stderr: | 20221209181030771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181030771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181030771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181030772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181030772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181030772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181030772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:32.585172 run patchelf(pid=32079): Terminating (SIGINT) 18:10:32.749946 run patchelf(pid=32079): Terminated: ok {rc=0} 18:10:32.869497 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32076): Process ended prematurely: osmo-stp_10.42.42.5(pid=32076) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32076)] [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:10:32.878569 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:10:32.907147 run osmo-hlr_10.42.42.2(pid=32073): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32073)] 18:10:32.955723 run osmo-hlr_10.42.42.2(pid=32073): stdout: | (launched: 2022-12-09_18:10:29.682921) 18:10:33.006225 run osmo-hlr_10.42.42.2(pid=32073): stderr: | 20221209181029858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181029858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181029858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181029858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181029858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181029858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181029871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181029879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181029879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181029879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:33.057314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32072): Terminating (SIGTERM) 18:10:33.098160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32075): Terminating (SIGTERM) 18:10:33.139041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32078): Terminating (SIGTERM) 18:10:33.180222 --- ParallelTerminationStrategy: PID 32072 died... 18:10:33.199356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32072): Terminated: ok {rc=0} 18:10:33.244903 --- ParallelTerminationStrategy: PID 32075 died... 18:10:33.263563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32075): Terminated: ok {rc=0} 18:10:33.309157 --- ParallelTerminationStrategy: PID 32078 died... 18:10:33.327750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32078): Terminated: ok {rc=0} 18:10:33.412839 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:10:34.710280 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:34.716700 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:10:34.747326 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:10:34.781625 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:10:34.835030 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:10:34.866545 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:10:34.901874 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:10:35.454958 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:10:35.460770 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:35.472484 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:10:35.539610 tst switch_tch_pdch.py: using LAC 22794 18:10:35.664052 tst switch_tch_pdch.py: using RAC 99 18:10:35.786023 tst switch_tch_pdch.py: using CellId 22794 18:10:35.915280 tst switch_tch_pdch.py: using BVCI 22795 18:10:36.029083 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:36.040850 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:36.052613 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:36.064428 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:36.076205 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:36.087897 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:36.099760 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:10:36.111363 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:10:36.230580 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:10:36.345405 tst switch_tch_pdch.py:51: start network... 18:10:36.541136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:36.991348 run create_hlr_db(pid=32084): Launched 18:10:37.103878 bus /gobi_6: Setting Powered False 18:10:38.162161 run create_hlr_db(pid=32084): Terminated: ok {rc=0} 18:10:38.590667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32086): Launched 18:10:38.903261 run osmo-hlr_10.42.42.2(pid=32087): Launched 18:10:39.022279 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:39.560409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32089): Launched 18:10:39.871451 run osmo-stp_10.42.42.5(pid=32090): Launched 18:10:39.990595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:40.528619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32092): Launched 18:10:40.647546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:40.910579 run patchelf(pid=32093): Launched 18:10:41.084352 run osmo-stp_10.42.42.5(pid=32090): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32090)] 18:10:41.216208 run osmo-stp_10.42.42.5(pid=32090): stdout: | (launched: 2022-12-09_18:10:39.814244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:41.350257 run osmo-stp_10.42.42.5(pid=32090): stderr: | 20221209181040006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181040007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181040007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181040007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181040008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181040008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181040008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:41.484082 run osmo-stp_10.42.42.5(pid=32090): stdout: | (launched: 2022-12-09_18:10:39.814244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:41.611642 run osmo-stp_10.42.42.5(pid=32090): stderr: | 20221209181040006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181040007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181040007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181040007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181040008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181040008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181040008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:41.762808 run patchelf(pid=32093): Terminating (SIGINT) 18:10:41.961061 run patchelf(pid=32093): Terminated: ok {rc=0} 18:10:42.086860 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32090): Process ended prematurely: osmo-stp_10.42.42.5(pid=32090) [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32090)] [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:10:42.096385 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 18:10:42.124274 run osmo-hlr_10.42.42.2(pid=32087): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32087)] 18:10:42.173861 run osmo-hlr_10.42.42.2(pid=32087): stdout: | (launched: 2022-12-09_18:10:38.845966) 18:10:42.225324 run osmo-hlr_10.42.42.2(pid=32087): stderr: | 20221209181039044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181039045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181039045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181039045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181039045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181039045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181039057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181039066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181039066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181039066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:42.277210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32086): Terminating (SIGTERM) 18:10:42.318517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32089): Terminating (SIGTERM) 18:10:42.360002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32092): Terminating (SIGTERM) 18:10:42.402016 --- ParallelTerminationStrategy: PID 32086 died... 18:10:42.421989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32086): Terminated: ok {rc=0} 18:10:42.468730 --- ParallelTerminationStrategy: PID 32089 died... 18:10:42.488517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32089): Terminated: ok {rc=0} 18:10:42.534541 --- ParallelTerminationStrategy: PID 32092 died... 18:10:42.554214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32092): Terminated: ok {rc=0} 18:10:42.641928 bus /gobi_0: Setting Powered False 18:10:43.740290 bus /gobi_0: Setting Powered False 18:10:44.855431 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:10:46.134522 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:46.141606 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:10:46.171933 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:10:46.207301 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:10:46.261528 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:10:46.300299 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:10:46.345201 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:10:46.910962 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:10:46.917542 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:46.930260 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:10:46.998806 tst switch_tch_pdch.py: using LAC 22795 18:10:47.123615 tst switch_tch_pdch.py: using RAC 100 18:10:47.243714 tst switch_tch_pdch.py: using CellId 22795 18:10:47.367616 tst switch_tch_pdch.py: using BVCI 22796 18:10:47.481408 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:47.492919 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:47.504643 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:47.515910 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:47.527043 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:47.538393 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:47.549748 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:10:47.560852 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:10:47.677678 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:10:47.792502 tst switch_tch_pdch.py:51: start network... 18:10:47.986568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:48.411138 run create_hlr_db(pid=32097): Launched 18:10:48.523615 bus /gobi_6: Setting Powered False 18:10:49.581600 run create_hlr_db(pid=32097): Terminated: ok {rc=0} 18:10:49.964479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32099): Launched 18:10:50.256259 run osmo-hlr_10.42.42.2(pid=32100): Launched 18:10:50.367382 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:50.875944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32102): Launched 18:10:51.187370 run osmo-stp_10.42.42.5(pid=32103): Launched 18:10:51.306045 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:10:51.815827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32105): Launched 18:10:51.935884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:10:52.198884 run patchelf(pid=32106): Launched 18:10:52.372659 run osmo-stp_10.42.42.5(pid=32103): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32103)] 18:10:52.504697 run osmo-stp_10.42.42.5(pid=32103): stdout: | (launched: 2022-12-09_18:10:51.130521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:52.639608 run osmo-stp_10.42.42.5(pid=32103): stderr: | 20221209181051319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181051319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181051320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181051320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181051322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181051322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181051322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:52.773870 run osmo-stp_10.42.42.5(pid=32103): stdout: | (launched: 2022-12-09_18:10:51.130521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:52.901874 run osmo-stp_10.42.42.5(pid=32103): stderr: | 20221209181051319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181051319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181051320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181051320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181051322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181051322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181051322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:53.053016 run patchelf(pid=32106): Terminating (SIGINT) 18:10:53.227887 run patchelf(pid=32106): Terminated: ok {rc=0} 18:10:53.353912 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32103): Process ended prematurely: osmo-stp_10.42.42.5(pid=32103) [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32103)] [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:10:53.363302 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 18:10:53.391408 run osmo-hlr_10.42.42.2(pid=32100): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32100)] 18:10:53.441089 run osmo-hlr_10.42.42.2(pid=32100): stdout: | (launched: 2022-12-09_18:10:50.202641) 18:10:53.492650 run osmo-hlr_10.42.42.2(pid=32100): stderr: | 20221209181050377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181050378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181050378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181050378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181050378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181050378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181050390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181050398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181050398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181050398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:53.544814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32099): Terminating (SIGTERM) 18:10:53.586828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32102): Terminating (SIGTERM) 18:10:53.628637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32105): Terminating (SIGTERM) 18:10:53.671035 --- ParallelTerminationStrategy: PID 32099 died... 18:10:53.690664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32099): Terminated: ok {rc=0} 18:10:53.737287 --- ParallelTerminationStrategy: PID 32102 died... 18:10:53.756853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32102): Terminated: ok {rc=0} 18:10:53.803026 --- ParallelTerminationStrategy: PID 32105 died... 18:10:53.822556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32105): Terminated: ok {rc=0} 18:10:53.909848 bus /gobi_0: Setting Powered False 18:10:55.008245 bus /gobi_0: Setting Powered False 18:10:56.123902 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_sms:nanobts --------------------------------------------------------------------- 18:10:57.373137 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:57.377185 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 18:10:57.401468 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 18:10:57.408533 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 18:10:57.461154 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 18:10:57.485261 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 18:10:57.492301 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 18:10:58.029889 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 18:10:58.035249 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 18:10:58.046486 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 18:10:58.085993 tst mo_mt_sms.py: using LAC 22796 18:10:58.209397 tst mo_mt_sms.py: using RAC 101 18:10:58.330831 tst mo_mt_sms.py: using CellId 22796 18:10:58.452766 tst mo_mt_sms.py: using BVCI 22797 18:10:58.565130 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 18:10:58.676708 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 18:10:58.793598 tst mo_mt_sms.py:9: start nitb and bts... 18:10:59.003610 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:10:59.638240 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32110): Launched 18:10:59.949276 run osmo-nitb_10.42.42.2(pid=32111): Launched 18:11:00.122233 run osmo-nitb_10.42.42.2(pid=32111): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32111)] 18:11:00.262479 run osmo-nitb_10.42.42.2(pid=32111): stdout: | (launched: 2022-12-09_18:10:59.892267) 18:11:00.404449 run osmo-nitb_10.42.42.2(pid=32111): stderr: | (launched: 2022-12-09_18:10:59.938575) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:00.546358 run osmo-nitb_10.42.42.2(pid=32111): stdout: | (launched: 2022-12-09_18:10:59.892267) 18:11:00.682577 run osmo-nitb_10.42.42.2(pid=32111): stderr: | (launched: 2022-12-09_18:10:59.938575) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32111): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32111) [trial-2362↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32111)] 18:11:01.066483 tst osmo-nitb_10.42.42.2(pid=32111): stdout: | (launched: 2022-12-09_18:10:59.892267) 18:11:01.193580 tst osmo-nitb_10.42.42.2(pid=32111): stderr: | (launched: 2022-12-09_18:10:59.938575) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:01.345573 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32111): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32111) [trial-2362↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32111)] [trial-2362↪nitb_sms:nanobts↪mo_mt_sms.py:11] 18:11:01.355592 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 18:11:01.363722 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32110): Terminating (SIGTERM) 18:11:01.576661 --- ParallelTerminationStrategy: PID 32110 died... 18:11:01.605724 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32110): Terminated: ok {rc=0} 18:11:01.713743 bus /sierra_3: Setting Powered False 18:11:02.814141 bus /sierra_3: Setting Powered False 18:11:03.931191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 sms:nanobts+band-1900 --------------------------------------------------------------------- 18:11:05.115240 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:05.120298 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:11:05.143857 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:11:05.169992 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 18:11:05.219209 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:11:05.242202 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:11:05.268699 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 18:11:05.816719 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 18:11:05.821643 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:05.832169 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:11:05.869595 tst mo_mt_sms.py: using LAC 22797 18:11:05.983803 tst mo_mt_sms.py: using RAC 102 18:11:06.096451 tst mo_mt_sms.py: using CellId 22797 18:11:06.208566 tst mo_mt_sms.py: using BVCI 22798 18:11:06.312910 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:06.323774 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:06.334235 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:06.345016 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:06.355667 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:06.366320 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 18:11:06.481818 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 18:11:06.593804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:07.043815 run create_hlr_db(pid=32115): Launched 18:11:07.154922 bus /sierra_2: Setting Powered False 18:11:08.213312 run create_hlr_db(pid=32115): Terminated: ok {rc=0} 18:11:08.620012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32117): Launched 18:11:08.911837 run osmo-hlr_10.42.42.2(pid=32118): Launched 18:11:09.023090 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:09.537409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32120): Launched 18:11:09.827952 run osmo-stp_10.42.42.5(pid=32121): Launched 18:11:09.939354 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:10.466308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32123): Launched 18:11:10.757241 run osmo-msc_10.42.42.6(pid=32124): Launched 18:11:10.919834 run osmo-stp_10.42.42.5(pid=32121): ERR: Terminated: ERROR {rc=1} [trial-2362↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32121)] 18:11:11.043260 run osmo-stp_10.42.42.5(pid=32121): stdout: | (launched: 2022-12-09_18:11:09.774496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:11.168250 run osmo-stp_10.42.42.5(pid=32121): stderr: | 20221209181109944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181109944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181109945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181109945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181109947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181109947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181109947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:11.289485 run osmo-stp_10.42.42.5(pid=32121): stdout: | (launched: 2022-12-09_18:11:09.774496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:11.405411 run osmo-stp_10.42.42.5(pid=32121): stderr: | 20221209181109944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181109944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181109945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181109945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181109947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181109947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181109947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:11.544208 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32121): Process ended prematurely: osmo-stp_10.42.42.5(pid=32121) [trial-2362↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32121)] [trial-2362↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 18:11:11.552443 tst mo_mt_sms.py:16: Test FAILED (5.7 sec) 18:11:11.578545 run osmo-hlr_10.42.42.2(pid=32118): ERR: Terminated: ERROR {rc=237} [trial-2362↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32118)] 18:11:11.626357 run osmo-hlr_10.42.42.2(pid=32118): stdout: | (launched: 2022-12-09_18:11:08.858074) 18:11:11.675919 run osmo-hlr_10.42.42.2(pid=32118): stderr: | 20221209181109033 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181109033 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181109033 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181109033 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181109033 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181109033 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181109046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181109056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181109057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181109057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:11.744828 run osmo-msc_10.42.42.6(pid=32124): ERR: Terminated: ERROR {rc=2} [trial-2362↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32124)] 18:11:11.792396 run osmo-msc_10.42.42.6(pid=32124): stdout: | (launched: 2022-12-09_18:11:10.703328) 18:11:11.841706 run osmo-msc_10.42.42.6(pid=32124): stderr: | 20221209181110976 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181110976 DLGLOBAL DEBUG validating counter group 0x7f3b9b0c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181110976 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181110976 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181110977 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181110977 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181110978 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181110979 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181110979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181110979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:11.891677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32117): Terminating (SIGTERM) 18:11:11.931413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32120): Terminating (SIGTERM) 18:11:11.970858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32123): Terminating (SIGTERM) 18:11:12.010665 --- ParallelTerminationStrategy: PID 32117 died... 18:11:12.029471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32117): Terminated: ok {rc=0} 18:11:12.073582 --- ParallelTerminationStrategy: PID 32120 died... 18:11:12.091990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32120): Terminated: ok {rc=0} 18:11:12.135985 --- ParallelTerminationStrategy: PID 32123 died... 18:11:12.154724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32123): Terminated: ok {rc=0} 18:11:12.240022 bus /sierra_3: Setting Powered False 18:11:13.339538 bus /sierra_3: Setting Powered False 18:11:14.454005 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 18:11:15.672570 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:15.677513 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:11:15.702117 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 18:11:15.709578 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 18:11:15.744103 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:11:15.767870 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 18:11:15.775842 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 18:11:16.302282 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 18:11:16.309515 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 18:11:16.323504 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:11:16.373248 tst assert_extension.py: using LAC 22798 18:11:16.496506 tst assert_extension.py: using RAC 103 18:11:16.647642 tst assert_extension.py: using CellId 22798 18:11:16.773135 tst assert_extension.py: using BVCI 22799 18:11:16.927003 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 18:11:17.044933 tst assert_extension.py:10: start nitb and bts... 18:11:17.278122 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:11:17.914710 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32129): Launched 18:11:18.225797 run osmo-nitb_10.42.42.2(pid=32130): Launched 18:11:18.397996 run osmo-nitb_10.42.42.2(pid=32130): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32130)] 18:11:18.538490 run osmo-nitb_10.42.42.2(pid=32130): stdout: | (launched: 2022-12-09_18:11:18.169360) 18:11:18.680418 run osmo-nitb_10.42.42.2(pid=32130): stderr: | (launched: 2022-12-09_18:11:18.215429) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:18.823147 run osmo-nitb_10.42.42.2(pid=32130): stdout: | (launched: 2022-12-09_18:11:18.169360) 18:11:18.959857 run osmo-nitb_10.42.42.2(pid=32130): stderr: | (launched: 2022-12-09_18:11:18.215429) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32130): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32130) [trial-2362↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32130)] 18:11:19.342488 tst osmo-nitb_10.42.42.2(pid=32130): stdout: | (launched: 2022-12-09_18:11:18.169360) 18:11:19.461250 tst osmo-nitb_10.42.42.2(pid=32130): stderr: | (launched: 2022-12-09_18:11:18.215429) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:11:19.600666 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32130): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32130) [trial-2362↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32130)] [trial-2362↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 18:11:19.609292 tst assert_extension.py:12: Test FAILED (3.3 sec) 18:11:19.616020 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32129): Terminating (SIGTERM) 18:11:19.825665 --- ParallelTerminationStrategy: PID 32129 died... 18:11:19.847581 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32129): Terminated: ok {rc=0} 18:11:19.933396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 ussd:nanobts+band-1900 --------------------------------------------------------------------- 18:11:21.099530 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:21.104446 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:11:21.128416 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:11:21.154762 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 18:11:21.190630 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:11:21.213855 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:11:21.240549 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 18:11:21.767966 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 18:11:21.773294 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:21.783866 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:11:21.825443 tst assert_extension.py: using LAC 22799 18:11:21.940799 tst assert_extension.py: using RAC 104 18:11:22.053810 tst assert_extension.py: using CellId 22799 18:11:22.166562 tst assert_extension.py: using BVCI 22800 18:11:22.271560 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:22.282469 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:22.293071 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:22.304076 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:22.315031 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:11:22.326022 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 18:11:22.442888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:22.925607 run create_hlr_db(pid=32134): Launched 18:11:23.052361 bus /sierra_2: Setting Powered False 18:11:24.114519 run create_hlr_db(pid=32134): Terminated: ok {rc=0} 18:11:24.531611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32136): Launched 18:11:24.824599 run osmo-hlr_10.42.42.2(pid=32137): Launched 18:11:24.936420 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:25.450544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32139): Launched 18:11:25.742978 run osmo-stp_10.42.42.5(pid=32140): Launched 18:11:25.854489 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:26.380118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32142): Launched 18:11:26.671769 run osmo-msc_10.42.42.6(pid=32143): Launched 18:11:26.835675 run osmo-stp_10.42.42.5(pid=32140): ERR: Terminated: ERROR {rc=1} [trial-2362↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32140)] 18:11:26.959492 run osmo-stp_10.42.42.5(pid=32140): stdout: | (launched: 2022-12-09_18:11:25.688741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:27.083981 run osmo-stp_10.42.42.5(pid=32140): stderr: | 20221209181125858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181125858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181125858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181125859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181125859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181125859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181125859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:27.205648 run osmo-stp_10.42.42.5(pid=32140): stdout: | (launched: 2022-12-09_18:11:25.688741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:27.321738 run osmo-stp_10.42.42.5(pid=32140): stderr: | 20221209181125858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181125858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181125858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181125859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181125859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181125859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181125859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:27.460306 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32140): Process ended prematurely: osmo-stp_10.42.42.5(pid=32140) [trial-2362↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32140)] [trial-2362↪ussd:nanobts+band-1900↪assert_extension.py:17] 18:11:27.468583 tst assert_extension.py:17: Test FAILED (5.7 sec) 18:11:27.494965 run osmo-hlr_10.42.42.2(pid=32137): ERR: Terminated: ERROR {rc=237} [trial-2362↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32137)] 18:11:27.543373 run osmo-hlr_10.42.42.2(pid=32137): stdout: | (launched: 2022-12-09_18:11:24.770441) 18:11:27.593168 run osmo-hlr_10.42.42.2(pid=32137): stderr: | 20221209181124945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181124945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181124945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181124945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181124946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181124946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181124959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181124969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181124969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181124969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:27.662366 run osmo-msc_10.42.42.6(pid=32143): ERR: Terminated: ERROR {rc=2} [trial-2362↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32143)] 18:11:27.710355 run osmo-msc_10.42.42.6(pid=32143): stdout: | (launched: 2022-12-09_18:11:26.618096) 18:11:27.759919 run osmo-msc_10.42.42.6(pid=32143): stderr: | 20221209181126889 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181126889 DLGLOBAL DEBUG validating counter group 0x7fe47e73bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181126889 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181126889 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181126889 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181126890 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181126891 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181126892 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181126892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181126892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:27.809984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32136): Terminating (SIGTERM) 18:11:27.850152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32139): Terminating (SIGTERM) 18:11:27.890204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32142): Terminating (SIGTERM) 18:11:27.930629 --- ParallelTerminationStrategy: PID 32136 died... 18:11:27.949694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32136): Terminated: ok {rc=0} 18:11:27.994265 --- ParallelTerminationStrategy: PID 32139 died... 18:11:28.012726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32139): Terminated: ok {rc=0} 18:11:28.057437 --- ParallelTerminationStrategy: PID 32142 died... 18:11:28.076008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32142): Terminated: ok {rc=0} 18:11:28.160129 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:11:29.359502 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:29.366666 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:11:29.389772 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:11:29.416696 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:11:29.467016 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:11:29.491736 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:11:29.520152 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:11:30.072916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:11:30.125521 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:30.137406 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:11:30.197410 tst mo_mt_call.py: using LAC 22800 18:11:30.320588 tst mo_mt_call.py: using RAC 105 18:11:30.445301 tst mo_mt_call.py: using CellId 22800 18:11:30.569101 tst mo_mt_call.py: using BVCI 22801 18:11:30.684271 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:30.695994 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:30.707519 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:30.719560 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:30.731774 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:30.743834 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:30.860078 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:30.985961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:31.490797 run create_hlr_db(pid=32148): Launched 18:11:31.654859 bus /sierra_2: Setting Powered False 18:11:32.714515 run create_hlr_db(pid=32148): Terminated: ok {rc=0} 18:11:33.154179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32150): Launched 18:11:33.471277 run osmo-hlr_10.42.42.2(pid=32151): Launched 18:11:33.591591 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:34.136397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32153): Launched 18:11:34.453129 run osmo-stp_10.42.42.5(pid=32154): Launched 18:11:34.573189 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:35.148813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32156): Launched 18:11:35.466300 run osmo-msc_10.42.42.6(pid=32157): Launched 18:11:35.642519 run osmo-stp_10.42.42.5(pid=32154): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32154)] 18:11:35.775946 run osmo-stp_10.42.42.5(pid=32154): stdout: | (launched: 2022-12-09_18:11:34.395267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:35.910827 run osmo-stp_10.42.42.5(pid=32154): stderr: | 20221209181134588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181134588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181134588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181134589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181134589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181134589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181134589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:36.044403 run osmo-stp_10.42.42.5(pid=32154): stdout: | (launched: 2022-12-09_18:11:34.395267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:36.170610 run osmo-stp_10.42.42.5(pid=32154): stderr: | 20221209181134588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181134588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181134588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181134589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181134589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181134589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181134589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:36.321140 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32154): Process ended prematurely: osmo-stp_10.42.42.5(pid=32154) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32154)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:11:36.330800 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:11:36.358699 run osmo-hlr_10.42.42.2(pid=32151): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32151)] 18:11:36.408350 run osmo-hlr_10.42.42.2(pid=32151): stdout: | (launched: 2022-12-09_18:11:33.413788) 18:11:36.459966 run osmo-hlr_10.42.42.2(pid=32151): stderr: | 20221209181133611 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181133611 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181133611 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181133611 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181133611 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181133611 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181133624 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181133632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181133633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181133633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:36.531769 run osmo-msc_10.42.42.6(pid=32157): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32157)] 18:11:36.581682 run osmo-msc_10.42.42.6(pid=32157): stdout: | (launched: 2022-12-09_18:11:35.408376) 18:11:36.633256 run osmo-msc_10.42.42.6(pid=32157): stderr: | 20221209181135730 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181135730 DLGLOBAL DEBUG validating counter group 0x7fda215b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181135731 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181135731 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181135731 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181135731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181135733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181135733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181135733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181135733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:36.685023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32150): Terminating (SIGTERM) 18:11:36.726223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32153): Terminating (SIGTERM) 18:11:36.767542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32156): Terminating (SIGTERM) 18:11:36.809140 --- ParallelTerminationStrategy: PID 32150 died... 18:11:36.829166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32150): Terminated: ok {rc=0} 18:11:36.875871 --- ParallelTerminationStrategy: PID 32153 died... 18:11:36.895653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32153): Terminated: ok {rc=0} 18:11:36.941586 --- ParallelTerminationStrategy: PID 32156 died... 18:11:36.960936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32156): Terminated: ok {rc=0} 18:11:37.048482 bus /sierra_3: Setting Powered False 18:11:38.147357 bus /sierra_3: Setting Powered False 18:11:39.261839 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:11:40.409604 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:40.421729 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:11:40.482188 tst mo_mt_call_osmux.py: using LAC 22801 18:11:40.611258 tst mo_mt_call_osmux.py: using RAC 106 18:11:40.734603 tst mo_mt_call_osmux.py: using CellId 22801 18:11:40.856822 tst mo_mt_call_osmux.py: using BVCI 22802 18:11:40.972941 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:40.984482 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:40.995855 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:41.007184 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:41.018631 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:11:41.029890 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:41.143029 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:11:41.261905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:41.753611 run create_hlr_db(pid=32159): Launched 18:11:41.882877 bus /sierra_2: Setting Powered False 18:11:42.946519 run create_hlr_db(pid=32159): Terminated: ok {rc=0} 18:11:43.370966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32161): Launched 18:11:43.668435 run osmo-hlr_10.42.42.2(pid=32162): Launched 18:11:43.781636 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:44.292408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32164): Launched 18:11:44.590998 run osmo-stp_10.42.42.5(pid=32165): Launched 18:11:44.703928 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:45.241612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32167): Launched 18:11:45.540389 run osmo-msc_10.42.42.6(pid=32168): Launched 18:11:45.719722 run osmo-stp_10.42.42.5(pid=32165): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32165)] 18:11:45.884595 run osmo-stp_10.42.42.5(pid=32165): stdout: | (launched: 2022-12-09_18:11:44.536290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:46.094983 run osmo-stp_10.42.42.5(pid=32165): stderr: | 20221209181144704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181144705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181144705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181144705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181144706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181144706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181144706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:46.372096 run osmo-stp_10.42.42.5(pid=32165): stdout: | (launched: 2022-12-09_18:11:44.536290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:46.491535 run osmo-stp_10.42.42.5(pid=32165): stderr: | 20221209181144704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181144705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181144705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181144705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181144706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181144706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181144706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:46.635258 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32165): Process ended prematurely: osmo-stp_10.42.42.5(pid=32165) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32165)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:11:46.644634 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:11:46.672167 run osmo-hlr_10.42.42.2(pid=32162): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32162)] 18:11:46.720513 run osmo-hlr_10.42.42.2(pid=32162): stdout: | (launched: 2022-12-09_18:11:43.613718) 18:11:46.770823 run osmo-hlr_10.42.42.2(pid=32162): stderr: | 20221209181143791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181143791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181143791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181143791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181143791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181143791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181143804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181143812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181143813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181143813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:46.840543 run osmo-msc_10.42.42.6(pid=32168): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32168)] 18:11:46.889298 run osmo-msc_10.42.42.6(pid=32168): stdout: | (launched: 2022-12-09_18:11:45.484785) 18:11:46.939522 run osmo-msc_10.42.42.6(pid=32168): stderr: | 20221209181145799 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181145799 DLGLOBAL DEBUG validating counter group 0x7f7283827c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181145799 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181145799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181145799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181145799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181145801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181145802 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181145802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181145802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:46.990257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32161): Terminating (SIGTERM) 18:11:47.030818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32164): Terminating (SIGTERM) 18:11:47.071253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32167): Terminating (SIGTERM) 18:11:47.111859 --- ParallelTerminationStrategy: PID 32161 died... 18:11:47.130832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32161): Terminated: ok {rc=0} 18:11:47.176061 --- ParallelTerminationStrategy: PID 32164 died... 18:11:47.195150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32164): Terminated: ok {rc=0} 18:11:47.240264 --- ParallelTerminationStrategy: PID 32167 died... 18:11:47.259081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32167): Terminated: ok {rc=0} 18:11:47.343850 bus /sierra_3: Setting Powered False 18:11:48.438108 bus /sierra_3: Setting Powered False 18:11:49.549617 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:11:50.793767 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:50.802141 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:11:50.826915 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:11:50.854004 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:11:50.907729 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:11:50.932883 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:11:50.960013 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:11:51.510131 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:11:51.561669 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:51.573307 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:11:51.634191 tst mo_mt_call.py: using LAC 22802 18:11:51.752056 tst mo_mt_call.py: using RAC 107 18:11:51.870402 tst mo_mt_call.py: using CellId 22802 18:11:51.987786 tst mo_mt_call.py: using BVCI 22803 18:11:52.095588 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:52.106840 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:52.117910 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:52.129767 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:52.141438 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:11:52.152885 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:11:52.271303 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:11:52.390322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:52.882279 run create_hlr_db(pid=32173): Launched 18:11:53.012497 bus /sierra_2: Setting Powered False 18:11:54.075570 run create_hlr_db(pid=32173): Terminated: ok {rc=0} 18:11:54.500593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32175): Launched 18:11:54.798947 run osmo-hlr_10.42.42.2(pid=32176): Launched 18:11:54.923356 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:55.444745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32178): Launched 18:11:55.743973 run osmo-stp_10.42.42.5(pid=32179): Launched 18:11:55.857982 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:56.394992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32181): Launched 18:11:56.693684 run osmo-msc_10.42.42.6(pid=32182): Launched 18:11:56.860051 run osmo-stp_10.42.42.5(pid=32179): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32179)] 18:11:56.985506 run osmo-stp_10.42.42.5(pid=32179): stdout: | (launched: 2022-12-09_18:11:55.688415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:57.111901 run osmo-stp_10.42.42.5(pid=32179): stderr: | 20221209181155858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181155858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181155858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181155859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181155859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181155859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181155859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:57.236397 run osmo-stp_10.42.42.5(pid=32179): stdout: | (launched: 2022-12-09_18:11:55.688415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:57.354533 run osmo-stp_10.42.42.5(pid=32179): stderr: | 20221209181155858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181155858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181155858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181155859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181155859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181155859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181155859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:57.496143 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32179): Process ended prematurely: osmo-stp_10.42.42.5(pid=32179) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32179)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:11:57.505345 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:11:57.532498 run osmo-hlr_10.42.42.2(pid=32176): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32176)] 18:11:57.580112 run osmo-hlr_10.42.42.2(pid=32176): stdout: | (launched: 2022-12-09_18:11:54.744378) 18:11:57.629637 run osmo-hlr_10.42.42.2(pid=32176): stderr: | 20221209181154929 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181154929 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181154929 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181154929 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181154929 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181154929 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181154941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181154950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181154951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181154951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:57.698555 run osmo-msc_10.42.42.6(pid=32182): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32182)] 18:11:57.746280 run osmo-msc_10.42.42.6(pid=32182): stdout: | (launched: 2022-12-09_18:11:56.638852) 18:11:57.795687 run osmo-msc_10.42.42.6(pid=32182): stderr: | 20221209181156911 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181156911 DLGLOBAL DEBUG validating counter group 0x7f0747f9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181156911 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181156911 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181156911 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181156911 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181156913 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181156914 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181156914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181156914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:57.845552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32175): Terminating (SIGTERM) 18:11:57.885605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32178): Terminating (SIGTERM) 18:11:57.925507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32181): Terminating (SIGTERM) 18:11:57.965570 --- ParallelTerminationStrategy: PID 32175 died... 18:11:57.984319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32175): Terminated: ok {rc=0} 18:11:58.029167 --- ParallelTerminationStrategy: PID 32178 died... 18:11:58.047532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32178): Terminated: ok {rc=0} 18:11:58.091381 --- ParallelTerminationStrategy: PID 32181 died... 18:11:58.109760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32181): Terminated: ok {rc=0} 18:11:58.193236 bus /sierra_3: Setting Powered False 18:11:59.290489 bus /sierra_3: Setting Powered False 18:12:00.407553 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:12:01.558066 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:01.571142 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:12:01.634098 tst mo_mt_call_osmux.py: using LAC 22803 18:12:01.802151 tst mo_mt_call_osmux.py: using RAC 108 18:12:01.936777 tst mo_mt_call_osmux.py: using CellId 22803 18:12:02.062988 tst mo_mt_call_osmux.py: using BVCI 22804 18:12:02.212783 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:02.228774 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:02.247297 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:02.262415 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:02.276329 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:12:02.288623 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:12:02.406257 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:12:02.523117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:02.982311 run create_hlr_db(pid=32184): Launched 18:12:03.096081 bus /sierra_2: Setting Powered False 18:12:04.156130 run create_hlr_db(pid=32184): Terminated: ok {rc=0} 18:12:04.590615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32186): Launched 18:12:04.908574 run osmo-hlr_10.42.42.2(pid=32187): Launched 18:12:05.029629 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:05.581477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32189): Launched 18:12:05.899787 run osmo-stp_10.42.42.5(pid=32190): Launched 18:12:06.020802 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:06.595332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32192): Launched 18:12:06.913878 run osmo-msc_10.42.42.6(pid=32193): Launched 18:12:07.090735 run osmo-stp_10.42.42.5(pid=32190): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32190)] 18:12:07.224528 run osmo-stp_10.42.42.5(pid=32190): stdout: | (launched: 2022-12-09_18:12:05.841660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:07.358779 run osmo-stp_10.42.42.5(pid=32190): stderr: | 20221209181206033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181206033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181206033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181206034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181206036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181206036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181206036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:07.492909 run osmo-stp_10.42.42.5(pid=32190): stdout: | (launched: 2022-12-09_18:12:05.841660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:07.619120 run osmo-stp_10.42.42.5(pid=32190): stderr: | 20221209181206033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181206033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181206033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181206034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181206036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181206036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181206036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:07.770405 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32190): Process ended prematurely: osmo-stp_10.42.42.5(pid=32190) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32190)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:12:07.779971 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:12:07.807916 run osmo-hlr_10.42.42.2(pid=32187): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32187)] 18:12:07.857912 run osmo-hlr_10.42.42.2(pid=32187): stdout: | (launched: 2022-12-09_18:12:04.850283) 18:12:07.909934 run osmo-hlr_10.42.42.2(pid=32187): stderr: | 20221209181205049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181205050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181205050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181205050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181205050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181205050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181205062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181205070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181205071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181205071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:07.982127 run osmo-msc_10.42.42.6(pid=32193): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32193)] 18:12:08.031988 run osmo-msc_10.42.42.6(pid=32193): stdout: | (launched: 2022-12-09_18:12:06.855392) 18:12:08.083427 run osmo-msc_10.42.42.6(pid=32193): stderr: | 20221209181207181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181207181 DLGLOBAL DEBUG validating counter group 0x7f360dd84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181207182 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181207182 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181207182 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181207182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181207184 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181207184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181207184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181207184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:08.135016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32186): Terminating (SIGTERM) 18:12:08.176473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32189): Terminating (SIGTERM) 18:12:08.217912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32192): Terminating (SIGTERM) 18:12:08.259584 --- ParallelTerminationStrategy: PID 32186 died... 18:12:08.279031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32186): Terminated: ok {rc=0} 18:12:08.325166 --- ParallelTerminationStrategy: PID 32189 died... 18:12:08.344620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32189): Terminated: ok {rc=0} 18:12:08.390602 --- ParallelTerminationStrategy: PID 32192 died... 18:12:08.410135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32192): Terminated: ok {rc=0} 18:12:08.497166 bus /sierra_3: Setting Powered False 18:12:09.595185 bus /sierra_3: Setting Powered False 18:12:10.710578 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:12:11.954313 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:11.961855 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:12:11.985220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:12:12.012475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:12:12.065269 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:12:12.089310 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:12:12.116340 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:12:12.662974 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:12:12.711054 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:12.722185 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:12:12.781275 tst mo_mt_call.py: using LAC 22804 18:12:12.899480 tst mo_mt_call.py: using RAC 109 18:12:13.017192 tst mo_mt_call.py: using CellId 22804 18:12:13.133743 tst mo_mt_call.py: using BVCI 22805 18:12:13.243383 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:13.254485 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:13.265381 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:13.276431 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:13.287577 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:13.298613 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:13.412431 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:13.530188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:14.022286 run create_hlr_db(pid=32199): Launched 18:12:14.152868 bus /sierra_2: Setting Powered False 18:12:15.216686 run create_hlr_db(pid=32199): Terminated: ok {rc=0} 18:12:15.659466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32201): Launched 18:12:16.006577 run osmo-hlr_10.42.42.2(pid=32202): Launched 18:12:16.275826 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:16.968499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32204): Launched 18:12:17.309847 run osmo-stp_10.42.42.5(pid=32205): Launched 18:12:17.465252 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:18.004763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32207): Launched 18:12:18.303584 run osmo-msc_10.42.42.6(pid=32208): Launched 18:12:18.470447 run osmo-stp_10.42.42.5(pid=32205): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32205)] 18:12:18.596310 run osmo-stp_10.42.42.5(pid=32205): stdout: | (launched: 2022-12-09_18:12:17.240020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:18.722555 run osmo-stp_10.42.42.5(pid=32205): stderr: | 20221209181217434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181217434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181217434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181217435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181217435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181217435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181217435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:18.847295 run osmo-stp_10.42.42.5(pid=32205): stdout: | (launched: 2022-12-09_18:12:17.240020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:18.965984 run osmo-stp_10.42.42.5(pid=32205): stderr: | 20221209181217434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181217434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181217434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181217435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181217435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181217435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181217435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:19.107504 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32205): Process ended prematurely: osmo-stp_10.42.42.5(pid=32205) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32205)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:12:19.116614 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:12:19.144797 run osmo-hlr_10.42.42.2(pid=32202): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32202)] 18:12:19.193186 run osmo-hlr_10.42.42.2(pid=32202): stdout: | (launched: 2022-12-09_18:12:15.931716) 18:12:19.243269 run osmo-hlr_10.42.42.2(pid=32202): stderr: | 20221209181216341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181216341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181216341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181216341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181216341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181216341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181216362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181216380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181216380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181216380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:19.313009 run osmo-msc_10.42.42.6(pid=32208): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32208)] 18:12:19.361484 run osmo-msc_10.42.42.6(pid=32208): stdout: | (launched: 2022-12-09_18:12:18.249251) 18:12:19.411367 run osmo-msc_10.42.42.6(pid=32208): stderr: | 20221209181218520 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181218520 DLGLOBAL DEBUG validating counter group 0x7f494645fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181218521 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181218521 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181218521 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181218522 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181218523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181218524 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181218524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181218524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:19.461875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32201): Terminating (SIGTERM) 18:12:19.501151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32204): Terminating (SIGTERM) 18:12:19.542168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32207): Terminating (SIGTERM) 18:12:19.582678 --- ParallelTerminationStrategy: PID 32201 died... 18:12:19.601625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32201): Terminated: ok {rc=0} 18:12:19.646797 --- ParallelTerminationStrategy: PID 32204 died... 18:12:19.665241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32204): Terminated: ok {rc=0} 18:12:19.710445 --- ParallelTerminationStrategy: PID 32207 died... 18:12:19.728766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32207): Terminated: ok {rc=0} 18:12:19.815276 bus /sierra_3: Setting Powered False 18:12:20.914491 bus /sierra_3: Setting Powered False 18:12:22.029661 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:12:23.174771 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:23.186634 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:12:23.246839 tst mo_mt_call_osmux.py: using LAC 22805 18:12:23.364345 tst mo_mt_call_osmux.py: using RAC 110 18:12:23.483510 tst mo_mt_call_osmux.py: using CellId 22805 18:12:23.599840 tst mo_mt_call_osmux.py: using BVCI 22806 18:12:23.707065 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:23.718138 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:23.728907 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:23.740153 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:23.751343 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:12:23.762432 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:23.881008 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:12:23.996357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:24.455058 run create_hlr_db(pid=32210): Launched 18:12:24.568224 bus /sierra_2: Setting Powered False 18:12:25.628153 run create_hlr_db(pid=32210): Terminated: ok {rc=0} 18:12:26.061323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32212): Launched 18:12:26.378493 run osmo-hlr_10.42.42.2(pid=32213): Launched 18:12:26.499276 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:27.044521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32215): Launched 18:12:27.362415 run osmo-stp_10.42.42.5(pid=32216): Launched 18:12:27.482912 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:28.061547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32218): Launched 18:12:28.379529 run osmo-msc_10.42.42.6(pid=32219): Launched 18:12:28.556524 run osmo-stp_10.42.42.5(pid=32216): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32216)] 18:12:28.691310 run osmo-stp_10.42.42.5(pid=32216): stdout: | (launched: 2022-12-09_18:12:27.304471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:28.826052 run osmo-stp_10.42.42.5(pid=32216): stderr: | 20221209181227496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181227496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181227496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181227497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181227497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181227497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181227497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:28.960557 run osmo-stp_10.42.42.5(pid=32216): stdout: | (launched: 2022-12-09_18:12:27.304471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:29.086416 run osmo-stp_10.42.42.5(pid=32216): stderr: | 20221209181227496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181227496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181227496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181227497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181227497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181227497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181227497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:29.237049 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32216): Process ended prematurely: osmo-stp_10.42.42.5(pid=32216) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32216)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:12:29.246723 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:12:29.274357 run osmo-hlr_10.42.42.2(pid=32213): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32213)] 18:12:29.324402 run osmo-hlr_10.42.42.2(pid=32213): stdout: | (launched: 2022-12-09_18:12:26.320546) 18:12:29.376024 run osmo-hlr_10.42.42.2(pid=32213): stderr: | 20221209181226515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181226515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181226516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181226516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181226516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181226516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181226535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181226546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181226546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181226547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:29.447643 run osmo-msc_10.42.42.6(pid=32219): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32219)] 18:12:29.497112 run osmo-msc_10.42.42.6(pid=32219): stdout: | (launched: 2022-12-09_18:12:28.321490) 18:12:29.548214 run osmo-msc_10.42.42.6(pid=32219): stderr: | 20221209181228642 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181228642 DLGLOBAL DEBUG validating counter group 0x7f5eab099c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181228643 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181228643 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181228643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181228643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181228645 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181228645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181228645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181228645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:29.599896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32212): Terminating (SIGTERM) 18:12:29.641077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32215): Terminating (SIGTERM) 18:12:29.682171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32218): Terminating (SIGTERM) 18:12:29.723566 --- ParallelTerminationStrategy: PID 32212 died... 18:12:29.743507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32212): Terminated: ok {rc=0} 18:12:29.789699 --- ParallelTerminationStrategy: PID 32215 died... 18:12:29.809196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32215): Terminated: ok {rc=0} 18:12:29.855123 --- ParallelTerminationStrategy: PID 32218 died... 18:12:29.874647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32218): Terminated: ok {rc=0} 18:12:29.962589 bus /sierra_3: Setting Powered False 18:12:31.065215 bus /sierra_3: Setting Powered False 18:12:32.195608 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:12:33.436929 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:33.444501 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:12:33.468628 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:12:33.495401 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:12:33.548786 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:12:33.573328 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:12:33.600010 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:12:34.154008 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:12:34.204325 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:34.215831 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:12:34.275280 tst mo_mt_call.py: using LAC 22806 18:12:34.397584 tst mo_mt_call.py: using RAC 111 18:12:34.520198 tst mo_mt_call.py: using CellId 22806 18:12:34.642745 tst mo_mt_call.py: using BVCI 22807 18:12:34.758835 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:34.770290 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:34.781598 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:34.792866 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:34.804295 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:34.815565 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:12:34.929880 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:12:35.042948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:35.501711 run create_hlr_db(pid=32225): Launched 18:12:35.616106 bus /sierra_2: Setting Powered False 18:12:36.675334 run create_hlr_db(pid=32225): Terminated: ok {rc=0} 18:12:37.109913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32227): Launched 18:12:37.427774 run osmo-hlr_10.42.42.2(pid=32228): Launched 18:12:37.548434 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:38.094339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32230): Launched 18:12:38.411020 run osmo-stp_10.42.42.5(pid=32231): Launched 18:12:38.531359 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:39.105701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32233): Launched 18:12:39.422947 run osmo-msc_10.42.42.6(pid=32234): Launched 18:12:39.599180 run osmo-stp_10.42.42.5(pid=32231): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32231)] 18:12:39.731534 run osmo-stp_10.42.42.5(pid=32231): stdout: | (launched: 2022-12-09_18:12:38.353126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:39.865194 run osmo-stp_10.42.42.5(pid=32231): stderr: | 20221209181238543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181238544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181238544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181238544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181238547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181238547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181238547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:39.998299 run osmo-stp_10.42.42.5(pid=32231): stdout: | (launched: 2022-12-09_18:12:38.353126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:40.123209 run osmo-stp_10.42.42.5(pid=32231): stderr: | 20221209181238543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181238544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181238544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181238544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181238547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181238547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181238547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:40.273148 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32231): Process ended prematurely: osmo-stp_10.42.42.5(pid=32231) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32231)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:12:40.282537 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:12:40.310272 run osmo-hlr_10.42.42.2(pid=32228): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32228)] 18:12:40.360076 run osmo-hlr_10.42.42.2(pid=32228): stdout: | (launched: 2022-12-09_18:12:37.369815) 18:12:40.411800 run osmo-hlr_10.42.42.2(pid=32228): stderr: | 20221209181237568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181237568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181237568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181237568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181237568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181237568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181237581 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181237589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181237589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181237589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:40.483624 run osmo-msc_10.42.42.6(pid=32234): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32234)] 18:12:40.533194 run osmo-msc_10.42.42.6(pid=32234): stdout: | (launched: 2022-12-09_18:12:39.364457) 18:12:40.584557 run osmo-msc_10.42.42.6(pid=32234): stderr: | 20221209181239687 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181239687 DLGLOBAL DEBUG validating counter group 0x7fccd2912c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181239687 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181239687 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181239688 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181239688 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181239690 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181239690 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181239690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181239690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:40.636269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32227): Terminating (SIGTERM) 18:12:40.677698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32230): Terminating (SIGTERM) 18:12:40.719010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32233): Terminating (SIGTERM) 18:12:40.760619 --- ParallelTerminationStrategy: PID 32227 died... 18:12:40.780525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32227): Terminated: ok {rc=0} 18:12:40.826186 --- ParallelTerminationStrategy: PID 32230 died... 18:12:40.845587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32230): Terminated: ok {rc=0} 18:12:40.891364 --- ParallelTerminationStrategy: PID 32233 died... 18:12:40.910984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32233): Terminated: ok {rc=0} 18:12:40.997514 bus /sierra_3: Setting Powered False 18:12:42.095744 bus /sierra_3: Setting Powered False 18:12:43.211885 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:12:44.359007 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:44.371091 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:12:44.431179 tst mo_mt_call_osmux.py: using LAC 22807 18:12:44.555335 tst mo_mt_call_osmux.py: using RAC 112 18:12:44.682212 tst mo_mt_call_osmux.py: using CellId 22807 18:12:44.807950 tst mo_mt_call_osmux.py: using BVCI 22808 18:12:44.924825 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:44.936300 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:44.947661 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:44.959021 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:44.970349 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:12:44.981591 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:12:45.095688 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:12:45.209230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:45.669882 run create_hlr_db(pid=32236): Launched 18:12:45.783567 bus /sierra_2: Setting Powered False 18:12:46.845333 run create_hlr_db(pid=32236): Terminated: ok {rc=0} 18:12:47.307384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32238): Launched 18:12:47.605777 run osmo-hlr_10.42.42.2(pid=32239): Launched 18:12:47.718471 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:48.227958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32241): Launched 18:12:48.526321 run osmo-stp_10.42.42.5(pid=32242): Launched 18:12:48.638578 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:49.178876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32244): Launched 18:12:49.477095 run osmo-msc_10.42.42.6(pid=32245): Launched 18:12:49.643619 run osmo-stp_10.42.42.5(pid=32242): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32242)] 18:12:49.769866 run osmo-stp_10.42.42.5(pid=32242): stdout: | (launched: 2022-12-09_18:12:48.471259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:49.896490 run osmo-stp_10.42.42.5(pid=32242): stderr: | 20221209181248641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181248641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181248642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181248642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181248643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181248643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181248643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:50.020510 run osmo-stp_10.42.42.5(pid=32242): stdout: | (launched: 2022-12-09_18:12:48.471259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:50.138394 run osmo-stp_10.42.42.5(pid=32242): stderr: | 20221209181248641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181248641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181248642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181248642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181248643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181248643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181248643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:50.279159 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32242): Process ended prematurely: osmo-stp_10.42.42.5(pid=32242) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32242)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:12:50.288065 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 18:12:50.314710 run osmo-hlr_10.42.42.2(pid=32239): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32239)] 18:12:50.362300 run osmo-hlr_10.42.42.2(pid=32239): stdout: | (launched: 2022-12-09_18:12:47.551137) 18:12:50.411663 run osmo-hlr_10.42.42.2(pid=32239): stderr: | 20221209181247724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181247724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181247724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181247724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181247725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181247725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181247736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181247746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181247747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181247747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:50.480799 run osmo-msc_10.42.42.6(pid=32245): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32245)] 18:12:50.528343 run osmo-msc_10.42.42.6(pid=32245): stdout: | (launched: 2022-12-09_18:12:49.421659) 18:12:50.577602 run osmo-msc_10.42.42.6(pid=32245): stderr: | 20221209181249693 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181249693 DLGLOBAL DEBUG validating counter group 0x7f3f8a876c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181249693 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181249693 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181249694 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181249694 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181249697 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181249698 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181249698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181249698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:50.627283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32238): Terminating (SIGTERM) 18:12:50.666759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32241): Terminating (SIGTERM) 18:12:50.706095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32244): Terminating (SIGTERM) 18:12:50.745796 --- ParallelTerminationStrategy: PID 32238 died... 18:12:50.764493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32238): Terminated: ok {rc=0} 18:12:50.808513 --- ParallelTerminationStrategy: PID 32241 died... 18:12:50.826939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32241): Terminated: ok {rc=0} 18:12:50.871317 --- ParallelTerminationStrategy: PID 32244 died... 18:12:50.889652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32244): Terminated: ok {rc=0} 18:12:50.975047 bus /sierra_3: Setting Powered False 18:12:52.074947 bus /sierra_3: Setting Powered False 18:12:53.188252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:12:54.435505 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:54.443319 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:12:54.467540 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:12:54.494252 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:12:54.545118 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:12:54.569255 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:12:54.596131 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:12:55.150222 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:12:55.200497 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:55.212075 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:12:55.271448 tst mo_mt_call.py: using LAC 22808 18:12:55.397177 tst mo_mt_call.py: using RAC 113 18:12:55.521140 tst mo_mt_call.py: using CellId 22808 18:12:55.644158 tst mo_mt_call.py: using BVCI 22809 18:12:55.758625 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:55.770170 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:55.781624 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:55.792926 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:55.804388 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:12:55.815716 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:12:55.928276 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:12:56.043896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:56.504101 run create_hlr_db(pid=32251): Launched 18:12:56.618659 bus /sierra_2: Setting Powered False 18:12:57.677672 run create_hlr_db(pid=32251): Terminated: ok {rc=0} 18:12:58.111579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32253): Launched 18:12:58.429795 run osmo-hlr_10.42.42.2(pid=32254): Launched 18:12:58.551420 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:59.101072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32256): Launched 18:12:59.417542 run osmo-stp_10.42.42.5(pid=32257): Launched 18:12:59.538248 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:00.115528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32259): Launched 18:13:00.433126 run osmo-msc_10.42.42.6(pid=32260): Launched 18:13:00.610968 run osmo-stp_10.42.42.5(pid=32257): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32257)] 18:13:00.745320 run osmo-stp_10.42.42.5(pid=32257): stdout: | (launched: 2022-12-09_18:12:59.359672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:00.966471 run osmo-stp_10.42.42.5(pid=32257): stderr: | 20221209181259552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181259552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181259552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181259552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181259553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181259553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181259553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:01.105335 run osmo-stp_10.42.42.5(pid=32257): stdout: | (launched: 2022-12-09_18:12:59.359672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:01.234293 run osmo-stp_10.42.42.5(pid=32257): stderr: | 20221209181259552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181259552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181259552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181259552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181259553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181259553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181259553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:01.388332 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32257): Process ended prematurely: osmo-stp_10.42.42.5(pid=32257) [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32257)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:13:01.398522 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:13:01.427102 run osmo-hlr_10.42.42.2(pid=32254): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32254)] 18:13:01.478719 run osmo-hlr_10.42.42.2(pid=32254): stdout: | (launched: 2022-12-09_18:12:58.371955) 18:13:01.532197 run osmo-hlr_10.42.42.2(pid=32254): stderr: | 20221209181258570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181258570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181258570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181258570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181258570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181258570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181258583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181258591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181258592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181258592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:01.606752 run osmo-msc_10.42.42.6(pid=32260): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32260)] 18:13:01.658120 run osmo-msc_10.42.42.6(pid=32260): stdout: | (launched: 2022-12-09_18:13:00.375083) 18:13:01.711093 run osmo-msc_10.42.42.6(pid=32260): stderr: | 20221209181300697 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181300697 DLGLOBAL DEBUG validating counter group 0x7f3d90844c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181300697 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181300697 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181300697 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181300698 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181300699 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181300700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181300700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181300700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:01.763961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32253): Terminating (SIGTERM) 18:13:01.807395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32256): Terminating (SIGTERM) 18:13:01.852501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32259): Terminating (SIGTERM) 18:13:01.896763 --- ParallelTerminationStrategy: PID 32253 died... 18:13:01.917304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32253): Terminated: ok {rc=0} 18:13:01.965327 --- ParallelTerminationStrategy: PID 32256 died... 18:13:01.985834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32256): Terminated: ok {rc=0} 18:13:02.032855 --- ParallelTerminationStrategy: PID 32259 died... 18:13:02.052887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32259): Terminated: ok {rc=0} 18:13:02.142061 bus /sierra_3: Setting Powered False 18:13:03.244505 bus /sierra_3: Setting Powered False 18:13:04.361477 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:13:05.506522 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:05.518238 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:13:05.577503 tst mo_mt_call_osmux.py: using LAC 22809 18:13:05.696091 tst mo_mt_call_osmux.py: using RAC 114 18:13:05.814586 tst mo_mt_call_osmux.py: using CellId 22809 18:13:05.930713 tst mo_mt_call_osmux.py: using BVCI 22810 18:13:06.039913 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:06.051035 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:06.062044 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:06.073200 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:06.084373 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:13:06.095521 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:13:06.212450 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:13:06.328262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:06.787077 run create_hlr_db(pid=32262): Launched 18:13:06.899841 bus /sierra_2: Setting Powered False 18:13:07.958419 run create_hlr_db(pid=32262): Terminated: ok {rc=0} 18:13:08.391392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32264): Launched 18:13:08.708456 run osmo-hlr_10.42.42.2(pid=32265): Launched 18:13:08.830012 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:09.376578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32267): Launched 18:13:09.694462 run osmo-stp_10.42.42.5(pid=32268): Launched 18:13:09.815481 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:10.390292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32270): Launched 18:13:10.707829 run osmo-msc_10.42.42.6(pid=32271): Launched 18:13:10.884482 run osmo-stp_10.42.42.5(pid=32268): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32268)] 18:13:11.018149 run osmo-stp_10.42.42.5(pid=32268): stdout: | (launched: 2022-12-09_18:13:09.636325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:11.151785 run osmo-stp_10.42.42.5(pid=32268): stderr: | 20221209181309829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181309829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181309829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181309830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181309830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181309830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181309830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:11.285456 run osmo-stp_10.42.42.5(pid=32268): stdout: | (launched: 2022-12-09_18:13:09.636325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:11.411070 run osmo-stp_10.42.42.5(pid=32268): stderr: | 20221209181309829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181309829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181309829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181309830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181309830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181309830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181309830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:11.561400 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32268): Process ended prematurely: osmo-stp_10.42.42.5(pid=32268) [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32268)] [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:13:11.570777 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:13:11.598654 run osmo-hlr_10.42.42.2(pid=32265): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32265)] 18:13:11.648607 run osmo-hlr_10.42.42.2(pid=32265): stdout: | (launched: 2022-12-09_18:13:08.650729) 18:13:11.699882 run osmo-hlr_10.42.42.2(pid=32265): stderr: | 20221209181308850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181308850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181308850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181308850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181308850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181308850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181308863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181308872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181308873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181308873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:11.771524 run osmo-msc_10.42.42.6(pid=32271): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32271)] 18:13:11.821069 run osmo-msc_10.42.42.6(pid=32271): stdout: | (launched: 2022-12-09_18:13:10.649900) 18:13:11.872096 run osmo-msc_10.42.42.6(pid=32271): stderr: | 20221209181310971 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181310971 DLGLOBAL DEBUG validating counter group 0x7f38f9947c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181310971 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181310971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181310972 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181310972 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181310974 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181310974 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181310974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181310974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:11.924214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32264): Terminating (SIGTERM) 18:13:11.965776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32267): Terminating (SIGTERM) 18:13:12.007169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32270): Terminating (SIGTERM) 18:13:12.048767 --- ParallelTerminationStrategy: PID 32264 died... 18:13:12.068692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32264): Terminated: ok {rc=0} 18:13:12.114569 --- ParallelTerminationStrategy: PID 32267 died... 18:13:12.133835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32267): Terminated: ok {rc=0} 18:13:12.179526 --- ParallelTerminationStrategy: PID 32270 died... 18:13:12.198938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32270): Terminated: ok {rc=0} 18:13:12.285247 bus /sierra_3: Setting Powered False 18:13:13.383105 bus /sierra_3: Setting Powered False 18:13:14.498978 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 emergency:nanobts+band-1900 --------------------------------------------------------------------- 18:13:15.734906 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:13:15.740157 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:13:15.764070 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:13:15.790248 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 18:13:15.894457 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:13:15.927577 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:13:15.958548 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 18:13:16.559508 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2362 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 18:13:16.570287 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:16.593581 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:13:16.653246 tst emergency_mo_mt_call.py: using LAC 22810 18:13:16.779559 tst emergency_mo_mt_call.py: using RAC 115 18:13:16.906760 tst emergency_mo_mt_call.py: using CellId 22810 18:13:17.023137 tst emergency_mo_mt_call.py: using BVCI 22811 18:13:17.155384 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:17.167377 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:17.179414 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:17.191517 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:17.203107 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:17.214649 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:17.340626 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:17.460382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:17.913664 run create_hlr_db(pid=32276): Launched 18:13:18.023837 bus /sierra_2: Setting Powered False 18:13:19.081929 run create_hlr_db(pid=32276): Terminated: ok {rc=0} 18:13:19.510049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32278): Launched 18:13:19.822701 run osmo-hlr_10.42.42.2(pid=32279): Launched 18:13:19.942543 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:20.479056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32281): Launched 18:13:20.789044 run osmo-stp_10.42.42.5(pid=32282): Launched 18:13:20.917321 tst emergency_mo_mt_call.py: using MSISDN 7306 18:13:21.077454 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:21.637395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32284): Launched 18:13:21.950806 run osmo-msc_10.42.42.6(pid=32285): Launched 18:13:22.124292 run osmo-stp_10.42.42.5(pid=32282): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32282)] 18:13:22.255160 run osmo-stp_10.42.42.5(pid=32282): stdout: | (launched: 2022-12-09_18:13:20.732251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:22.386868 run osmo-stp_10.42.42.5(pid=32282): stderr: | 20221209181320921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181320921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181320922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181320922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181320922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181320923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181320923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:22.517967 run osmo-stp_10.42.42.5(pid=32282): stdout: | (launched: 2022-12-09_18:13:20.732251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:22.642331 run osmo-stp_10.42.42.5(pid=32282): stderr: | 20221209181320921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181320921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181320922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181320922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181320922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181320923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181320923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:22.790567 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32282): Process ended prematurely: osmo-stp_10.42.42.5(pid=32282) [trial-2362↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32282)] [trial-2362↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 18:13:22.799578 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 18:13:22.827218 run osmo-hlr_10.42.42.2(pid=32279): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32279)] 18:13:22.877590 run osmo-hlr_10.42.42.2(pid=32279): stdout: | (launched: 2022-12-09_18:13:19.765561) 18:13:22.929624 run osmo-hlr_10.42.42.2(pid=32279): stderr: | 20221209181319963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181319963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181319963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181319963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181319963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181319963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181319976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181319985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181319985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181319985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:23.002282 run osmo-msc_10.42.42.6(pid=32285): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32285)] 18:13:23.052046 run osmo-msc_10.42.42.6(pid=32285): stdout: | (launched: 2022-12-09_18:13:21.892708) 18:13:23.103716 run osmo-msc_10.42.42.6(pid=32285): stderr: | 20221209181322214 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181322215 DLGLOBAL DEBUG validating counter group 0x7f3b34271c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181322215 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181322215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181322215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181322215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181322217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181322217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181322218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181322218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:23.155556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32278): Terminating (SIGTERM) 18:13:23.197212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32281): Terminating (SIGTERM) 18:13:23.238966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32284): Terminating (SIGTERM) 18:13:23.281037 --- ParallelTerminationStrategy: PID 32278 died... 18:13:23.300650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32278): Terminated: ok {rc=0} 18:13:23.346847 --- ParallelTerminationStrategy: PID 32281 died... 18:13:23.366488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32281): Terminated: ok {rc=0} 18:13:23.413975 --- ParallelTerminationStrategy: PID 32284 died... 18:13:23.433650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32284): Terminated: ok {rc=0} 18:13:23.520440 bus /sierra_3: Setting Powered False 18:13:24.619494 bus /sierra_3: Setting Powered False 18:13:25.734009 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 18:13:26.819853 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:26.831798 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:13:26.874444 tst emergency_preemptive_call.py: using LAC 22811 18:13:26.999204 tst emergency_preemptive_call.py: using RAC 116 18:13:27.122894 tst emergency_preemptive_call.py: using CellId 22811 18:13:27.244825 tst emergency_preemptive_call.py: using BVCI 22812 18:13:27.356927 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:27.368016 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:27.379031 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:27.389962 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:27.400796 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:13:27.411750 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:27.528598 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:27.641310 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:27.752617 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:27.867870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:28.351443 run create_hlr_db(pid=32287): Launched 18:13:28.477442 bus /sierra_2: Setting Powered False 18:13:29.540122 run create_hlr_db(pid=32287): Terminated: ok {rc=0} 18:13:29.958044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32289): Launched 18:13:30.249597 run osmo-hlr_10.42.42.2(pid=32290): Launched 18:13:30.361306 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:30.880671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32292): Launched 18:13:31.239165 run osmo-stp_10.42.42.5(pid=32293): Launched 18:13:31.489532 tst emergency_preemptive_call.py: using MSISDN 7307 18:13:31.729204 run osmo-msc_10.42.42.6: Starting osmo-msc 18:13:32.299974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32295): Launched 18:13:32.612437 run osmo-msc_10.42.42.6(pid=32296): Launched 18:13:32.786414 run osmo-stp_10.42.42.5(pid=32293): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32293)] 18:13:32.917698 run osmo-stp_10.42.42.5(pid=32293): stdout: | (launched: 2022-12-09_18:13:31.174045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:33.050184 run osmo-stp_10.42.42.5(pid=32293): stderr: | 20221209181331470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181331470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181331471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181331471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181331473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181331474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181331474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:33.181537 run osmo-stp_10.42.42.5(pid=32293): stdout: | (launched: 2022-12-09_18:13:31.174045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:33.305591 run osmo-stp_10.42.42.5(pid=32293): stderr: | 20221209181331470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181331470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181331471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181331471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181331473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181331474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181331474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:33.454083 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32293): Process ended prematurely: osmo-stp_10.42.42.5(pid=32293) [trial-2362↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32293)] [trial-2362↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 18:13:33.462870 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 18:13:33.490371 run osmo-hlr_10.42.42.2(pid=32290): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32290)] 18:13:33.540145 run osmo-hlr_10.42.42.2(pid=32290): stdout: | (launched: 2022-12-09_18:13:30.195170) 18:13:33.591731 run osmo-hlr_10.42.42.2(pid=32290): stderr: | 20221209181330372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181330372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181330372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181330373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181330373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181330373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181330385 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181330394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181330394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181330394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:33.663844 run osmo-msc_10.42.42.6(pid=32296): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32296)] 18:13:33.713574 run osmo-msc_10.42.42.6(pid=32296): stdout: | (launched: 2022-12-09_18:13:32.555060) 18:13:33.765109 run osmo-msc_10.42.42.6(pid=32296): stderr: | 20221209181332876 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181332876 DLGLOBAL DEBUG validating counter group 0x7f66765cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181332876 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181332876 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181332876 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181332877 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181332878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181332879 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181332879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181332879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:13:33.817485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32289): Terminating (SIGTERM) 18:13:33.858958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32292): Terminating (SIGTERM) 18:13:33.900526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32295): Terminating (SIGTERM) 18:13:33.942628 --- ParallelTerminationStrategy: PID 32289 died... 18:13:33.962487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32289): Terminated: ok {rc=0} 18:13:34.008361 --- ParallelTerminationStrategy: PID 32292 died... 18:13:34.027692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32292): Terminated: ok {rc=0} 18:13:34.073441 --- ParallelTerminationStrategy: PID 32295 died... 18:13:34.092835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32295): Terminated: ok {rc=0} 18:13:34.179697 bus /sierra_9: Setting Powered False 18:13:35.279227 bus /sierra_9: Setting Powered False 18:13:36.394679 bus /sierra_8: Setting Powered False 18:13:37.491234 bus /sierra_8: Setting Powered False 18:13:38.605707 bus /sierra_3: Setting Powered False 18:13:39.703077 bus /sierra_3: Setting Powered False 18:13:40.818904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-1900 --------------------------------------------------------------------- 18:13:42.089168 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:13:42.094273 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:13:42.117700 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 18:13:42.156157 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 18:13:42.241189 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:13:42.264074 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 18:13:42.301686 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 18:13:42.891135 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 18:13:42.939718 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:42.950436 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:13:42.989250 tst cs_paging_gprs_active.py: using LAC 22812 18:13:43.115604 tst cs_paging_gprs_active.py: using RAC 117 18:13:43.242208 tst cs_paging_gprs_active.py: using CellId 22812 18:13:43.368244 tst cs_paging_gprs_active.py: using BVCI 22813 18:13:43.485761 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:43.496832 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:43.507826 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:43.519093 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:43.530285 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:43.541489 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:43.552689 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:43.563732 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:43.575091 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:43.692390 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:43.807715 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:13:44.006869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:44.304576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32301): Launched 18:13:44.564539 run iperf3-srv_10.42.42.10(pid=32302): Launched 18:13:44.676088 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:13:44.874296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:45.172863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32303): Launched 18:13:45.432575 run iperf3-srv_10.42.42.10(pid=32304): Launched 18:13:45.544351 tst cs_paging_gprs_active.py:38: start network... 18:13:45.743167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:46.231915 run create_hlr_db(pid=32305): Launched 18:13:46.386222 bus /sierra_2: Setting Powered False 18:13:47.446206 run create_hlr_db(pid=32305): Terminated: ok {rc=0} 18:13:47.881613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32307): Launched 18:13:48.201269 run osmo-hlr_10.42.42.2(pid=32308): Launched 18:13:48.323256 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:48.875713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32310): Launched 18:13:49.194197 run osmo-stp_10.42.42.5(pid=32311): Launched 18:13:49.315183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:13:49.864550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32313): Launched 18:13:49.987902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:13:50.257664 run patchelf(pid=32314): Launched 18:13:50.435897 run osmo-stp_10.42.42.5(pid=32311): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32311)] 18:13:50.571548 run osmo-stp_10.42.42.5(pid=32311): stdout: | (launched: 2022-12-09_18:13:49.136245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:50.708189 run osmo-stp_10.42.42.5(pid=32311): stderr: | 20221209181349329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181349330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181349330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181349330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181349331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181349331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181349331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:50.844771 run osmo-stp_10.42.42.5(pid=32311): stdout: | (launched: 2022-12-09_18:13:49.136245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:50.975855 run osmo-stp_10.42.42.5(pid=32311): stderr: | 20221209181349329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181349330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181349330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181349330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181349331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181349331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181349331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:51.130971 run patchelf(pid=32314): Terminating (SIGINT) 18:13:51.310340 run patchelf(pid=32314): Terminated: ok {rc=0} 18:13:51.440124 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32311): Process ended prematurely: osmo-stp_10.42.42.5(pid=32311) [trial-2362↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32311)] [trial-2362↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 18:13:51.450190 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:13:51.478708 run osmo-hlr_10.42.42.2(pid=32308): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32308)] 18:13:51.528475 run osmo-hlr_10.42.42.2(pid=32308): stdout: | (launched: 2022-12-09_18:13:48.143093) 18:13:51.579826 run osmo-hlr_10.42.42.2(pid=32308): stderr: | 20221209181348342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181348342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181348342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181348343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181348343 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181348343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181348355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181348364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181348365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181348365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:51.631747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32301): Terminating (SIGTERM) 18:13:51.673511 run iperf3-srv_10.42.42.10(pid=32302): Terminating (SIGTERM) 18:13:51.715143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32303): Terminating (SIGTERM) 18:13:51.756851 run iperf3-srv_10.42.42.10(pid=32304): Terminating (SIGTERM) 18:13:51.798399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32307): Terminating (SIGTERM) 18:13:51.840183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32310): Terminating (SIGTERM) 18:13:51.881874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32313): Terminating (SIGTERM) 18:13:51.923798 --- ParallelTerminationStrategy: PID 32301 died... 18:13:51.944120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32301): Terminated: ok {rc=0} 18:13:51.991298 --- ParallelTerminationStrategy: PID 32302 died... 18:13:52.010888 run iperf3-srv_10.42.42.10(pid=32302): Terminated {rc=256} 18:13:52.056652 --- ParallelTerminationStrategy: PID 32303 died... 18:13:52.076282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32303): Terminated: ok {rc=0} 18:13:52.122267 --- ParallelTerminationStrategy: PID 32304 died... 18:13:52.141797 run iperf3-srv_10.42.42.10(pid=32304): Terminated {rc=256} 18:13:52.187623 --- ParallelTerminationStrategy: PID 32307 died... 18:13:52.207205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32307): Terminated: ok {rc=0} 18:13:52.253300 --- ParallelTerminationStrategy: PID 32310 died... 18:13:52.272879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32310): Terminated: ok {rc=0} 18:13:52.318834 --- ParallelTerminationStrategy: PID 32313 died... 18:13:52.338481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32313): Terminated: ok {rc=0} 18:13:52.426466 bus /gobi_0: Setting Powered False 18:13:53.526587 bus /gobi_0: Setting Powered False 18:13:54.641438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 18:13:55.783368 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:55.794768 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:13:55.834202 tst iperf3.py: using LAC 22813 18:13:55.952660 tst iperf3.py: using RAC 118 18:13:56.069350 tst iperf3.py: using CellId 22813 18:13:56.188190 tst iperf3.py: using BVCI 22814 18:13:56.295703 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:56.306529 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:56.317189 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:56.327836 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:56.338396 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:56.348785 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:56.359745 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:56.370475 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:13:56.381451 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:13:56.501858 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:13:56.715847 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:57.034225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32315): Launched 18:13:57.309801 run iperf3-srv_10.42.42.10(pid=32316): Launched 18:13:57.428357 tst iperf3.py:8: start network... 18:13:57.641552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:58.132414 run create_hlr_db(pid=32317): Launched 18:13:58.260779 bus /gobi_6: Setting Powered False 18:13:59.323688 run create_hlr_db(pid=32317): Terminated: ok {rc=0} 18:13:59.748111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32319): Launched 18:14:00.046391 run osmo-hlr_10.42.42.2(pid=32320): Launched 18:14:00.159929 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:00.683523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32322): Launched 18:14:01.017689 run osmo-stp_10.42.42.5(pid=32323): Launched 18:14:01.152606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:01.872439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32325): Launched 18:14:02.039308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:02.323816 run patchelf(pid=32326): Launched 18:14:02.501611 run osmo-stp_10.42.42.5(pid=32323): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32323)] 18:14:02.636613 run osmo-stp_10.42.42.5(pid=32323): stdout: | (launched: 2022-12-09_18:14:00.950417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:02.774176 run osmo-stp_10.42.42.5(pid=32323): stderr: | 20221209181401300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181401300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181401301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181401301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181401302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181401302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181401302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:02.911074 run osmo-stp_10.42.42.5(pid=32323): stdout: | (launched: 2022-12-09_18:14:00.950417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:03.042586 run osmo-stp_10.42.42.5(pid=32323): stderr: | 20221209181401300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181401300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181401301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181401301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181401302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181401302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181401302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:03.197401 run patchelf(pid=32326): Terminating (SIGINT) 18:14:03.376228 run patchelf(pid=32326): Terminated: ok {rc=0} 18:14:03.505158 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32323): Process ended prematurely: osmo-stp_10.42.42.5(pid=32323) [trial-2362↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32323)] [trial-2362↪gprs:nanobts+band-1900↪iperf3.py:8] 18:14:03.515285 tst iperf3.py:8: Test FAILED (7.8 sec) 18:14:03.543680 run osmo-hlr_10.42.42.2(pid=32320): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32320)] 18:14:03.593501 run osmo-hlr_10.42.42.2(pid=32320): stdout: | (launched: 2022-12-09_18:13:59.991418) 18:14:03.645138 run osmo-hlr_10.42.42.2(pid=32320): stderr: | 20221209181400167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181400167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181400167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181400167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181400167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181400167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181400179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181400190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181400190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181400190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:03.696874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32315): Terminating (SIGTERM) 18:14:03.738672 run iperf3-srv_10.42.42.10(pid=32316): Terminating (SIGTERM) 18:14:03.780339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32319): Terminating (SIGTERM) 18:14:03.822065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32322): Terminating (SIGTERM) 18:14:03.863660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32325): Terminating (SIGTERM) 18:14:03.905650 --- ParallelTerminationStrategy: PID 32315 died... 18:14:03.925596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32315): Terminated: ok {rc=0} 18:14:03.972198 --- ParallelTerminationStrategy: PID 32316 died... 18:14:03.991917 run iperf3-srv_10.42.42.10(pid=32316): Terminated {rc=256} 18:14:04.038099 --- ParallelTerminationStrategy: PID 32319 died... 18:14:04.058063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32319): Terminated: ok {rc=0} 18:14:04.104301 --- ParallelTerminationStrategy: PID 32322 died... 18:14:04.123996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32322): Terminated: ok {rc=0} 18:14:04.170463 --- ParallelTerminationStrategy: PID 32325 died... 18:14:04.190068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32325): Terminated: ok {rc=0} 18:14:04.277285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 18:14:05.422432 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:05.433819 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:14:05.471381 tst iperf3m4.py: using LAC 22814 18:14:05.596688 tst iperf3m4.py: using RAC 119 18:14:05.721204 tst iperf3m4.py: using CellId 22814 18:14:05.844568 tst iperf3m4.py: using BVCI 22815 18:14:05.960581 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:05.971734 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:05.982663 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:05.994202 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:06.005518 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:06.016811 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:06.028328 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:06.039492 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:06.050968 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:06.167832 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:06.288097 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:06.403299 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:06.514669 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:14:06.714060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:07.014251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32327): Launched 18:14:07.273813 run iperf3-srv_10.42.42.10(pid=32328): Launched 18:14:07.385670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:14:07.583704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:07.881834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32329): Launched 18:14:08.142297 run iperf3-srv_10.42.42.10(pid=32330): Launched 18:14:08.254069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:14:08.451973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:08.750998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32331): Launched 18:14:09.011045 run iperf3-srv_10.42.42.10(pid=32332): Launched 18:14:09.122529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:14:09.320489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:09.619605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32333): Launched 18:14:09.879236 run iperf3-srv_10.42.42.10(pid=32334): Launched 18:14:09.990971 tst iperf3m4.py:8: start network... 18:14:10.198939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:10.691009 run create_hlr_db(pid=32335): Launched 18:14:10.819174 bus /gobi_6: Setting Powered False 18:14:11.881835 run create_hlr_db(pid=32335): Terminated: ok {rc=0} 18:14:12.325026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32337): Launched 18:14:12.643349 run osmo-hlr_10.42.42.2(pid=32338): Launched 18:14:12.764352 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:13.310221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32340): Launched 18:14:13.628179 run osmo-stp_10.42.42.5(pid=32341): Launched 18:14:13.750040 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:14.299617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32343): Launched 18:14:14.421628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:14.689472 run patchelf(pid=32344): Launched 18:14:14.867428 run osmo-stp_10.42.42.5(pid=32341): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32341)] 18:14:15.002634 run osmo-stp_10.42.42.5(pid=32341): stdout: | (launched: 2022-12-09_18:14:13.569866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:15.139217 run osmo-stp_10.42.42.5(pid=32341): stderr: | 20221209181413763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181413763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181413763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181413764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181413764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181413764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181413764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:15.275387 run osmo-stp_10.42.42.5(pid=32341): stdout: | (launched: 2022-12-09_18:14:13.569866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:15.405754 run osmo-stp_10.42.42.5(pid=32341): stderr: | 20221209181413763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181413763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181413763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181413764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181413764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181413764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181413764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:15.559910 run patchelf(pid=32344): Terminating (SIGINT) 18:14:15.738813 run patchelf(pid=32344): Terminated: ok {rc=0} 18:14:15.868822 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32341): Process ended prematurely: osmo-stp_10.42.42.5(pid=32341) [trial-2362↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32341)] [trial-2362↪gprs:nanobts+band-1900↪iperf3m4.py:8] 18:14:15.880066 tst iperf3m4.py:8: Test FAILED (10.5 sec) 18:14:15.918741 run osmo-hlr_10.42.42.2(pid=32338): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32338)] 18:14:15.969195 run osmo-hlr_10.42.42.2(pid=32338): stdout: | (launched: 2022-12-09_18:14:12.585133) 18:14:16.021247 run osmo-hlr_10.42.42.2(pid=32338): stderr: | 20221209181412783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181412783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181412783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181412783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181412783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181412783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181412795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181412803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181412803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181412803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:16.091746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32327): Terminating (SIGTERM) 18:14:16.138942 run iperf3-srv_10.42.42.10(pid=32328): Terminating (SIGTERM) 18:14:16.182403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32329): Terminating (SIGTERM) 18:14:16.225137 run iperf3-srv_10.42.42.10(pid=32330): Terminating (SIGTERM) 18:14:16.267595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32331): Terminating (SIGTERM) 18:14:16.311601 run iperf3-srv_10.42.42.10(pid=32332): Terminating (SIGTERM) 18:14:16.355246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32333): Terminating (SIGTERM) 18:14:16.399037 run iperf3-srv_10.42.42.10(pid=32334): Terminating (SIGTERM) 18:14:16.442932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32337): Terminating (SIGTERM) 18:14:16.486139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32340): Terminating (SIGTERM) 18:14:16.530501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32343): Terminating (SIGTERM) 18:14:16.576142 --- ParallelTerminationStrategy: PID 32327 died... 18:14:16.596521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32327): Terminated: ok {rc=0} 18:14:16.645673 --- ParallelTerminationStrategy: PID 32328 died... 18:14:16.665486 run iperf3-srv_10.42.42.10(pid=32328): Terminated {rc=256} 18:14:16.713096 --- ParallelTerminationStrategy: PID 32329 died... 18:14:16.733168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32329): Terminated: ok {rc=0} 18:14:16.790720 --- ParallelTerminationStrategy: PID 32330 died... 18:14:16.815295 run iperf3-srv_10.42.42.10(pid=32330): Terminated {rc=256} 18:14:16.874011 --- ParallelTerminationStrategy: PID 32331 died... 18:14:16.896890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32331): Terminated: ok {rc=0} 18:14:16.954221 --- ParallelTerminationStrategy: PID 32332 died... 18:14:16.978568 run iperf3-srv_10.42.42.10(pid=32332): Terminated {rc=256} 18:14:17.037362 --- ParallelTerminationStrategy: PID 32333 died... 18:14:17.062666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32333): Terminated: ok {rc=0} 18:14:17.117327 --- ParallelTerminationStrategy: PID 32334 died... 18:14:17.143225 run iperf3-srv_10.42.42.10(pid=32334): Terminated {rc=256} 18:14:17.202661 --- ParallelTerminationStrategy: PID 32337 died... 18:14:17.227968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32337): Terminated: ok {rc=0} 18:14:17.276038 --- ParallelTerminationStrategy: PID 32340 died... 18:14:17.296645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32340): Terminated: ok {rc=0} 18:14:17.344094 --- ParallelTerminationStrategy: PID 32343 died... 18:14:17.363192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32343): Terminated: ok {rc=0} 18:14:17.449669 bus /gobi_4: Setting Powered False 18:14:18.548226 bus /gobi_4: Setting Powered False 18:14:19.664182 bus /gobi_1: Setting Powered False 18:14:20.762072 bus /gobi_1: Setting Powered False 18:14:21.874549 bus /gobi_0: Setting Powered False 18:14:22.973822 bus /gobi_0: Setting Powered False 18:14:24.090955 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 18:14:25.192770 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:25.204095 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:14:25.242518 tst ping.py: using LAC 22815 18:14:25.357703 tst ping.py: using RAC 120 18:14:25.479294 tst ping.py: using CellId 22815 18:14:25.593330 tst ping.py: using BVCI 22816 18:14:25.698608 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:25.709444 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:25.720013 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:25.730853 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:25.741700 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:25.752334 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:25.763065 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:25.773752 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:25.888472 tst ping.py:19: start network... 18:14:26.100163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:26.583020 run create_hlr_db(pid=32346): Launched 18:14:26.710406 bus /gobi_6: Setting Powered False 18:14:27.772561 run create_hlr_db(pid=32346): Terminated: ok {rc=0} 18:14:28.207706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32348): Launched 18:14:28.519300 run osmo-hlr_10.42.42.2(pid=32349): Launched 18:14:28.637915 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:29.180255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32351): Launched 18:14:29.491874 run osmo-stp_10.42.42.5(pid=32352): Launched 18:14:29.610377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:30.148266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32354): Launched 18:14:30.267832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:30.530755 run patchelf(pid=32355): Launched 18:14:30.703917 run osmo-stp_10.42.42.5(pid=32352): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32352)] 18:14:30.847846 run osmo-stp_10.42.42.5(pid=32352): stdout: | (launched: 2022-12-09_18:14:29.434727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:30.994730 run osmo-stp_10.42.42.5(pid=32352): stderr: | 20221209181429625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181429625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181429625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181429626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181429626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181429626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181429626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:31.125208 run osmo-stp_10.42.42.5(pid=32352): stdout: | (launched: 2022-12-09_18:14:29.434727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:31.249618 run osmo-stp_10.42.42.5(pid=32352): stderr: | 20221209181429625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181429625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181429625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181429626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181429626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181429626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181429626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:31.397944 run patchelf(pid=32355): Terminating (SIGINT) 18:14:31.569189 run patchelf(pid=32355): Terminated: ok {rc=0} 18:14:31.692492 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32352): Process ended prematurely: osmo-stp_10.42.42.5(pid=32352) [trial-2362↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32352)] [trial-2362↪gprs:nanobts+band-1900↪ping.py:22] 18:14:31.702587 tst ping.py:22: Test FAILED (6.5 sec) 18:14:31.732866 run osmo-hlr_10.42.42.2(pid=32349): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32349)] 18:14:31.784321 run osmo-hlr_10.42.42.2(pid=32349): stdout: | (launched: 2022-12-09_18:14:28.462237) 18:14:31.836665 run osmo-hlr_10.42.42.2(pid=32349): stderr: | 20221209181428658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181428658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181428658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181428658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181428658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181428658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181428671 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181428679 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181428680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181428680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:31.889437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32348): Terminating (SIGTERM) 18:14:31.931657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32351): Terminating (SIGTERM) 18:14:31.977856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32354): Terminating (SIGTERM) 18:14:32.022638 --- ParallelTerminationStrategy: PID 32348 died... 18:14:32.042596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32348): Terminated: ok {rc=0} 18:14:32.091289 --- ParallelTerminationStrategy: PID 32351 died... 18:14:32.111047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32351): Terminated: ok {rc=0} 18:14:32.159748 --- ParallelTerminationStrategy: PID 32354 died... 18:14:32.178710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32354): Terminated: ok {rc=0} 18:14:32.264443 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 18:14:33.352644 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:33.364468 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:14:33.405669 tst ping_idle_ping.py: using LAC 22816 18:14:33.527290 tst ping_idle_ping.py: using RAC 121 18:14:33.649573 tst ping_idle_ping.py: using CellId 22816 18:14:33.771435 tst ping_idle_ping.py: using BVCI 22817 18:14:33.885864 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:33.897060 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:33.908082 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:33.919140 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:33.930113 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:33.941057 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:33.952661 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:14:33.963732 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:14:34.075443 tst ping_idle_ping.py:24: start network... 18:14:34.271529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:34.726582 run create_hlr_db(pid=32356): Launched 18:14:34.838998 bus /gobi_6: Setting Powered False 18:14:35.901662 run create_hlr_db(pid=32356): Terminated: ok {rc=0} 18:14:36.323352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32358): Launched 18:14:36.615567 run osmo-hlr_10.42.42.2(pid=32359): Launched 18:14:36.727889 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:37.229555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32361): Launched 18:14:37.522711 run osmo-stp_10.42.42.5(pid=32362): Launched 18:14:37.634851 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:38.138392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32364): Launched 18:14:38.250539 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:38.498747 run patchelf(pid=32365): Launched 18:14:38.662326 run osmo-stp_10.42.42.5(pid=32362): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32362)] 18:14:38.786850 run osmo-stp_10.42.42.5(pid=32362): stdout: | (launched: 2022-12-09_18:14:37.468340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:38.914001 run osmo-stp_10.42.42.5(pid=32362): stderr: | 20221209181437638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181437638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181437638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181437639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181437639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181437639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181437639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:39.040837 run osmo-stp_10.42.42.5(pid=32362): stdout: | (launched: 2022-12-09_18:14:37.468340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:39.161673 run osmo-stp_10.42.42.5(pid=32362): stderr: | 20221209181437638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181437638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181437638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181437639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181437639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181437639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181437639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:39.304330 run patchelf(pid=32365): Terminating (SIGINT) 18:14:39.469373 run patchelf(pid=32365): Terminated: ok {rc=0} 18:14:39.588297 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32362): Process ended prematurely: osmo-stp_10.42.42.5(pid=32362) [trial-2362↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32362)] [trial-2362↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 18:14:39.597249 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 18:14:39.624481 run osmo-hlr_10.42.42.2(pid=32359): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32359)] 18:14:39.672348 run osmo-hlr_10.42.42.2(pid=32359): stdout: | (launched: 2022-12-09_18:14:36.562037) 18:14:39.721799 run osmo-hlr_10.42.42.2(pid=32359): stderr: | 20221209181436734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181436734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181436734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181436734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181436734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181436734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181436746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181436754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181436755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181436755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:39.771689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32358): Terminating (SIGTERM) 18:14:39.811499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32361): Terminating (SIGTERM) 18:14:39.851212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32364): Terminating (SIGTERM) 18:14:39.891495 --- ParallelTerminationStrategy: PID 32358 died... 18:14:39.910630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32358): Terminated: ok {rc=0} 18:14:39.955425 --- ParallelTerminationStrategy: PID 32361 died... 18:14:39.974174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32361): Terminated: ok {rc=0} 18:14:40.018581 --- ParallelTerminationStrategy: PID 32364 died... 18:14:40.037122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32364): Terminated: ok {rc=0} 18:14:40.123174 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 18:14:41.413815 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:14:41.419836 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:14:41.443914 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:14:41.481761 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:14:41.566686 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:14:41.589683 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:14:41.627304 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:14:42.220528 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:14:42.268641 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:42.279443 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:14:42.319884 tst cs_paging_gprs_active.py: using LAC 22817 18:14:42.437736 tst cs_paging_gprs_active.py: using RAC 122 18:14:42.553906 tst cs_paging_gprs_active.py: using CellId 22817 18:14:42.670091 tst cs_paging_gprs_active.py: using BVCI 22818 18:14:42.785973 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:42.797508 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:42.808700 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:42.820123 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:42.831429 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:42.843072 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:42.854657 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:42.866035 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:42.877757 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:42.992533 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:43.105993 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:14:43.304879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:43.602736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32369): Launched 18:14:43.862429 run iperf3-srv_10.42.42.10(pid=32370): Launched 18:14:43.974006 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:14:44.172728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:44.472754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32371): Launched 18:14:44.731725 run iperf3-srv_10.42.42.10(pid=32372): Launched 18:14:44.843478 tst cs_paging_gprs_active.py:38: start network... 18:14:45.042020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:45.503558 run create_hlr_db(pid=32373): Launched 18:14:45.618474 bus /gobi_6: Setting Powered False 18:14:46.682672 run create_hlr_db(pid=32373): Terminated: ok {rc=0} 18:14:47.142034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32375): Launched 18:14:47.467476 run osmo-hlr_10.42.42.2(pid=32376): Launched 18:14:47.591594 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:48.140003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32378): Launched 18:14:48.459214 run osmo-stp_10.42.42.5(pid=32379): Launched 18:14:48.581481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:49.131035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32381): Launched 18:14:49.253794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:49.523352 run patchelf(pid=32382): Launched 18:14:49.701448 run osmo-stp_10.42.42.5(pid=32379): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32379)] 18:14:49.836887 run osmo-stp_10.42.42.5(pid=32379): stdout: | (launched: 2022-12-09_18:14:48.400806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:49.973919 run osmo-stp_10.42.42.5(pid=32379): stderr: | 20221209181448591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181448592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181448592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181448592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181448594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181448595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181448595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:50.110792 run osmo-stp_10.42.42.5(pid=32379): stdout: | (launched: 2022-12-09_18:14:48.400806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:50.241557 run osmo-stp_10.42.42.5(pid=32379): stderr: | 20221209181448591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181448592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181448592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181448592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181448594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181448595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181448595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:50.396478 run patchelf(pid=32382): Terminating (SIGINT) 18:14:50.576217 run patchelf(pid=32382): Terminated: ok {rc=0} 18:14:50.705641 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32379): Process ended prematurely: osmo-stp_10.42.42.5(pid=32379) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32379)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:14:50.715838 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:14:50.744452 run osmo-hlr_10.42.42.2(pid=32376): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32376)] 18:14:50.793952 run osmo-hlr_10.42.42.2(pid=32376): stdout: | (launched: 2022-12-09_18:14:47.409505) 18:14:50.845301 run osmo-hlr_10.42.42.2(pid=32376): stderr: | 20221209181447608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181447608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181447608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181447608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181447608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181447608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181447619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181447628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181447628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181447628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:50.897214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32369): Terminating (SIGTERM) 18:14:50.938427 run iperf3-srv_10.42.42.10(pid=32370): Terminating (SIGTERM) 18:14:50.980576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32371): Terminating (SIGTERM) 18:14:51.022277 run iperf3-srv_10.42.42.10(pid=32372): Terminating (SIGTERM) 18:14:51.063637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32375): Terminating (SIGTERM) 18:14:51.105221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32378): Terminating (SIGTERM) 18:14:51.146679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32381): Terminating (SIGTERM) 18:14:51.188320 --- ParallelTerminationStrategy: PID 32369 died... 18:14:51.208246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32369): Terminated: ok {rc=0} 18:14:51.254405 --- ParallelTerminationStrategy: PID 32370 died... 18:14:51.273711 run iperf3-srv_10.42.42.10(pid=32370): Terminated {rc=256} 18:14:51.319364 --- ParallelTerminationStrategy: PID 32371 died... 18:14:51.338751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32371): Terminated: ok {rc=0} 18:14:51.384438 --- ParallelTerminationStrategy: PID 32372 died... 18:14:51.403745 run iperf3-srv_10.42.42.10(pid=32372): Terminated {rc=256} 18:14:51.449265 --- ParallelTerminationStrategy: PID 32375 died... 18:14:51.468573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32375): Terminated: ok {rc=0} 18:14:51.514406 --- ParallelTerminationStrategy: PID 32378 died... 18:14:51.533860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32378): Terminated: ok {rc=0} 18:14:51.579811 --- ParallelTerminationStrategy: PID 32381 died... 18:14:51.599384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32381): Terminated: ok {rc=0} 18:14:51.685941 bus /gobi_0: Setting Powered False 18:14:52.783795 bus /gobi_0: Setting Powered False 18:14:53.899113 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:14:55.047238 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:55.059159 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:14:55.102722 tst iperf3.py: using LAC 22818 18:14:55.229084 tst iperf3.py: using RAC 123 18:14:55.354775 tst iperf3.py: using CellId 22818 18:14:55.479380 tst iperf3.py: using BVCI 22819 18:14:55.594607 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:55.606190 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:55.617308 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:55.628333 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:55.639329 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:55.650281 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:55.661511 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:55.672538 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:55.683736 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:55.798122 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:14:55.998956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:56.298211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32383): Launched 18:14:56.559074 run iperf3-srv_10.42.42.10(pid=32384): Launched 18:14:56.671825 tst iperf3.py:8: start network... 18:14:56.871108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:57.332669 run create_hlr_db(pid=32385): Launched 18:14:57.447908 bus /gobi_6: Setting Powered False 18:14:58.508398 run create_hlr_db(pid=32385): Terminated: ok {rc=0} 18:14:58.924078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32387): Launched 18:14:59.222441 run osmo-hlr_10.42.42.2(pid=32388): Launched 18:14:59.336239 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:59.851623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32390): Launched 18:15:00.150219 run osmo-stp_10.42.42.5(pid=32391): Launched 18:15:00.264231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:00.778361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32393): Launched 18:15:00.934497 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:01.250584 run patchelf(pid=32394): Launched 18:15:01.466065 run osmo-stp_10.42.42.5(pid=32391): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32391)] 18:15:01.630427 run osmo-stp_10.42.42.5(pid=32391): stdout: | (launched: 2022-12-09_18:15:00.095084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:01.799870 run osmo-stp_10.42.42.5(pid=32391): stderr: | 20221209181500263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181500263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181500263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181500263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181500266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181500266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181500266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:01.943287 run osmo-stp_10.42.42.5(pid=32391): stdout: | (launched: 2022-12-09_18:15:00.095084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:02.073587 run osmo-stp_10.42.42.5(pid=32391): stderr: | 20221209181500263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181500263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181500263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181500263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181500266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181500266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181500266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:02.221483 run patchelf(pid=32394): Terminating (SIGINT) 18:15:02.392056 run patchelf(pid=32394): Terminated: ok {rc=0} 18:15:02.514880 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32391): Process ended prematurely: osmo-stp_10.42.42.5(pid=32391) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32391)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 18:15:02.524668 tst iperf3.py:8: Test FAILED (7.5 sec) 18:15:02.553124 run osmo-hlr_10.42.42.2(pid=32388): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32388)] 18:15:02.602607 run osmo-hlr_10.42.42.2(pid=32388): stdout: | (launched: 2022-12-09_18:14:59.167797) 18:15:02.652759 run osmo-hlr_10.42.42.2(pid=32388): stderr: | 20221209181459345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181459345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181459345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181459345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181459345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181459345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181459357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181459367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181459367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181459367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:02.704138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32383): Terminating (SIGTERM) 18:15:02.744625 run iperf3-srv_10.42.42.10(pid=32384): Terminating (SIGTERM) 18:15:02.785218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32387): Terminating (SIGTERM) 18:15:02.825778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32390): Terminating (SIGTERM) 18:15:02.866182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32393): Terminating (SIGTERM) 18:15:02.906940 --- ParallelTerminationStrategy: PID 32383 died... 18:15:02.926067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32383): Terminated: ok {rc=0} 18:15:02.971930 --- ParallelTerminationStrategy: PID 32384 died... 18:15:02.990798 run iperf3-srv_10.42.42.10(pid=32384): Terminated {rc=256} 18:15:03.036377 --- ParallelTerminationStrategy: PID 32387 died... 18:15:03.054963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32387): Terminated: ok {rc=0} 18:15:03.100210 --- ParallelTerminationStrategy: PID 32390 died... 18:15:03.118958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32390): Terminated: ok {rc=0} 18:15:03.164411 --- ParallelTerminationStrategy: PID 32393 died... 18:15:03.183138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32393): Terminated: ok {rc=0} 18:15:03.270829 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:15:04.416998 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:04.428372 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:15:04.470273 tst iperf3m4.py: using LAC 22819 18:15:04.587555 tst iperf3m4.py: using RAC 124 18:15:04.704818 tst iperf3m4.py: using CellId 22819 18:15:04.832063 tst iperf3m4.py: using BVCI 22820 18:15:04.947469 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:04.959073 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:04.970675 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:04.982344 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:04.993742 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:05.004938 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:05.016359 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:05.027485 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:05.038759 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:05.154568 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:05.273736 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:05.386585 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:05.503720 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:15:05.718751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:06.039992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32398): Launched 18:15:06.318262 run iperf3-srv_10.42.42.10(pid=32399): Launched 18:15:06.438234 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:15:06.653330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:06.973133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32400): Launched 18:15:07.250453 run iperf3-srv_10.42.42.10(pid=32401): Launched 18:15:07.370365 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:15:07.585051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:07.905311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32402): Launched 18:15:08.183625 run iperf3-srv_10.42.42.10(pid=32403): Launched 18:15:08.303560 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:15:08.517775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:08.838467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32404): Launched 18:15:09.117214 run iperf3-srv_10.42.42.10(pid=32405): Launched 18:15:09.236469 tst iperf3m4.py:8: start network... 18:15:09.450847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:09.946969 run create_hlr_db(pid=32406): Launched 18:15:10.076462 bus /gobi_6: Setting Powered False 18:15:11.140183 run create_hlr_db(pid=32406): Terminated: ok {rc=0} 18:15:11.585708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32408): Launched 18:15:11.904512 run osmo-hlr_10.42.42.2(pid=32409): Launched 18:15:12.026452 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:12.573996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32411): Launched 18:15:12.892449 run osmo-stp_10.42.42.5(pid=32412): Launched 18:15:13.014348 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:13.562692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32414): Launched 18:15:13.684925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:13.953375 run patchelf(pid=32415): Launched 18:15:14.131246 run osmo-stp_10.42.42.5(pid=32412): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32412)] 18:15:14.265909 run osmo-stp_10.42.42.5(pid=32412): stdout: | (launched: 2022-12-09_18:15:12.834281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:14.402426 run osmo-stp_10.42.42.5(pid=32412): stderr: | 20221209181513027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181513027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181513028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181513028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181513028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181513028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181513029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:14.538667 run osmo-stp_10.42.42.5(pid=32412): stdout: | (launched: 2022-12-09_18:15:12.834281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:14.669447 run osmo-stp_10.42.42.5(pid=32412): stderr: | 20221209181513027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181513027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181513028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181513028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181513028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181513028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181513029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:14.823533 run patchelf(pid=32415): Terminating (SIGINT) 18:15:15.002262 run patchelf(pid=32415): Terminated: ok {rc=0} 18:15:15.131308 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32412): Process ended prematurely: osmo-stp_10.42.42.5(pid=32412) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32412)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 18:15:15.141445 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:15:15.170176 run osmo-hlr_10.42.42.2(pid=32409): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32409)] 18:15:15.219786 run osmo-hlr_10.42.42.2(pid=32409): stdout: | (launched: 2022-12-09_18:15:11.846074) 18:15:15.271417 run osmo-hlr_10.42.42.2(pid=32409): stderr: | 20221209181512043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181512044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181512044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181512044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181512044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181512044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181512057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181512065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181512065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181512065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:15.323693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32398): Terminating (SIGTERM) 18:15:15.365373 run iperf3-srv_10.42.42.10(pid=32399): Terminating (SIGTERM) 18:15:15.406989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32400): Terminating (SIGTERM) 18:15:15.448838 run iperf3-srv_10.42.42.10(pid=32401): Terminating (SIGTERM) 18:15:15.490673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32402): Terminating (SIGTERM) 18:15:15.532516 run iperf3-srv_10.42.42.10(pid=32403): Terminating (SIGTERM) 18:15:15.574428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32404): Terminating (SIGTERM) 18:15:15.616260 run iperf3-srv_10.42.42.10(pid=32405): Terminating (SIGTERM) 18:15:15.658078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32408): Terminating (SIGTERM) 18:15:15.699831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32411): Terminating (SIGTERM) 18:15:15.741660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32414): Terminating (SIGTERM) 18:15:15.783844 --- ParallelTerminationStrategy: PID 32398 died... 18:15:15.803949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32398): Terminated: ok {rc=0} 18:15:15.863496 --- ParallelTerminationStrategy: PID 32399 died... 18:15:15.885846 run iperf3-srv_10.42.42.10(pid=32399): Terminated {rc=256} 18:15:15.945783 --- ParallelTerminationStrategy: PID 32400 died... 18:15:15.965156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32400): Terminated: ok {rc=0} 18:15:16.036353 --- ParallelTerminationStrategy: PID 32401 died... 18:15:16.062060 run iperf3-srv_10.42.42.10(pid=32401): Terminated {rc=256} 18:15:16.120612 --- ParallelTerminationStrategy: PID 32402 died... 18:15:16.145625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32402): Terminated: ok {rc=0} 18:15:16.205258 --- ParallelTerminationStrategy: PID 32403 died... 18:15:16.230454 run iperf3-srv_10.42.42.10(pid=32403): Terminated {rc=256} 18:15:16.289745 --- ParallelTerminationStrategy: PID 32404 died... 18:15:16.311136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32404): Terminated: ok {rc=0} 18:15:16.366946 --- ParallelTerminationStrategy: PID 32405 died... 18:15:16.392076 run iperf3-srv_10.42.42.10(pid=32405): Terminated {rc=256} 18:15:16.451439 --- ParallelTerminationStrategy: PID 32408 died... 18:15:16.477076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32408): Terminated: ok {rc=0} 18:15:16.536191 --- ParallelTerminationStrategy: PID 32411 died... 18:15:16.558179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32411): Terminated: ok {rc=0} 18:15:16.617360 --- ParallelTerminationStrategy: PID 32414 died... 18:15:16.643360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32414): Terminated: ok {rc=0} 18:15:16.752018 bus /gobi_4: Setting Powered False 18:15:17.864008 bus /gobi_4: Setting Powered False 18:15:18.979498 bus /gobi_1: Setting Powered False 18:15:20.078131 bus /gobi_1: Setting Powered False 18:15:21.193887 bus /gobi_0: Setting Powered False 18:15:22.291400 bus /gobi_0: Setting Powered False 18:15:23.404531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 18:15:24.507238 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:24.519126 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:15:24.561208 tst ping.py: using LAC 22820 18:15:24.677636 tst ping.py: using RAC 125 18:15:24.800789 tst ping.py: using CellId 22820 18:15:24.923048 tst ping.py: using BVCI 22821 18:15:25.035959 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:25.047149 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:25.058334 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:25.069434 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:25.080331 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:25.091376 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:25.102734 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:25.113785 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:25.226311 tst ping.py:19: start network... 18:15:25.420281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:25.869349 run create_hlr_db(pid=32416): Launched 18:15:25.980056 bus /gobi_6: Setting Powered False 18:15:27.037810 run create_hlr_db(pid=32416): Terminated: ok {rc=0} 18:15:27.464515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32418): Launched 18:15:27.774544 run osmo-hlr_10.42.42.2(pid=32419): Launched 18:15:27.892480 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:28.433481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32421): Launched 18:15:28.745150 run osmo-stp_10.42.42.5(pid=32422): Launched 18:15:28.863318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:29.399590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32424): Launched 18:15:29.518704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:29.781676 run patchelf(pid=32425): Launched 18:15:29.955270 run osmo-stp_10.42.42.5(pid=32422): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32422)] 18:15:30.087743 run osmo-stp_10.42.42.5(pid=32422): stdout: | (launched: 2022-12-09_18:15:28.686706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:30.222155 run osmo-stp_10.42.42.5(pid=32422): stderr: | 20221209181528878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181528878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181528879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181528879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181528879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181528880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181528880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:30.356810 run osmo-stp_10.42.42.5(pid=32422): stdout: | (launched: 2022-12-09_18:15:28.686706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:30.484620 run osmo-stp_10.42.42.5(pid=32422): stderr: | 20221209181528878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181528878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181528879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181528879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181528879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181528880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181528880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:30.636057 run patchelf(pid=32425): Terminating (SIGINT) 18:15:30.811605 run patchelf(pid=32425): Terminated: ok {rc=0} 18:15:30.973513 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32422): Process ended prematurely: osmo-stp_10.42.42.5(pid=32422) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32422)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 18:15:30.983984 tst ping.py:22: Test FAILED (6.5 sec) 18:15:31.013122 run osmo-hlr_10.42.42.2(pid=32419): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32419)] 18:15:31.065694 run osmo-hlr_10.42.42.2(pid=32419): stdout: | (launched: 2022-12-09_18:15:27.717585) 18:15:31.117969 run osmo-hlr_10.42.42.2(pid=32419): stderr: | 20221209181527914 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181527914 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181527914 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181527914 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181527914 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181527914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181527927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181527937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181527937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181527937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:31.170917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32418): Terminating (SIGTERM) 18:15:31.213235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32421): Terminating (SIGTERM) 18:15:31.256320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32424): Terminating (SIGTERM) 18:15:31.301227 --- ParallelTerminationStrategy: PID 32418 died... 18:15:31.321465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32418): Terminated: ok {rc=0} 18:15:31.370051 --- ParallelTerminationStrategy: PID 32421 died... 18:15:31.390399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32421): Terminated: ok {rc=0} 18:15:31.437567 --- ParallelTerminationStrategy: PID 32424 died... 18:15:31.457534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32424): Terminated: ok {rc=0} 18:15:31.546302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:15:32.632670 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:32.644779 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:15:32.687782 tst ping_idle_ping.py: using LAC 22821 18:15:32.812709 tst ping_idle_ping.py: using RAC 126 18:15:32.936887 tst ping_idle_ping.py: using CellId 22821 18:15:33.059753 tst ping_idle_ping.py: using BVCI 22822 18:15:33.174763 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:33.186402 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:33.197543 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:33.208785 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:33.220002 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:33.231018 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:33.242529 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:15:33.253773 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:15:33.371234 tst ping_idle_ping.py:24: start network... 18:15:33.581006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:34.070935 run create_hlr_db(pid=32426): Launched 18:15:34.197693 bus /gobi_6: Setting Powered False 18:15:35.257366 run create_hlr_db(pid=32426): Terminated: ok {rc=0} 18:15:35.694399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32428): Launched 18:15:36.008147 run osmo-hlr_10.42.42.2(pid=32429): Launched 18:15:36.128378 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:36.667024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32431): Launched 18:15:36.978978 run osmo-stp_10.42.42.5(pid=32432): Launched 18:15:37.098381 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:37.636337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32434): Launched 18:15:37.756542 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:38.020658 run patchelf(pid=32435): Launched 18:15:38.194494 run osmo-stp_10.42.42.5(pid=32432): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32432)] 18:15:38.327010 run osmo-stp_10.42.42.5(pid=32432): stdout: | (launched: 2022-12-09_18:15:36.922000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:38.461438 run osmo-stp_10.42.42.5(pid=32432): stderr: | 20221209181537110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181537111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181537111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181537111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181537112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181537112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181537112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:38.595749 run osmo-stp_10.42.42.5(pid=32432): stdout: | (launched: 2022-12-09_18:15:36.922000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:38.723664 run osmo-stp_10.42.42.5(pid=32432): stderr: | 20221209181537110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181537111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181537111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181537111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181537112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181537112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181537112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:38.875633 run patchelf(pid=32435): Terminating (SIGINT) 18:15:39.051562 run patchelf(pid=32435): Terminated: ok {rc=0} 18:15:39.178496 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32432): Process ended prematurely: osmo-stp_10.42.42.5(pid=32432) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32432)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 18:15:39.187923 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:15:39.216034 run osmo-hlr_10.42.42.2(pid=32429): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32429)] 18:15:39.265508 run osmo-hlr_10.42.42.2(pid=32429): stdout: | (launched: 2022-12-09_18:15:35.950172) 18:15:39.316565 run osmo-hlr_10.42.42.2(pid=32429): stderr: | 20221209181536150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181536150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181536150 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181536150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181536151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181536151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181536163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181536173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181536173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181536173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:39.368111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32428): Terminating (SIGTERM) 18:15:39.409815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32431): Terminating (SIGTERM) 18:15:39.451468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32434): Terminating (SIGTERM) 18:15:39.493480 --- ParallelTerminationStrategy: PID 32428 died... 18:15:39.513382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32428): Terminated: ok {rc=0} 18:15:39.559775 --- ParallelTerminationStrategy: PID 32431 died... 18:15:39.579249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32431): Terminated: ok {rc=0} 18:15:39.624934 --- ParallelTerminationStrategy: PID 32434 died... 18:15:39.644357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32434): Terminated: ok {rc=0} 18:15:39.731198 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:15:41.032413 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:15:41.041647 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:15:41.066501 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:15:41.105401 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:15:41.192335 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:15:41.215487 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:15:41.253618 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:15:41.852132 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:15:41.903385 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:41.914705 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:15:41.973729 tst cs_paging_gprs_active.py: using LAC 22822 18:15:42.096674 tst cs_paging_gprs_active.py: using RAC 127 18:15:42.220573 tst cs_paging_gprs_active.py: using CellId 22822 18:15:42.343258 tst cs_paging_gprs_active.py: using BVCI 22823 18:15:42.458555 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:42.470009 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:42.481080 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:42.492125 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:42.503265 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:42.514413 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:42.525689 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:42.536612 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:42.547976 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:42.661819 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:42.776429 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:15:42.975602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:43.274125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32439): Launched 18:15:43.533282 run iperf3-srv_10.42.42.10(pid=32440): Launched 18:15:43.644874 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:15:43.843810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:44.142894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32441): Launched 18:15:44.401968 run iperf3-srv_10.42.42.10(pid=32442): Launched 18:15:44.514108 tst cs_paging_gprs_active.py:38: start network... 18:15:44.713071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:45.175439 run create_hlr_db(pid=32443): Launched 18:15:45.289732 bus /gobi_6: Setting Powered False 18:15:46.368358 run create_hlr_db(pid=32443): Terminated: ok {rc=0} 18:15:46.817221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32445): Launched 18:15:47.161689 run osmo-hlr_10.42.42.2(pid=32446): Launched 18:15:47.283263 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:47.831321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32448): Launched 18:15:48.149544 run osmo-stp_10.42.42.5(pid=32449): Launched 18:15:48.270328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:48.817722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32451): Launched 18:15:48.940512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:49.209974 run patchelf(pid=32452): Launched 18:15:49.387685 run osmo-stp_10.42.42.5(pid=32449): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32449)] 18:15:49.522923 run osmo-stp_10.42.42.5(pid=32449): stdout: | (launched: 2022-12-09_18:15:48.091559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:49.659596 run osmo-stp_10.42.42.5(pid=32449): stderr: | 20221209181548282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181548282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181548282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181548282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181548283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181548283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181548283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:49.796057 run osmo-stp_10.42.42.5(pid=32449): stdout: | (launched: 2022-12-09_18:15:48.091559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:49.926975 run osmo-stp_10.42.42.5(pid=32449): stderr: | 20221209181548282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181548282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181548282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181548282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181548283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181548283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181548283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:50.081589 run patchelf(pid=32452): Terminating (SIGINT) 18:15:50.260072 run patchelf(pid=32452): Terminated: ok {rc=0} 18:15:50.389879 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32449): Process ended prematurely: osmo-stp_10.42.42.5(pid=32449) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32449)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:15:50.399886 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:15:50.428336 run osmo-hlr_10.42.42.2(pid=32446): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32446)] 18:15:50.477798 run osmo-hlr_10.42.42.2(pid=32446): stdout: | (launched: 2022-12-09_18:15:47.088472) 18:15:50.529118 run osmo-hlr_10.42.42.2(pid=32446): stderr: | 20221209181547302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181547302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181547302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181547302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181547302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181547302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181547315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181547323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181547323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181547323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:50.580771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32439): Terminating (SIGTERM) 18:15:50.622189 run iperf3-srv_10.42.42.10(pid=32440): Terminating (SIGTERM) 18:15:50.663704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32441): Terminating (SIGTERM) 18:15:50.705349 run iperf3-srv_10.42.42.10(pid=32442): Terminating (SIGTERM) 18:15:50.746762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32445): Terminating (SIGTERM) 18:15:50.788399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32448): Terminating (SIGTERM) 18:15:50.829908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32451): Terminating (SIGTERM) 18:15:50.871665 --- ParallelTerminationStrategy: PID 32439 died... 18:15:50.891823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32439): Terminated: ok {rc=0} 18:15:50.938142 --- ParallelTerminationStrategy: PID 32440 died... 18:15:50.957493 run iperf3-srv_10.42.42.10(pid=32440): Terminated {rc=256} 18:15:51.003485 --- ParallelTerminationStrategy: PID 32441 died... 18:15:51.022833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32441): Terminated: ok {rc=0} 18:15:51.068595 --- ParallelTerminationStrategy: PID 32442 died... 18:15:51.087962 run iperf3-srv_10.42.42.10(pid=32442): Terminated {rc=256} 18:15:51.133483 --- ParallelTerminationStrategy: PID 32445 died... 18:15:51.152818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32445): Terminated: ok {rc=0} 18:15:51.198582 --- ParallelTerminationStrategy: PID 32448 died... 18:15:51.217948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32448): Terminated: ok {rc=0} 18:15:51.263633 --- ParallelTerminationStrategy: PID 32451 died... 18:15:51.282981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32451): Terminated: ok {rc=0} 18:15:51.370153 bus /gobi_0: Setting Powered False 18:15:52.466022 bus /gobi_0: Setting Powered False 18:15:53.580093 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:15:54.728558 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:54.740399 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:15:54.803900 tst iperf3.py: using LAC 22823 18:15:54.927074 tst iperf3.py: using RAC 128 18:15:55.051821 tst iperf3.py: using CellId 22823 18:15:55.173179 tst iperf3.py: using BVCI 22824 18:15:55.282040 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:55.293118 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:55.303865 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:55.314985 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:55.325881 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:55.336680 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:55.347760 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:55.358630 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:55.369718 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:55.484480 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:15:55.684401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:55.983130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32453): Launched 18:15:56.242143 run iperf3-srv_10.42.42.10(pid=32454): Launched 18:15:56.353701 tst iperf3.py:8: start network... 18:15:56.551545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:57.009517 run create_hlr_db(pid=32455): Launched 18:15:57.122142 bus /gobi_6: Setting Powered False 18:15:58.182251 run create_hlr_db(pid=32455): Terminated: ok {rc=0} 18:15:58.595195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32457): Launched 18:15:58.891237 run osmo-hlr_10.42.42.2(pid=32458): Launched 18:15:59.004075 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:59.517282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32460): Launched 18:15:59.814730 run osmo-stp_10.42.42.5(pid=32461): Launched 18:15:59.927814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:00.438469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32463): Launched 18:16:00.552894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:00.803455 run patchelf(pid=32464): Launched 18:16:00.993722 run osmo-stp_10.42.42.5(pid=32461): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32461)] 18:16:01.131359 run osmo-stp_10.42.42.5(pid=32461): stdout: | (launched: 2022-12-09_18:15:59.760011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:01.271987 run osmo-stp_10.42.42.5(pid=32461): stderr: | 20221209181559929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181559930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181559930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181559930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181559931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181559931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181559931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:01.413980 run osmo-stp_10.42.42.5(pid=32461): stdout: | (launched: 2022-12-09_18:15:59.760011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:01.548834 run osmo-stp_10.42.42.5(pid=32461): stderr: | 20221209181559929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181559930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181559930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181559930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181559931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181559931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181559931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:01.708353 run patchelf(pid=32464): Terminating (SIGINT) 18:16:01.891995 run patchelf(pid=32464): Terminated: ok {rc=0} 18:16:02.026512 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32461): Process ended prematurely: osmo-stp_10.42.42.5(pid=32461) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32461)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 18:16:02.037565 tst iperf3.py:8: Test FAILED (7.3 sec) 18:16:02.066988 run osmo-hlr_10.42.42.2(pid=32458): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32458)] 18:16:02.121931 run osmo-hlr_10.42.42.2(pid=32458): stdout: | (launched: 2022-12-09_18:15:58.837167) 18:16:02.173250 run osmo-hlr_10.42.42.2(pid=32458): stderr: | 20221209181559015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181559015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181559016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181559016 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181559016 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181559016 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181559028 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181559036 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181559036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181559036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:02.223163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32453): Terminating (SIGTERM) 18:16:02.263308 run iperf3-srv_10.42.42.10(pid=32454): Terminating (SIGTERM) 18:16:02.302889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32457): Terminating (SIGTERM) 18:16:02.342528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32460): Terminating (SIGTERM) 18:16:02.382300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32463): Terminating (SIGTERM) 18:16:02.422158 --- ParallelTerminationStrategy: PID 32453 died... 18:16:02.441122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32453): Terminated: ok {rc=0} 18:16:02.485437 --- ParallelTerminationStrategy: PID 32454 died... 18:16:02.504156 run iperf3-srv_10.42.42.10(pid=32454): Terminated {rc=256} 18:16:02.548339 --- ParallelTerminationStrategy: PID 32457 died... 18:16:02.566991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32457): Terminated: ok {rc=0} 18:16:02.611220 --- ParallelTerminationStrategy: PID 32460 died... 18:16:02.629974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32460): Terminated: ok {rc=0} 18:16:02.674360 --- ParallelTerminationStrategy: PID 32463 died... 18:16:02.693060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32463): Terminated: ok {rc=0} 18:16:02.778960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:16:03.925883 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:03.937592 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:16:04.001159 tst iperf3m4.py: using LAC 22824 18:16:04.121603 tst iperf3m4.py: using RAC 129 18:16:04.235829 tst iperf3m4.py: using CellId 22824 18:16:04.350452 tst iperf3m4.py: using BVCI 22825 18:16:04.458184 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:04.469257 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:04.479916 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:04.490838 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:04.501704 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:04.512568 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:04.523529 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:04.534401 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:04.545622 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:04.663988 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:04.781329 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:04.897502 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:05.013335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:16:05.212161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:05.510094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32465): Launched 18:16:05.768933 run iperf3-srv_10.42.42.10(pid=32466): Launched 18:16:05.880596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:16:06.079159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:06.377937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32467): Launched 18:16:06.637185 run iperf3-srv_10.42.42.10(pid=32468): Launched 18:16:06.748001 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:16:06.944547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:07.242626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32469): Launched 18:16:07.500584 run iperf3-srv_10.42.42.10(pid=32470): Launched 18:16:07.612059 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:16:07.809266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:08.106749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32471): Launched 18:16:08.364825 run iperf3-srv_10.42.42.10(pid=32472): Launched 18:16:08.476354 tst iperf3m4.py:8: start network... 18:16:08.674582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:09.133885 run create_hlr_db(pid=32473): Launched 18:16:09.246521 bus /gobi_6: Setting Powered False 18:16:10.305648 run create_hlr_db(pid=32473): Terminated: ok {rc=0} 18:16:10.719601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32475): Launched 18:16:11.016202 run osmo-hlr_10.42.42.2(pid=32476): Launched 18:16:11.129911 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:11.647556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32478): Launched 18:16:11.944029 run osmo-stp_10.42.42.5(pid=32479): Launched 18:16:12.069009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:12.617945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32481): Launched 18:16:12.739480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:13.007346 run patchelf(pid=32482): Launched 18:16:13.184266 run osmo-stp_10.42.42.5(pid=32479): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32479)] 18:16:13.318550 run osmo-stp_10.42.42.5(pid=32479): stdout: | (launched: 2022-12-09_18:16:11.889622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:13.454699 run osmo-stp_10.42.42.5(pid=32479): stderr: | 20221209181612076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181612076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181612077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181612077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181612078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181612078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181612078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:13.590540 run osmo-stp_10.42.42.5(pid=32479): stdout: | (launched: 2022-12-09_18:16:11.889622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:13.720210 run osmo-stp_10.42.42.5(pid=32479): stderr: | 20221209181612076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181612076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181612077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181612077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181612078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181612078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181612078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:13.873889 run patchelf(pid=32482): Terminating (SIGINT) 18:16:14.051753 run patchelf(pid=32482): Terminated: ok {rc=0} 18:16:14.179873 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32479): Process ended prematurely: osmo-stp_10.42.42.5(pid=32479) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32479)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:16:14.190096 tst iperf3m4.py:8: Test FAILED (10.3 sec) 18:16:14.218591 run osmo-hlr_10.42.42.2(pid=32476): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32476)] 18:16:14.267951 run osmo-hlr_10.42.42.2(pid=32476): stdout: | (launched: 2022-12-09_18:16:10.961417) 18:16:14.319293 run osmo-hlr_10.42.42.2(pid=32476): stderr: | 20221209181611136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181611136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181611136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181611136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181611136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181611136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181611148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181611157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181611157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181611157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:14.370752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32465): Terminating (SIGTERM) 18:16:14.412139 run iperf3-srv_10.42.42.10(pid=32466): Terminating (SIGTERM) 18:16:14.453729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32467): Terminating (SIGTERM) 18:16:14.495946 run iperf3-srv_10.42.42.10(pid=32468): Terminating (SIGTERM) 18:16:14.537453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32469): Terminating (SIGTERM) 18:16:14.579541 run iperf3-srv_10.42.42.10(pid=32470): Terminating (SIGTERM) 18:16:14.622157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32471): Terminating (SIGTERM) 18:16:14.664815 run iperf3-srv_10.42.42.10(pid=32472): Terminating (SIGTERM) 18:16:14.705281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32475): Terminating (SIGTERM) 18:16:14.746213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32478): Terminating (SIGTERM) 18:16:14.786505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32481): Terminating (SIGTERM) 18:16:14.827234 --- ParallelTerminationStrategy: PID 32465 died... 18:16:14.846258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32465): Terminated: ok {rc=0} 18:16:14.891825 --- ParallelTerminationStrategy: PID 32466 died... 18:16:14.910236 run iperf3-srv_10.42.42.10(pid=32466): Terminated {rc=256} 18:16:14.955097 --- ParallelTerminationStrategy: PID 32467 died... 18:16:14.973625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32467): Terminated: ok {rc=0} 18:16:15.018893 --- ParallelTerminationStrategy: PID 32468 died... 18:16:15.037360 run iperf3-srv_10.42.42.10(pid=32468): Terminated {rc=256} 18:16:15.082120 --- ParallelTerminationStrategy: PID 32469 died... 18:16:15.100676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32469): Terminated: ok {rc=0} 18:16:15.146377 --- ParallelTerminationStrategy: PID 32470 died... 18:16:15.164683 run iperf3-srv_10.42.42.10(pid=32470): Terminated {rc=256} 18:16:15.209431 --- ParallelTerminationStrategy: PID 32471 died... 18:16:15.227898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32471): Terminated: ok {rc=0} 18:16:15.273185 --- ParallelTerminationStrategy: PID 32472 died... 18:16:15.291490 run iperf3-srv_10.42.42.10(pid=32472): Terminated {rc=256} 18:16:15.336196 --- ParallelTerminationStrategy: PID 32475 died... 18:16:15.354636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32475): Terminated: ok {rc=0} 18:16:15.399456 --- ParallelTerminationStrategy: PID 32478 died... 18:16:15.417951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32478): Terminated: ok {rc=0} 18:16:15.462864 --- ParallelTerminationStrategy: PID 32481 died... 18:16:15.481392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32481): Terminated: ok {rc=0} 18:16:15.567564 bus /gobi_4: Setting Powered False 18:16:16.671806 bus /gobi_4: Setting Powered False 18:16:17.789096 bus /gobi_1: Setting Powered False 18:16:18.887292 bus /gobi_1: Setting Powered False 18:16:20.000752 bus /gobi_0: Setting Powered False 18:16:21.099273 bus /gobi_0: Setting Powered False 18:16:22.218760 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:16:23.320364 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:23.331927 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:16:23.391947 tst ping.py: using LAC 22825 18:16:23.507824 tst ping.py: using RAC 130 18:16:23.621650 tst ping.py: using CellId 22825 18:16:23.735764 tst ping.py: using BVCI 22826 18:16:23.841360 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:23.852157 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:23.862766 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:23.873698 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:23.884570 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:23.895499 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:23.906552 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:23.917503 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:24.034375 tst ping.py:19: start network... 18:16:24.231157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:24.681533 run create_hlr_db(pid=32483): Launched 18:16:24.793454 bus /gobi_6: Setting Powered False 18:16:25.852155 run create_hlr_db(pid=32483): Terminated: ok {rc=0} 18:16:26.280879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32485): Launched 18:16:26.593161 run osmo-hlr_10.42.42.2(pid=32486): Launched 18:16:26.712326 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:27.260501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32488): Launched 18:16:27.572596 run osmo-stp_10.42.42.5(pid=32489): Launched 18:16:27.691700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:28.230558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32491): Launched 18:16:28.349188 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:28.611579 run patchelf(pid=32492): Launched 18:16:28.784786 run osmo-stp_10.42.42.5(pid=32489): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32489)] 18:16:28.916847 run osmo-stp_10.42.42.5(pid=32489): stdout: | (launched: 2022-12-09_18:16:27.515569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:29.051552 run osmo-stp_10.42.42.5(pid=32489): stderr: | 20221209181627709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181627709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181627709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181627710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181627710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181627710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181627710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:29.185904 run osmo-stp_10.42.42.5(pid=32489): stdout: | (launched: 2022-12-09_18:16:27.515569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:29.314054 run osmo-stp_10.42.42.5(pid=32489): stderr: | 20221209181627709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181627709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181627709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181627710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181627710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181627710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181627710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:29.465206 run patchelf(pid=32492): Terminating (SIGINT) 18:16:29.639292 run patchelf(pid=32492): Terminated: ok {rc=0} 18:16:29.765243 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32489): Process ended prematurely: osmo-stp_10.42.42.5(pid=32489) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32489)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 18:16:29.774829 tst ping.py:22: Test FAILED (6.4 sec) 18:16:29.802657 run osmo-hlr_10.42.42.2(pid=32486): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32486)] 18:16:29.852010 run osmo-hlr_10.42.42.2(pid=32486): stdout: | (launched: 2022-12-09_18:16:26.535816) 18:16:29.903338 run osmo-hlr_10.42.42.2(pid=32486): stderr: | 20221209181626733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181626733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181626734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181626734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181626734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181626734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181626746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181626754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181626755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181626755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:29.954742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32485): Terminating (SIGTERM) 18:16:29.995897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32488): Terminating (SIGTERM) 18:16:30.037849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32491): Terminating (SIGTERM) 18:16:30.079832 --- ParallelTerminationStrategy: PID 32485 died... 18:16:30.099842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32485): Terminated: ok {rc=0} 18:16:30.146366 --- ParallelTerminationStrategy: PID 32488 died... 18:16:30.165976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32488): Terminated: ok {rc=0} 18:16:30.211967 --- ParallelTerminationStrategy: PID 32491 died... 18:16:30.231382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32491): Terminated: ok {rc=0} 18:16:30.318262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:16:31.404025 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:31.417502 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:16:31.490116 tst ping_idle_ping.py: using LAC 22826 18:16:31.650826 tst ping_idle_ping.py: using RAC 131 18:16:31.814294 tst ping_idle_ping.py: using CellId 22826 18:16:31.961134 tst ping_idle_ping.py: using BVCI 22827 18:16:32.068763 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:32.080304 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:32.091683 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:32.103752 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:32.115670 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:32.128556 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:32.140759 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:16:32.152829 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:16:32.266914 tst ping_idle_ping.py:24: start network... 18:16:32.465003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:32.919950 run create_hlr_db(pid=32493): Launched 18:16:33.031455 bus /gobi_6: Setting Powered False 18:16:34.090234 run create_hlr_db(pid=32493): Terminated: ok {rc=0} 18:16:34.521465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32495): Launched 18:16:34.833997 run osmo-hlr_10.42.42.2(pid=32496): Launched 18:16:34.953043 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:35.490377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32498): Launched 18:16:35.802146 run osmo-stp_10.42.42.5(pid=32499): Launched 18:16:35.920587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:36.458946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32501): Launched 18:16:36.578019 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:36.840465 run patchelf(pid=32502): Launched 18:16:37.014069 run osmo-stp_10.42.42.5(pid=32499): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32499)] 18:16:37.146364 run osmo-stp_10.42.42.5(pid=32499): stdout: | (launched: 2022-12-09_18:16:35.745077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:37.281268 run osmo-stp_10.42.42.5(pid=32499): stderr: | 20221209181635933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181635933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181635934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181635934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181635936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181635936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181635937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:37.415576 run osmo-stp_10.42.42.5(pid=32499): stdout: | (launched: 2022-12-09_18:16:35.745077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:37.543615 run osmo-stp_10.42.42.5(pid=32499): stderr: | 20221209181635933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181635933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181635934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181635934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181635936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181635936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181635937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:37.695125 run patchelf(pid=32502): Terminating (SIGINT) 18:16:37.869930 run patchelf(pid=32502): Terminated: ok {rc=0} 18:16:37.996256 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32499): Process ended prematurely: osmo-stp_10.42.42.5(pid=32499) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32499)] [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:16:38.005707 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:16:38.033930 run osmo-hlr_10.42.42.2(pid=32496): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32496)] 18:16:38.083507 run osmo-hlr_10.42.42.2(pid=32496): stdout: | (launched: 2022-12-09_18:16:34.776835) 18:16:38.134737 run osmo-hlr_10.42.42.2(pid=32496): stderr: | 20221209181634976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181634976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181634976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181634976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181634976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181634976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181634988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181634996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181634996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181634997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:38.186114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32495): Terminating (SIGTERM) 18:16:38.227393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32498): Terminating (SIGTERM) 18:16:38.268761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32501): Terminating (SIGTERM) 18:16:38.310875 --- ParallelTerminationStrategy: PID 32495 died... 18:16:38.330844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32495): Terminated: ok {rc=0} 18:16:38.376811 --- ParallelTerminationStrategy: PID 32498 died... 18:16:38.396437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32498): Terminated: ok {rc=0} 18:16:38.442175 --- ParallelTerminationStrategy: PID 32501 died... 18:16:38.461657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32501): Terminated: ok {rc=0} 18:16:38.548391 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 18:16:39.847344 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:16:39.855424 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:16:39.879787 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:16:39.914716 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:16:39.967200 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:16:39.991102 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:16:40.026127 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:16:40.589553 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:16:40.594896 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:40.606887 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:16:40.666332 tst switch_tch_pdch.py: using LAC 22827 18:16:40.787552 tst switch_tch_pdch.py: using RAC 132 18:16:40.907740 tst switch_tch_pdch.py: using CellId 22827 18:16:41.028435 tst switch_tch_pdch.py: using BVCI 22828 18:16:41.141391 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:41.153319 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:41.165003 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:41.176688 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:41.188631 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:41.200240 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:41.212081 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:41.223786 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:16:41.339408 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:16:41.451733 tst switch_tch_pdch.py:51: start network... 18:16:41.646237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:42.096105 run create_hlr_db(pid=32507): Launched 18:16:42.208576 bus /gobi_6: Setting Powered False 18:16:43.266857 run create_hlr_db(pid=32507): Terminated: ok {rc=0} 18:16:43.694752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32509): Launched 18:16:44.005729 run osmo-hlr_10.42.42.2(pid=32510): Launched 18:16:44.124669 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:44.660260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32512): Launched 18:16:44.971563 run osmo-stp_10.42.42.5(pid=32513): Launched 18:16:45.090617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:45.633102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32515): Launched 18:16:45.751610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:46.042424 run patchelf(pid=32516): Launched 18:16:46.228030 run osmo-stp_10.42.42.5(pid=32513): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32513)] 18:16:46.363347 run osmo-stp_10.42.42.5(pid=32513): stdout: | (launched: 2022-12-09_18:16:44.914295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:46.495288 run osmo-stp_10.42.42.5(pid=32513): stderr: | 20221209181645105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181645105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181645106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181645106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181645107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181645107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181645107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:46.627213 run osmo-stp_10.42.42.5(pid=32513): stdout: | (launched: 2022-12-09_18:16:44.914295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:46.752700 run osmo-stp_10.42.42.5(pid=32513): stderr: | 20221209181645105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181645105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181645106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181645106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181645107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181645107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181645107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:46.898318 run patchelf(pid=32516): Terminating (SIGINT) 18:16:47.069215 run patchelf(pid=32516): Terminated: ok {rc=0} 18:16:47.190930 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32513): Process ended prematurely: osmo-stp_10.42.42.5(pid=32513) [trial-2362↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32513)] [trial-2362↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:16:47.200872 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 18:16:47.230949 run osmo-hlr_10.42.42.2(pid=32510): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32510)] 18:16:47.280209 run osmo-hlr_10.42.42.2(pid=32510): stdout: | (launched: 2022-12-09_18:16:43.948811) 18:16:47.330441 run osmo-hlr_10.42.42.2(pid=32510): stderr: | 20221209181644146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181644146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181644146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181644146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181644146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181644146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181644159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181644169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181644169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181644169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:47.382216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32509): Terminating (SIGTERM) 18:16:47.422516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32512): Terminating (SIGTERM) 18:16:47.462859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32515): Terminating (SIGTERM) 18:16:47.503602 --- ParallelTerminationStrategy: PID 32509 died... 18:16:47.522970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32509): Terminated: ok {rc=0} 18:16:47.572688 --- ParallelTerminationStrategy: PID 32512 died... 18:16:47.592194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32512): Terminated: ok {rc=0} 18:16:47.638192 --- ParallelTerminationStrategy: PID 32515 died... 18:16:47.657737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32515): Terminated: ok {rc=0} 18:16:47.745228 bus /gobi_0: Setting Powered False 18:16:48.840940 bus /gobi_0: Setting Powered False 18:16:49.954405 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 sms:nanobts+band-900 --------------------------------------------------------------------- 18:16:51.199531 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:16:51.204107 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:16:51.235969 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 18:16:51.261756 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 18:16:51.314100 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:16:51.347065 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 18:16:51.374294 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 18:16:51.916929 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 18:16:51.922782 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:16:51.933818 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 18:16:51.982101 tst mo_mt_sms.py: using LAC 22828 18:16:52.094341 tst mo_mt_sms.py: using RAC 133 18:16:52.207058 tst mo_mt_sms.py: using CellId 22828 18:16:52.318993 tst mo_mt_sms.py: using BVCI 22829 18:16:52.433397 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:16:52.444412 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:16:52.455470 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:16:52.466474 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:16:52.477487 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:16:52.488549 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 18:16:52.606203 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 18:16:52.723200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:53.204940 run create_hlr_db(pid=32522): Launched 18:16:53.331912 bus /gobi_6: Setting Powered False 18:16:54.394806 run create_hlr_db(pid=32522): Terminated: ok {rc=0} 18:16:54.830163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32524): Launched 18:16:55.141157 run osmo-hlr_10.42.42.2(pid=32525): Launched 18:16:55.260299 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:55.802979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32527): Launched 18:16:56.115220 run osmo-stp_10.42.42.5(pid=32528): Launched 18:16:56.234320 run osmo-msc_10.42.42.6: Starting osmo-msc 18:16:56.798684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32530): Launched 18:16:57.110768 run osmo-msc_10.42.42.6(pid=32531): Launched 18:16:57.284534 run osmo-stp_10.42.42.5(pid=32528): ERR: Terminated: ERROR {rc=1} [trial-2362↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32528)] 18:16:57.416833 run osmo-stp_10.42.42.5(pid=32528): stdout: | (launched: 2022-12-09_18:16:56.057837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:57.551651 run osmo-stp_10.42.42.5(pid=32528): stderr: | 20221209181656248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181656248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181656249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181656249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181656249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181656249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181656249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:57.683709 run osmo-stp_10.42.42.5(pid=32528): stdout: | (launched: 2022-12-09_18:16:56.057837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:57.808073 run osmo-stp_10.42.42.5(pid=32528): stderr: | 20221209181656248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181656248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181656249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181656249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181656249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181656249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181656249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:57.956938 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32528): Process ended prematurely: osmo-stp_10.42.42.5(pid=32528) [trial-2362↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32528)] [trial-2362↪sms:nanobts+band-900↪mo_mt_sms.py:16] 18:16:57.965849 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 18:16:57.993116 run osmo-hlr_10.42.42.2(pid=32525): ERR: Terminated: ERROR {rc=237} [trial-2362↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32525)] 18:16:58.043404 run osmo-hlr_10.42.42.2(pid=32525): stdout: | (launched: 2022-12-09_18:16:55.084127) 18:16:58.094924 run osmo-hlr_10.42.42.2(pid=32525): stderr: | 20221209181655282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181655282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181655283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181655283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181655283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181655283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181655295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181655303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181655304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181655304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:58.167262 run osmo-msc_10.42.42.6(pid=32531): ERR: Terminated: ERROR {rc=2} [trial-2362↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32531)] 18:16:58.217093 run osmo-msc_10.42.42.6(pid=32531): stdout: | (launched: 2022-12-09_18:16:57.053689) 18:16:58.268424 run osmo-msc_10.42.42.6(pid=32531): stderr: | 20221209181657374 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181657374 DLGLOBAL DEBUG validating counter group 0x7feff11dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181657374 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181657374 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181657374 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181657374 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181657376 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181657376 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181657376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181657377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:16:58.320316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32524): Terminating (SIGTERM) 18:16:58.361930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32527): Terminating (SIGTERM) 18:16:58.403506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32530): Terminating (SIGTERM) 18:16:58.445703 --- ParallelTerminationStrategy: PID 32524 died... 18:16:58.465564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32524): Terminated: ok {rc=0} 18:16:58.511566 --- ParallelTerminationStrategy: PID 32527 died... 18:16:58.531028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32527): Terminated: ok {rc=0} 18:16:58.576845 --- ParallelTerminationStrategy: PID 32530 died... 18:16:58.596577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32530): Terminated: ok {rc=0} 18:16:58.683989 bus /sierra_3: Setting Powered False 18:16:59.782388 bus /sierra_3: Setting Powered False 18:17:00.904730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 18:17:02.194499 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:02.200088 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:17:02.240620 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 18:17:02.247953 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 18:17:02.282969 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:17:02.315697 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 18:17:02.322575 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 18:17:02.843376 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 18:17:02.848649 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 18:17:02.859876 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 18:17:02.906873 tst assert_extension.py: using LAC 22829 18:17:03.029909 tst assert_extension.py: using RAC 134 18:17:03.145137 tst assert_extension.py: using CellId 22829 18:17:03.259148 tst assert_extension.py: using BVCI 22830 18:17:03.364185 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 18:17:03.479406 tst assert_extension.py:10: start nitb and bts... 18:17:03.691281 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:17:04.330694 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32539): Launched 18:17:04.642474 run osmo-nitb_10.42.42.2(pid=32540): Launched 18:17:04.814753 run osmo-nitb_10.42.42.2(pid=32540): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32540)] 18:17:04.954928 run osmo-nitb_10.42.42.2(pid=32540): stdout: | (launched: 2022-12-09_18:17:04.585473) 18:17:05.097660 run osmo-nitb_10.42.42.2(pid=32540): stderr: | (launched: 2022-12-09_18:17:04.631758) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:17:05.239812 run osmo-nitb_10.42.42.2(pid=32540): stdout: | (launched: 2022-12-09_18:17:04.585473) 18:17:05.375612 run osmo-nitb_10.42.42.2(pid=32540): stderr: | (launched: 2022-12-09_18:17:04.631758) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32540): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32540) [trial-2362↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32540)] 18:17:05.759188 tst osmo-nitb_10.42.42.2(pid=32540): stdout: | (launched: 2022-12-09_18:17:04.585473) 18:17:05.885312 tst osmo-nitb_10.42.42.2(pid=32540): stderr: | (launched: 2022-12-09_18:17:04.631758) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:17:06.034100 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32540): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32540) [trial-2362↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32540)] [trial-2362↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 18:17:06.043353 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:17:06.050577 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32539): Terminating (SIGTERM) 18:17:06.261752 --- ParallelTerminationStrategy: PID 32539 died... 18:17:06.283866 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32539): Terminated: ok {rc=0} 18:17:06.371560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 ussd:nanobts+band-900 --------------------------------------------------------------------- 18:17:07.548844 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:07.554141 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:17:07.586902 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 18:17:07.613828 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 18:17:07.649390 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:17:07.681313 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 18:17:07.707291 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 18:17:08.238665 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 18:17:08.244823 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:08.256302 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 18:17:08.302346 tst assert_extension.py: using LAC 22830 18:17:08.418480 tst assert_extension.py: using RAC 135 18:17:08.533035 tst assert_extension.py: using CellId 22830 18:17:08.649335 tst assert_extension.py: using BVCI 22831 18:17:08.755069 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:08.765617 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:08.776030 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:08.786707 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:08.797480 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:17:08.807973 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 18:17:08.918718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:09.369712 run create_hlr_db(pid=32544): Launched 18:17:09.480238 bus /sierra_2: Setting Powered False 18:17:10.539229 run create_hlr_db(pid=32544): Terminated: ok {rc=0} 18:17:10.969045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32546): Launched 18:17:11.281699 run osmo-hlr_10.42.42.2(pid=32547): Launched 18:17:11.400943 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:11.943243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32549): Launched 18:17:12.255395 run osmo-stp_10.42.42.5(pid=32550): Launched 18:17:12.374786 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:12.938876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32552): Launched 18:17:13.250547 run osmo-msc_10.42.42.6(pid=32553): Launched 18:17:13.424742 run osmo-stp_10.42.42.5(pid=32550): ERR: Terminated: ERROR {rc=1} [trial-2362↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32550)] 18:17:13.557196 run osmo-stp_10.42.42.5(pid=32550): stdout: | (launched: 2022-12-09_18:17:12.198439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:13.689557 run osmo-stp_10.42.42.5(pid=32550): stderr: | 20221209181712388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181712388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181712389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181712389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181712389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181712389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181712390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:13.821217 run osmo-stp_10.42.42.5(pid=32550): stdout: | (launched: 2022-12-09_18:17:12.198439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:13.945299 run osmo-stp_10.42.42.5(pid=32550): stderr: | 20221209181712388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181712388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181712389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181712389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181712389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181712389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181712390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:14.094439 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32550): Process ended prematurely: osmo-stp_10.42.42.5(pid=32550) [trial-2362↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32550)] [trial-2362↪ussd:nanobts+band-900↪assert_extension.py:17] 18:17:14.103295 tst assert_extension.py:17: Test FAILED (5.9 sec) 18:17:14.130499 run osmo-hlr_10.42.42.2(pid=32547): ERR: Terminated: ERROR {rc=237} [trial-2362↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32547)] 18:17:14.180116 run osmo-hlr_10.42.42.2(pid=32547): stdout: | (launched: 2022-12-09_18:17:11.224641) 18:17:14.231862 run osmo-hlr_10.42.42.2(pid=32547): stderr: | 20221209181711420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181711420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181711420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181711420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181711421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181711421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181711433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181711442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181711442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181711442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:14.303869 run osmo-msc_10.42.42.6(pid=32553): ERR: Terminated: ERROR {rc=2} [trial-2362↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32553)] 18:17:14.353634 run osmo-msc_10.42.42.6(pid=32553): stdout: | (launched: 2022-12-09_18:17:13.193632) 18:17:14.405136 run osmo-msc_10.42.42.6(pid=32553): stderr: | 20221209181713512 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181713513 DLGLOBAL DEBUG validating counter group 0x7fd41b65ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181713513 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181713513 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181713513 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181713513 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181713515 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181713515 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181713515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181713515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:14.457232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32546): Terminating (SIGTERM) 18:17:14.498769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32549): Terminating (SIGTERM) 18:17:14.540435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32552): Terminating (SIGTERM) 18:17:14.582339 --- ParallelTerminationStrategy: PID 32546 died... 18:17:14.602143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32546): Terminated: ok {rc=0} 18:17:14.648164 --- ParallelTerminationStrategy: PID 32549 died... 18:17:14.667478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32549): Terminated: ok {rc=0} 18:17:14.713074 --- ParallelTerminationStrategy: PID 32552 died... 18:17:14.732308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32552): Terminated: ok {rc=0} 18:17:14.818534 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:17:16.045613 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:16.055175 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:17:16.093719 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:17:16.129116 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:17:16.194909 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:17:16.233406 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:17:16.261348 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:17:16.830920 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:17:16.901518 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:16.914224 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:17:16.984078 tst mo_mt_call.py: using LAC 22831 18:17:17.110179 tst mo_mt_call.py: using RAC 136 18:17:17.270292 tst mo_mt_call.py: using CellId 22831 18:17:17.396547 tst mo_mt_call.py: using BVCI 22832 18:17:17.511710 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:17.523220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:17.534510 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:17.545846 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:17.557381 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:17.568800 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:17.685054 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:17.803319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:18.296166 run create_hlr_db(pid=32558): Launched 18:17:18.425344 bus /sierra_2: Setting Powered False 18:17:19.488605 run create_hlr_db(pid=32558): Terminated: ok {rc=0} 18:17:19.914054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32560): Launched 18:17:20.211564 run osmo-hlr_10.42.42.2(pid=32561): Launched 18:17:20.323733 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:20.832214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32563): Launched 18:17:21.129472 run osmo-stp_10.42.42.5(pid=32564): Launched 18:17:21.242870 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:21.778743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32566): Launched 18:17:22.075996 run osmo-msc_10.42.42.6(pid=32567): Launched 18:17:22.241577 run osmo-stp_10.42.42.5(pid=32564): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32564)] 18:17:22.366876 run osmo-stp_10.42.42.5(pid=32564): stdout: | (launched: 2022-12-09_18:17:21.074781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:22.492673 run osmo-stp_10.42.42.5(pid=32564): stderr: | 20221209181721246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181721246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181721246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181721247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181721247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181721247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181721247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:22.616269 run osmo-stp_10.42.42.5(pid=32564): stdout: | (launched: 2022-12-09_18:17:21.074781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:22.733810 run osmo-stp_10.42.42.5(pid=32564): stderr: | 20221209181721246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181721246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181721246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181721247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181721247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181721247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181721247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:22.874490 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32564): Process ended prematurely: osmo-stp_10.42.42.5(pid=32564) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32564)] [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:17:22.883444 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:17:22.910404 run osmo-hlr_10.42.42.2(pid=32561): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32561)] 18:17:22.958370 run osmo-hlr_10.42.42.2(pid=32561): stdout: | (launched: 2022-12-09_18:17:20.156644) 18:17:23.007753 run osmo-hlr_10.42.42.2(pid=32561): stderr: | 20221209181720330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181720330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181720330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181720330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181720330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181720330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181720344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181720353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181720353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181720353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:23.076562 run osmo-msc_10.42.42.6(pid=32567): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32567)] 18:17:23.124121 run osmo-msc_10.42.42.6(pid=32567): stdout: | (launched: 2022-12-09_18:17:22.021163) 18:17:23.173200 run osmo-msc_10.42.42.6(pid=32567): stderr: | 20221209181722294 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181722294 DLGLOBAL DEBUG validating counter group 0x7f09f7d5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181722294 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181722294 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181722295 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181722295 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181722296 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181722297 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181722297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181722297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:23.222606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32560): Terminating (SIGTERM) 18:17:23.261794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32563): Terminating (SIGTERM) 18:17:23.301170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32566): Terminating (SIGTERM) 18:17:23.341080 --- ParallelTerminationStrategy: PID 32560 died... 18:17:23.359447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32560): Terminated: ok {rc=0} 18:17:23.403667 --- ParallelTerminationStrategy: PID 32563 died... 18:17:23.422057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32563): Terminated: ok {rc=0} 18:17:23.465890 --- ParallelTerminationStrategy: PID 32566 died... 18:17:23.484289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32566): Terminated: ok {rc=0} 18:17:23.567895 bus /sierra_3: Setting Powered False 18:17:24.665329 bus /sierra_3: Setting Powered False 18:17:25.782893 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:17:26.926869 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:26.938483 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:17:27.004873 tst mo_mt_call_osmux.py: using LAC 22832 18:17:27.122465 tst mo_mt_call_osmux.py: using RAC 137 18:17:27.243192 tst mo_mt_call_osmux.py: using CellId 22832 18:17:27.358328 tst mo_mt_call_osmux.py: using BVCI 22833 18:17:27.467283 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:27.478368 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:27.489254 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:27.500390 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:27.511604 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:27.522644 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:27.641114 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:27.761488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:28.253625 run create_hlr_db(pid=32569): Launched 18:17:28.383134 bus /sierra_2: Setting Powered False 18:17:29.446078 run create_hlr_db(pid=32569): Terminated: ok {rc=0} 18:17:29.872169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32571): Launched 18:17:30.170841 run osmo-hlr_10.42.42.2(pid=32572): Launched 18:17:30.284532 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:30.815367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32574): Launched 18:17:31.181778 run osmo-stp_10.42.42.5(pid=32575): Launched 18:17:31.447825 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:32.038245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32577): Launched 18:17:32.354882 run osmo-msc_10.42.42.6(pid=32578): Launched 18:17:32.522226 run osmo-stp_10.42.42.5(pid=32575): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32575)] 18:17:32.649734 run osmo-stp_10.42.42.5(pid=32575): stdout: | (launched: 2022-12-09_18:17:31.110664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:32.777226 run osmo-stp_10.42.42.5(pid=32575): stderr: | 20221209181731311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181731311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181731311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181731311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181731314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181731314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181731314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:32.901608 run osmo-stp_10.42.42.5(pid=32575): stdout: | (launched: 2022-12-09_18:17:31.110664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:33.019556 run osmo-stp_10.42.42.5(pid=32575): stderr: | 20221209181731311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181731311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181731311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181731311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181731314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181731314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181731314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:33.161752 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32575): Process ended prematurely: osmo-stp_10.42.42.5(pid=32575) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32575)] [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:17:33.170572 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:17:33.197278 run osmo-hlr_10.42.42.2(pid=32572): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32572)] 18:17:33.245071 run osmo-hlr_10.42.42.2(pid=32572): stdout: | (launched: 2022-12-09_18:17:30.115977) 18:17:33.294326 run osmo-hlr_10.42.42.2(pid=32572): stderr: | 20221209181730289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181730289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181730289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181730289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181730290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181730290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181730301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181730310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181730310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181730310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:33.363645 run osmo-msc_10.42.42.6(pid=32578): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32578)] 18:17:33.411269 run osmo-msc_10.42.42.6(pid=32578): stdout: | (launched: 2022-12-09_18:17:32.299598) 18:17:33.460446 run osmo-msc_10.42.42.6(pid=32578): stderr: | 20221209181732572 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181732572 DLGLOBAL DEBUG validating counter group 0x7f82130c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181732572 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181732572 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181732573 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181732573 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181732575 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181732575 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181732575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181732575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:33.510096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32571): Terminating (SIGTERM) 18:17:33.549745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32574): Terminating (SIGTERM) 18:17:33.589704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32577): Terminating (SIGTERM) 18:17:33.629631 --- ParallelTerminationStrategy: PID 32571 died... 18:17:33.648690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32571): Terminated: ok {rc=0} 18:17:33.693218 --- ParallelTerminationStrategy: PID 32574 died... 18:17:33.711955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32574): Terminated: ok {rc=0} 18:17:33.756390 --- ParallelTerminationStrategy: PID 32577 died... 18:17:33.775105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32577): Terminated: ok {rc=0} 18:17:33.858882 bus /sierra_3: Setting Powered False 18:17:34.954189 bus /sierra_3: Setting Powered False 18:17:36.068275 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:17:37.317992 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:37.325484 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:17:37.359469 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:17:37.385977 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:17:37.436912 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:17:37.469155 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:17:37.495500 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:17:38.045236 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:17:38.094070 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:38.105110 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:17:38.171136 tst mo_mt_call.py: using LAC 22833 18:17:38.287452 tst mo_mt_call.py: using RAC 138 18:17:38.405317 tst mo_mt_call.py: using CellId 22833 18:17:38.527329 tst mo_mt_call.py: using BVCI 22834 18:17:38.634879 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:38.645908 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:38.656572 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:38.668158 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:38.679752 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:38.691170 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:17:38.809958 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:17:38.927772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:39.419929 run create_hlr_db(pid=32583): Launched 18:17:39.550294 bus /sierra_2: Setting Powered False 18:17:40.613939 run create_hlr_db(pid=32583): Terminated: ok {rc=0} 18:17:41.038126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32585): Launched 18:17:41.335632 run osmo-hlr_10.42.42.2(pid=32586): Launched 18:17:41.448829 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:41.961311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32588): Launched 18:17:42.259324 run osmo-stp_10.42.42.5(pid=32589): Launched 18:17:42.372318 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:42.909387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32591): Launched 18:17:43.208304 run osmo-msc_10.42.42.6(pid=32592): Launched 18:17:43.375128 run osmo-stp_10.42.42.5(pid=32589): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32589)] 18:17:43.501229 run osmo-stp_10.42.42.5(pid=32589): stdout: | (launched: 2022-12-09_18:17:42.204537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:43.627439 run osmo-stp_10.42.42.5(pid=32589): stderr: | 20221209181742374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181742374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181742374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181742375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181742377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181742377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181742377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:43.751600 run osmo-stp_10.42.42.5(pid=32589): stdout: | (launched: 2022-12-09_18:17:42.204537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:43.870623 run osmo-stp_10.42.42.5(pid=32589): stderr: | 20221209181742374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181742374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181742374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181742375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181742377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181742377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181742377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:44.011839 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32589): Process ended prematurely: osmo-stp_10.42.42.5(pid=32589) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32589)] [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:17:44.020682 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:17:44.047389 run osmo-hlr_10.42.42.2(pid=32586): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32586)] 18:17:44.095959 run osmo-hlr_10.42.42.2(pid=32586): stdout: | (launched: 2022-12-09_18:17:41.281366) 18:17:44.145535 run osmo-hlr_10.42.42.2(pid=32586): stderr: | 20221209181741455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181741455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181741455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181741455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181741455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181741456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181741471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181741481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181741481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181741481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:44.214569 run osmo-msc_10.42.42.6(pid=32592): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32592)] 18:17:44.262673 run osmo-msc_10.42.42.6(pid=32592): stdout: | (launched: 2022-12-09_18:17:43.153487) 18:17:44.311877 run osmo-msc_10.42.42.6(pid=32592): stderr: | 20221209181743423 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181743423 DLGLOBAL DEBUG validating counter group 0x7fcfdd4fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181743423 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181743423 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181743423 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181743423 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181743426 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181743426 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181743426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181743426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:44.361596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32585): Terminating (SIGTERM) 18:17:44.401456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32588): Terminating (SIGTERM) 18:17:44.441209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32591): Terminating (SIGTERM) 18:17:44.482033 --- ParallelTerminationStrategy: PID 32585 died... 18:17:44.501192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32585): Terminated: ok {rc=0} 18:17:44.545932 --- ParallelTerminationStrategy: PID 32588 died... 18:17:44.564326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32588): Terminated: ok {rc=0} 18:17:44.608741 --- ParallelTerminationStrategy: PID 32591 died... 18:17:44.627310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32591): Terminated: ok {rc=0} 18:17:44.714050 bus /sierra_3: Setting Powered False 18:17:45.813139 bus /sierra_3: Setting Powered False 18:17:46.939352 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:17:48.089921 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:48.102130 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:17:48.173166 tst mo_mt_call_osmux.py: using LAC 22834 18:17:48.298022 tst mo_mt_call_osmux.py: using RAC 139 18:17:48.416543 tst mo_mt_call_osmux.py: using CellId 22834 18:17:48.532422 tst mo_mt_call_osmux.py: using BVCI 22835 18:17:48.640536 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:48.651604 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:48.662572 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:48.674210 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:48.685444 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:17:48.696341 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:17:48.813302 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:17:48.928876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:49.389489 run create_hlr_db(pid=32597): Launched 18:17:49.502484 bus /sierra_2: Setting Powered False 18:17:50.565674 run create_hlr_db(pid=32597): Terminated: ok {rc=0} 18:17:51.008938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32599): Launched 18:17:51.327824 run osmo-hlr_10.42.42.2(pid=32600): Launched 18:17:51.448856 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:51.994960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32602): Launched 18:17:52.312603 run osmo-stp_10.42.42.5(pid=32603): Launched 18:17:52.433964 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:53.006843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32605): Launched 18:17:53.324848 run osmo-msc_10.42.42.6(pid=32606): Launched 18:17:53.502954 run osmo-stp_10.42.42.5(pid=32603): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32603)] 18:17:53.636758 run osmo-stp_10.42.42.5(pid=32603): stdout: | (launched: 2022-12-09_18:17:52.254515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:53.771361 run osmo-stp_10.42.42.5(pid=32603): stderr: | 20221209181752447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181752448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181752448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181752448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181752449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181752449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181752449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:53.906541 run osmo-stp_10.42.42.5(pid=32603): stdout: | (launched: 2022-12-09_18:17:52.254515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:54.032527 run osmo-stp_10.42.42.5(pid=32603): stderr: | 20221209181752447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181752448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181752448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181752448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181752449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181752449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181752449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:54.183977 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32603): Process ended prematurely: osmo-stp_10.42.42.5(pid=32603) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32603)] [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:17:54.193599 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:17:54.221279 run osmo-hlr_10.42.42.2(pid=32600): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32600)] 18:17:54.270799 run osmo-hlr_10.42.42.2(pid=32600): stdout: | (launched: 2022-12-09_18:17:51.269884) 18:17:54.322625 run osmo-hlr_10.42.42.2(pid=32600): stderr: | 20221209181751467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181751467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181751467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181751467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181751468 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181751468 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181751480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181751489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181751489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181751489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:54.394507 run osmo-msc_10.42.42.6(pid=32606): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32606)] 18:17:54.443896 run osmo-msc_10.42.42.6(pid=32606): stdout: | (launched: 2022-12-09_18:17:53.266602) 18:17:54.494841 run osmo-msc_10.42.42.6(pid=32606): stderr: | 20221209181753590 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181753591 DLGLOBAL DEBUG validating counter group 0x7f02911a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181753591 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181753591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181753591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181753591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181753593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181753593 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181753593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181753594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:54.546553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32599): Terminating (SIGTERM) 18:17:54.587757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32602): Terminating (SIGTERM) 18:17:54.629139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32605): Terminating (SIGTERM) 18:17:54.670722 --- ParallelTerminationStrategy: PID 32599 died... 18:17:54.690171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32599): Terminated: ok {rc=0} 18:17:54.736364 --- ParallelTerminationStrategy: PID 32602 died... 18:17:54.755823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32602): Terminated: ok {rc=0} 18:17:54.801362 --- ParallelTerminationStrategy: PID 32605 died... 18:17:54.820642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32605): Terminated: ok {rc=0} 18:17:54.907231 bus /sierra_3: Setting Powered False 18:17:56.002639 bus /sierra_3: Setting Powered False 18:17:57.117788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:17:58.358658 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:58.365831 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:17:58.398001 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:17:58.424252 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:17:58.474721 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:17:58.506187 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:17:58.532149 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:17:59.088455 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:17:59.139727 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:17:59.151207 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:17:59.218152 tst mo_mt_call.py: using LAC 22835 18:17:59.343154 tst mo_mt_call.py: using RAC 140 18:17:59.467762 tst mo_mt_call.py: using CellId 22835 18:17:59.596073 tst mo_mt_call.py: using BVCI 22836 18:17:59.713128 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:17:59.724572 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:17:59.735971 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:17:59.747237 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:17:59.758621 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:17:59.769904 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:17:59.883243 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:17:59.997502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:00.460703 run create_hlr_db(pid=32611): Launched 18:18:00.574844 bus /sierra_2: Setting Powered False 18:18:01.641812 run create_hlr_db(pid=32611): Terminated: ok {rc=0} 18:18:02.098640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32613): Launched 18:18:02.411710 run osmo-hlr_10.42.42.2(pid=32614): Launched 18:18:02.526100 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:03.053461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32616): Launched 18:18:03.352811 run osmo-stp_10.42.42.5(pid=32617): Launched 18:18:03.466076 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:04.002756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32619): Launched 18:18:04.300312 run osmo-msc_10.42.42.6(pid=32620): Launched 18:18:04.466490 run osmo-stp_10.42.42.5(pid=32617): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32617)] 18:18:04.592580 run osmo-stp_10.42.42.5(pid=32617): stdout: | (launched: 2022-12-09_18:18:03.297142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:04.718971 run osmo-stp_10.42.42.5(pid=32617): stderr: | 20221209181803466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181803466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181803466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181803467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181803467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181803467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181803467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:04.842405 run osmo-stp_10.42.42.5(pid=32617): stdout: | (launched: 2022-12-09_18:18:03.297142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:04.959595 run osmo-stp_10.42.42.5(pid=32617): stderr: | 20221209181803466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181803466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181803466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181803467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181803467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181803467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181803467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:05.100895 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32617): Process ended prematurely: osmo-stp_10.42.42.5(pid=32617) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32617)] [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:18:05.109749 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:18:05.136784 run osmo-hlr_10.42.42.2(pid=32614): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32614)] 18:18:05.184808 run osmo-hlr_10.42.42.2(pid=32614): stdout: | (launched: 2022-12-09_18:18:02.356652) 18:18:05.234058 run osmo-hlr_10.42.42.2(pid=32614): stderr: | 20221209181802533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181802533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181802533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181802533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181802533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181802533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181802545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181802556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181802557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181802557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:05.303011 run osmo-msc_10.42.42.6(pid=32620): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32620)] 18:18:05.350409 run osmo-msc_10.42.42.6(pid=32620): stdout: | (launched: 2022-12-09_18:18:04.245596) 18:18:05.399607 run osmo-msc_10.42.42.6(pid=32620): stderr: | 20221209181804519 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181804519 DLGLOBAL DEBUG validating counter group 0x7f793b1c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181804519 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181804519 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181804520 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181804520 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181804522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181804523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181804523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181804523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:05.449172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32613): Terminating (SIGTERM) 18:18:05.488384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32616): Terminating (SIGTERM) 18:18:05.527881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32619): Terminating (SIGTERM) 18:18:05.567817 --- ParallelTerminationStrategy: PID 32613 died... 18:18:05.586542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32613): Terminated: ok {rc=0} 18:18:05.630767 --- ParallelTerminationStrategy: PID 32616 died... 18:18:05.649243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32616): Terminated: ok {rc=0} 18:18:05.693150 --- ParallelTerminationStrategy: PID 32619 died... 18:18:05.711681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32619): Terminated: ok {rc=0} 18:18:05.797115 bus /sierra_3: Setting Powered False 18:18:06.895326 bus /sierra_3: Setting Powered False 18:18:08.010982 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:18:09.155662 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:09.167425 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:18:09.233391 tst mo_mt_call_osmux.py: using LAC 22836 18:18:09.351216 tst mo_mt_call_osmux.py: using RAC 141 18:18:09.468648 tst mo_mt_call_osmux.py: using CellId 22836 18:18:09.584095 tst mo_mt_call_osmux.py: using BVCI 22837 18:18:09.691265 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:09.702439 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:09.713390 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:09.724459 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:09.735681 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:09.746873 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:09.860767 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:09.979768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:10.439347 run create_hlr_db(pid=32622): Launched 18:18:10.553539 bus /sierra_2: Setting Powered False 18:18:11.612700 run create_hlr_db(pid=32622): Terminated: ok {rc=0} 18:18:12.049288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32624): Launched 18:18:12.368118 run osmo-hlr_10.42.42.2(pid=32625): Launched 18:18:12.489153 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:13.040396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32627): Launched 18:18:13.358475 run osmo-stp_10.42.42.5(pid=32628): Launched 18:18:13.479348 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:14.054985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32630): Launched 18:18:14.373899 run osmo-msc_10.42.42.6(pid=32631): Launched 18:18:14.551234 run osmo-stp_10.42.42.5(pid=32628): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32628)] 18:18:14.685109 run osmo-stp_10.42.42.5(pid=32628): stdout: | (launched: 2022-12-09_18:18:13.300398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:14.819120 run osmo-stp_10.42.42.5(pid=32628): stderr: | 20221209181813491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181813491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181813492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181813492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181813494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181813494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181813495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:14.952511 run osmo-stp_10.42.42.5(pid=32628): stdout: | (launched: 2022-12-09_18:18:13.300398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:15.078977 run osmo-stp_10.42.42.5(pid=32628): stderr: | 20221209181813491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181813491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181813492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181813492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181813494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181813494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181813495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:15.230158 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32628): Process ended prematurely: osmo-stp_10.42.42.5(pid=32628) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32628)] [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:18:15.239717 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:18:15.267207 run osmo-hlr_10.42.42.2(pid=32625): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32625)] 18:18:15.316848 run osmo-hlr_10.42.42.2(pid=32625): stdout: | (launched: 2022-12-09_18:18:12.310048) 18:18:15.368173 run osmo-hlr_10.42.42.2(pid=32625): stderr: | 20221209181812509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181812509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181812510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181812510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181812510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181812510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181812522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181812532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181812532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181812532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:15.439780 run osmo-msc_10.42.42.6(pid=32631): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32631)] 18:18:15.489274 run osmo-msc_10.42.42.6(pid=32631): stdout: | (launched: 2022-12-09_18:18:14.315719) 18:18:15.540511 run osmo-msc_10.42.42.6(pid=32631): stderr: | 20221209181814637 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181814637 DLGLOBAL DEBUG validating counter group 0x7fd9af05cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181814637 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181814637 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181814637 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181814637 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181814639 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181814639 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181814640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181814640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:15.592084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32624): Terminating (SIGTERM) 18:18:15.633240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32627): Terminating (SIGTERM) 18:18:15.674371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32630): Terminating (SIGTERM) 18:18:15.715918 --- ParallelTerminationStrategy: PID 32624 died... 18:18:15.735618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32624): Terminated: ok {rc=0} 18:18:15.781158 --- ParallelTerminationStrategy: PID 32627 died... 18:18:15.800234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32627): Terminated: ok {rc=0} 18:18:15.862451 --- ParallelTerminationStrategy: PID 32630 died... 18:18:15.882395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32630): Terminated: ok {rc=0} 18:18:15.981362 bus /sierra_3: Setting Powered False 18:18:17.082714 bus /sierra_3: Setting Powered False 18:18:18.215009 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:18:19.464321 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:18:19.472425 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:18:19.504910 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:18:19.531775 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:18:19.586011 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:18:19.618919 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:18:19.645105 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:18:20.192773 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:18:20.241259 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:20.252424 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:18:20.317386 tst mo_mt_call.py: using LAC 22837 18:18:20.434064 tst mo_mt_call.py: using RAC 142 18:18:20.553300 tst mo_mt_call.py: using CellId 22837 18:18:20.678459 tst mo_mt_call.py: using BVCI 22838 18:18:20.795577 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:20.807148 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:20.818477 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:20.829803 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:20.841157 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:20.852810 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:18:20.966367 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:18:21.082506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:21.573417 run create_hlr_db(pid=32636): Launched 18:18:21.702259 bus /sierra_2: Setting Powered False 18:18:22.765337 run create_hlr_db(pid=32636): Terminated: ok {rc=0} 18:18:23.208055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32638): Launched 18:18:23.526244 run osmo-hlr_10.42.42.2(pid=32639): Launched 18:18:23.646934 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:24.196606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32641): Launched 18:18:24.513261 run osmo-stp_10.42.42.5(pid=32642): Launched 18:18:24.634275 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:25.209406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32644): Launched 18:18:25.527598 run osmo-msc_10.42.42.6(pid=32645): Launched 18:18:25.703587 run osmo-stp_10.42.42.5(pid=32642): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32642)] 18:18:25.836364 run osmo-stp_10.42.42.5(pid=32642): stdout: | (launched: 2022-12-09_18:18:24.455141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:25.970375 run osmo-stp_10.42.42.5(pid=32642): stderr: | 20221209181824647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181824647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181824647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181824647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181824650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181824650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181824650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:26.104355 run osmo-stp_10.42.42.5(pid=32642): stdout: | (launched: 2022-12-09_18:18:24.455141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:26.230745 run osmo-stp_10.42.42.5(pid=32642): stderr: | 20221209181824647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181824647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181824647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181824647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181824650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181824650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181824650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:26.381049 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32642): Process ended prematurely: osmo-stp_10.42.42.5(pid=32642) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32642)] [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:18:26.390502 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:18:26.418107 run osmo-hlr_10.42.42.2(pid=32639): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32639)] 18:18:26.467436 run osmo-hlr_10.42.42.2(pid=32639): stdout: | (launched: 2022-12-09_18:18:23.467589) 18:18:26.518604 run osmo-hlr_10.42.42.2(pid=32639): stderr: | 20221209181823666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181823666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181823666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181823666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181823666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181823666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181823679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181823687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181823687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181823687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:26.590041 run osmo-msc_10.42.42.6(pid=32645): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32645)] 18:18:26.639312 run osmo-msc_10.42.42.6(pid=32645): stdout: | (launched: 2022-12-09_18:18:25.469525) 18:18:26.690545 run osmo-msc_10.42.42.6(pid=32645): stderr: | 20221209181825792 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181825792 DLGLOBAL DEBUG validating counter group 0x7f5c301a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181825792 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181825793 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181825793 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181825793 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181825795 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181825795 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181825795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181825795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:26.741929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32638): Terminating (SIGTERM) 18:18:26.783171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32641): Terminating (SIGTERM) 18:18:26.824425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32644): Terminating (SIGTERM) 18:18:26.866284 --- ParallelTerminationStrategy: PID 32638 died... 18:18:26.885714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32638): Terminated: ok {rc=0} 18:18:26.931509 --- ParallelTerminationStrategy: PID 32641 died... 18:18:26.950902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32641): Terminated: ok {rc=0} 18:18:26.996446 --- ParallelTerminationStrategy: PID 32644 died... 18:18:27.015809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32644): Terminated: ok {rc=0} 18:18:27.102566 bus /sierra_3: Setting Powered False 18:18:28.201226 bus /sierra_3: Setting Powered False 18:18:29.314853 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:18:30.455488 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:30.467136 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:18:30.533040 tst mo_mt_call_osmux.py: using LAC 22838 18:18:30.652352 tst mo_mt_call_osmux.py: using RAC 143 18:18:30.769140 tst mo_mt_call_osmux.py: using CellId 22838 18:18:30.891690 tst mo_mt_call_osmux.py: using BVCI 22839 18:18:31.034856 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:31.047206 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:31.059462 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:31.073718 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:31.087027 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:18:31.099000 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:18:31.223450 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:18:31.338572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:31.814953 run create_hlr_db(pid=32647): Launched 18:18:31.972386 bus /sierra_2: Setting Powered False 18:18:33.031600 run create_hlr_db(pid=32647): Terminated: ok {rc=0} 18:18:33.467106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32649): Launched 18:18:33.784672 run osmo-hlr_10.42.42.2(pid=32650): Launched 18:18:33.905373 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:34.455848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32652): Launched 18:18:34.773520 run osmo-stp_10.42.42.5(pid=32653): Launched 18:18:34.894172 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:35.470254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32655): Launched 18:18:35.789694 run osmo-msc_10.42.42.6(pid=32656): Launched 18:18:35.966861 run osmo-stp_10.42.42.5(pid=32653): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32653)] 18:18:36.101977 run osmo-stp_10.42.42.5(pid=32653): stdout: | (launched: 2022-12-09_18:18:34.715435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:36.238356 run osmo-stp_10.42.42.5(pid=32653): stderr: | 20221209181834905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181834905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181834905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181834906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181834908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181834908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181834908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:36.372769 run osmo-stp_10.42.42.5(pid=32653): stdout: | (launched: 2022-12-09_18:18:34.715435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:36.499098 run osmo-stp_10.42.42.5(pid=32653): stderr: | 20221209181834905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181834905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181834905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181834906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181834908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181834908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181834908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:36.650824 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32653): Process ended prematurely: osmo-stp_10.42.42.5(pid=32653) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32653)] [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:18:36.660290 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:18:36.688041 run osmo-hlr_10.42.42.2(pid=32650): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32650)] 18:18:36.737776 run osmo-hlr_10.42.42.2(pid=32650): stdout: | (launched: 2022-12-09_18:18:33.726786) 18:18:36.789252 run osmo-hlr_10.42.42.2(pid=32650): stderr: | 20221209181833925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181833925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181833925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181833925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181833925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181833925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181833938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181833946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181833946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181833946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:36.860864 run osmo-msc_10.42.42.6(pid=32656): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32656)] 18:18:36.910485 run osmo-msc_10.42.42.6(pid=32656): stdout: | (launched: 2022-12-09_18:18:35.731203) 18:18:36.961477 run osmo-msc_10.42.42.6(pid=32656): stderr: | 20221209181836051 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181836052 DLGLOBAL DEBUG validating counter group 0x7f7faab7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181836052 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181836052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181836052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181836052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181836054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181836054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181836054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181836054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:37.012874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32649): Terminating (SIGTERM) 18:18:37.054475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32652): Terminating (SIGTERM) 18:18:37.096348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32655): Terminating (SIGTERM) 18:18:37.138414 --- ParallelTerminationStrategy: PID 32649 died... 18:18:37.158235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32649): Terminated: ok {rc=0} 18:18:37.204348 --- ParallelTerminationStrategy: PID 32652 died... 18:18:37.223847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32652): Terminated: ok {rc=0} 18:18:37.269435 --- ParallelTerminationStrategy: PID 32655 died... 18:18:37.288713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32655): Terminated: ok {rc=0} 18:18:37.375098 bus /sierra_3: Setting Powered False 18:18:38.472941 bus /sierra_3: Setting Powered False 18:18:39.584296 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:18:40.835205 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:18:40.843355 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:18:40.875824 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:18:40.902757 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:18:40.958184 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:18:40.991259 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:18:41.017558 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:18:41.568833 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:18:41.620621 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:41.632341 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:18:41.701943 tst mo_mt_call.py: using LAC 22839 18:18:41.827272 tst mo_mt_call.py: using RAC 144 18:18:41.952018 tst mo_mt_call.py: using CellId 22839 18:18:42.077577 tst mo_mt_call.py: using BVCI 22840 18:18:42.188488 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:42.200115 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:42.211256 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:42.222444 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:42.233944 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:42.245273 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:18:42.362780 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:18:42.484354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:42.978040 run create_hlr_db(pid=32661): Launched 18:18:43.108604 bus /sierra_2: Setting Powered False 18:18:44.171927 run create_hlr_db(pid=32661): Terminated: ok {rc=0} 18:18:44.599819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32663): Launched 18:18:44.899261 run osmo-hlr_10.42.42.2(pid=32664): Launched 18:18:45.013925 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:45.528142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32666): Launched 18:18:45.825417 run osmo-stp_10.42.42.5(pid=32667): Launched 18:18:46.064681 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:46.657693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32669): Launched 18:18:46.978482 run osmo-msc_10.42.42.6(pid=32670): Launched 18:18:47.350033 run osmo-stp_10.42.42.5(pid=32667): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32667)] 18:18:47.594387 run osmo-stp_10.42.42.5(pid=32667): stdout: | (launched: 2022-12-09_18:18:45.770647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:47.718158 run osmo-stp_10.42.42.5(pid=32667): stderr: | 20221209181846005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181846005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181846006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181846006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181846006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181846007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181846007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:47.841917 run osmo-stp_10.42.42.5(pid=32667): stdout: | (launched: 2022-12-09_18:18:45.770647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:47.959535 run osmo-stp_10.42.42.5(pid=32667): stderr: | 20221209181846005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181846005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181846006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181846006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181846006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181846007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181846007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:48.100715 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32667): Process ended prematurely: osmo-stp_10.42.42.5(pid=32667) [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32667)] [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:18:48.109744 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:18:48.136297 run osmo-hlr_10.42.42.2(pid=32664): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32664)] 18:18:48.184322 run osmo-hlr_10.42.42.2(pid=32664): stdout: | (launched: 2022-12-09_18:18:44.844315) 18:18:48.233970 run osmo-hlr_10.42.42.2(pid=32664): stderr: | 20221209181845021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181845021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181845021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181845022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181845022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181845022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181845034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181845043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181845043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181845043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:48.303188 run osmo-msc_10.42.42.6(pid=32670): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32670)] 18:18:48.351110 run osmo-msc_10.42.42.6(pid=32670): stdout: | (launched: 2022-12-09_18:18:46.917769) 18:18:48.400285 run osmo-msc_10.42.42.6(pid=32670): stderr: | 20221209181847278 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181847278 DLGLOBAL DEBUG validating counter group 0x7f4231893c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181847278 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181847278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181847279 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181847279 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181847282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181847283 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181847283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181847283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:48.449785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32663): Terminating (SIGTERM) 18:18:48.489609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32666): Terminating (SIGTERM) 18:18:48.529264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32669): Terminating (SIGTERM) 18:18:48.569666 --- ParallelTerminationStrategy: PID 32663 died... 18:18:48.588405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32663): Terminated: ok {rc=0} 18:18:48.632793 --- ParallelTerminationStrategy: PID 32666 died... 18:18:48.651708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32666): Terminated: ok {rc=0} 18:18:48.695685 --- ParallelTerminationStrategy: PID 32669 died... 18:18:48.714200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32669): Terminated: ok {rc=0} 18:18:48.800287 bus /sierra_3: Setting Powered False 18:18:49.898779 bus /sierra_3: Setting Powered False 18:18:51.014467 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:18:52.157314 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:52.168918 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:18:52.235914 tst mo_mt_call_osmux.py: using LAC 22840 18:18:52.362803 tst mo_mt_call_osmux.py: using RAC 145 18:18:52.489536 tst mo_mt_call_osmux.py: using CellId 22840 18:18:52.616049 tst mo_mt_call_osmux.py: using BVCI 22841 18:18:52.732397 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:52.744162 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:52.755563 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:52.766972 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:52.778486 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:18:52.789857 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:18:52.905091 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:18:53.019852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:53.480739 run create_hlr_db(pid=32672): Launched 18:18:53.595676 bus /sierra_2: Setting Powered False 18:18:54.659524 run create_hlr_db(pid=32672): Terminated: ok {rc=0} 18:18:55.103889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32674): Launched 18:18:55.422135 run osmo-hlr_10.42.42.2(pid=32675): Launched 18:18:55.542572 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:56.090284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32677): Launched 18:18:56.410036 run osmo-stp_10.42.42.5(pid=32678): Launched 18:18:56.531321 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:57.107540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32680): Launched 18:18:57.425699 run osmo-msc_10.42.42.6(pid=32681): Launched 18:18:57.602630 run osmo-stp_10.42.42.5(pid=32678): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32678)] 18:18:57.735851 run osmo-stp_10.42.42.5(pid=32678): stdout: | (launched: 2022-12-09_18:18:56.351082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:57.869387 run osmo-stp_10.42.42.5(pid=32678): stderr: | 20221209181856542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181856543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181856543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181856543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181856544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181856544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181856544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:58.002805 run osmo-stp_10.42.42.5(pid=32678): stdout: | (launched: 2022-12-09_18:18:56.351082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:58.128891 run osmo-stp_10.42.42.5(pid=32678): stderr: | 20221209181856542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181856543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181856543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181856543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181856544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181856544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181856544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:58.279712 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32678): Process ended prematurely: osmo-stp_10.42.42.5(pid=32678) [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32678)] [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:18:58.289229 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:18:58.316724 run osmo-hlr_10.42.42.2(pid=32675): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32675)] 18:18:58.366241 run osmo-hlr_10.42.42.2(pid=32675): stdout: | (launched: 2022-12-09_18:18:55.364192) 18:18:58.418079 run osmo-hlr_10.42.42.2(pid=32675): stderr: | 20221209181855562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181855562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181855562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181855562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181855562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181855562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181855574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181855582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181855583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181855583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:58.489756 run osmo-msc_10.42.42.6(pid=32681): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32681)] 18:18:58.539218 run osmo-msc_10.42.42.6(pid=32681): stdout: | (launched: 2022-12-09_18:18:57.367629) 18:18:58.590462 run osmo-msc_10.42.42.6(pid=32681): stderr: | 20221209181857690 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181857691 DLGLOBAL DEBUG validating counter group 0x7f7a05b86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181857691 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181857691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181857691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181857691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181857693 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181857693 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181857693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181857694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:58.641995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32674): Terminating (SIGTERM) 18:18:58.683297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32677): Terminating (SIGTERM) 18:18:58.724627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32680): Terminating (SIGTERM) 18:18:58.766663 --- ParallelTerminationStrategy: PID 32674 died... 18:18:58.786687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32674): Terminated: ok {rc=0} 18:18:58.832871 --- ParallelTerminationStrategy: PID 32677 died... 18:18:58.852597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32677): Terminated: ok {rc=0} 18:18:58.898586 --- ParallelTerminationStrategy: PID 32680 died... 18:18:58.918137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32680): Terminated: ok {rc=0} 18:18:59.004444 bus /sierra_3: Setting Powered False 18:19:00.102179 bus /sierra_3: Setting Powered False 18:19:01.222861 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:19:02.465907 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:19:02.472721 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:19:02.504900 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 18:19:02.534986 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 18:19:02.586367 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:19:02.618755 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 18:19:02.645445 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 18:19:03.201725 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 18:19:03.252155 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:03.263896 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:19:03.316564 tst mo_mt_call.py: using LAC 22841 18:19:03.440838 tst mo_mt_call.py: using RAC 146 18:19:03.564550 tst mo_mt_call.py: using CellId 22841 18:19:03.687176 tst mo_mt_call.py: using BVCI 22842 18:19:03.802624 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:03.814453 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:03.825989 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:03.837510 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:03.849021 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:03.860473 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:19:03.977054 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:19:04.093350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:04.554838 run create_hlr_db(pid=32686): Launched 18:19:04.669899 bus /sierra_2: Setting Powered False 18:19:05.729904 run create_hlr_db(pid=32686): Terminated: ok {rc=0} 18:19:06.166687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32688): Launched 18:19:06.487452 run osmo-hlr_10.42.42.2(pid=32689): Launched 18:19:06.609859 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:07.158965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32691): Launched 18:19:07.477366 run osmo-stp_10.42.42.5(pid=32692): Launched 18:19:07.599330 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:08.176286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32694): Launched 18:19:08.495300 run osmo-msc_10.42.42.6(pid=32695): Launched 18:19:08.674034 run osmo-stp_10.42.42.5(pid=32692): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32692)] 18:19:08.808610 run osmo-stp_10.42.42.5(pid=32692): stdout: | (launched: 2022-12-09_18:19:07.418823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:08.943208 run osmo-stp_10.42.42.5(pid=32692): stderr: | 20221209181907613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181907613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181907613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181907613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181907614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181907614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181907614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:09.077175 run osmo-stp_10.42.42.5(pid=32692): stdout: | (launched: 2022-12-09_18:19:07.418823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:09.203656 run osmo-stp_10.42.42.5(pid=32692): stderr: | 20221209181907613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181907613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181907613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181907613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181907614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181907614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181907614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:09.354801 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32692): Process ended prematurely: osmo-stp_10.42.42.5(pid=32692) [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32692)] [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 18:19:09.364104 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:19:09.391814 run osmo-hlr_10.42.42.2(pid=32689): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32689)] 18:19:09.441730 run osmo-hlr_10.42.42.2(pid=32689): stdout: | (launched: 2022-12-09_18:19:06.428574) 18:19:09.493312 run osmo-hlr_10.42.42.2(pid=32689): stderr: | 20221209181906630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181906630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181906630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181906630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181906630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181906630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181906643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181906652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181906653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181906653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:09.565234 run osmo-msc_10.42.42.6(pid=32695): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32695)] 18:19:09.614957 run osmo-msc_10.42.42.6(pid=32695): stdout: | (launched: 2022-12-09_18:19:08.436309) 18:19:09.666338 run osmo-msc_10.42.42.6(pid=32695): stderr: | 20221209181908761 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181908761 DLGLOBAL DEBUG validating counter group 0x7f590818ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181908761 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181908761 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181908761 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181908761 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181908763 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181908763 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181908763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181908764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:09.718165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32688): Terminating (SIGTERM) 18:19:09.759797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32691): Terminating (SIGTERM) 18:19:09.801538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32694): Terminating (SIGTERM) 18:19:09.843552 --- ParallelTerminationStrategy: PID 32688 died... 18:19:09.863230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32688): Terminated: ok {rc=0} 18:19:09.909213 --- ParallelTerminationStrategy: PID 32691 died... 18:19:09.928301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32691): Terminated: ok {rc=0} 18:19:09.973975 --- ParallelTerminationStrategy: PID 32694 died... 18:19:09.993348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32694): Terminated: ok {rc=0} 18:19:10.080854 bus /sierra_3: Setting Powered False 18:19:11.179489 bus /sierra_3: Setting Powered False 18:19:12.296818 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 18:19:13.442265 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:13.454066 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:19:13.503552 tst mo_mt_call_osmux.py: using LAC 22842 18:19:13.623139 tst mo_mt_call_osmux.py: using RAC 147 18:19:13.739607 tst mo_mt_call_osmux.py: using CellId 22842 18:19:13.857380 tst mo_mt_call_osmux.py: using BVCI 22843 18:19:13.964936 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:13.976227 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:13.987329 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:13.998590 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:14.009910 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:19:14.021125 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:19:14.134586 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:19:14.254115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:14.748748 run create_hlr_db(pid=32697): Launched 18:19:14.878829 bus /sierra_2: Setting Powered False 18:19:15.941119 run create_hlr_db(pid=32697): Terminated: ok {rc=0} 18:19:16.397133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32699): Launched 18:19:16.738300 run osmo-hlr_10.42.42.2(pid=32700): Launched 18:19:16.923024 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:17.546658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32702): Launched 18:19:17.847462 run osmo-stp_10.42.42.5(pid=32703): Launched 18:19:17.960606 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:18.497818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32705): Launched 18:19:18.795683 run osmo-msc_10.42.42.6(pid=32706): Launched 18:19:18.961829 run osmo-stp_10.42.42.5(pid=32703): ERR: Terminated: ERROR {rc=1} [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32703)] 18:19:19.088166 run osmo-stp_10.42.42.5(pid=32703): stdout: | (launched: 2022-12-09_18:19:17.792190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:19.215060 run osmo-stp_10.42.42.5(pid=32703): stderr: | 20221209181917963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181917963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181917963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181917964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181917964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181917964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181917964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:19.339215 run osmo-stp_10.42.42.5(pid=32703): stdout: | (launched: 2022-12-09_18:19:17.792190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:19.457254 run osmo-stp_10.42.42.5(pid=32703): stderr: | 20221209181917963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181917963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181917963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181917964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181917964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181917964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181917964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:19.598623 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32703): Process ended prematurely: osmo-stp_10.42.42.5(pid=32703) [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32703)] [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 18:19:19.607420 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:19:19.634321 run osmo-hlr_10.42.42.2(pid=32700): ERR: Terminated: ERROR {rc=237} [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32700)] 18:19:19.681677 run osmo-hlr_10.42.42.2(pid=32700): stdout: | (launched: 2022-12-09_18:19:16.674797) 18:19:19.730696 run osmo-hlr_10.42.42.2(pid=32700): stderr: | 20221209181916991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181916991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181916991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181916991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181916991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181916991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181917007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181917025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181917025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181917025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:19.799309 run osmo-msc_10.42.42.6(pid=32706): ERR: Terminated: ERROR {rc=2} [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32706)] 18:19:19.846968 run osmo-msc_10.42.42.6(pid=32706): stdout: | (launched: 2022-12-09_18:19:18.740737) 18:19:19.895704 run osmo-msc_10.42.42.6(pid=32706): stderr: | 20221209181919012 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181919012 DLGLOBAL DEBUG validating counter group 0x7f2f6ef86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181919013 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181919013 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181919013 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181919013 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181919015 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181919015 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181919015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181919015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:19.945000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32699): Terminating (SIGTERM) 18:19:19.984523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32702): Terminating (SIGTERM) 18:19:20.024294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32705): Terminating (SIGTERM) 18:19:20.064322 --- ParallelTerminationStrategy: PID 32699 died... 18:19:20.083258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32699): Terminated: ok {rc=0} 18:19:20.127934 --- ParallelTerminationStrategy: PID 32702 died... 18:19:20.146481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32702): Terminated: ok {rc=0} 18:19:20.190778 --- ParallelTerminationStrategy: PID 32705 died... 18:19:20.209321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32705): Terminated: ok {rc=0} 18:19:20.293179 bus /sierra_3: Setting Powered False 18:19:21.391143 bus /sierra_3: Setting Powered False 18:19:22.506124 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 emergency:nanobts+band-900 --------------------------------------------------------------------- 18:19:23.761567 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:19:23.767273 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:19:23.799633 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 18:19:23.826290 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 18:19:23.910454 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:19:23.942586 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 18:19:23.969366 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 18:19:24.555011 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2362 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 18:19:24.560371 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:24.571405 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 18:19:24.626497 tst emergency_mo_mt_call.py: using LAC 22843 18:19:24.748868 tst emergency_mo_mt_call.py: using RAC 148 18:19:24.866237 tst emergency_mo_mt_call.py: using CellId 22843 18:19:24.981118 tst emergency_mo_mt_call.py: using BVCI 22844 18:19:25.086080 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:25.096854 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:25.107568 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:25.118255 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:25.129081 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:25.139788 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:19:25.255880 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:19:25.372508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:25.855659 run create_hlr_db(pid=32711): Launched 18:19:25.982576 bus /sierra_2: Setting Powered False 18:19:27.045424 run create_hlr_db(pid=32711): Terminated: ok {rc=0} 18:19:27.464368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32713): Launched 18:19:27.756355 run osmo-hlr_10.42.42.2(pid=32714): Launched 18:19:27.868464 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:28.387466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32716): Launched 18:19:28.678724 run osmo-stp_10.42.42.5(pid=32717): Launched 18:19:28.799066 tst emergency_mo_mt_call.py: using MSISDN 7308 18:19:28.960998 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:29.486797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32719): Launched 18:19:29.779290 run osmo-msc_10.42.42.6(pid=32720): Launched 18:19:29.942898 run osmo-stp_10.42.42.5(pid=32717): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32717)] 18:19:30.066973 run osmo-stp_10.42.42.5(pid=32717): stdout: | (launched: 2022-12-09_18:19:28.624942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:30.191825 run osmo-stp_10.42.42.5(pid=32717): stderr: | 20221209181928795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181928795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181928795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181928796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181928797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181928797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181928797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:30.313749 run osmo-stp_10.42.42.5(pid=32717): stdout: | (launched: 2022-12-09_18:19:28.624942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:30.430050 run osmo-stp_10.42.42.5(pid=32717): stderr: | 20221209181928795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181928795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181928795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181928796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181928797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181928797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181928797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:30.569262 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32717): Process ended prematurely: osmo-stp_10.42.42.5(pid=32717) [trial-2362↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32717)] [trial-2362↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 18:19:30.577601 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 18:19:30.604242 run osmo-hlr_10.42.42.2(pid=32714): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32714)] 18:19:30.652812 run osmo-hlr_10.42.42.2(pid=32714): stdout: | (launched: 2022-12-09_18:19:27.702756) 18:19:30.703398 run osmo-hlr_10.42.42.2(pid=32714): stderr: | 20221209181927880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181927880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181927880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181927880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181927880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181927880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181927892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181927900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181927900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181927900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:30.772784 run osmo-msc_10.42.42.6(pid=32720): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32720)] 18:19:30.820377 run osmo-msc_10.42.42.6(pid=32720): stdout: | (launched: 2022-12-09_18:19:29.725143) 18:19:30.879195 run osmo-msc_10.42.42.6(pid=32720): stderr: | 20221209181929995 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181929995 DLGLOBAL DEBUG validating counter group 0x7f67ba61ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181929995 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181929995 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181929995 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181929995 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181929997 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181929998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181929998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181929998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:30.935377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32713): Terminating (SIGTERM) 18:19:30.980729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32716): Terminating (SIGTERM) 18:19:31.025868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32719): Terminating (SIGTERM) 18:19:31.071463 --- ParallelTerminationStrategy: PID 32713 died... 18:19:31.092144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32713): Terminated: ok {rc=0} 18:19:31.141338 --- ParallelTerminationStrategy: PID 32716 died... 18:19:31.162079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32716): Terminated: ok {rc=0} 18:19:31.210565 --- ParallelTerminationStrategy: PID 32719 died... 18:19:31.231367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32719): Terminated: ok {rc=0} 18:19:31.321177 bus /sierra_3: Setting Powered False 18:19:32.420369 bus /sierra_3: Setting Powered False 18:19:33.536783 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 18:19:34.623898 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:34.635254 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 18:19:34.684522 tst emergency_preemptive_call.py: using LAC 22844 18:19:34.801837 tst emergency_preemptive_call.py: using RAC 149 18:19:34.924771 tst emergency_preemptive_call.py: using CellId 22844 18:19:35.047307 tst emergency_preemptive_call.py: using BVCI 22845 18:19:35.160803 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:35.172084 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:35.183083 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:35.194106 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:35.204841 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:19:35.215785 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:19:35.329826 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:19:35.443237 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:19:35.557799 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:19:35.674233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:36.161488 run create_hlr_db(pid=32722): Launched 18:19:36.288382 bus /sierra_2: Setting Powered False 18:19:37.351143 run create_hlr_db(pid=32722): Terminated: ok {rc=0} 18:19:37.790170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32725): Launched 18:19:38.103010 run osmo-hlr_10.42.42.2(pid=32726): Launched 18:19:38.222903 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:38.766180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32728): Launched 18:19:39.079474 run osmo-stp_10.42.42.5(pid=32729): Launched 18:19:39.213718 tst emergency_preemptive_call.py: using MSISDN 7309 18:19:39.375801 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:39.938442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32731): Launched 18:19:40.253030 run osmo-msc_10.42.42.6(pid=32732): Launched 18:19:40.427555 run osmo-stp_10.42.42.5(pid=32729): ERR: Terminated: ERROR {rc=1} [trial-2362↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32729)] 18:19:40.559256 run osmo-stp_10.42.42.5(pid=32729): stdout: | (launched: 2022-12-09_18:19:39.022215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:40.691905 run osmo-stp_10.42.42.5(pid=32729): stderr: | 20221209181939211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181939212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181939212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181939212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181939215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181939215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181939215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:40.824738 run osmo-stp_10.42.42.5(pid=32729): stdout: | (launched: 2022-12-09_18:19:39.022215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:40.949752 run osmo-stp_10.42.42.5(pid=32729): stderr: | 20221209181939211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181939212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181939212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181939212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181939215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181939215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181939215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:41.098801 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32729): Process ended prematurely: osmo-stp_10.42.42.5(pid=32729) [trial-2362↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32729)] [trial-2362↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 18:19:41.108264 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 18:19:41.135871 run osmo-hlr_10.42.42.2(pid=32726): ERR: Terminated: ERROR {rc=237} [trial-2362↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32726)] 18:19:41.186285 run osmo-hlr_10.42.42.2(pid=32726): stdout: | (launched: 2022-12-09_18:19:38.045701) 18:19:41.238005 run osmo-hlr_10.42.42.2(pid=32726): stderr: | 20221209181938243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181938243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181938243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181938243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181938243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181938243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181938256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181938266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181938266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181938266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:41.310195 run osmo-msc_10.42.42.6(pid=32732): ERR: Terminated: ERROR {rc=2} [trial-2362↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32732)] 18:19:41.359853 run osmo-msc_10.42.42.6(pid=32732): stdout: | (launched: 2022-12-09_18:19:40.195243) 18:19:41.411125 run osmo-msc_10.42.42.6(pid=32732): stderr: | 20221209181940516 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209181940516 DLGLOBAL DEBUG validating counter group 0x7f5ba430fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209181940516 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209181940517 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209181940517 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209181940517 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209181940519 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209181940519 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209181940519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209181940519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:41.462925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32725): Terminating (SIGTERM) 18:19:41.504164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32728): Terminating (SIGTERM) 18:19:41.546208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32731): Terminating (SIGTERM) 18:19:41.588325 --- ParallelTerminationStrategy: PID 32725 died... 18:19:41.608182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32725): Terminated: ok {rc=0} 18:19:41.654637 --- ParallelTerminationStrategy: PID 32728 died... 18:19:41.674387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32728): Terminated: ok {rc=0} 18:19:41.720780 --- ParallelTerminationStrategy: PID 32731 died... 18:19:41.740699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32731): Terminated: ok {rc=0} 18:19:41.827888 bus /sierra_9: Setting Powered False 18:19:42.927018 bus /sierra_9: Setting Powered False 18:19:44.042763 bus /sierra_8: Setting Powered False 18:19:45.141754 bus /sierra_8: Setting Powered False 18:19:46.272701 bus /sierra_3: Setting Powered False 18:19:47.374740 bus /sierra_3: Setting Powered False 18:19:48.489797 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-900 --------------------------------------------------------------------- 18:19:49.761984 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:19:49.767034 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:19:49.799265 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 18:19:49.836900 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 18:19:49.922013 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:19:49.953767 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 18:19:49.991559 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 18:19:50.582080 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 18:19:50.631157 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:19:50.641788 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:19:50.687881 tst cs_paging_gprs_active.py: using LAC 22845 18:19:50.806003 tst cs_paging_gprs_active.py: using RAC 150 18:19:50.924747 tst cs_paging_gprs_active.py: using CellId 22845 18:19:51.041356 tst cs_paging_gprs_active.py: using BVCI 22846 18:19:51.149699 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:19:51.160193 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:19:51.170615 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:19:51.181762 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:19:51.192268 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:19:51.202872 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:19:51.213597 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:19:51.223993 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:19:51.234679 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:19:51.353285 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:19:51.472900 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:19:51.688630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:19:52.008422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32737): Launched 18:19:52.286187 run iperf3-srv_10.42.42.10(pid=32738): Launched 18:19:52.405849 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:19:52.621135 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:19:52.942386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32739): Launched 18:19:53.221216 run iperf3-srv_10.42.42.10(pid=32740): Launched 18:19:53.341142 tst cs_paging_gprs_active.py:38: start network... 18:19:53.556603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:54.052422 run create_hlr_db(pid=32741): Launched 18:19:54.183058 bus /sierra_2: Setting Powered False 18:19:55.246017 run create_hlr_db(pid=32741): Terminated: ok {rc=0} 18:19:55.672386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32743): Launched 18:19:55.972168 run osmo-hlr_10.42.42.2(pid=32744): Launched 18:19:56.094328 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:56.629170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32746): Launched 18:19:56.927717 run osmo-stp_10.42.42.5(pid=32747): Launched 18:19:57.041766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:19:57.556620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32749): Launched 18:19:57.672155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:19:57.924448 run patchelf(pid=32750): Launched 18:19:58.091365 run osmo-stp_10.42.42.5(pid=32747): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32747)] 18:19:58.218441 run osmo-stp_10.42.42.5(pid=32747): stdout: | (launched: 2022-12-09_18:19:56.872488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:58.346264 run osmo-stp_10.42.42.5(pid=32747): stderr: | 20221209181957041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181957041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181957042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181957042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181957044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181957044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181957044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:58.474240 run osmo-stp_10.42.42.5(pid=32747): stdout: | (launched: 2022-12-09_18:19:56.872488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:58.596467 run osmo-stp_10.42.42.5(pid=32747): stderr: | 20221209181957041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209181957041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209181957042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209181957042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209181957044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209181957044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209181957044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:58.741138 run patchelf(pid=32750): Terminating (SIGINT) 18:19:58.910227 run patchelf(pid=32750): Terminated: ok {rc=0} 18:19:59.031941 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32747): Process ended prematurely: osmo-stp_10.42.42.5(pid=32747) [trial-2362↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32747)] [trial-2362↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 18:19:59.041519 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 18:19:59.068760 run osmo-hlr_10.42.42.2(pid=32744): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32744)] 18:19:59.116633 run osmo-hlr_10.42.42.2(pid=32744): stdout: | (launched: 2022-12-09_18:19:55.916271) 18:19:59.166033 run osmo-hlr_10.42.42.2(pid=32744): stderr: | 20221209181956093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209181956093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209181956093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209181956093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209181956093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209181956093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209181956105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209181956114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209181956114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209181956114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:59.215745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32737): Terminating (SIGTERM) 18:19:59.255272 run iperf3-srv_10.42.42.10(pid=32738): Terminating (SIGTERM) 18:19:59.294619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32739): Terminating (SIGTERM) 18:19:59.334231 run iperf3-srv_10.42.42.10(pid=32740): Terminating (SIGTERM) 18:19:59.373788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32743): Terminating (SIGTERM) 18:19:59.413438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32746): Terminating (SIGTERM) 18:19:59.453025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32749): Terminating (SIGTERM) 18:19:59.493190 --- ParallelTerminationStrategy: PID 32737 died... 18:19:59.512093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32737): Terminated: ok {rc=0} 18:19:59.561527 --- ParallelTerminationStrategy: PID 32738 died... 18:19:59.581065 run iperf3-srv_10.42.42.10(pid=32738): Terminated {rc=256} 18:19:59.627869 --- ParallelTerminationStrategy: PID 32739 died... 18:19:59.647298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32739): Terminated: ok {rc=0} 18:19:59.694087 --- ParallelTerminationStrategy: PID 32740 died... 18:19:59.713559 run iperf3-srv_10.42.42.10(pid=32740): Terminated {rc=256} 18:19:59.760259 --- ParallelTerminationStrategy: PID 32743 died... 18:19:59.779809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32743): Terminated: ok {rc=0} 18:19:59.826027 --- ParallelTerminationStrategy: PID 32746 died... 18:19:59.845533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32746): Terminated: ok {rc=0} 18:19:59.891302 --- ParallelTerminationStrategy: PID 32749 died... 18:19:59.910773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32749): Terminated: ok {rc=0} 18:19:59.997115 bus /gobi_0: Setting Powered False 18:20:01.097566 bus /gobi_0: Setting Powered False 18:20:02.222105 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 18:20:03.369270 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:03.380786 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:20:03.431943 tst iperf3.py: using LAC 22846 18:20:03.556834 tst iperf3.py: using RAC 151 18:20:03.682338 tst iperf3.py: using CellId 22846 18:20:03.809125 tst iperf3.py: using BVCI 22847 18:20:03.924818 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:03.935929 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:03.946833 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:03.957665 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:03.968359 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:03.979136 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:03.990098 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:04.001429 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:04.012464 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:04.129994 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:20:04.346377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:04.667897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32754): Launched 18:20:04.946875 run iperf3-srv_10.42.42.10(pid=32755): Launched 18:20:05.067738 tst iperf3.py:8: start network... 18:20:05.283873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:05.778991 run create_hlr_db(pid=32756): Launched 18:20:05.908685 bus /gobi_6: Setting Powered False 18:20:06.972594 run create_hlr_db(pid=32756): Terminated: ok {rc=0} 18:20:07.401657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32758): Launched 18:20:07.701291 run osmo-hlr_10.42.42.2(pid=32759): Launched 18:20:07.815258 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:08.345237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32761): Launched 18:20:08.644332 run osmo-stp_10.42.42.5(pid=32762): Launched 18:20:08.757519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:20:09.272130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32764): Launched 18:20:09.387442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:20:09.639589 run patchelf(pid=32765): Launched 18:20:09.806322 run osmo-stp_10.42.42.5(pid=32762): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32762)] 18:20:09.933557 run osmo-stp_10.42.42.5(pid=32762): stdout: | (launched: 2022-12-09_18:20:08.589506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:10.062346 run osmo-stp_10.42.42.5(pid=32762): stderr: | 20221209182008758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182008758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182008758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182008758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182008759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182008759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182008759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:10.191527 run osmo-stp_10.42.42.5(pid=32762): stdout: | (launched: 2022-12-09_18:20:08.589506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:10.314395 run osmo-stp_10.42.42.5(pid=32762): stderr: | 20221209182008758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182008758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182008758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182008758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182008759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182008759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182008759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:10.459741 run patchelf(pid=32765): Terminating (SIGINT) 18:20:10.627898 run patchelf(pid=32765): Terminated: ok {rc=0} 18:20:10.749222 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32762): Process ended prematurely: osmo-stp_10.42.42.5(pid=32762) [trial-2362↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32762)] [trial-2362↪gprs:nanobts+band-900↪iperf3.py:8] 18:20:10.758662 tst iperf3.py:8: Test FAILED (7.4 sec) 18:20:10.786435 run osmo-hlr_10.42.42.2(pid=32759): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32759)] 18:20:10.834596 run osmo-hlr_10.42.42.2(pid=32759): stdout: | (launched: 2022-12-09_18:20:07.646193) 18:20:10.884434 run osmo-hlr_10.42.42.2(pid=32759): stderr: | 20221209182007822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182007823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182007823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182007823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182007823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182007823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182007834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182007843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182007843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182007843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:10.934446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32754): Terminating (SIGTERM) 18:20:10.974975 run iperf3-srv_10.42.42.10(pid=32755): Terminating (SIGTERM) 18:20:11.014883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32758): Terminating (SIGTERM) 18:20:11.054948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32761): Terminating (SIGTERM) 18:20:11.094848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32764): Terminating (SIGTERM) 18:20:11.135038 --- ParallelTerminationStrategy: PID 32754 died... 18:20:11.154219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32754): Terminated: ok {rc=0} 18:20:11.198770 --- ParallelTerminationStrategy: PID 32755 died... 18:20:11.217386 run iperf3-srv_10.42.42.10(pid=32755): Terminated {rc=256} 18:20:11.261845 --- ParallelTerminationStrategy: PID 32758 died... 18:20:11.280415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32758): Terminated: ok {rc=0} 18:20:11.324885 --- ParallelTerminationStrategy: PID 32761 died... 18:20:11.343954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32761): Terminated: ok {rc=0} 18:20:11.388621 --- ParallelTerminationStrategy: PID 32764 died... 18:20:11.407330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32764): Terminated: ok {rc=0} 18:20:11.494582 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 18:20:12.641896 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:12.652847 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:20:12.700933 tst iperf3m4.py: using LAC 22847 18:20:12.819148 tst iperf3m4.py: using RAC 152 18:20:12.936810 tst iperf3m4.py: using CellId 22847 18:20:13.054136 tst iperf3m4.py: using BVCI 22848 18:20:13.162353 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:13.172998 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:13.183342 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:13.193928 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:13.204389 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:13.214992 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:13.225852 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:13.236286 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:13.246998 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:13.365403 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:13.480577 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:13.598965 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:13.716611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:20:13.932797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:14.254636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32766): Launched 18:20:14.533764 run iperf3-srv_10.42.42.10(pid=32767): Launched 18:20:14.653785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:20:14.867890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:15.189100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=300): Launched 18:20:15.465572 run iperf3-srv_10.42.42.10(pid=301): Launched 18:20:15.585260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:20:15.799562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:16.138193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=302): Launched 18:20:16.431285 run iperf3-srv_10.42.42.10(pid=303): Launched 18:20:16.565603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:20:16.783725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:17.114224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=304): Launched 18:20:17.399298 run iperf3-srv_10.42.42.10(pid=305): Launched 18:20:17.519026 tst iperf3m4.py:8: start network... 18:20:17.733950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:18.230202 run create_hlr_db(pid=306): Launched 18:20:18.359944 bus /gobi_6: Setting Powered False 18:20:19.423950 run create_hlr_db(pid=306): Terminated: ok {rc=0} 18:20:19.851780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=308): Launched 18:20:20.153025 run osmo-hlr_10.42.42.2(pid=309): Launched 18:20:20.268074 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:20.819646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=311): Launched 18:20:21.142289 run osmo-stp_10.42.42.5(pid=312): Launched 18:20:21.265083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:20:21.817062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=314): Launched 18:20:21.939683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:20:22.210284 run patchelf(pid=315): Launched 18:20:22.388038 run osmo-stp_10.42.42.5(pid=312): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=312)] 18:20:22.523788 run osmo-stp_10.42.42.5(pid=312): stdout: | (launched: 2022-12-09_18:20:21.082936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:22.661307 run osmo-stp_10.42.42.5(pid=312): stderr: | 20221209182021275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182021275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182021275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182021276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182021276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182021276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182021276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:22.798662 run osmo-stp_10.42.42.5(pid=312): stdout: | (launched: 2022-12-09_18:20:21.082936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:22.929599 run osmo-stp_10.42.42.5(pid=312): stderr: | 20221209182021275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182021275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182021275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182021276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182021276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182021276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182021276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:23.085590 run patchelf(pid=315): Terminating (SIGINT) 18:20:23.266503 run patchelf(pid=315): Terminated: ok {rc=0} 18:20:23.395853 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=312): Process ended prematurely: osmo-stp_10.42.42.5(pid=312) [trial-2362↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=312)] [trial-2362↪gprs:nanobts+band-900↪iperf3m4.py:8] 18:20:23.406180 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:20:23.434958 run osmo-hlr_10.42.42.2(pid=309): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=309)] 18:20:23.485550 run osmo-hlr_10.42.42.2(pid=309): stdout: | (launched: 2022-12-09_18:20:20.097220) 18:20:23.537953 run osmo-hlr_10.42.42.2(pid=309): stderr: | 20221209182020274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182020274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182020274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182020274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182020274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182020274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182020286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182020297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182020298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182020298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:23.590783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32766): Terminating (SIGTERM) 18:20:23.633127 run iperf3-srv_10.42.42.10(pid=32767): Terminating (SIGTERM) 18:20:23.675409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=300): Terminating (SIGTERM) 18:20:23.717887 run iperf3-srv_10.42.42.10(pid=301): Terminating (SIGTERM) 18:20:23.760036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=302): Terminating (SIGTERM) 18:20:23.802451 run iperf3-srv_10.42.42.10(pid=303): Terminating (SIGTERM) 18:20:23.844459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=304): Terminating (SIGTERM) 18:20:23.886637 run iperf3-srv_10.42.42.10(pid=305): Terminating (SIGTERM) 18:20:23.928827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=308): Terminating (SIGTERM) 18:20:23.971124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=311): Terminating (SIGTERM) 18:20:24.013246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=314): Terminating (SIGTERM) 18:20:24.055713 --- ParallelTerminationStrategy: PID 32766 died... 18:20:24.076084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32766): Terminated: ok {rc=0} 18:20:24.122735 --- ParallelTerminationStrategy: PID 32767 died... 18:20:24.142650 run iperf3-srv_10.42.42.10(pid=32767): Terminated {rc=256} 18:20:24.189315 --- ParallelTerminationStrategy: PID 300 died... 18:20:24.209033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=300): Terminated: ok {rc=0} 18:20:24.255727 --- ParallelTerminationStrategy: PID 301 died... 18:20:24.275215 run iperf3-srv_10.42.42.10(pid=301): Terminated {rc=256} 18:20:24.321335 --- ParallelTerminationStrategy: PID 302 died... 18:20:24.340942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=302): Terminated: ok {rc=0} 18:20:24.387110 --- ParallelTerminationStrategy: PID 303 died... 18:20:24.406652 run iperf3-srv_10.42.42.10(pid=303): Terminated {rc=256} 18:20:24.453202 --- ParallelTerminationStrategy: PID 304 died... 18:20:24.473053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=304): Terminated: ok {rc=0} 18:20:24.519115 --- ParallelTerminationStrategy: PID 305 died... 18:20:24.538676 run iperf3-srv_10.42.42.10(pid=305): Terminated {rc=256} 18:20:24.584826 --- ParallelTerminationStrategy: PID 308 died... 18:20:24.604564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=308): Terminated: ok {rc=0} 18:20:24.651098 --- ParallelTerminationStrategy: PID 311 died... 18:20:24.670843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=311): Terminated: ok {rc=0} 18:20:24.717427 --- ParallelTerminationStrategy: PID 314 died... 18:20:24.736796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=314): Terminated: ok {rc=0} 18:20:24.825098 bus /gobi_4: Setting Powered False 18:20:25.925036 bus /gobi_4: Setting Powered False 18:20:27.039563 bus /gobi_1: Setting Powered False 18:20:28.139075 bus /gobi_1: Setting Powered False 18:20:29.254423 bus /gobi_0: Setting Powered False 18:20:30.352736 bus /gobi_0: Setting Powered False 18:20:31.474250 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900 ping.py ---------------------------------------------- 18:20:32.576246 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:32.587537 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:20:32.634904 tst ping.py: using LAC 22848 18:20:32.752567 tst ping.py: using RAC 153 18:20:32.876190 tst ping.py: using CellId 22848 18:20:32.998799 tst ping.py: using BVCI 22849 18:20:33.114310 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:33.125400 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:33.136783 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:33.147761 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:33.158610 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:33.169406 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:33.180520 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:33.191351 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:33.303618 tst ping.py:19: start network... 18:20:33.500207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:33.953727 run create_hlr_db(pid=316): Launched 18:20:34.082180 bus /gobi_6: Setting Powered False 18:20:35.146031 run create_hlr_db(pid=316): Terminated: ok {rc=0} 18:20:35.583244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=318): Launched 18:20:35.897282 run osmo-hlr_10.42.42.2(pid=319): Launched 18:20:36.016412 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:36.560260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=321): Launched 18:20:36.873436 run osmo-stp_10.42.42.5(pid=322): Launched 18:20:36.992091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:20:37.533532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=324): Launched 18:20:37.653228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:20:37.918353 run patchelf(pid=325): Launched 18:20:38.093168 run osmo-stp_10.42.42.5(pid=322): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=322)] 18:20:38.227071 run osmo-stp_10.42.42.5(pid=322): stdout: | (launched: 2022-12-09_18:20:36.815974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:38.362561 run osmo-stp_10.42.42.5(pid=322): stderr: | 20221209182037008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182037008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182037009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182037009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182037010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182037010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182037010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:38.498020 run osmo-stp_10.42.42.5(pid=322): stdout: | (launched: 2022-12-09_18:20:36.815974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:38.627234 run osmo-stp_10.42.42.5(pid=322): stderr: | 20221209182037008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182037008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182037009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182037009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182037010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182037010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182037010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:38.779552 run patchelf(pid=325): Terminating (SIGINT) 18:20:38.955694 run patchelf(pid=325): Terminated: ok {rc=0} 18:20:39.082636 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=322): Process ended prematurely: osmo-stp_10.42.42.5(pid=322) [trial-2362↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=322)] [trial-2362↪gprs:nanobts+band-900↪ping.py:22] 18:20:39.091991 tst ping.py:22: Test FAILED (6.5 sec) 18:20:39.120385 run osmo-hlr_10.42.42.2(pid=319): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=319)] 18:20:39.170843 run osmo-hlr_10.42.42.2(pid=319): stdout: | (launched: 2022-12-09_18:20:35.838957) 18:20:39.222916 run osmo-hlr_10.42.42.2(pid=319): stderr: | 20221209182036039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182036039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182036040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182036040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182036040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182036040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182036052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182036060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182036061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182036061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:39.274701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=318): Terminating (SIGTERM) 18:20:39.316289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=321): Terminating (SIGTERM) 18:20:39.358060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=324): Terminating (SIGTERM) 18:20:39.399992 --- ParallelTerminationStrategy: PID 318 died... 18:20:39.420040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=318): Terminated: ok {rc=0} 18:20:39.466708 --- ParallelTerminationStrategy: PID 321 died... 18:20:39.486330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=321): Terminated: ok {rc=0} 18:20:39.532429 --- ParallelTerminationStrategy: PID 324 died... 18:20:39.552023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=324): Terminated: ok {rc=0} 18:20:39.638599 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 18:20:40.726748 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:40.738651 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:20:40.788594 tst ping_idle_ping.py: using LAC 22849 18:20:40.917501 tst ping_idle_ping.py: using RAC 154 18:20:41.040639 tst ping_idle_ping.py: using CellId 22849 18:20:41.162125 tst ping_idle_ping.py: using BVCI 22850 18:20:41.276618 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:41.287648 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:41.298646 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:41.309536 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:41.320325 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:41.331206 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:41.342140 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:20:41.352929 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:20:41.466669 tst ping_idle_ping.py:24: start network... 18:20:41.664418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:42.122811 run create_hlr_db(pid=326): Launched 18:20:42.236378 bus /gobi_6: Setting Powered False 18:20:43.295082 run create_hlr_db(pid=326): Terminated: ok {rc=0} 18:20:43.707541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=328): Launched 18:20:44.002055 run osmo-hlr_10.42.42.2(pid=329): Launched 18:20:44.114249 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:44.618132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=331): Launched 18:20:44.911921 run osmo-stp_10.42.42.5(pid=332): Launched 18:20:45.024504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:20:45.532843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=334): Launched 18:20:45.646250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:20:45.919705 run patchelf(pid=335): Launched 18:20:46.100584 run osmo-stp_10.42.42.5(pid=332): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=332)] 18:20:46.228577 run osmo-stp_10.42.42.5(pid=332): stdout: | (launched: 2022-12-09_18:20:44.857722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:46.359362 run osmo-stp_10.42.42.5(pid=332): stderr: | 20221209182045028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182045028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182045028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182045029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182045029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182045029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182045029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:46.490027 run osmo-stp_10.42.42.5(pid=332): stdout: | (launched: 2022-12-09_18:20:44.857722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:46.614226 run osmo-stp_10.42.42.5(pid=332): stderr: | 20221209182045028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182045028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182045028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182045029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182045029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182045029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182045029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:46.760562 run patchelf(pid=335): Terminating (SIGINT) 18:20:46.930983 run patchelf(pid=335): Terminated: ok {rc=0} 18:20:47.054223 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=332): Process ended prematurely: osmo-stp_10.42.42.5(pid=332) [trial-2362↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=332)] [trial-2362↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 18:20:47.064057 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 18:20:47.094576 run osmo-hlr_10.42.42.2(pid=329): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=329)] 18:20:47.144636 run osmo-hlr_10.42.42.2(pid=329): stdout: | (launched: 2022-12-09_18:20:43.947634) 18:20:47.195731 run osmo-hlr_10.42.42.2(pid=329): stderr: | 20221209182044120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182044120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182044120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182044120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182044120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182044120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182044132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182044141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182044141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182044142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:47.245680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=328): Terminating (SIGTERM) 18:20:47.285906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=331): Terminating (SIGTERM) 18:20:47.325934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=334): Terminating (SIGTERM) 18:20:47.365760 --- ParallelTerminationStrategy: PID 328 died... 18:20:47.384817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=328): Terminated: ok {rc=0} 18:20:47.429652 --- ParallelTerminationStrategy: PID 331 died... 18:20:47.448320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=331): Terminated: ok {rc=0} 18:20:47.492676 --- ParallelTerminationStrategy: PID 334 died... 18:20:47.511273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=334): Terminated: ok {rc=0} 18:20:47.596292 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 18:20:48.894570 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:20:48.901745 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:20:48.935516 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:20:48.975484 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:20:49.066884 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:20:49.100025 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:20:49.137908 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:20:49.737310 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:20:49.791219 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:20:49.802563 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:20:49.853433 tst cs_paging_gprs_active.py: using LAC 22850 18:20:49.983465 tst cs_paging_gprs_active.py: using RAC 155 18:20:50.108676 tst cs_paging_gprs_active.py: using CellId 22850 18:20:50.232767 tst cs_paging_gprs_active.py: using BVCI 22851 18:20:50.348927 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:20:50.360300 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:20:50.371408 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:20:50.382995 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:20:50.394007 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:20:50.405088 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:20:50.416254 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:20:50.427225 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:20:50.438405 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:20:50.551947 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:20:50.669594 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:20:50.886027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:51.208404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=339): Launched 18:20:51.488402 run iperf3-srv_10.42.42.10(pid=340): Launched 18:20:51.608700 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:20:51.824494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:20:52.147181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=341): Launched 18:20:52.425690 run iperf3-srv_10.42.42.10(pid=342): Launched 18:20:52.545326 tst cs_paging_gprs_active.py:38: start network... 18:20:52.760495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:53.257366 run create_hlr_db(pid=343): Launched 18:20:53.387465 bus /gobi_6: Setting Powered False 18:20:54.447363 run create_hlr_db(pid=343): Terminated: ok {rc=0} 18:20:54.892597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=345): Launched 18:20:55.214586 run osmo-hlr_10.42.42.2(pid=347): Launched 18:20:55.337588 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:55.888378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=355): Launched 18:20:56.208400 run osmo-stp_10.42.42.5(pid=356): Launched 18:20:56.330655 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:20:56.882770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=359): Launched 18:20:57.005389 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:20:57.276552 run patchelf(pid=360): Launched 18:20:57.455385 run osmo-stp_10.42.42.5(pid=356): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=356)] 18:20:57.591271 run osmo-stp_10.42.42.5(pid=356): stdout: | (launched: 2022-12-09_18:20:56.149702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:57.727911 run osmo-stp_10.42.42.5(pid=356): stderr: | 20221209182056341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182056341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182056341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182056342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182056342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182056342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182056342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:57.864489 run osmo-stp_10.42.42.5(pid=356): stdout: | (launched: 2022-12-09_18:20:56.149702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:57.995282 run osmo-stp_10.42.42.5(pid=356): stderr: | 20221209182056341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182056341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182056341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182056342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182056342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182056342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182056342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:58.150332 run patchelf(pid=360): Terminating (SIGINT) 18:20:58.329501 run patchelf(pid=360): Terminated: ok {rc=0} 18:20:58.458905 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=356): Process ended prematurely: osmo-stp_10.42.42.5(pid=356) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=356)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:20:58.469082 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:20:58.497564 run osmo-hlr_10.42.42.2(pid=347): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=347)] 18:20:58.547105 run osmo-hlr_10.42.42.2(pid=347): stdout: | (launched: 2022-12-09_18:20:55.155111) 18:20:58.598211 run osmo-hlr_10.42.42.2(pid=347): stderr: | 20221209182055353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182055354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182055354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182055354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182055354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182055354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182055366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182055375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182055376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182055376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:58.649798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=339): Terminating (SIGTERM) 18:20:58.691443 run iperf3-srv_10.42.42.10(pid=340): Terminating (SIGTERM) 18:20:58.732805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=341): Terminating (SIGTERM) 18:20:58.774739 run iperf3-srv_10.42.42.10(pid=342): Terminating (SIGTERM) 18:20:58.815815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=345): Terminating (SIGTERM) 18:20:58.857136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=355): Terminating (SIGTERM) 18:20:58.898306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=359): Terminating (SIGTERM) 18:20:58.939842 --- ParallelTerminationStrategy: PID 339 died... 18:20:58.959614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=339): Terminated: ok {rc=0} 18:20:59.005560 --- ParallelTerminationStrategy: PID 340 died... 18:20:59.024693 run iperf3-srv_10.42.42.10(pid=340): Terminated {rc=256} 18:20:59.070503 --- ParallelTerminationStrategy: PID 341 died... 18:20:59.089956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=341): Terminated: ok {rc=0} 18:20:59.135502 --- ParallelTerminationStrategy: PID 342 died... 18:20:59.155014 run iperf3-srv_10.42.42.10(pid=342): Terminated {rc=256} 18:20:59.200619 --- ParallelTerminationStrategy: PID 345 died... 18:20:59.219980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=345): Terminated: ok {rc=0} 18:20:59.265451 --- ParallelTerminationStrategy: PID 355 died... 18:20:59.284665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=355): Terminated: ok {rc=0} 18:20:59.330382 --- ParallelTerminationStrategy: PID 359 died... 18:20:59.349996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=359): Terminated: ok {rc=0} 18:20:59.437535 bus /gobi_0: Setting Powered False 18:21:00.534202 bus /gobi_0: Setting Powered False 18:21:01.653402 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:21:02.814170 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:02.825977 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:21:02.878451 tst iperf3.py: using LAC 22851 18:21:03.005291 tst iperf3.py: using RAC 156 18:21:03.130275 tst iperf3.py: using CellId 22851 18:21:03.256679 tst iperf3.py: using BVCI 22852 18:21:03.372181 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:03.383958 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:03.395070 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:03.406153 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:03.417244 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:03.428131 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:03.439352 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:03.450311 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:03.461530 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:03.575742 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:21:03.791425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:04.113136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=361): Launched 18:21:04.392673 run iperf3-srv_10.42.42.10(pid=362): Launched 18:21:04.512795 tst iperf3.py:8: start network... 18:21:04.728672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:05.226549 run create_hlr_db(pid=368): Launched 18:21:05.356554 bus /gobi_6: Setting Powered False 18:21:06.420106 run create_hlr_db(pid=368): Terminated: ok {rc=0} 18:21:06.867489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=370): Launched 18:21:07.189691 run osmo-hlr_10.42.42.2(pid=371): Launched 18:21:07.312875 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:07.867639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=373): Launched 18:21:08.189734 run osmo-stp_10.42.42.5(pid=374): Launched 18:21:08.311951 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:08.865625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=376): Launched 18:21:08.989049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:09.261119 run patchelf(pid=377): Launched 18:21:09.441063 run osmo-stp_10.42.42.5(pid=374): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=374)] 18:21:09.577172 run osmo-stp_10.42.42.5(pid=374): stdout: | (launched: 2022-12-09_18:21:08.130292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:09.714322 run osmo-stp_10.42.42.5(pid=374): stderr: | 20221209182108324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182108324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182108324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182108324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182108325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182108325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182108325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:09.851904 run osmo-stp_10.42.42.5(pid=374): stdout: | (launched: 2022-12-09_18:21:08.130292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:09.983407 run osmo-stp_10.42.42.5(pid=374): stderr: | 20221209182108324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182108324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182108324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182108324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182108325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182108325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182108325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:10.139710 run patchelf(pid=377): Terminating (SIGINT) 18:21:10.319681 run patchelf(pid=377): Terminated: ok {rc=0} 18:21:10.448867 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=374): Process ended prematurely: osmo-stp_10.42.42.5(pid=374) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=374)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 18:21:10.459053 tst iperf3.py:8: Test FAILED (7.7 sec) 18:21:10.487611 run osmo-hlr_10.42.42.2(pid=371): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=371)] 18:21:10.537500 run osmo-hlr_10.42.42.2(pid=371): stdout: | (launched: 2022-12-09_18:21:07.129909) 18:21:10.588905 run osmo-hlr_10.42.42.2(pid=371): stderr: | 20221209182107330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182107330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182107330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182107330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182107330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182107330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182107342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182107351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182107351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182107351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:10.640783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=361): Terminating (SIGTERM) 18:21:10.682474 run iperf3-srv_10.42.42.10(pid=362): Terminating (SIGTERM) 18:21:10.724422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=370): Terminating (SIGTERM) 18:21:10.766337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=373): Terminating (SIGTERM) 18:21:10.808134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=376): Terminating (SIGTERM) 18:21:10.850521 --- ParallelTerminationStrategy: PID 361 died... 18:21:10.870657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=361): Terminated: ok {rc=0} 18:21:10.917042 --- ParallelTerminationStrategy: PID 362 died... 18:21:10.936518 run iperf3-srv_10.42.42.10(pid=362): Terminated {rc=256} 18:21:10.982919 --- ParallelTerminationStrategy: PID 370 died... 18:21:11.002590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=370): Terminated: ok {rc=0} 18:21:11.048873 --- ParallelTerminationStrategy: PID 373 died... 18:21:11.068879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=373): Terminated: ok {rc=0} 18:21:11.115790 --- ParallelTerminationStrategy: PID 376 died... 18:21:11.135415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=376): Terminated: ok {rc=0} 18:21:11.223419 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:21:12.373010 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:12.384714 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:21:12.437361 tst iperf3m4.py: using LAC 22852 18:21:12.562018 tst iperf3m4.py: using RAC 157 18:21:12.679633 tst iperf3m4.py: using CellId 22852 18:21:12.795357 tst iperf3m4.py: using BVCI 22853 18:21:12.904643 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:12.915712 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:12.926380 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:12.937463 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:12.948157 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:12.958971 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:12.970102 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:12.980786 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:12.991803 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:13.106370 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:13.223198 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:13.339702 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:13.456415 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:21:13.657506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:13.958848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=378): Launched 18:21:14.219908 run iperf3-srv_10.42.42.10(pid=379): Launched 18:21:14.332813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:21:14.532802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:14.833652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=380): Launched 18:21:15.094898 run iperf3-srv_10.42.42.10(pid=381): Launched 18:21:15.207590 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:21:15.407148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:15.708214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=382): Launched 18:21:15.990750 run iperf3-srv_10.42.42.10(pid=383): Launched 18:21:16.115955 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:21:16.319905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:16.629839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=384): Launched 18:21:16.909891 run iperf3-srv_10.42.42.10(pid=385): Launched 18:21:17.056106 tst iperf3m4.py:8: start network... 18:21:17.263669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:17.726814 run create_hlr_db(pid=386): Launched 18:21:17.841317 bus /gobi_6: Setting Powered False 18:21:18.901154 run create_hlr_db(pid=386): Terminated: ok {rc=0} 18:21:19.339399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=388): Launched 18:21:19.661927 run osmo-hlr_10.42.42.2(pid=389): Launched 18:21:19.785427 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:20.344402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=391): Launched 18:21:20.666771 run osmo-stp_10.42.42.5(pid=392): Launched 18:21:20.788895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:21.342695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=394): Launched 18:21:21.465746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:21.737228 run patchelf(pid=395): Launched 18:21:21.915720 run osmo-stp_10.42.42.5(pid=392): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=392)] 18:21:22.051850 run osmo-stp_10.42.42.5(pid=392): stdout: | (launched: 2022-12-09_18:21:20.607853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:22.189762 run osmo-stp_10.42.42.5(pid=392): stderr: | 20221209182120799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182120800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182120800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182120800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182120801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182120801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182120801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:22.327080 run osmo-stp_10.42.42.5(pid=392): stdout: | (launched: 2022-12-09_18:21:20.607853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:22.458226 run osmo-stp_10.42.42.5(pid=392): stderr: | 20221209182120799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182120800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182120800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182120800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182120801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182120801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182120801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:22.613836 run patchelf(pid=395): Terminating (SIGINT) 18:21:22.793174 run patchelf(pid=395): Terminated: ok {rc=0} 18:21:22.922304 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=392): Process ended prematurely: osmo-stp_10.42.42.5(pid=392) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=392)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 18:21:22.932521 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:21:22.961562 run osmo-hlr_10.42.42.2(pid=389): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=389)] 18:21:23.011559 run osmo-hlr_10.42.42.2(pid=389): stdout: | (launched: 2022-12-09_18:21:19.602971) 18:21:23.063324 run osmo-hlr_10.42.42.2(pid=389): stderr: | 20221209182119804 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182119804 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182119804 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182119804 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182119804 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182119804 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182119817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182119825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182119825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182119825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:23.115378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=378): Terminating (SIGTERM) 18:21:23.157774 run iperf3-srv_10.42.42.10(pid=379): Terminating (SIGTERM) 18:21:23.199673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=380): Terminating (SIGTERM) 18:21:23.241676 run iperf3-srv_10.42.42.10(pid=381): Terminating (SIGTERM) 18:21:23.283701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=382): Terminating (SIGTERM) 18:21:23.325737 run iperf3-srv_10.42.42.10(pid=383): Terminating (SIGTERM) 18:21:23.367528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=384): Terminating (SIGTERM) 18:21:23.409494 run iperf3-srv_10.42.42.10(pid=385): Terminating (SIGTERM) 18:21:23.451194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=388): Terminating (SIGTERM) 18:21:23.493143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=391): Terminating (SIGTERM) 18:21:23.535050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=394): Terminating (SIGTERM) 18:21:23.577655 --- ParallelTerminationStrategy: PID 378 died... 18:21:23.597752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=378): Terminated: ok {rc=0} 18:21:23.644157 --- ParallelTerminationStrategy: PID 379 died... 18:21:23.663715 run iperf3-srv_10.42.42.10(pid=379): Terminated {rc=256} 18:21:23.709513 --- ParallelTerminationStrategy: PID 380 died... 18:21:23.729018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=380): Terminated: ok {rc=0} 18:21:23.774916 --- ParallelTerminationStrategy: PID 381 died... 18:21:23.794476 run iperf3-srv_10.42.42.10(pid=381): Terminated {rc=256} 18:21:23.840445 --- ParallelTerminationStrategy: PID 382 died... 18:21:23.860053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=382): Terminated: ok {rc=0} 18:21:23.906463 --- ParallelTerminationStrategy: PID 383 died... 18:21:23.926124 run iperf3-srv_10.42.42.10(pid=383): Terminated {rc=256} 18:21:23.972047 --- ParallelTerminationStrategy: PID 384 died... 18:21:23.991578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=384): Terminated: ok {rc=0} 18:21:24.037791 --- ParallelTerminationStrategy: PID 385 died... 18:21:24.057408 run iperf3-srv_10.42.42.10(pid=385): Terminated {rc=256} 18:21:24.103442 --- ParallelTerminationStrategy: PID 388 died... 18:21:24.122919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=388): Terminated: ok {rc=0} 18:21:24.169361 --- ParallelTerminationStrategy: PID 391 died... 18:21:24.188777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=391): Terminated: ok {rc=0} 18:21:24.234844 --- ParallelTerminationStrategy: PID 394 died... 18:21:24.254383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=394): Terminated: ok {rc=0} 18:21:24.342283 bus /gobi_4: Setting Powered False 18:21:25.441638 bus /gobi_4: Setting Powered False 18:21:26.557419 bus /gobi_1: Setting Powered False 18:21:27.656712 bus /gobi_1: Setting Powered False 18:21:28.772915 bus /gobi_0: Setting Powered False 18:21:29.869990 bus /gobi_0: Setting Powered False 18:21:30.999479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 18:21:32.110641 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.123117 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:21:32.176900 tst ping.py: using LAC 22853 18:21:32.297935 tst ping.py: using RAC 158 18:21:32.413071 tst ping.py: using CellId 22853 18:21:32.530275 tst ping.py: using BVCI 22854 18:21:32.636201 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.647139 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.657849 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.668905 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.679738 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.690322 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.701577 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:32.712306 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:32.825654 tst ping.py:19: start network... 18:21:33.021367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:33.475668 run create_hlr_db(pid=397): Launched 18:21:33.587119 bus /gobi_6: Setting Powered False 18:21:34.646687 run create_hlr_db(pid=397): Terminated: ok {rc=0} 18:21:35.078418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=399): Launched 18:21:35.394372 run osmo-hlr_10.42.42.2(pid=400): Launched 18:21:35.514173 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:36.062387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=402): Launched 18:21:36.377198 run osmo-stp_10.42.42.5(pid=403): Launched 18:21:36.496839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:37.040634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=405): Launched 18:21:37.161480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:37.426961 run patchelf(pid=406): Launched 18:21:37.602826 run osmo-stp_10.42.42.5(pid=403): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=403)] 18:21:37.737226 run osmo-stp_10.42.42.5(pid=403): stdout: | (launched: 2022-12-09_18:21:36.318697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:37.873190 run osmo-stp_10.42.42.5(pid=403): stderr: | 20221209182136510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182136511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182136511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182136511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182136512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182136512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182136512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:38.009194 run osmo-stp_10.42.42.5(pid=403): stdout: | (launched: 2022-12-09_18:21:36.318697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:38.138667 run osmo-stp_10.42.42.5(pid=403): stderr: | 20221209182136510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182136511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182136511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182136511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182136512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182136512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182136512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:38.292252 run patchelf(pid=406): Terminating (SIGINT) 18:21:38.468781 run patchelf(pid=406): Terminated: ok {rc=0} 18:21:38.596142 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=403): Process ended prematurely: osmo-stp_10.42.42.5(pid=403) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=403)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 18:21:38.605694 tst ping.py:22: Test FAILED (6.5 sec) 18:21:38.634006 run osmo-hlr_10.42.42.2(pid=400): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=400)] 18:21:38.684172 run osmo-hlr_10.42.42.2(pid=400): stdout: | (launched: 2022-12-09_18:21:35.336662) 18:21:38.736077 run osmo-hlr_10.42.42.2(pid=400): stderr: | 20221209182135532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182135532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182135532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182135532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182135532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182135532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182135544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182135552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182135553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182135553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:38.788215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=399): Terminating (SIGTERM) 18:21:38.830192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=402): Terminating (SIGTERM) 18:21:38.872114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=405): Terminating (SIGTERM) 18:21:38.914355 --- ParallelTerminationStrategy: PID 399 died... 18:21:38.934384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=399): Terminated: ok {rc=0} 18:21:38.981091 --- ParallelTerminationStrategy: PID 402 died... 18:21:39.000833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=402): Terminated: ok {rc=0} 18:21:39.047333 --- ParallelTerminationStrategy: PID 405 died... 18:21:39.066990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=405): Terminated: ok {rc=0} 18:21:39.155273 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:21:40.243672 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:40.255974 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:21:40.308637 tst ping_idle_ping.py: using LAC 22854 18:21:40.432526 tst ping_idle_ping.py: using RAC 159 18:21:40.561498 tst ping_idle_ping.py: using CellId 22854 18:21:40.684854 tst ping_idle_ping.py: using BVCI 22855 18:21:40.799075 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:40.810597 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:40.821838 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:40.833103 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:40.844137 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:40.855244 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:40.866614 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:21:40.877748 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:21:40.994560 tst ping_idle_ping.py:24: start network... 18:21:41.192690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:41.651595 run create_hlr_db(pid=407): Launched 18:21:41.765265 bus /gobi_6: Setting Powered False 18:21:42.825269 run create_hlr_db(pid=407): Terminated: ok {rc=0} 18:21:43.259740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=409): Launched 18:21:43.576068 run osmo-hlr_10.42.42.2(pid=410): Launched 18:21:43.696746 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:44.242466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=412): Launched 18:21:44.558171 run osmo-stp_10.42.42.5(pid=413): Launched 18:21:44.678590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:45.223342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=415): Launched 18:21:45.344190 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:45.610241 run patchelf(pid=416): Launched 18:21:45.786654 run osmo-stp_10.42.42.5(pid=413): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=413)] 18:21:45.936186 run osmo-stp_10.42.42.5(pid=413): stdout: | (launched: 2022-12-09_18:21:44.500044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:46.084203 run osmo-stp_10.42.42.5(pid=413): stderr: | 20221209182144693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182144693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182144693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182144694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182144694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182144694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182144694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:46.216437 run osmo-stp_10.42.42.5(pid=413): stdout: | (launched: 2022-12-09_18:21:44.500044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:46.341167 run osmo-stp_10.42.42.5(pid=413): stderr: | 20221209182144693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182144693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182144693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182144694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182144694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182144694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182144694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:46.490317 run patchelf(pid=416): Terminating (SIGINT) 18:21:46.662464 run patchelf(pid=416): Terminated: ok {rc=0} 18:21:46.788934 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=413): Process ended prematurely: osmo-stp_10.42.42.5(pid=413) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=413)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 18:21:46.799201 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:21:46.829785 run osmo-hlr_10.42.42.2(pid=410): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=410)] 18:21:46.879861 run osmo-hlr_10.42.42.2(pid=410): stdout: | (launched: 2022-12-09_18:21:43.518079) 18:21:46.931576 run osmo-hlr_10.42.42.2(pid=410): stderr: | 20221209182143716 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182143716 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182143716 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182143716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182143716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182143716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182143728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182143737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182143737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182143737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:46.985795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=409): Terminating (SIGTERM) 18:21:47.029095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=412): Terminating (SIGTERM) 18:21:47.073655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=415): Terminating (SIGTERM) 18:21:47.118048 --- ParallelTerminationStrategy: PID 409 died... 18:21:47.137869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=409): Terminated: ok {rc=0} 18:21:47.187466 --- ParallelTerminationStrategy: PID 412 died... 18:21:47.207022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=412): Terminated: ok {rc=0} 18:21:47.253522 --- ParallelTerminationStrategy: PID 415 died... 18:21:47.273209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=415): Terminated: ok {rc=0} 18:21:47.361830 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:21:48.668829 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:21:48.677252 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:21:48.709640 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:21:48.747556 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:21:48.833357 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:21:48.865353 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:21:48.903231 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:21:49.496660 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:21:49.545220 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:21:49.556032 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:21:49.621788 tst cs_paging_gprs_active.py: using LAC 22855 18:21:49.744780 tst cs_paging_gprs_active.py: using RAC 160 18:21:49.863803 tst cs_paging_gprs_active.py: using CellId 22855 18:21:49.981856 tst cs_paging_gprs_active.py: using BVCI 22856 18:21:50.090185 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:21:50.101089 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:21:50.111734 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:21:50.122654 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:21:50.133456 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:21:50.144365 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:21:50.155326 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:21:50.166115 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:21:50.177095 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:21:50.295935 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:21:50.410572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:21:50.610765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:50.910671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=420): Launched 18:21:51.170837 run iperf3-srv_10.42.42.10(pid=421): Launched 18:21:51.282977 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:21:51.482017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:51.782097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=422): Launched 18:21:52.041724 run iperf3-srv_10.42.42.10(pid=423): Launched 18:21:52.154123 tst cs_paging_gprs_active.py:38: start network... 18:21:52.353078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:52.813820 run create_hlr_db(pid=424): Launched 18:21:52.927653 bus /gobi_6: Setting Powered False 18:21:53.987153 run create_hlr_db(pid=424): Terminated: ok {rc=0} 18:21:54.402324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=426): Launched 18:21:54.700695 run osmo-hlr_10.42.42.2(pid=427): Launched 18:21:54.815438 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:55.343659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=429): Launched 18:21:55.642262 run osmo-stp_10.42.42.5(pid=430): Launched 18:21:55.756143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:56.273213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=432): Launched 18:21:56.388101 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:56.641683 run patchelf(pid=433): Launched 18:21:56.808880 run osmo-stp_10.42.42.5(pid=430): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=430)] 18:21:56.936207 run osmo-stp_10.42.42.5(pid=430): stdout: | (launched: 2022-12-09_18:21:55.587847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:57.064485 run osmo-stp_10.42.42.5(pid=430): stderr: | 20221209182155757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182155757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182155757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182155758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182155758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182155758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182155758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:57.193720 run osmo-stp_10.42.42.5(pid=430): stdout: | (launched: 2022-12-09_18:21:55.587847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:57.316468 run osmo-stp_10.42.42.5(pid=430): stderr: | 20221209182155757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182155757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182155757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182155758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182155758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182155758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182155758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:57.462549 run patchelf(pid=433): Terminating (SIGINT) 18:21:57.631124 run patchelf(pid=433): Terminated: ok {rc=0} 18:21:57.753179 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=430): Process ended prematurely: osmo-stp_10.42.42.5(pid=430) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=430)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:21:57.762736 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 18:21:57.790480 run osmo-hlr_10.42.42.2(pid=427): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=427)] 18:21:57.838298 run osmo-hlr_10.42.42.2(pid=427): stdout: | (launched: 2022-12-09_18:21:54.645809) 18:21:57.887503 run osmo-hlr_10.42.42.2(pid=427): stderr: | 20221209182154819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182154819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182154819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182154819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182154819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182154819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182154832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182154840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182154840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182154840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:57.937044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=420): Terminating (SIGTERM) 18:21:57.976730 run iperf3-srv_10.42.42.10(pid=421): Terminating (SIGTERM) 18:21:58.016369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=422): Terminating (SIGTERM) 18:21:58.056041 run iperf3-srv_10.42.42.10(pid=423): Terminating (SIGTERM) 18:21:58.095675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=426): Terminating (SIGTERM) 18:21:58.135449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=429): Terminating (SIGTERM) 18:21:58.175088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=432): Terminating (SIGTERM) 18:21:58.215160 --- ParallelTerminationStrategy: PID 420 died... 18:21:58.234224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=420): Terminated: ok {rc=0} 18:21:58.278856 --- ParallelTerminationStrategy: PID 421 died... 18:21:58.297413 run iperf3-srv_10.42.42.10(pid=421): Terminated {rc=256} 18:21:58.341356 --- ParallelTerminationStrategy: PID 422 died... 18:21:58.359848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=422): Terminated: ok {rc=0} 18:21:58.403785 --- ParallelTerminationStrategy: PID 423 died... 18:21:58.422229 run iperf3-srv_10.42.42.10(pid=423): Terminated {rc=256} 18:21:58.466183 --- ParallelTerminationStrategy: PID 426 died... 18:21:58.484612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=426): Terminated: ok {rc=0} 18:21:58.528532 --- ParallelTerminationStrategy: PID 429 died... 18:21:58.547060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=429): Terminated: ok {rc=0} 18:21:58.590893 --- ParallelTerminationStrategy: PID 432 died... 18:21:58.609702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=432): Terminated: ok {rc=0} 18:21:58.695059 bus /gobi_0: Setting Powered False 18:21:59.794712 bus /gobi_0: Setting Powered False 18:22:00.924622 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:22:02.072072 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:02.084701 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:22:02.156275 tst iperf3.py: using LAC 22856 18:22:02.283065 tst iperf3.py: using RAC 161 18:22:02.409421 tst iperf3.py: using CellId 22856 18:22:02.538994 tst iperf3.py: using BVCI 22857 18:22:02.655158 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:02.666657 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:02.677811 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:02.688893 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:02.699978 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:02.711063 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:02.722330 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:02.733327 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:02.744450 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:02.858530 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:22:03.059538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:03.361154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=434): Launched 18:22:03.623244 run iperf3-srv_10.42.42.10(pid=435): Launched 18:22:03.735719 tst iperf3.py:8: start network... 18:22:03.936877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:04.401350 run create_hlr_db(pid=436): Launched 18:22:04.517252 bus /gobi_6: Setting Powered False 18:22:05.577215 run create_hlr_db(pid=436): Terminated: ok {rc=0} 18:22:05.996525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=438): Launched 18:22:06.297254 run osmo-hlr_10.42.42.2(pid=439): Launched 18:22:06.411874 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:06.944763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=441): Launched 18:22:07.244015 run osmo-stp_10.42.42.5(pid=442): Launched 18:22:07.358260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:07.872158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=444): Launched 18:22:07.988510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:08.241283 run patchelf(pid=445): Launched 18:22:08.407729 run osmo-stp_10.42.42.5(pid=442): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=442)] 18:22:08.534523 run osmo-stp_10.42.42.5(pid=442): stdout: | (launched: 2022-12-09_18:22:07.188746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:08.663004 run osmo-stp_10.42.42.5(pid=442): stderr: | 20221209182207359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182207359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182207360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182207360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182207360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182207361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182207361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:08.791708 run osmo-stp_10.42.42.5(pid=442): stdout: | (launched: 2022-12-09_18:22:07.188746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:08.914493 run osmo-stp_10.42.42.5(pid=442): stderr: | 20221209182207359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182207359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182207360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182207360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182207360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182207361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182207361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:09.059525 run patchelf(pid=445): Terminating (SIGINT) 18:22:09.227755 run patchelf(pid=445): Terminated: ok {rc=0} 18:22:09.348877 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=442): Process ended prematurely: osmo-stp_10.42.42.5(pid=442) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=442)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 18:22:09.358523 tst iperf3.py:8: Test FAILED (7.3 sec) 18:22:09.385955 run osmo-hlr_10.42.42.2(pid=439): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=439)] 18:22:09.433595 run osmo-hlr_10.42.42.2(pid=439): stdout: | (launched: 2022-12-09_18:22:06.242168) 18:22:09.482779 run osmo-hlr_10.42.42.2(pid=439): stderr: | 20221209182206419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182206419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182206419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182206419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182206419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182206420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182206432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182206440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182206440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182206441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:09.532509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=434): Terminating (SIGTERM) 18:22:09.571914 run iperf3-srv_10.42.42.10(pid=435): Terminating (SIGTERM) 18:22:09.611268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=438): Terminating (SIGTERM) 18:22:09.650664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=441): Terminating (SIGTERM) 18:22:09.690067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=444): Terminating (SIGTERM) 18:22:09.729719 --- ParallelTerminationStrategy: PID 434 died... 18:22:09.748442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=434): Terminated: ok {rc=0} 18:22:09.792636 --- ParallelTerminationStrategy: PID 435 died... 18:22:09.811118 run iperf3-srv_10.42.42.10(pid=435): Terminated {rc=256} 18:22:09.855623 --- ParallelTerminationStrategy: PID 438 died... 18:22:09.874143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=438): Terminated: ok {rc=0} 18:22:09.918784 --- ParallelTerminationStrategy: PID 441 died... 18:22:09.937421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=441): Terminated: ok {rc=0} 18:22:09.981447 --- ParallelTerminationStrategy: PID 444 died... 18:22:09.999781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=444): Terminated: ok {rc=0} 18:22:10.083385 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:22:11.230476 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:11.242351 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:22:11.311103 tst iperf3m4.py: using LAC 22857 18:22:11.435875 tst iperf3m4.py: using RAC 162 18:22:11.562502 tst iperf3m4.py: using CellId 22857 18:22:11.687729 tst iperf3m4.py: using BVCI 22858 18:22:11.803486 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:11.814950 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:11.826083 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:11.837325 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:11.848325 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:11.859449 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:11.870705 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:11.881782 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:11.893028 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:12.011773 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:12.129609 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:12.249629 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:12.366212 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:22:12.567188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:12.868249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=446): Launched 18:22:13.129489 run iperf3-srv_10.42.42.10(pid=447): Launched 18:22:13.242791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:22:13.443134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:13.744756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=448): Launched 18:22:14.007124 run iperf3-srv_10.42.42.10(pid=449): Launched 18:22:14.119520 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:22:14.319510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:14.620055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=450): Launched 18:22:14.881655 run iperf3-srv_10.42.42.10(pid=451): Launched 18:22:14.994324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:22:15.194640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:15.495651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=452): Launched 18:22:15.757896 run iperf3-srv_10.42.42.10(pid=453): Launched 18:22:15.893795 tst iperf3m4.py:8: start network... 18:22:16.112143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:16.588121 run create_hlr_db(pid=454): Launched 18:22:16.742775 bus /gobi_6: Setting Powered False 18:22:17.806514 run create_hlr_db(pid=454): Terminated: ok {rc=0} 18:22:18.255035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=456): Launched 18:22:18.576525 run osmo-hlr_10.42.42.2(pid=457): Launched 18:22:18.698194 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:19.255307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=459): Launched 18:22:19.577640 run osmo-stp_10.42.42.5(pid=460): Launched 18:22:19.701287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:20.255111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=462): Launched 18:22:20.378393 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:20.648821 run patchelf(pid=463): Launched 18:22:20.826704 run osmo-stp_10.42.42.5(pid=460): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=460)] 18:22:20.961875 run osmo-stp_10.42.42.5(pid=460): stdout: | (launched: 2022-12-09_18:22:19.517860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:21.099161 run osmo-stp_10.42.42.5(pid=460): stderr: | 20221209182219711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182219711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182219712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182219712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182219713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182219713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182219713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:21.236685 run osmo-stp_10.42.42.5(pid=460): stdout: | (launched: 2022-12-09_18:22:19.517860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:21.367162 run osmo-stp_10.42.42.5(pid=460): stderr: | 20221209182219711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182219711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182219712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182219712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182219713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182219713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182219713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:21.521992 run patchelf(pid=463): Terminating (SIGINT) 18:22:21.701829 run patchelf(pid=463): Terminated: ok {rc=0} 18:22:21.831515 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=460): Process ended prematurely: osmo-stp_10.42.42.5(pid=460) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=460)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:22:21.841812 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:22:21.870375 run osmo-hlr_10.42.42.2(pid=457): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=457)] 18:22:21.919981 run osmo-hlr_10.42.42.2(pid=457): stdout: | (launched: 2022-12-09_18:22:18.517704) 18:22:21.971372 run osmo-hlr_10.42.42.2(pid=457): stderr: | 20221209182218718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182218718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182218718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182218718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182218718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182218718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182218730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182218739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182218739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182218739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:22.023533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=446): Terminating (SIGTERM) 18:22:22.064931 run iperf3-srv_10.42.42.10(pid=447): Terminating (SIGTERM) 18:22:22.106318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=448): Terminating (SIGTERM) 18:22:22.147766 run iperf3-srv_10.42.42.10(pid=449): Terminating (SIGTERM) 18:22:22.189544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=450): Terminating (SIGTERM) 18:22:22.231149 run iperf3-srv_10.42.42.10(pid=451): Terminating (SIGTERM) 18:22:22.272563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=452): Terminating (SIGTERM) 18:22:22.314275 run iperf3-srv_10.42.42.10(pid=453): Terminating (SIGTERM) 18:22:22.355598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=456): Terminating (SIGTERM) 18:22:22.396906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=459): Terminating (SIGTERM) 18:22:22.438326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=462): Terminating (SIGTERM) 18:22:22.480132 --- ParallelTerminationStrategy: PID 446 died... 18:22:22.500111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=446): Terminated: ok {rc=0} 18:22:22.545966 --- ParallelTerminationStrategy: PID 447 died... 18:22:22.565365 run iperf3-srv_10.42.42.10(pid=447): Terminated {rc=256} 18:22:22.611352 --- ParallelTerminationStrategy: PID 448 died... 18:22:22.630773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=448): Terminated: ok {rc=0} 18:22:22.676461 --- ParallelTerminationStrategy: PID 449 died... 18:22:22.695976 run iperf3-srv_10.42.42.10(pid=449): Terminated {rc=256} 18:22:22.741656 --- ParallelTerminationStrategy: PID 450 died... 18:22:22.761065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=450): Terminated: ok {rc=0} 18:22:22.806745 --- ParallelTerminationStrategy: PID 451 died... 18:22:22.826179 run iperf3-srv_10.42.42.10(pid=451): Terminated {rc=256} 18:22:22.872157 --- ParallelTerminationStrategy: PID 452 died... 18:22:22.891557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=452): Terminated: ok {rc=0} 18:22:22.937329 --- ParallelTerminationStrategy: PID 453 died... 18:22:22.956546 run iperf3-srv_10.42.42.10(pid=453): Terminated {rc=256} 18:22:23.002560 --- ParallelTerminationStrategy: PID 456 died... 18:22:23.021960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=456): Terminated: ok {rc=0} 18:22:23.067720 --- ParallelTerminationStrategy: PID 459 died... 18:22:23.087319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=459): Terminated: ok {rc=0} 18:22:23.133214 --- ParallelTerminationStrategy: PID 462 died... 18:22:23.152589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=462): Terminated: ok {rc=0} 18:22:23.240747 bus /gobi_4: Setting Powered False 18:22:24.340630 bus /gobi_4: Setting Powered False 18:22:25.457088 bus /gobi_1: Setting Powered False 18:22:26.554232 bus /gobi_1: Setting Powered False 18:22:27.668267 bus /gobi_0: Setting Powered False 18:22:28.765499 bus /gobi_0: Setting Powered False 18:22:29.880675 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:22:30.986594 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:30.999147 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:22:31.068262 tst ping.py: using LAC 22858 18:22:31.212503 tst ping.py: using RAC 163 18:22:31.367172 tst ping.py: using CellId 22858 18:22:31.529148 tst ping.py: using BVCI 22859 18:22:31.671235 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:31.683101 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:31.695613 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:31.708083 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:31.719950 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:31.731866 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:31.744233 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:31.756074 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:31.876246 tst ping.py:19: start network... 18:22:32.094050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:32.560297 run create_hlr_db(pid=464): Launched 18:22:32.672812 bus /gobi_6: Setting Powered False 18:22:33.731569 run create_hlr_db(pid=464): Terminated: ok {rc=0} 18:22:34.143938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=466): Launched 18:22:34.438358 run osmo-hlr_10.42.42.2(pid=467): Launched 18:22:34.550984 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:35.058618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=469): Launched 18:22:35.353346 run osmo-stp_10.42.42.5(pid=470): Launched 18:22:35.465066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:35.976850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=478): Launched 18:22:36.099384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:36.368355 run patchelf(pid=479): Launched 18:22:36.545250 run osmo-stp_10.42.42.5(pid=470): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=470)] 18:22:36.679780 run osmo-stp_10.42.42.5(pid=470): stdout: | (launched: 2022-12-09_18:22:35.298740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:36.816146 run osmo-stp_10.42.42.5(pid=470): stderr: | 20221209182235468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182235468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182235468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182235469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182235471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182235471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182235471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:36.952913 run osmo-stp_10.42.42.5(pid=470): stdout: | (launched: 2022-12-09_18:22:35.298740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:37.083110 run osmo-stp_10.42.42.5(pid=470): stderr: | 20221209182235468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182235468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182235468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182235469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182235471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182235471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182235471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:37.237324 run patchelf(pid=479): Terminating (SIGINT) 18:22:37.414691 run patchelf(pid=479): Terminated: ok {rc=0} 18:22:37.542917 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=470): Process ended prematurely: osmo-stp_10.42.42.5(pid=470) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=470)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 18:22:37.552431 tst ping.py:22: Test FAILED (6.6 sec) 18:22:37.581727 run osmo-hlr_10.42.42.2(pid=467): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=467)] 18:22:37.632212 run osmo-hlr_10.42.42.2(pid=467): stdout: | (launched: 2022-12-09_18:22:34.383855) 18:22:37.684473 run osmo-hlr_10.42.42.2(pid=467): stderr: | 20221209182234558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182234558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182234558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182234558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182234558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182234558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182234576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182234584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182234585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182234585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:37.737108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=466): Terminating (SIGTERM) 18:22:37.779581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=469): Terminating (SIGTERM) 18:22:37.822011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=478): Terminating (SIGTERM) 18:22:37.864863 --- ParallelTerminationStrategy: PID 466 died... 18:22:37.885253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=466): Terminated: ok {rc=0} 18:22:37.932727 --- ParallelTerminationStrategy: PID 469 died... 18:22:37.952335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=469): Terminated: ok {rc=0} 18:22:37.999792 --- ParallelTerminationStrategy: PID 478 died... 18:22:38.019424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=478): Terminated: ok {rc=0} 18:22:38.108588 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:22:39.196618 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:39.208595 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:22:39.279435 tst ping_idle_ping.py: using LAC 22859 18:22:39.404513 tst ping_idle_ping.py: using RAC 164 18:22:39.520873 tst ping_idle_ping.py: using CellId 22859 18:22:39.638116 tst ping_idle_ping.py: using BVCI 22860 18:22:39.747024 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:39.758177 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:39.769148 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:39.780454 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:39.791737 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:39.802958 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:39.814159 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:22:39.825228 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:22:39.941133 tst ping_idle_ping.py:24: start network... 18:22:40.156299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:40.650804 run create_hlr_db(pid=480): Launched 18:22:40.780864 bus /gobi_6: Setting Powered False 18:22:41.843924 run create_hlr_db(pid=480): Terminated: ok {rc=0} 18:22:42.287134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=482): Launched 18:22:42.603674 run osmo-hlr_10.42.42.2(pid=483): Launched 18:22:42.724257 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:43.273109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=485): Launched 18:22:43.589529 run osmo-stp_10.42.42.5(pid=486): Launched 18:22:43.710068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:44.256174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=488): Launched 18:22:44.377954 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:44.645546 run patchelf(pid=489): Launched 18:22:44.821524 run osmo-stp_10.42.42.5(pid=486): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=486)] 18:22:44.955371 run osmo-stp_10.42.42.5(pid=486): stdout: | (launched: 2022-12-09_18:22:43.531485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:45.091688 run osmo-stp_10.42.42.5(pid=486): stderr: | 20221209182243724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182243724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182243724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182243724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182243725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182243725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182243725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:45.228422 run osmo-stp_10.42.42.5(pid=486): stdout: | (launched: 2022-12-09_18:22:43.531485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:45.358452 run osmo-stp_10.42.42.5(pid=486): stderr: | 20221209182243724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182243724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182243724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182243724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182243725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182243725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182243725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:45.512006 run patchelf(pid=489): Terminating (SIGINT) 18:22:45.689584 run patchelf(pid=489): Terminated: ok {rc=0} 18:22:45.817521 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=486): Process ended prematurely: osmo-stp_10.42.42.5(pid=486) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=486)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:22:45.828730 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:22:45.861262 run osmo-hlr_10.42.42.2(pid=483): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=483)] 18:22:45.913462 run osmo-hlr_10.42.42.2(pid=483): stdout: | (launched: 2022-12-09_18:22:42.545897) 18:22:45.966277 run osmo-hlr_10.42.42.2(pid=483): stderr: | 20221209182242745 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182242745 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182242745 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182242745 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182242745 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182242745 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182242757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182242766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182242766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182242766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:46.019778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=482): Terminating (SIGTERM) 18:22:46.063217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=485): Terminating (SIGTERM) 18:22:46.107836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=488): Terminating (SIGTERM) 18:22:46.151370 --- ParallelTerminationStrategy: PID 482 died... 18:22:46.171702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=482): Terminated: ok {rc=0} 18:22:46.219883 --- ParallelTerminationStrategy: PID 485 died... 18:22:46.240247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=485): Terminated: ok {rc=0} 18:22:46.287556 --- ParallelTerminationStrategy: PID 488 died... 18:22:46.307832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=488): Terminated: ok {rc=0} 18:22:46.397814 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:22:47.714375 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:22:47.722045 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:22:47.754429 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 18:22:47.793110 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 18:22:47.879704 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:22:47.911997 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 18:22:47.950594 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 18:22:48.553999 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 18:22:48.605793 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:22:48.617120 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:22:48.664888 tst cs_paging_gprs_active.py: using LAC 22860 18:22:48.779830 tst cs_paging_gprs_active.py: using RAC 165 18:22:48.906939 tst cs_paging_gprs_active.py: using CellId 22860 18:22:49.031500 tst cs_paging_gprs_active.py: using BVCI 22861 18:22:49.148038 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:22:49.159976 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:22:49.171641 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:22:49.183482 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:22:49.195444 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:22:49.207071 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:22:49.218743 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:22:49.230294 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:22:49.242141 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:22:49.362291 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:22:49.478504 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:22:49.679412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:49.978336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=494): Launched 18:22:50.237721 run iperf3-srv_10.42.42.10(pid=495): Launched 18:22:50.349896 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:22:50.549097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:50.847518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=496): Launched 18:22:51.106351 run iperf3-srv_10.42.42.10(pid=497): Launched 18:22:51.218923 tst cs_paging_gprs_active.py:38: start network... 18:22:51.418517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:51.879512 run create_hlr_db(pid=498): Launched 18:22:51.995217 bus /gobi_6: Setting Powered False 18:22:53.054823 run create_hlr_db(pid=498): Terminated: ok {rc=0} 18:22:53.491256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=500): Launched 18:22:53.809387 run osmo-hlr_10.42.42.2(pid=501): Launched 18:22:53.931423 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:54.482851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=503): Launched 18:22:54.799958 run osmo-stp_10.42.42.5(pid=504): Launched 18:22:54.921526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:55.470083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=506): Launched 18:22:55.591933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:55.861154 run patchelf(pid=507): Launched 18:22:56.038130 run osmo-stp_10.42.42.5(pid=504): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=504)] 18:22:56.173355 run osmo-stp_10.42.42.5(pid=504): stdout: | (launched: 2022-12-09_18:22:54.742110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:56.310967 run osmo-stp_10.42.42.5(pid=504): stderr: | 20221209182254934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182254934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182254934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182254935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182254935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182254935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182254935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:56.447507 run osmo-stp_10.42.42.5(pid=504): stdout: | (launched: 2022-12-09_18:22:54.742110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:56.578262 run osmo-stp_10.42.42.5(pid=504): stderr: | 20221209182254934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182254934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182254934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182254935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182254935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182254935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182254935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:56.732837 run patchelf(pid=507): Terminating (SIGINT) 18:22:56.912129 run patchelf(pid=507): Terminated: ok {rc=0} 18:22:57.041958 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=504): Process ended prematurely: osmo-stp_10.42.42.5(pid=504) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=504)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 18:22:57.052265 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:22:57.080779 run osmo-hlr_10.42.42.2(pid=501): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=501)] 18:22:57.130785 run osmo-hlr_10.42.42.2(pid=501): stdout: | (launched: 2022-12-09_18:22:53.751686) 18:22:57.182518 run osmo-hlr_10.42.42.2(pid=501): stderr: | 20221209182253949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182253949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182253949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182253949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182253949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182253949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182253962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182253970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182253970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182253970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:57.234549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=494): Terminating (SIGTERM) 18:22:57.276227 run iperf3-srv_10.42.42.10(pid=495): Terminating (SIGTERM) 18:22:57.317920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=496): Terminating (SIGTERM) 18:22:57.359671 run iperf3-srv_10.42.42.10(pid=497): Terminating (SIGTERM) 18:22:57.401426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=500): Terminating (SIGTERM) 18:22:57.443251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=503): Terminating (SIGTERM) 18:22:57.484828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=506): Terminating (SIGTERM) 18:22:57.527254 --- ParallelTerminationStrategy: PID 494 died... 18:22:57.547081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=494): Terminated: ok {rc=0} 18:22:57.593068 --- ParallelTerminationStrategy: PID 495 died... 18:22:57.612278 run iperf3-srv_10.42.42.10(pid=495): Terminated {rc=256} 18:22:57.657996 --- ParallelTerminationStrategy: PID 496 died... 18:22:57.677246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=496): Terminated: ok {rc=0} 18:22:57.722907 --- ParallelTerminationStrategy: PID 497 died... 18:22:57.742110 run iperf3-srv_10.42.42.10(pid=497): Terminated {rc=256} 18:22:57.787724 --- ParallelTerminationStrategy: PID 500 died... 18:22:57.807171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=500): Terminated: ok {rc=0} 18:22:57.852864 --- ParallelTerminationStrategy: PID 503 died... 18:22:57.872556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=503): Terminated: ok {rc=0} 18:22:57.918331 --- ParallelTerminationStrategy: PID 506 died... 18:22:57.937693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=506): Terminated: ok {rc=0} 18:22:58.026073 bus /gobi_0: Setting Powered False 18:22:59.126097 bus /gobi_0: Setting Powered False 18:23:00.242071 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 18:23:01.406724 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:01.423143 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:23:01.481232 tst iperf3.py: using LAC 22861 18:23:01.640657 tst iperf3.py: using RAC 166 18:23:01.800632 tst iperf3.py: using CellId 22861 18:23:01.936833 tst iperf3.py: using BVCI 22862 18:23:02.060860 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:02.073367 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:02.085464 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:02.098931 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:02.110983 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:02.135798 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:02.148621 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:02.168087 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:02.181557 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:02.321516 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:23:02.551111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:02.869747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=556): Launched 18:23:03.214978 run iperf3-srv_10.42.42.10(pid=578): Launched 18:23:03.370850 tst iperf3.py:8: start network... 18:23:03.628811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:04.199278 run create_hlr_db(pid=696): Launched 18:23:04.411224 bus /gobi_6: Setting Powered False 18:23:05.470323 run create_hlr_db(pid=696): Terminated: ok {rc=0} 18:23:05.947827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=781): Launched 18:23:06.269676 run osmo-hlr_10.42.42.2(pid=782): Launched 18:23:06.484596 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:07.157703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=786): Launched 18:23:07.482406 run osmo-stp_10.42.42.5(pid=787): Launched 18:23:07.718613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:08.411352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=789): Launched 18:23:08.534228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:08.800489 run patchelf(pid=790): Launched 18:23:08.986398 run osmo-stp_10.42.42.5(pid=787): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=787)] 18:23:09.118475 run osmo-stp_10.42.42.5(pid=787): stdout: | (launched: 2022-12-09_18:23:07.414450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:09.252583 run osmo-stp_10.42.42.5(pid=787): stderr: | 20221209182307744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182307744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182307753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182307754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182307754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182307754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182307754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:09.387775 run osmo-stp_10.42.42.5(pid=787): stdout: | (launched: 2022-12-09_18:23:07.414450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:09.515649 run osmo-stp_10.42.42.5(pid=787): stderr: | 20221209182307744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182307744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182307753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182307754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182307754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182307754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182307754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:09.669848 run patchelf(pid=790): Terminating (SIGINT) 18:23:09.845956 run patchelf(pid=790): Terminated: ok {rc=0} 18:23:09.974242 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=787): Process ended prematurely: osmo-stp_10.42.42.5(pid=787) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=787)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 18:23:09.985122 tst iperf3.py:8: Test FAILED (8.6 sec) 18:23:10.017089 run osmo-hlr_10.42.42.2(pid=782): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=782)] 18:23:10.068413 run osmo-hlr_10.42.42.2(pid=782): stdout: | (launched: 2022-12-09_18:23:06.205358) 18:23:10.121263 run osmo-hlr_10.42.42.2(pid=782): stderr: | 20221209182306503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182306503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182306503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182306503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182306503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182306503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182306528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182306536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182306537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182306537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:10.175422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=556): Terminating (SIGTERM) 18:23:10.218894 run iperf3-srv_10.42.42.10(pid=578): Terminating (SIGTERM) 18:23:10.264582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=781): Terminating (SIGTERM) 18:23:10.308196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=786): Terminating (SIGTERM) 18:23:10.353678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=789): Terminating (SIGTERM) 18:23:10.399657 --- ParallelTerminationStrategy: PID 556 died... 18:23:10.419754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=556): Terminated: ok {rc=0} 18:23:10.469428 --- ParallelTerminationStrategy: PID 578 died... 18:23:10.488914 run iperf3-srv_10.42.42.10(pid=578): Terminated {rc=256} 18:23:10.536931 --- ParallelTerminationStrategy: PID 781 died... 18:23:10.556599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=781): Terminated: ok {rc=0} 18:23:10.606262 --- ParallelTerminationStrategy: PID 786 died... 18:23:10.626478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=786): Terminated: ok {rc=0} 18:23:10.674644 --- ParallelTerminationStrategy: PID 789 died... 18:23:10.694230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=789): Terminated: ok {rc=0} 18:23:10.785254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 18:23:11.934390 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:11.947685 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:23:12.003337 tst iperf3m4.py: using LAC 22862 18:23:12.125626 tst iperf3m4.py: using RAC 167 18:23:12.250508 tst iperf3m4.py: using CellId 22862 18:23:12.373864 tst iperf3m4.py: using BVCI 22863 18:23:12.487249 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:12.499650 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:12.511906 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:12.526442 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:12.539791 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:12.551911 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:12.566642 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:12.581218 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:12.593705 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:12.716430 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:12.838734 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:12.959547 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:13.079817 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:23:13.289313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:13.613353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=791): Launched 18:23:13.898124 run iperf3-srv_10.42.42.10(pid=792): Launched 18:23:14.030966 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:23:14.237443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:14.549948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=793): Launched 18:23:14.835711 run iperf3-srv_10.42.42.10(pid=794): Launched 18:23:14.965879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:23:15.174294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:15.486331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=795): Launched 18:23:15.777050 run iperf3-srv_10.42.42.10(pid=796): Launched 18:23:15.908789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:23:16.122218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:16.437699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=797): Launched 18:23:16.728306 run iperf3-srv_10.42.42.10(pid=798): Launched 18:23:16.856804 tst iperf3m4.py:8: start network... 18:23:17.063789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:17.544517 run create_hlr_db(pid=799): Launched 18:23:17.731803 bus /gobi_6: Setting Powered False 18:23:18.798083 run create_hlr_db(pid=799): Terminated: ok {rc=0} 18:23:19.264614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=801): Launched 18:23:19.611806 run osmo-hlr_10.42.42.2(pid=802): Launched 18:23:19.864181 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:20.531414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=804): Launched 18:23:20.874816 run osmo-stp_10.42.42.5(pid=805): Launched 18:23:21.122836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:21.770313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=807): Launched 18:23:21.906642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:22.191481 run patchelf(pid=808): Launched 18:23:22.388170 run osmo-stp_10.42.42.5(pid=805): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=805)] 18:23:22.530651 run osmo-stp_10.42.42.5(pid=805): stdout: | (launched: 2022-12-09_18:23:20.813027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:22.672091 run osmo-stp_10.42.42.5(pid=805): stderr: | 20221209182321110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182321110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182321111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182321111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182321112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182321112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182321112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:22.812886 run osmo-stp_10.42.42.5(pid=805): stdout: | (launched: 2022-12-09_18:23:20.813027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:22.947704 run osmo-stp_10.42.42.5(pid=805): stderr: | 20221209182321110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182321110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182321111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182321111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182321112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182321112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182321112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:23.107991 run patchelf(pid=808): Terminating (SIGINT) 18:23:23.293519 run patchelf(pid=808): Terminated: ok {rc=0} 18:23:23.427209 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=805): Process ended prematurely: osmo-stp_10.42.42.5(pid=805) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=805)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 18:23:23.437823 tst iperf3m4.py:8: Test FAILED (11.5 sec) 18:23:23.467719 run osmo-hlr_10.42.42.2(pid=802): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=802)] 18:23:23.519413 run osmo-hlr_10.42.42.2(pid=802): stdout: | (launched: 2022-12-09_18:23:19.543871) 18:23:23.574251 run osmo-hlr_10.42.42.2(pid=802): stderr: | 20221209182319856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182319856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182319856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182319856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182319856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182319856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182319875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182319888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182319888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182319888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:23.628225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=791): Terminating (SIGTERM) 18:23:23.671445 run iperf3-srv_10.42.42.10(pid=792): Terminating (SIGTERM) 18:23:23.717343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=793): Terminating (SIGTERM) 18:23:23.761694 run iperf3-srv_10.42.42.10(pid=794): Terminating (SIGTERM) 18:23:23.808072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=795): Terminating (SIGTERM) 18:23:23.851923 run iperf3-srv_10.42.42.10(pid=796): Terminating (SIGTERM) 18:23:23.897868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=797): Terminating (SIGTERM) 18:23:23.941549 run iperf3-srv_10.42.42.10(pid=798): Terminating (SIGTERM) 18:23:23.988306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=801): Terminating (SIGTERM) 18:23:24.032194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=804): Terminating (SIGTERM) 18:23:24.077282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=807): Terminating (SIGTERM) 18:23:24.122414 --- ParallelTerminationStrategy: PID 791 died... 18:23:24.143164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=791): Terminated: ok {rc=0} 18:23:24.193438 --- ParallelTerminationStrategy: PID 792 died... 18:23:24.214058 run iperf3-srv_10.42.42.10(pid=792): Terminated {rc=256} 18:23:24.261746 --- ParallelTerminationStrategy: PID 793 died... 18:23:24.282188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=793): Terminated: ok {rc=0} 18:23:24.329740 --- ParallelTerminationStrategy: PID 794 died... 18:23:24.350325 run iperf3-srv_10.42.42.10(pid=794): Terminated {rc=256} 18:23:24.398778 --- ParallelTerminationStrategy: PID 795 died... 18:23:24.419638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=795): Terminated: ok {rc=0} 18:23:24.468231 --- ParallelTerminationStrategy: PID 796 died... 18:23:24.488783 run iperf3-srv_10.42.42.10(pid=796): Terminated {rc=256} 18:23:24.538718 --- ParallelTerminationStrategy: PID 797 died... 18:23:24.559523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=797): Terminated: ok {rc=0} 18:23:24.609275 --- ParallelTerminationStrategy: PID 798 died... 18:23:24.629665 run iperf3-srv_10.42.42.10(pid=798): Terminated {rc=256} 18:23:24.678530 --- ParallelTerminationStrategy: PID 801 died... 18:23:24.699127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=801): Terminated: ok {rc=0} 18:23:24.748602 --- ParallelTerminationStrategy: PID 804 died... 18:23:24.769837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=804): Terminated: ok {rc=0} 18:23:24.819674 --- ParallelTerminationStrategy: PID 807 died... 18:23:24.840223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=807): Terminated: ok {rc=0} 18:23:24.932845 bus /gobi_4: Setting Powered False 18:23:26.034624 bus /gobi_4: Setting Powered False 18:23:27.147355 bus /gobi_1: Setting Powered False 18:23:28.245598 bus /gobi_1: Setting Powered False 18:23:29.360830 bus /gobi_0: Setting Powered False 18:23:30.458589 bus /gobi_0: Setting Powered False 18:23:31.575903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 18:23:32.682219 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:32.694556 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:23:32.746963 tst ping.py: using LAC 22863 18:23:32.869472 tst ping.py: using RAC 168 18:23:32.988682 tst ping.py: using CellId 22863 18:23:33.103356 tst ping.py: using BVCI 22864 18:23:33.209080 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.220550 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.231887 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.243702 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.255325 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.266985 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.278912 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:33.290676 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:33.408563 tst ping.py:19: start network... 18:23:33.619328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:34.102747 run create_hlr_db(pid=810): Launched 18:23:34.230656 bus /gobi_6: Setting Powered False 18:23:35.292421 run create_hlr_db(pid=810): Terminated: ok {rc=0} 18:23:35.711966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=812): Launched 18:23:36.004447 run osmo-hlr_10.42.42.2(pid=813): Launched 18:23:36.116129 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:36.636029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=815): Launched 18:23:36.927712 run osmo-stp_10.42.42.5(pid=816): Launched 18:23:37.038668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:37.542109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=818): Launched 18:23:37.653961 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:37.899280 run patchelf(pid=820): Launched 18:23:38.061806 run osmo-stp_10.42.42.5(pid=816): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=816)] 18:23:38.185627 run osmo-stp_10.42.42.5(pid=816): stdout: | (launched: 2022-12-09_18:23:36.874066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:38.311718 run osmo-stp_10.42.42.5(pid=816): stderr: | 20221209182337043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182337044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182337044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182337044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182337045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182337045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182337045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:38.437764 run osmo-stp_10.42.42.5(pid=816): stdout: | (launched: 2022-12-09_18:23:36.874066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:38.557682 run osmo-stp_10.42.42.5(pid=816): stderr: | 20221209182337043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182337044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182337044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182337044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182337045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182337045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182337045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:38.700281 run patchelf(pid=820): Terminating (SIGINT) 18:23:38.864776 run patchelf(pid=820): Terminated: ok {rc=0} 18:23:38.983608 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=816): Process ended prematurely: osmo-stp_10.42.42.5(pid=816) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=816)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 18:23:38.992511 tst ping.py:22: Test FAILED (6.3 sec) 18:23:39.019682 run osmo-hlr_10.42.42.2(pid=813): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=813)] 18:23:39.067609 run osmo-hlr_10.42.42.2(pid=813): stdout: | (launched: 2022-12-09_18:23:35.950790) 18:23:39.117059 run osmo-hlr_10.42.42.2(pid=813): stderr: | 20221209182336125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182336125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182336125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182336125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182336125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182336125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182336142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182336152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182336152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182336152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:39.166670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=812): Terminating (SIGTERM) 18:23:39.206648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=815): Terminating (SIGTERM) 18:23:39.246730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=818): Terminating (SIGTERM) 18:23:39.286906 --- ParallelTerminationStrategy: PID 812 died... 18:23:39.306060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=812): Terminated: ok {rc=0} 18:23:39.350900 --- ParallelTerminationStrategy: PID 815 died... 18:23:39.369477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=815): Terminated: ok {rc=0} 18:23:39.414409 --- ParallelTerminationStrategy: PID 818 died... 18:23:39.432907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=818): Terminated: ok {rc=0} 18:23:39.516324 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 18:23:40.602547 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:40.615041 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:23:40.668439 tst ping_idle_ping.py: using LAC 22864 18:23:40.793443 tst ping_idle_ping.py: using RAC 169 18:23:40.917441 tst ping_idle_ping.py: using CellId 22864 18:23:41.040620 tst ping_idle_ping.py: using BVCI 22865 18:23:41.154399 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:41.166330 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:41.178018 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:41.190154 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:41.202190 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:41.215055 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:41.227811 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:23:41.239300 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:23:41.353151 tst ping_idle_ping.py:24: start network... 18:23:41.549893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:42.005322 run create_hlr_db(pid=821): Launched 18:23:42.118400 bus /gobi_6: Setting Powered False 18:23:43.177235 run create_hlr_db(pid=821): Terminated: ok {rc=0} 18:23:43.587687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=824): Launched 18:23:43.881240 run osmo-hlr_10.42.42.2(pid=825): Launched 18:23:43.993799 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:44.506448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=827): Launched 18:23:44.799320 run osmo-stp_10.42.42.5(pid=828): Launched 18:23:44.911251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:45.415208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=833): Launched 18:23:45.527813 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:45.774610 run patchelf(pid=834): Launched 18:23:45.951837 run osmo-stp_10.42.42.5(pid=828): ERR: Terminated: ERROR {rc=1} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=828)] 18:23:46.080793 run osmo-stp_10.42.42.5(pid=828): stdout: | (launched: 2022-12-09_18:23:44.745857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:46.211637 run osmo-stp_10.42.42.5(pid=828): stderr: | 20221209182344913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182344913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182344913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182344914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182344914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182344914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182344914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:46.342158 run osmo-stp_10.42.42.5(pid=828): stdout: | (launched: 2022-12-09_18:23:44.745857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:46.465562 run osmo-stp_10.42.42.5(pid=828): stderr: | 20221209182344913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182344913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182344913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182344914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182344914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182344914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182344914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:46.611957 run patchelf(pid=834): Terminating (SIGINT) 18:23:46.782101 run patchelf(pid=834): Terminated: ok {rc=0} 18:23:46.904797 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=828): Process ended prematurely: osmo-stp_10.42.42.5(pid=828) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=828)] [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 18:23:46.915023 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 18:23:46.945267 run osmo-hlr_10.42.42.2(pid=825): ERR: Terminated: ERROR {rc=237} [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=825)] 18:23:46.996364 run osmo-hlr_10.42.42.2(pid=825): stdout: | (launched: 2022-12-09_18:23:43.827380) 18:23:47.048679 run osmo-hlr_10.42.42.2(pid=825): stderr: | 20221209182344001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182344001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182344001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182344001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182344001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182344001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182344014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182344022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182344023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182344023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:47.100932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=824): Terminating (SIGTERM) 18:23:47.143058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=827): Terminating (SIGTERM) 18:23:47.186654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=833): Terminating (SIGTERM) 18:23:47.227047 --- ParallelTerminationStrategy: PID 824 died... 18:23:47.245962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=824): Terminated: ok {rc=0} 18:23:47.290695 --- ParallelTerminationStrategy: PID 827 died... 18:23:47.309468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=827): Terminated: ok {rc=0} 18:23:47.353681 --- ParallelTerminationStrategy: PID 833 died... 18:23:47.372252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=833): Terminated: ok {rc=0} 18:23:47.458176 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 18:23:48.769945 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:23:48.777393 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:23:48.809618 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:23:48.843179 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:23:48.899896 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:23:48.933081 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:23:48.966790 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:23:49.521183 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2362 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:23:49.526131 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:23:49.537584 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:23:49.605171 tst switch_tch_pdch.py: using LAC 22865 18:23:49.719748 tst switch_tch_pdch.py: using RAC 170 18:23:49.833160 tst switch_tch_pdch.py: using CellId 22865 18:23:49.948291 tst switch_tch_pdch.py: using BVCI 22866 18:23:50.053694 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:23:50.065143 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:23:50.076331 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:23:50.087697 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:23:50.099214 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:23:50.110740 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:23:50.122397 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:23:50.133828 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:23:50.251403 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:23:50.370720 tst switch_tch_pdch.py:51: start network... 18:23:50.581153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:51.064382 run create_hlr_db(pid=839): Launched 18:23:51.191600 bus /gobi_6: Setting Powered False 18:23:52.254782 run create_hlr_db(pid=839): Terminated: ok {rc=0} 18:23:52.673886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=841): Launched 18:23:52.965461 run osmo-hlr_10.42.42.2(pid=842): Launched 18:23:53.077927 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:53.595068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=845): Launched 18:23:53.887231 run osmo-stp_10.42.42.5(pid=846): Launched 18:23:53.998878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:54.503412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=848): Launched 18:23:54.616352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:54.863900 run patchelf(pid=849): Launched 18:23:55.026550 run osmo-stp_10.42.42.5(pid=846): ERR: Terminated: ERROR {rc=1} [trial-2362↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=846)] 18:23:55.150843 run osmo-stp_10.42.42.5(pid=846): stdout: | (launched: 2022-12-09_18:23:53.833775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:55.277233 run osmo-stp_10.42.42.5(pid=846): stderr: | 20221209182354004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182354004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182354004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182354005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182354005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182354005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182354005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:55.403342 run osmo-stp_10.42.42.5(pid=846): stdout: | (launched: 2022-12-09_18:23:53.833775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:55.523050 run osmo-stp_10.42.42.5(pid=846): stderr: | 20221209182354004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182354004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182354004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182354005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182354005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182354005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182354005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:55.665543 run patchelf(pid=849): Terminating (SIGINT) 18:23:55.829729 run patchelf(pid=849): Terminated: ok {rc=0} 18:23:55.948090 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=846): Process ended prematurely: osmo-stp_10.42.42.5(pid=846) [trial-2362↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=846)] [trial-2362↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:23:55.957070 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 18:23:55.983880 run osmo-hlr_10.42.42.2(pid=842): ERR: Terminated: ERROR {rc=237} [trial-2362↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=842)] 18:23:56.031341 run osmo-hlr_10.42.42.2(pid=842): stdout: | (launched: 2022-12-09_18:23:52.912301) 18:23:56.080548 run osmo-hlr_10.42.42.2(pid=842): stderr: | 20221209182353087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182353087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182353087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182353087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182353087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182353087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182353099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182353109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182353110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182353110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:56.130161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=841): Terminating (SIGTERM) 18:23:56.169605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=845): Terminating (SIGTERM) 18:23:56.208875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=848): Terminating (SIGTERM) 18:23:56.248516 --- ParallelTerminationStrategy: PID 841 died... 18:23:56.267271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=841): Terminated: ok {rc=0} 18:23:56.311090 --- ParallelTerminationStrategy: PID 845 died... 18:23:56.329407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=845): Terminated: ok {rc=0} 18:23:56.373064 --- ParallelTerminationStrategy: PID 848 died... 18:23:56.391573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=848): Terminated: ok {rc=0} 18:23:56.474508 bus /gobi_0: Setting Powered False 18:23:57.569996 bus /gobi_0: Setting Powered False 18:23:58.683882 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2362 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 nitb_smpp --------------------------------------------------------------------- 18:23:59.936182 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:23:59.939543 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 18:23:59.960786 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 18:23:59.968660 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 18:24:00.005481 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 18:24:00.026113 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 18:24:00.033099 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 18:24:00.549987 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2362 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 18:24:00.556351 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:24:00.575193 tst esme_connect_policy_acceptall.py: using MSISDN 7310 18:24:00.709702 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:24:01.287857 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=853): Launched 18:24:01.604257 run osmo-nitb_10.42.42.2(pid=854): Launched 18:24:01.792293 run osmo-nitb_10.42.42.2(pid=854): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=854)] 18:24:01.930066 run osmo-nitb_10.42.42.2(pid=854): stdout: | (launched: 2022-12-09_18:24:01.543497) 18:24:02.068829 run osmo-nitb_10.42.42.2(pid=854): stderr: | (launched: 2022-12-09_18:24:01.588654) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:02.207310 run osmo-nitb_10.42.42.2(pid=854): stdout: | (launched: 2022-12-09_18:24:01.543497) 18:24:02.337607 run osmo-nitb_10.42.42.2(pid=854): stderr: | (launched: 2022-12-09_18:24:01.588654) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=854): Process ended prematurely: osmo-nitb_10.42.42.2(pid=854) [trial-2362↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=854)] 18:24:02.739181 tst osmo-nitb_10.42.42.2(pid=854): stdout: | (launched: 2022-12-09_18:24:01.543497) 18:24:02.860610 tst osmo-nitb_10.42.42.2(pid=854): stderr: | (launched: 2022-12-09_18:24:01.588654) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:03.003323 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=854): Process ended prematurely: osmo-nitb_10.42.42.2(pid=854) [trial-2362↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=854)] [trial-2362↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 18:24:03.011542 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 18:24:03.018114 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=853): Terminating (SIGTERM) 18:24:03.228841 --- ParallelTerminationStrategy: PID 853 died... 18:24:03.249766 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=853): Terminated: ok {rc=0} ---------------------------------------------- trial-2362 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 18:24:03.299352 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:24:03.320400 tst esme_connect_policy_closed.py: using MSISDN 7311 18:24:03.449871 tst esme_connect_policy_closed.py: using MSISDN 7312 18:24:03.566767 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:24:04.161662 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=855): Launched 18:24:04.481582 run osmo-nitb_10.42.42.2(pid=856): Launched 18:24:04.653698 run osmo-nitb_10.42.42.2(pid=856): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=856)] 18:24:04.785254 run osmo-nitb_10.42.42.2(pid=856): stdout: | (launched: 2022-12-09_18:24:04.423446) 18:24:04.919209 run osmo-nitb_10.42.42.2(pid=856): stderr: | (launched: 2022-12-09_18:24:04.471060) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:05.052439 run osmo-nitb_10.42.42.2(pid=856): stdout: | (launched: 2022-12-09_18:24:04.423446) 18:24:05.179810 run osmo-nitb_10.42.42.2(pid=856): stderr: | (launched: 2022-12-09_18:24:04.471060) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:05.332705 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=856): Process ended prematurely: osmo-nitb_10.42.42.2(pid=856) [trial-2362↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=856)] [trial-2362↪nitb_smpp↪esme_connect_policy_closed.py:24] 18:24:05.341859 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 18:24:05.349201 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=855): Terminating (SIGTERM) 18:24:05.559879 --- ParallelTerminationStrategy: PID 855 died... 18:24:05.581133 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=855): Terminated: ok {rc=0} ---------------------------------------------- trial-2362 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 18:24:05.631331 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:24:05.642820 tst nitb_smpp: Using 1 x bts (candidates: 1) 18:24:05.678994 tst esme_ms_sms_storeforward.py: using LAC 22866 18:24:05.806494 tst esme_ms_sms_storeforward.py: using RAC 171 18:24:05.931847 tst esme_ms_sms_storeforward.py: using CellId 22866 18:24:06.050730 tst esme_ms_sms_storeforward.py: using BVCI 22867 18:24:06.161189 tst nitb_smpp: Using 1 x modem (candidates: 1) 18:24:06.290688 tst esme_ms_sms_storeforward.py: using MSISDN 7313 18:24:06.407344 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 18:24:06.624605 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:24:07.278453 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=857): Launched 18:24:07.599058 run osmo-nitb_10.42.42.2(pid=858): Launched 18:24:07.771961 run osmo-nitb_10.42.42.2(pid=858): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=858)] 18:24:07.904372 run osmo-nitb_10.42.42.2(pid=858): stdout: | (launched: 2022-12-09_18:24:07.540761) 18:24:08.037752 run osmo-nitb_10.42.42.2(pid=858): stderr: | (launched: 2022-12-09_18:24:07.588548) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:08.171526 run osmo-nitb_10.42.42.2(pid=858): stdout: | (launched: 2022-12-09_18:24:07.540761) 18:24:08.299587 run osmo-nitb_10.42.42.2(pid=858): stderr: | (launched: 2022-12-09_18:24:07.588548) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:08.452265 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=858): Process ended prematurely: osmo-nitb_10.42.42.2(pid=858) [trial-2362↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=858)] [trial-2362↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 18:24:08.461380 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 18:24:08.468217 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=857): Terminating (SIGTERM) 18:24:08.679244 --- ParallelTerminationStrategy: PID 857 died... 18:24:08.700648 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=857): Terminated: ok {rc=0} 18:24:08.787526 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 18:24:09.875364 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:24:09.886409 tst nitb_smpp: Using 1 x bts (candidates: 1) 18:24:09.922468 tst esme_ms_sms_transaction.py: using LAC 22867 18:24:10.042427 tst esme_ms_sms_transaction.py: using RAC 172 18:24:10.159960 tst esme_ms_sms_transaction.py: using CellId 22867 18:24:10.283318 tst esme_ms_sms_transaction.py: using BVCI 22868 18:24:10.392879 tst nitb_smpp: Using 1 x modem (candidates: 1) 18:24:10.515199 tst esme_ms_sms_transaction.py: using MSISDN 7314 18:24:10.622707 tst esme_ms_sms_transaction.py:18: start nitb and bts... 18:24:10.823128 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:24:11.431462 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=859): Launched 18:24:11.731222 run osmo-nitb_10.42.42.2(pid=860): Launched 18:24:11.897305 run osmo-nitb_10.42.42.2(pid=860): ERR: Terminated: ERROR {rc=2} [trial-2362↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=860)] 18:24:12.031629 run osmo-nitb_10.42.42.2(pid=860): stdout: | (launched: 2022-12-09_18:24:11.676482) 18:24:12.167280 run osmo-nitb_10.42.42.2(pid=860): stderr: | (launched: 2022-12-09_18:24:11.720912) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:12.302734 run osmo-nitb_10.42.42.2(pid=860): stdout: | (launched: 2022-12-09_18:24:11.676482) 18:24:12.432729 run osmo-nitb_10.42.42.2(pid=860): stderr: | (launched: 2022-12-09_18:24:11.720912) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f0b145e9268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=860): Process ended prematurely: osmo-nitb_10.42.42.2(pid=860) [trial-2362↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=860)] 18:24:12.844269 tst osmo-nitb_10.42.42.2(pid=860): stdout: | (launched: 2022-12-09_18:24:11.676482) 18:24:12.965862 tst osmo-nitb_10.42.42.2(pid=860): stderr: | (launched: 2022-12-09_18:24:11.720912) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:24:13.108228 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=860): Process ended prematurely: osmo-nitb_10.42.42.2(pid=860) [trial-2362↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=860)] [trial-2362↪nitb_smpp↪esme_ms_sms_transaction.py:21] 18:24:13.116786 tst esme_ms_sms_transaction.py:21: Test FAILED (3.2 sec) 18:24:13.123297 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=859): Terminating (SIGTERM) 18:24:13.332716 --- ParallelTerminationStrategy: PID 859 died... 18:24:13.353191 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=859): Terminated: ok {rc=0} 18:24:13.438983 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 smpp --------------------------------------------------------------------- 18:24:14.603324 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:24:14.605989 tst smpp: Verifying 1 x bts (candidates: 11) 18:24:14.626087 tst smpp: Verifying 6 x ip_address (candidates: 9) 18:24:14.653373 tst smpp: Verifying 1 x modem (candidates: 12) 18:24:14.690914 tst smpp: Reserving 1 x bts (candidates: 11) 18:24:14.711889 tst smpp: Reserving 6 x ip_address (candidates: 9) 18:24:14.738800 tst smpp: Reserving 1 x modem (candidates: 12) 18:24:15.261266 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 18:24:15.266129 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:15.276305 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:15.286570 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:15.297353 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:15.316167 tst esme_connect_policy_acceptall.py: using MSISDN 7315 18:24:15.433177 run osmo-stp_10.42.42.4: Starting osmo-stp 18:24:15.998903 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=866): Launched 18:24:16.328317 run osmo-stp_10.42.42.4(pid=867): Launched 18:24:16.535242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:17.054253 run create_hlr_db(pid=868): Launched 18:24:17.194995 bus /sierra_2: Setting Powered False 18:24:18.258516 run create_hlr_db(pid=868): Terminated: ok {rc=0} 18:24:18.686496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=870): Launched 18:24:18.985882 run osmo-hlr_10.42.42.2(pid=871): Launched 18:24:19.099599 run osmo-msc_10.42.42.5: Starting osmo-msc 18:24:19.642052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=887): Launched 18:24:19.941658 run osmo-msc_10.42.42.5(pid=888): Launched 18:24:20.109679 run osmo-hlr_10.42.42.2(pid=871): ERR: Terminated: ERROR {rc=237} [trial-2362↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=871)] 18:24:20.241153 run osmo-hlr_10.42.42.2(pid=871): stdout: | (launched: 2022-12-09_18:24:18.930853) 18:24:20.369543 run osmo-hlr_10.42.42.2(pid=871): stderr: | 20221209182419105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182419105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182419105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182419105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182419105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182419105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182419118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182419127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182419127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182419127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:20.494870 run osmo-hlr_10.42.42.2(pid=871): stdout: | (launched: 2022-12-09_18:24:18.930853) 18:24:20.614157 run osmo-hlr_10.42.42.2(pid=871): stderr: | 20221209182419105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182419105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182419105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182419105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182419105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182419105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182419118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182419127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182419127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182419127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:20.756934 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=871): Process ended prematurely: osmo-hlr_10.42.42.2(pid=871) [trial-2362↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=871)] [trial-2362↪smpp↪esme_connect_policy_acceptall.py:23] 18:24:20.765473 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.5 sec) 18:24:20.791621 run osmo-msc_10.42.42.5(pid=888): ERR: Terminated: ERROR {rc=9} [trial-2362↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=888)] 18:24:20.839700 run osmo-msc_10.42.42.5(pid=888): stdout: | (launched: 2022-12-09_18:24:19.886845) 18:24:20.889136 run osmo-msc_10.42.42.5(pid=888): stderr: | 20221209182420200 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209182420200 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209182420200 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182420200 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209182420200 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209182420200 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209182420200 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209182420200 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209182420200 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 18:24:20.938790 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=866): Terminating (SIGTERM) 18:24:20.978358 run osmo-stp_10.42.42.4(pid=867): Terminating (SIGTERM) 18:24:21.017819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=870): Terminating (SIGTERM) 18:24:21.058885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=887): Terminating (SIGTERM) 18:24:21.099644 --- ParallelTerminationStrategy: PID 866 died... 18:24:21.118699 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=866): Terminated: ok {rc=0} 18:24:21.162917 --- ParallelTerminationStrategy: PID 867 died... 18:24:21.181344 run osmo-stp_10.42.42.4(pid=867): Terminated: ok {rc=0} 18:24:21.225466 --- ParallelTerminationStrategy: PID 870 died... 18:24:21.243909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=870): Terminated: ok {rc=0} 18:24:21.288080 --- ParallelTerminationStrategy: PID 887 died... 18:24:21.306889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=887): Terminated: ok {rc=0} ---------------------------------------------- trial-2362 smpp esme_connect_policy_closed.py ---------------------------------------------- 18:24:21.355740 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:21.366698 tst smpp: Using 1 x bts (candidates: 1) 18:24:21.402316 tst esme_connect_policy_closed.py: using LAC 22868 18:24:21.522447 tst esme_connect_policy_closed.py: using RAC 173 18:24:21.642800 tst esme_connect_policy_closed.py: using CellId 22868 18:24:21.760306 tst esme_connect_policy_closed.py: using BVCI 22869 18:24:21.870619 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:21.881011 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:21.891434 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:21.911357 tst esme_connect_policy_closed.py: using MSISDN 7316 18:24:22.030267 tst esme_connect_policy_closed.py: using MSISDN 7317 18:24:22.140009 run osmo-stp_10.42.42.4: Starting osmo-stp 18:24:22.648730 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=891): Launched 18:24:22.948762 run osmo-stp_10.42.42.4(pid=892): Launched 18:24:23.063883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:23.528401 run create_hlr_db(pid=893): Launched 18:24:24.696529 run create_hlr_db(pid=893): Terminated: ok {rc=0} 18:24:25.013880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=895): Launched 18:24:25.335186 run osmo-hlr_10.42.42.2(pid=896): Launched 18:24:25.458273 run osmo-msc_10.42.42.5: Starting osmo-msc 18:24:26.038433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=898): Launched 18:24:26.359644 run osmo-msc_10.42.42.5(pid=899): Launched 18:24:26.538758 run osmo-hlr_10.42.42.2(pid=896): ERR: Terminated: ERROR {rc=237} [trial-2362↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=896)] 18:24:26.675230 run osmo-hlr_10.42.42.2(pid=896): stdout: | (launched: 2022-12-09_18:24:25.277070) 18:24:26.811037 run osmo-hlr_10.42.42.2(pid=896): stderr: | 20221209182425473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182425473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182425473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182425473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182425474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182425474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182425509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182425519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182425519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182425519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:26.945720 run osmo-hlr_10.42.42.2(pid=896): stdout: | (launched: 2022-12-09_18:24:25.277070) 18:24:27.073476 run osmo-hlr_10.42.42.2(pid=896): stderr: | 20221209182425473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182425473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182425473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182425473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182425474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182425474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182425509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182425519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182425519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182425519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:27.225676 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=896): Process ended prematurely: osmo-hlr_10.42.42.2(pid=896) [trial-2362↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=896)] [trial-2362↪smpp↪esme_connect_policy_closed.py:31] 18:24:27.234550 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 18:24:27.262301 run osmo-msc_10.42.42.5(pid=899): ERR: Terminated: ERROR {rc=9} [trial-2362↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=899)] 18:24:27.312683 run osmo-msc_10.42.42.5(pid=899): stdout: | (launched: 2022-12-09_18:24:26.301313) 18:24:27.364539 run osmo-msc_10.42.42.5(pid=899): stderr: | 20221209182426671 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209182426671 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209182426671 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182426671 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209182426671 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209182426671 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209182426671 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209182426671 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209182426671 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 18:24:27.416682 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=891): Terminating (SIGTERM) 18:24:27.458329 run osmo-stp_10.42.42.4(pid=892): Terminating (SIGTERM) 18:24:27.499789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=895): Terminating (SIGTERM) 18:24:27.542886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=898): Terminating (SIGTERM) 18:24:27.586442 --- ParallelTerminationStrategy: PID 891 died... 18:24:27.606407 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=891): Terminated: ok {rc=0} 18:24:27.653576 --- ParallelTerminationStrategy: PID 892 died... 18:24:27.672922 run osmo-stp_10.42.42.4(pid=892): Terminated: ok {rc=0} 18:24:27.718847 --- ParallelTerminationStrategy: PID 895 died... 18:24:27.738308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=895): Terminated: ok {rc=0} 18:24:27.783980 --- ParallelTerminationStrategy: PID 898 died... 18:24:27.803444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=898): Terminated: ok {rc=0} ---------------------------------------------- trial-2362 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 18:24:27.854138 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:27.865395 tst smpp: Using 1 x bts (candidates: 1) 18:24:27.901464 tst esme_ms_sms_storeforward.py: using LAC 22869 18:24:28.029387 tst esme_ms_sms_storeforward.py: using RAC 174 18:24:28.154365 tst esme_ms_sms_storeforward.py: using CellId 22869 18:24:28.280130 tst esme_ms_sms_storeforward.py: using BVCI 22870 18:24:28.398460 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:28.409213 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:28.419780 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:28.430827 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:28.441913 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:28.453241 tst smpp: Using 1 x modem (candidates: 1) 18:24:28.577163 tst esme_ms_sms_storeforward.py: using MSISDN 7318 18:24:28.686189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:29.150938 run create_hlr_db(pid=902): Launched 18:24:30.319251 run create_hlr_db(pid=902): Terminated: ok {rc=0} 18:24:30.636241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=904): Launched 18:24:30.952541 run osmo-hlr_10.42.42.2(pid=905): Launched 18:24:31.086289 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:31.951495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=907): Launched 18:24:32.295862 run osmo-stp_10.42.42.5(pid=908): Launched 18:24:32.417923 run osmo-msc_10.42.42.6: Starting osmo-msc 18:24:32.959328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=910): Launched 18:24:33.259409 run osmo-msc_10.42.42.6(pid=911): Launched 18:24:33.426119 run osmo-stp_10.42.42.5(pid=908): ERR: Terminated: ERROR {rc=1} [trial-2362↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=908)] 18:24:33.553349 run osmo-stp_10.42.42.5(pid=908): stdout: | (launched: 2022-12-09_18:24:32.231907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:33.681113 run osmo-stp_10.42.42.5(pid=908): stderr: | 20221209182432415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182432415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182432415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182432416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182432418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182432418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182432418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:33.806741 run osmo-stp_10.42.42.5(pid=908): stdout: | (launched: 2022-12-09_18:24:32.231907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:33.926417 run osmo-stp_10.42.42.5(pid=908): stderr: | 20221209182432415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182432415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182432415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182432416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182432418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182432418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182432418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:34.070271 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=908): Process ended prematurely: osmo-stp_10.42.42.5(pid=908) [trial-2362↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=908)] [trial-2362↪smpp↪esme_ms_sms_storeforward.py:30] 18:24:34.078400 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 18:24:34.104667 run osmo-hlr_10.42.42.2(pid=905): ERR: Terminated: ERROR {rc=237} [trial-2362↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=905)] 18:24:34.152394 run osmo-hlr_10.42.42.2(pid=905): stdout: | (launched: 2022-12-09_18:24:30.891139) 18:24:34.201855 run osmo-hlr_10.42.42.2(pid=905): stderr: | 20221209182431347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182431347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182431347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182431347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182431347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182431348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182431376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182431417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182431418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182431419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:34.270530 run osmo-msc_10.42.42.6(pid=911): ERR: Terminated: ERROR {rc=2} [trial-2362↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=911)] 18:24:34.318176 run osmo-msc_10.42.42.6(pid=911): stdout: | (launched: 2022-12-09_18:24:33.204371) 18:24:34.367527 run osmo-msc_10.42.42.6(pid=911): stderr: | 20221209182433474 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182433474 DLGLOBAL DEBUG validating counter group 0x7f934f45dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182433475 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182433475 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182433475 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182433475 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182433477 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182433477 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182433478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182433478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:24:34.417492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=904): Terminating (SIGTERM) 18:24:34.457375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=907): Terminating (SIGTERM) 18:24:34.497266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=910): Terminating (SIGTERM) 18:24:34.537682 --- ParallelTerminationStrategy: PID 904 died... 18:24:34.556610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=904): Terminated: ok {rc=0} 18:24:34.601042 --- ParallelTerminationStrategy: PID 907 died... 18:24:34.619433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=907): Terminated: ok {rc=0} 18:24:34.663491 --- ParallelTerminationStrategy: PID 910 died... 18:24:34.681961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=910): Terminated: ok {rc=0} 18:24:34.768688 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 smpp esme_ms_sms_transaction.py ---------------------------------------------- 18:24:35.855723 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:35.866625 tst smpp: Using 1 x bts (candidates: 1) 18:24:35.904714 tst esme_ms_sms_transaction.py: using LAC 22870 18:24:36.033089 tst esme_ms_sms_transaction.py: using RAC 175 18:24:36.158248 tst esme_ms_sms_transaction.py: using CellId 22870 18:24:36.284675 tst esme_ms_sms_transaction.py: using BVCI 22871 18:24:36.402234 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:36.413397 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:36.424083 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:36.434627 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:36.445239 tst smpp: Using 1 x ip_address (candidates: 6) 18:24:36.455608 tst smpp: Using 1 x modem (candidates: 1) 18:24:36.588399 tst esme_ms_sms_transaction.py: using MSISDN 7319 18:24:36.705474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:37.202272 run create_hlr_db(pid=913): Launched 18:24:37.333651 bus /sierra_2: Setting Powered False 18:24:38.397449 run create_hlr_db(pid=913): Terminated: ok {rc=0} 18:24:38.826813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=915): Launched 18:24:39.129432 run osmo-hlr_10.42.42.2(pid=916): Launched 18:24:39.244559 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:39.766126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=918): Launched 18:24:40.066115 run osmo-stp_10.42.42.5(pid=919): Launched 18:24:40.180894 run osmo-msc_10.42.42.6: Starting osmo-msc 18:24:40.724157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=921): Launched 18:24:41.025893 run osmo-msc_10.42.42.6(pid=922): Launched 18:24:41.194402 run osmo-stp_10.42.42.5(pid=919): ERR: Terminated: ERROR {rc=1} [trial-2362↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=919)] 18:24:41.326170 run osmo-stp_10.42.42.5(pid=919): stdout: | (launched: 2022-12-09_18:24:40.011309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:41.453851 run osmo-stp_10.42.42.5(pid=919): stderr: | 20221209182440182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182440182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182440183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182440183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182440183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182440184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182440184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:41.578817 run osmo-stp_10.42.42.5(pid=919): stdout: | (launched: 2022-12-09_18:24:40.011309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:41.698405 run osmo-stp_10.42.42.5(pid=919): stderr: | 20221209182440182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182440182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182440183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182440183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182440183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182440184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182440184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:41.841491 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=919): Process ended prematurely: osmo-stp_10.42.42.5(pid=919) [trial-2362↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=919)] [trial-2362↪smpp↪esme_ms_sms_transaction.py:28] 18:24:41.849726 tst esme_ms_sms_transaction.py:28: Test FAILED (6.0 sec) 18:24:41.876237 run osmo-hlr_10.42.42.2(pid=916): ERR: Terminated: ERROR {rc=237} [trial-2362↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=916)] 18:24:41.924460 run osmo-hlr_10.42.42.2(pid=916): stdout: | (launched: 2022-12-09_18:24:39.073479) 18:24:41.974326 run osmo-hlr_10.42.42.2(pid=916): stderr: | 20221209182439253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182439253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182439253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182439253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182439253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182439253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182439264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182439273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182439273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182439273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:42.044024 run osmo-msc_10.42.42.6(pid=922): ERR: Terminated: ERROR {rc=2} [trial-2362↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=922)] 18:24:42.092091 run osmo-msc_10.42.42.6(pid=922): stdout: | (launched: 2022-12-09_18:24:40.970572) 18:24:42.142187 run osmo-msc_10.42.42.6(pid=922): stderr: | 20221209182441240 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182441241 DLGLOBAL DEBUG validating counter group 0x7f6d26fd8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182441241 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182441241 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182441241 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182441241 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182441243 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182441243 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182441244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182441244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:24:42.192299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=915): Terminating (SIGTERM) 18:24:42.232238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=918): Terminating (SIGTERM) 18:24:42.272237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=921): Terminating (SIGTERM) 18:24:42.312506 --- ParallelTerminationStrategy: PID 915 died... 18:24:42.331454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=915): Terminated: ok {rc=0} 18:24:42.376061 --- ParallelTerminationStrategy: PID 918 died... 18:24:42.394490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=918): Terminated: ok {rc=0} 18:24:42.438601 --- ParallelTerminationStrategy: PID 921 died... 18:24:42.457075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=921): Terminated: ok {rc=0} 18:24:42.540350 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 encryption --------------------------------------------------------------------- 18:24:43.728172 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:24:43.731443 tst encryption: Verifying 1 x bts (candidates: 11) 18:24:43.751728 tst encryption: Verifying 6 x ip_address (candidates: 9) 18:24:43.778282 tst encryption: Verifying 1 x modem (candidates: 12) 18:24:43.813898 tst encryption: Reserving 1 x bts (candidates: 11) 18:24:43.835739 tst encryption: Reserving 6 x ip_address (candidates: 9) 18:24:43.863037 tst encryption: Reserving 1 x modem (candidates: 12) 18:24:44.387813 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2362 encryption register_a5_0_authopt.py ---------------------------------------------- 18:24:44.439064 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:44.449443 tst encryption: Using 1 x bts (candidates: 1) 18:24:44.485195 tst register_a5_0_authopt.py: using LAC 22871 18:24:44.616055 tst register_a5_0_authopt.py: using RAC 176 18:24:44.746987 tst register_a5_0_authopt.py: using CellId 22871 18:24:44.874259 tst register_a5_0_authopt.py: using BVCI 22872 18:24:44.992168 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:45.003207 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:45.014110 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:45.025497 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:45.036485 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:45.047509 tst encryption: Using 1 x modem (candidates: 1) 18:24:45.166546 tst register_a5_0_authopt.py:8: start network... 18:24:45.388796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:45.899928 run create_hlr_db(pid=927): Launched 18:24:46.064359 bus /sierra_2: Setting Powered False 18:24:47.143211 run create_hlr_db(pid=927): Terminated: ok {rc=0} 18:24:47.625171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=929): Launched 18:24:47.950105 run osmo-hlr_10.42.42.2(pid=930): Launched 18:24:48.073591 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:48.632038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=932): Launched 18:24:48.955221 run osmo-stp_10.42.42.5(pid=933): Launched 18:24:49.078052 run osmo-msc_10.42.42.6: Starting osmo-msc 18:24:49.664666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=936): Launched 18:24:49.988534 run osmo-msc_10.42.42.6(pid=937): Launched 18:24:50.170320 run osmo-stp_10.42.42.5(pid=933): ERR: Terminated: ERROR {rc=1} [trial-2362↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=933)] 18:24:50.307866 run osmo-stp_10.42.42.5(pid=933): stdout: | (launched: 2022-12-09_18:24:48.896379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:50.445216 run osmo-stp_10.42.42.5(pid=933): stderr: | 20221209182449090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182449091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182449091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182449091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182449092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182449092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182449092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:50.581295 run osmo-stp_10.42.42.5(pid=933): stdout: | (launched: 2022-12-09_18:24:48.896379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:50.710399 run osmo-stp_10.42.42.5(pid=933): stderr: | 20221209182449090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182449091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182449091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182449091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182449092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182449092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182449092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:50.864554 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=933): Process ended prematurely: osmo-stp_10.42.42.5(pid=933) [trial-2362↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=933)] [trial-2362↪encryption↪register_a5_0_authopt.py:8] 18:24:50.874338 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 18:24:50.901966 run osmo-hlr_10.42.42.2(pid=930): ERR: Terminated: ERROR {rc=237} [trial-2362↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=930)] 18:24:50.951941 run osmo-hlr_10.42.42.2(pid=930): stdout: | (launched: 2022-12-09_18:24:47.891147) 18:24:51.003824 run osmo-hlr_10.42.42.2(pid=930): stderr: | 20221209182448090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182448090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182448090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182448090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182448091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182448091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182448102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182448110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182448110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182448111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:51.076226 run osmo-msc_10.42.42.6(pid=937): ERR: Terminated: ERROR {rc=2} [trial-2362↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=937)] 18:24:51.125963 run osmo-msc_10.42.42.6(pid=937): stdout: | (launched: 2022-12-09_18:24:49.929536) 18:24:51.177544 run osmo-msc_10.42.42.6(pid=937): stderr: | 20221209182450254 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182450254 DLGLOBAL DEBUG validating counter group 0x7f7b29928c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182450255 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182450255 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182450255 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182450255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182450257 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182450257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182450257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182450257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:24:51.229621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=929): Terminating (SIGTERM) 18:24:51.271867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=932): Terminating (SIGTERM) 18:24:51.314262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=936): Terminating (SIGTERM) 18:24:51.356245 --- ParallelTerminationStrategy: PID 929 died... 18:24:51.376158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=929): Terminated: ok {rc=0} 18:24:51.422675 --- ParallelTerminationStrategy: PID 932 died... 18:24:51.442220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=932): Terminated: ok {rc=0} 18:24:51.488280 --- ParallelTerminationStrategy: PID 936 died... 18:24:51.507680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=936): Terminated: ok {rc=0} 18:24:51.594824 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 encryption register_a5_0_authreq.py ---------------------------------------------- 18:24:52.742587 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:52.753590 tst encryption: Using 1 x bts (candidates: 1) 18:24:52.795135 tst register_a5_0_authreq.py: using LAC 22872 18:24:52.914767 tst register_a5_0_authreq.py: using RAC 177 18:24:53.032779 tst register_a5_0_authreq.py: using CellId 22872 18:24:53.149996 tst register_a5_0_authreq.py: using BVCI 22873 18:24:53.260070 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:53.270582 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:53.280850 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:53.291840 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:53.302862 tst encryption: Using 1 x ip_address (candidates: 6) 18:24:53.313880 tst encryption: Using 1 x modem (candidates: 1) 18:24:53.434146 tst register_a5_0_authreq.py:8: start network... 18:24:53.654882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:54.157729 run create_hlr_db(pid=939): Launched 18:24:54.289852 bus /sierra_2: Setting Powered False 18:24:55.354435 run create_hlr_db(pid=939): Terminated: ok {rc=0} 18:24:55.806834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=941): Launched 18:24:56.132496 run osmo-hlr_10.42.42.2(pid=942): Launched 18:24:56.257388 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:56.818102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=944): Launched 18:24:57.142050 run osmo-stp_10.42.42.5(pid=945): Launched 18:24:57.266927 run osmo-msc_10.42.42.6: Starting osmo-msc 18:24:57.853609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=947): Launched 18:24:58.181183 run osmo-msc_10.42.42.6(pid=948): Launched 18:24:58.362913 run osmo-stp_10.42.42.5(pid=945): ERR: Terminated: ERROR {rc=1} [trial-2362↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=945)] 18:24:58.501220 run osmo-stp_10.42.42.5(pid=945): stdout: | (launched: 2022-12-09_18:24:57.083194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:58.638896 run osmo-stp_10.42.42.5(pid=945): stderr: | 20221209182457275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182457275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182457275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182457276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182457276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182457276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182457276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:58.775376 run osmo-stp_10.42.42.5(pid=945): stdout: | (launched: 2022-12-09_18:24:57.083194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:58.904499 run osmo-stp_10.42.42.5(pid=945): stderr: | 20221209182457275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182457275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182457275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182457276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182457276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182457276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182457276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:59.059167 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=945): Process ended prematurely: osmo-stp_10.42.42.5(pid=945) [trial-2362↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=945)] [trial-2362↪encryption↪register_a5_0_authreq.py:8] 18:24:59.068658 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 18:24:59.096295 run osmo-hlr_10.42.42.2(pid=942): ERR: Terminated: ERROR {rc=237} [trial-2362↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=942)] 18:24:59.146204 run osmo-hlr_10.42.42.2(pid=942): stdout: | (launched: 2022-12-09_18:24:56.073611) 18:24:59.198332 run osmo-hlr_10.42.42.2(pid=942): stderr: | 20221209182456273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182456273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182456273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182456273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182456273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182456274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182456286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182456294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182456294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182456295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:59.271268 run osmo-msc_10.42.42.6(pid=948): ERR: Terminated: ERROR {rc=2} [trial-2362↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=948)] 18:24:59.321544 run osmo-msc_10.42.42.6(pid=948): stdout: | (launched: 2022-12-09_18:24:58.120280) 18:24:59.373534 run osmo-msc_10.42.42.6(pid=948): stderr: | 20221209182458441 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182458442 DLGLOBAL DEBUG validating counter group 0x7fe2fae75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182458442 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182458442 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182458442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182458442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182458446 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182458446 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182458446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182458446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:24:59.425560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=941): Terminating (SIGTERM) 18:24:59.467438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=944): Terminating (SIGTERM) 18:24:59.509605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=947): Terminating (SIGTERM) 18:24:59.551830 --- ParallelTerminationStrategy: PID 941 died... 18:24:59.571405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=941): Terminated: ok {rc=0} 18:24:59.617793 --- ParallelTerminationStrategy: PID 944 died... 18:24:59.637332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=944): Terminated: ok {rc=0} 18:24:59.683558 --- ParallelTerminationStrategy: PID 947 died... 18:24:59.703740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=947): Terminated: ok {rc=0} 18:24:59.790623 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 encryption register_a5_1_authreq.py ---------------------------------------------- 18:25:00.957859 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:00.970548 tst encryption: Using 1 x bts (candidates: 1) 18:25:01.011398 tst register_a5_1_authreq.py: using LAC 22873 18:25:01.144818 tst register_a5_1_authreq.py: using RAC 178 18:25:01.271112 tst register_a5_1_authreq.py: using CellId 22873 18:25:01.394337 tst register_a5_1_authreq.py: using BVCI 22874 18:25:01.515620 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:01.527565 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:01.539056 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:01.551060 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:01.564923 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:01.578868 tst encryption: Using 1 x modem (candidates: 1) 18:25:01.704801 tst register_a5_1_authreq.py:8: start network... 18:25:01.980690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:02.488769 run create_hlr_db(pid=954): Launched 18:25:02.620099 bus /sierra_2: Setting Powered False 18:25:03.683182 run create_hlr_db(pid=954): Terminated: ok {rc=0} 18:25:04.134909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=958): Launched 18:25:04.459798 run osmo-hlr_10.42.42.2(pid=959): Launched 18:25:04.583517 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:05.146612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=961): Launched 18:25:05.472929 run osmo-stp_10.42.42.5(pid=962): Launched 18:25:05.597471 run osmo-msc_10.42.42.6: Starting osmo-msc 18:25:06.182832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=964): Launched 18:25:06.508081 run osmo-msc_10.42.42.6(pid=965): Launched 18:25:06.688810 run osmo-stp_10.42.42.5(pid=962): ERR: Terminated: ERROR {rc=1} [trial-2362↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=962)] 18:25:06.825954 run osmo-stp_10.42.42.5(pid=962): stdout: | (launched: 2022-12-09_18:25:05.413691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:06.963064 run osmo-stp_10.42.42.5(pid=962): stderr: | 20221209182505606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182505606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182505606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182505607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182505609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182505609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182505609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:07.099580 run osmo-stp_10.42.42.5(pid=962): stdout: | (launched: 2022-12-09_18:25:05.413691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:07.228523 run osmo-stp_10.42.42.5(pid=962): stderr: | 20221209182505606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182505606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182505606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182505607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182505609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182505609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182505609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:07.384364 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=962): Process ended prematurely: osmo-stp_10.42.42.5(pid=962) [trial-2362↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=962)] [trial-2362↪encryption↪register_a5_1_authreq.py:8] 18:25:07.393946 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 18:25:07.421499 run osmo-hlr_10.42.42.2(pid=959): ERR: Terminated: ERROR {rc=237} [trial-2362↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=959)] 18:25:07.471421 run osmo-hlr_10.42.42.2(pid=959): stdout: | (launched: 2022-12-09_18:25:04.400794) 18:25:07.523774 run osmo-hlr_10.42.42.2(pid=959): stderr: | 20221209182504601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182504601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182504601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182504601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182504601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182504601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182504614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182504622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182504623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182504623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:07.595737 run osmo-msc_10.42.42.6(pid=965): ERR: Terminated: ERROR {rc=2} [trial-2362↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=965)] 18:25:07.645643 run osmo-msc_10.42.42.6(pid=965): stdout: | (launched: 2022-12-09_18:25:06.448701) 18:25:07.697322 run osmo-msc_10.42.42.6(pid=965): stderr: | 20221209182506771 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182506771 DLGLOBAL DEBUG validating counter group 0x7fc5c1c9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182506771 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182506771 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182506771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182506772 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182506776 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182506776 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182506777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182506777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:25:07.749273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=958): Terminating (SIGTERM) 18:25:07.791004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=961): Terminating (SIGTERM) 18:25:07.832817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=964): Terminating (SIGTERM) 18:25:07.874976 --- ParallelTerminationStrategy: PID 958 died... 18:25:07.894540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=958): Terminated: ok {rc=0} 18:25:07.940499 --- ParallelTerminationStrategy: PID 961 died... 18:25:07.959885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=961): Terminated: ok {rc=0} 18:25:08.005513 --- ParallelTerminationStrategy: PID 964 died... 18:25:08.024789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=964): Terminated: ok {rc=0} 18:25:08.112340 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2362 encryption register_a5_3_authreq.py ---------------------------------------------- 18:25:09.262764 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:09.274314 tst encryption: Using 1 x bts (candidates: 1) 18:25:09.311141 tst register_a5_3_authreq.py: using LAC 22874 18:25:09.439832 tst register_a5_3_authreq.py: using RAC 179 18:25:09.569483 tst register_a5_3_authreq.py: using CellId 22874 18:25:09.696931 tst register_a5_3_authreq.py: using BVCI 22875 18:25:09.814636 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:09.825770 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:09.836652 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:09.847520 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:09.858349 tst encryption: Using 1 x ip_address (candidates: 6) 18:25:09.869101 tst encryption: Using 1 x modem (candidates: 1) 18:25:09.998466 tst register_a5_3_authreq.py:8: start network... 18:25:10.203390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:10.673349 run create_hlr_db(pid=967): Launched 18:25:10.790462 bus /sierra_2: Setting Powered False 18:25:11.850508 run create_hlr_db(pid=967): Terminated: ok {rc=0} 18:25:12.294432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=969): Launched 18:25:12.618095 run osmo-hlr_10.42.42.2(pid=970): Launched 18:25:12.741776 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:13.303987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=972): Launched 18:25:13.628760 run osmo-stp_10.42.42.5(pid=973): Launched 18:25:13.752682 run osmo-msc_10.42.42.6: Starting osmo-msc 18:25:14.338683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=975): Launched 18:25:14.662220 run osmo-msc_10.42.42.6(pid=976): Launched 18:25:14.842742 run osmo-stp_10.42.42.5(pid=973): ERR: Terminated: ERROR {rc=1} [trial-2362↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=973)] 18:25:14.979284 run osmo-stp_10.42.42.5(pid=973): stdout: | (launched: 2022-12-09_18:25:13.569774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:15.116693 run osmo-stp_10.42.42.5(pid=973): stderr: | 20221209182513763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182513763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182513763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182513763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182513764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182513764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182513764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:15.252344 run osmo-stp_10.42.42.5(pid=973): stdout: | (launched: 2022-12-09_18:25:13.569774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:15.382217 run osmo-stp_10.42.42.5(pid=973): stderr: | 20221209182513763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182513763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182513763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182513763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182513764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182513764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182513764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:15.536712 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=973): Process ended prematurely: osmo-stp_10.42.42.5(pid=973) [trial-2362↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=973)] [trial-2362↪encryption↪register_a5_3_authreq.py:8] 18:25:15.546240 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 18:25:15.573633 run osmo-hlr_10.42.42.2(pid=970): ERR: Terminated: ERROR {rc=237} [trial-2362↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=970)] 18:25:15.623515 run osmo-hlr_10.42.42.2(pid=970): stdout: | (launched: 2022-12-09_18:25:12.559495) 18:25:15.675284 run osmo-hlr_10.42.42.2(pid=970): stderr: | 20221209182512755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182512755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182512755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182512755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182512755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182512755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182512768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182512778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182512778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182512779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:15.747496 run osmo-msc_10.42.42.6(pid=976): ERR: Terminated: ERROR {rc=2} [trial-2362↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=976)] 18:25:15.797232 run osmo-msc_10.42.42.6(pid=976): stdout: | (launched: 2022-12-09_18:25:14.603579) 18:25:15.848657 run osmo-msc_10.42.42.6(pid=976): stderr: | 20221209182514925 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182514925 DLGLOBAL DEBUG validating counter group 0x7f0f9fcd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182514925 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182514925 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182514926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182514926 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182514927 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182514928 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182514928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182514928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:25:15.904098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=969): Terminating (SIGTERM) 18:25:15.946182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=972): Terminating (SIGTERM) 18:25:15.988385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=975): Terminating (SIGTERM) 18:25:16.030797 --- ParallelTerminationStrategy: PID 969 died... 18:25:16.050452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=969): Terminated: ok {rc=0} 18:25:16.097190 --- ParallelTerminationStrategy: PID 972 died... 18:25:16.117063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=972): Terminated: ok {rc=0} 18:25:16.163344 --- ParallelTerminationStrategy: PID 975 died... 18:25:16.183194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=975): Terminated: ok {rc=0} 18:25:16.272024 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 18:25:17.478322 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:25:17.483536 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 18:25:17.501746 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 18:25:17.530691 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 18:25:17.561591 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 18:25:17.580500 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 18:25:17.607497 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 18:25:18.115303 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2362 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 18:25:18.120169 tst handover.py:11: TEST_CONFIG: {} 18:25:18.338506 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:25:18.355023 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:25:18.378902 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:25:18.427628 tst handover.py: using MSISDN 7320 18:25:18.539848 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7320', subscriber_id=0} 18:25:18.645758 run srsepc_10.42.42.118: Starting srsepc 18:25:20.464658 run rm-remote-dir(pid=981): Launched 18:25:20.586560 bus /sierra_2: Setting Powered False 18:25:21.650734 run rm-remote-dir(pid=981): Terminated: ok {rc=0} 18:25:22.108354 run mk-remote-dir(pid=982): Launched 18:25:23.297178 run mk-remote-dir(pid=982): Terminated: ok {rc=0} 18:25:23.604444 run scp-inst-to-remote(pid=983): Launched 18:25:25.788867 run scp-inst-to-remote(pid=983): Terminated: ok {rc=0} 18:25:26.119205 run rm-remote-dir(pid=985): Launched 18:25:27.298723 run rm-remote-dir(pid=985): Terminated: ok {rc=0} 18:25:27.631391 run mk-remote-dir(pid=986): Launched 18:25:28.810357 run mk-remote-dir(pid=986): Terminated: ok {rc=0} 18:25:29.093365 run scp-cfg-to-remote(pid=988): Launched 18:25:30.269597 run scp-cfg-to-remote(pid=988): Terminated: ok {rc=0} 18:25:30.550911 run scp-db-to-remote(pid=990): Launched 18:25:31.742374 run scp-db-to-remote(pid=990): Terminated: ok {rc=0} 18:25:31.914345 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:25:32.255170 run patchelf(pid=996): Launched 18:25:33.431319 run patchelf(pid=996): Terminated: ok {rc=0} 18:25:33.561552 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:25:33.865386 run setcap-netadm(pid=997): Launched 18:25:35.040607 run setcap-netadm(pid=997): Terminated: ok {rc=0} 18:25:35.359329 run srsepc(pid=998): Launched 18:25:35.473054 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:25:36.563324 run rm-remote-dir(pid=999): Launched 18:25:36.738873 run srsepc(pid=998): ERR: Terminated: ERROR {rc=127} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=998)] 18:25:36.873198 run srsepc(pid=998): stdout: | (launched: 2022-12-09_18:25:35.303698) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:25:37.006152 run srsepc(pid=998): stderr: | (launched: 2022-12-09_18:25:35.348601) | Connection to 10.42.42.116 closed. 18:25:37.138932 run srsepc(pid=998): stdout: | (launched: 2022-12-09_18:25:35.303698) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:25:37.266483 run srsepc(pid=998): stderr: | (launched: 2022-12-09_18:25:35.348601) | Connection to 10.42.42.116 closed. 18:25:37.417630 run rm-remote-dir(pid=999): Terminating (SIGINT) 18:25:37.593087 run rm-remote-dir(pid=999): Terminated: ok {rc=0} 18:25:37.719321 tst handover.py:37: ERR: Error: srsepc(pid=998): Process ended prematurely: srsepc(pid=998) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=998)] [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 18:25:37.729131 tst handover.py:37: Test FAILED (19.6 sec) 18:25:37.805708 run scp-back-log(pid=1000): Launched 18:25:38.888354 run scp-back-log(pid=1000): ERR: Terminated: ERROR {rc=1} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1000)] 18:25:38.952369 run scp-back-log(pid=1000): stdout: | (launched: 2022-12-09_18:25:37.775385) 18:25:39.017605 run scp-back-log(pid=1000): stderr: | (launched: 2022-12-09_18:25:37.795047) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:25:39.091621 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1000): launch_sync(): local process exited with status 1 [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1000)]') ---------------------------------------------- trial-2362 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 18:25:39.139048 tst iperf3_bidir.py:13: Number of physical ue: 1 18:25:39.358365 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:25:39.401905 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 18:25:39.603760 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:25:39.619414 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:25:39.652309 tst iperf3_bidir.py: using MSISDN 7321 18:25:39.761705 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7321', subscriber_id=0} 18:25:39.866332 run srsepc_10.42.42.118: Starting srsepc 18:25:40.485982 run rm-remote-dir(pid=1002): Launched 18:25:41.665166 run rm-remote-dir(pid=1002): Terminated: ok {rc=0} 18:25:42.000782 run mk-remote-dir(pid=1003): Launched 18:25:43.178923 run mk-remote-dir(pid=1003): Terminated: ok {rc=0} 18:25:43.461576 run scp-inst-to-remote(pid=1004): Launched 18:25:45.644031 run scp-inst-to-remote(pid=1004): Terminated: ok {rc=0} 18:25:46.024023 run rm-remote-dir(pid=1006): Launched 18:25:47.271688 run rm-remote-dir(pid=1006): Terminated: ok {rc=0} 18:25:47.607410 run mk-remote-dir(pid=1007): Launched 18:25:48.788286 run mk-remote-dir(pid=1007): Terminated: ok {rc=0} 18:25:49.071533 run scp-cfg-to-remote(pid=1008): Launched 18:25:50.248488 run scp-cfg-to-remote(pid=1008): Terminated: ok {rc=0} 18:25:50.529718 run scp-db-to-remote(pid=1010): Launched 18:25:51.706377 run scp-db-to-remote(pid=1010): Terminated: ok {rc=0} 18:25:51.836163 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:25:52.141128 run patchelf(pid=1012): Launched 18:25:53.316829 run patchelf(pid=1012): Terminated: ok {rc=0} 18:25:53.447362 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:25:53.752752 run setcap-netadm(pid=1013): Launched 18:25:54.928916 run setcap-netadm(pid=1013): Terminated: ok {rc=0} 18:25:55.248371 run srsepc(pid=1014): Launched 18:25:55.362197 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:25:56.459584 run rm-remote-dir(pid=1015): Launched 18:25:56.635281 run srsepc(pid=1014): ERR: Terminated: ERROR {rc=127} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1014)] 18:25:56.769361 run srsepc(pid=1014): stdout: | (launched: 2022-12-09_18:25:55.192495) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:25:56.902945 run srsepc(pid=1014): stderr: | (launched: 2022-12-09_18:25:55.237642) | Connection to 10.42.42.116 closed. 18:25:57.035857 run srsepc(pid=1014): stdout: | (launched: 2022-12-09_18:25:55.192495) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:25:57.163896 run srsepc(pid=1014): stderr: | (launched: 2022-12-09_18:25:55.237642) | Connection to 10.42.42.116 closed. 18:25:57.315501 run rm-remote-dir(pid=1015): Terminating (SIGINT) 18:25:57.490794 run rm-remote-dir(pid=1015): Terminated: ok {rc=0} 18:25:57.617583 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=1014): Process ended prematurely: srsepc(pid=1014) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1014)] [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 18:25:57.627482 tst iperf3_bidir.py:42: Test FAILED (18.5 sec) 18:25:57.704493 run scp-back-log(pid=1016): Launched 18:25:58.781372 run scp-back-log(pid=1016): ERR: Terminated: ERROR {rc=1} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1016)] 18:25:58.841632 run scp-back-log(pid=1016): stdout: | (launched: 2022-12-09_18:25:57.674100) 18:25:58.903665 run scp-back-log(pid=1016): stderr: | (launched: 2022-12-09_18:25:57.693948) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:25:58.973977 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1016): launch_sync(): local process exited with status 1 [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1016)]') ---------------------------------------------- trial-2362 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 18:25:59.018690 tst iperf3_dl.py:13: Number of physical ue: 1 18:25:59.221781 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:25:59.265691 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 18:25:59.466354 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:25:59.482007 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:25:59.513650 tst iperf3_dl.py: using MSISDN 7322 18:25:59.632020 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7322', subscriber_id=0} 18:25:59.745890 run srsepc_10.42.42.118: Starting srsepc 18:26:00.407137 run rm-remote-dir(pid=1018): Launched 18:26:01.596278 run rm-remote-dir(pid=1018): Terminated: ok {rc=0} 18:26:01.965221 run mk-remote-dir(pid=1019): Launched 18:26:03.208391 run mk-remote-dir(pid=1019): Terminated: ok {rc=0} 18:26:03.510055 run scp-inst-to-remote(pid=1020): Launched 18:26:05.696816 run scp-inst-to-remote(pid=1020): Terminated: ok {rc=0} 18:26:06.049591 run rm-remote-dir(pid=1022): Launched 18:26:07.237862 run rm-remote-dir(pid=1022): Terminated: ok {rc=0} 18:26:07.591964 run mk-remote-dir(pid=1023): Launched 18:26:08.781179 run mk-remote-dir(pid=1023): Terminated: ok {rc=0} 18:26:09.082524 run scp-cfg-to-remote(pid=1024): Launched 18:26:10.267469 run scp-cfg-to-remote(pid=1024): Terminated: ok {rc=0} 18:26:10.567294 run scp-db-to-remote(pid=1026): Launched 18:26:11.753461 run scp-db-to-remote(pid=1026): Terminated: ok {rc=0} 18:26:11.893033 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:26:12.218895 run patchelf(pid=1028): Launched 18:26:13.405746 run patchelf(pid=1028): Terminated: ok {rc=0} 18:26:13.544407 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:26:13.870164 run setcap-netadm(pid=1029): Launched 18:26:15.057171 run setcap-netadm(pid=1029): Terminated: ok {rc=0} 18:26:15.398206 run srsepc(pid=1030): Launched 18:26:15.518335 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:26:16.722122 run rm-remote-dir(pid=1031): Launched 18:26:17.045015 run srsepc(pid=1030): ERR: Terminated: ERROR {rc=127} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1030)] 18:26:17.218020 run srsepc(pid=1030): stdout: | (launched: 2022-12-09_18:26:15.338718) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:17.354283 run srsepc(pid=1030): stderr: | (launched: 2022-12-09_18:26:15.386960) | Connection to 10.42.42.116 closed. 18:26:17.488649 run srsepc(pid=1030): stdout: | (launched: 2022-12-09_18:26:15.338718) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:17.618038 run srsepc(pid=1030): stderr: | (launched: 2022-12-09_18:26:15.386960) | Connection to 10.42.42.116 closed. 18:26:17.770879 run rm-remote-dir(pid=1031): Terminating (SIGINT) 18:26:17.947254 run rm-remote-dir(pid=1031): Terminated: ok {rc=0} 18:26:18.075326 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=1030): Process ended prematurely: srsepc(pid=1030) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1030)] [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 18:26:18.085333 tst iperf3_dl.py:42: Test FAILED (19.1 sec) 18:26:18.162299 run scp-back-log(pid=1032): Launched 18:26:19.239101 run scp-back-log(pid=1032): ERR: Terminated: ERROR {rc=1} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1032)] 18:26:19.299398 run scp-back-log(pid=1032): stdout: | (launched: 2022-12-09_18:26:18.131899) 18:26:19.361465 run scp-back-log(pid=1032): stderr: | (launched: 2022-12-09_18:26:18.151775) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:26:19.431209 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1032): launch_sync(): local process exited with status 1 [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1032)]') ---------------------------------------------- trial-2362 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 18:26:19.475865 tst iperf3_ul.py:13: Number of physical ue: 1 18:26:19.678428 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:26:19.719136 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 18:26:19.921924 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:26:19.937640 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:26:19.970197 tst iperf3_ul.py: using MSISDN 7323 18:26:20.087821 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7323', subscriber_id=0} 18:26:20.200562 run srsepc_10.42.42.118: Starting srsepc 18:26:20.863732 run rm-remote-dir(pid=1034): Launched 18:26:22.052186 run rm-remote-dir(pid=1034): Terminated: ok {rc=0} 18:26:22.406335 run mk-remote-dir(pid=1035): Launched 18:26:23.594158 run mk-remote-dir(pid=1035): Terminated: ok {rc=0} 18:26:23.896068 run scp-inst-to-remote(pid=1036): Launched 18:26:26.080907 run scp-inst-to-remote(pid=1036): Terminated: ok {rc=0} 18:26:26.411056 run rm-remote-dir(pid=1038): Launched 18:26:27.589545 run rm-remote-dir(pid=1038): Terminated: ok {rc=0} 18:26:27.921225 run mk-remote-dir(pid=1039): Launched 18:26:29.099902 run mk-remote-dir(pid=1039): Terminated: ok {rc=0} 18:26:29.382536 run scp-cfg-to-remote(pid=1040): Launched 18:26:30.557499 run scp-cfg-to-remote(pid=1040): Terminated: ok {rc=0} 18:26:30.851238 run scp-db-to-remote(pid=1042): Launched 18:26:32.111310 run scp-db-to-remote(pid=1042): Terminated: ok {rc=0} 18:26:32.283942 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:26:32.614043 run patchelf(pid=1044): Launched 18:26:33.799256 run patchelf(pid=1044): Terminated: ok {rc=0} 18:26:33.938227 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:26:34.264649 run setcap-netadm(pid=1045): Launched 18:26:35.451157 run setcap-netadm(pid=1045): Terminated: ok {rc=0} 18:26:35.792167 run srsepc(pid=1046): Launched 18:26:35.912436 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:26:37.103001 run rm-remote-dir(pid=1047): Launched 18:26:37.289076 run srsepc(pid=1046): ERR: Terminated: ERROR {rc=127} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1046)] 18:26:37.431982 run srsepc(pid=1046): stdout: | (launched: 2022-12-09_18:26:35.733322) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:37.574876 run srsepc(pid=1046): stderr: | (launched: 2022-12-09_18:26:35.781432) | Connection to 10.42.42.116 closed. 18:26:37.717311 run srsepc(pid=1046): stdout: | (launched: 2022-12-09_18:26:35.733322) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:37.854332 run srsepc(pid=1046): stderr: | (launched: 2022-12-09_18:26:35.781432) | Connection to 10.42.42.116 closed. 18:26:38.016713 run rm-remote-dir(pid=1047): Terminating (SIGINT) 18:26:38.204725 run rm-remote-dir(pid=1047): Terminated: ok {rc=0} 18:26:38.341087 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=1046): Process ended prematurely: srsepc(pid=1046) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1046)] [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 18:26:38.351773 tst iperf3_ul.py:42: Test FAILED (18.9 sec) 18:26:38.433523 run scp-back-log(pid=1048): Launched 18:26:39.514086 run scp-back-log(pid=1048): ERR: Terminated: ERROR {rc=1} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1048)] 18:26:39.578538 run scp-back-log(pid=1048): stdout: | (launched: 2022-12-09_18:26:38.401524) 18:26:39.644113 run scp-back-log(pid=1048): stderr: | (launched: 2022-12-09_18:26:38.422344) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:26:39.718169 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1048): launch_sync(): local process exited with status 1 [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1048)]') ---------------------------------------------- trial-2362 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 18:26:39.766653 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:26:39.783678 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:26:39.807547 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:26:39.861203 tst ping.py: using MSISDN 7324 18:26:39.981850 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7324', subscriber_id=0} 18:26:40.095464 run srsepc_10.42.42.118: Starting srsepc 18:26:40.758963 run rm-remote-dir(pid=1050): Launched 18:26:41.944006 run rm-remote-dir(pid=1050): Terminated: ok {rc=0} 18:26:42.275834 run mk-remote-dir(pid=1051): Launched 18:26:43.453594 run mk-remote-dir(pid=1051): Terminated: ok {rc=0} 18:26:43.735751 run scp-inst-to-remote(pid=1052): Launched 18:26:45.936049 run scp-inst-to-remote(pid=1052): Terminated: ok {rc=0} 18:26:46.317612 run rm-remote-dir(pid=1054): Launched 18:26:47.570477 run rm-remote-dir(pid=1054): Terminated: ok {rc=0} 18:26:47.901830 run mk-remote-dir(pid=1055): Launched 18:26:49.079010 run mk-remote-dir(pid=1055): Terminated: ok {rc=0} 18:26:49.360723 run scp-cfg-to-remote(pid=1056): Launched 18:26:50.536553 run scp-cfg-to-remote(pid=1056): Terminated: ok {rc=0} 18:26:50.817390 run scp-db-to-remote(pid=1058): Launched 18:26:51.994763 run scp-db-to-remote(pid=1058): Terminated: ok {rc=0} 18:26:52.124113 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:26:52.427612 run patchelf(pid=1060): Launched 18:26:53.601972 run patchelf(pid=1060): Terminated: ok {rc=0} 18:26:53.731311 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:26:54.034419 run setcap-netadm(pid=1061): Launched 18:26:55.209595 run setcap-netadm(pid=1061): Terminated: ok {rc=0} 18:26:55.527351 run srsepc(pid=1062): Launched 18:26:55.640503 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:26:56.733559 run rm-remote-dir(pid=1063): Launched 18:26:56.909135 run srsepc(pid=1062): ERR: Terminated: ERROR {rc=127} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1062)] 18:26:57.043716 run srsepc(pid=1062): stdout: | (launched: 2022-12-09_18:26:55.471546) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:57.177170 run srsepc(pid=1062): stderr: | (launched: 2022-12-09_18:26:55.516441) | Connection to 10.42.42.116 closed. 18:26:57.310662 run srsepc(pid=1062): stdout: | (launched: 2022-12-09_18:26:55.471546) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:26:57.438720 run srsepc(pid=1062): stderr: | (launched: 2022-12-09_18:26:55.516441) | Connection to 10.42.42.116 closed. 18:26:57.590779 run rm-remote-dir(pid=1063): Terminating (SIGINT) 18:26:57.766511 run rm-remote-dir(pid=1063): Terminated: ok {rc=0} 18:26:57.893265 tst ping.py:16: ERR: Error: srsepc(pid=1062): Process ended prematurely: srsepc(pid=1062) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1062)] [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 18:26:57.903096 tst ping.py:16: Test FAILED (18.1 sec) 18:26:57.980484 run scp-back-log(pid=1064): Launched 18:26:59.057977 run scp-back-log(pid=1064): ERR: Terminated: ERROR {rc=1} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1064)] 18:26:59.118496 run scp-back-log(pid=1064): stdout: | (launched: 2022-12-09_18:26:57.949352) 18:26:59.180412 run scp-back-log(pid=1064): stderr: | (launched: 2022-12-09_18:26:57.969083) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:26:59.250613 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1064): launch_sync(): local process exited with status 1 [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1064)]') ---------------------------------------------- trial-2362 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 18:26:59.296128 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:26:59.312396 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:26:59.334941 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:26:59.385244 tst rrc_idle_mo_ping.py: using MSISDN 7325 18:26:59.496004 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7325', subscriber_id=0} 18:26:59.600214 run srsepc_10.42.42.118: Starting srsepc 18:27:00.215928 run rm-remote-dir(pid=1066): Launched 18:27:01.400830 run rm-remote-dir(pid=1066): Terminated: ok {rc=0} 18:27:01.767845 run mk-remote-dir(pid=1067): Launched 18:27:03.005995 run mk-remote-dir(pid=1067): Terminated: ok {rc=0} 18:27:03.288525 run scp-inst-to-remote(pid=1068): Launched 18:27:05.468937 run scp-inst-to-remote(pid=1068): Terminated: ok {rc=0} 18:27:05.821423 run rm-remote-dir(pid=1070): Launched 18:27:07.009573 run rm-remote-dir(pid=1070): Terminated: ok {rc=0} 18:27:07.364116 run mk-remote-dir(pid=1071): Launched 18:27:08.553052 run mk-remote-dir(pid=1071): Terminated: ok {rc=0} 18:27:08.854601 run scp-cfg-to-remote(pid=1072): Launched 18:27:10.039887 run scp-cfg-to-remote(pid=1072): Terminated: ok {rc=0} 18:27:10.340239 run scp-db-to-remote(pid=1074): Launched 18:27:11.529413 run scp-db-to-remote(pid=1074): Terminated: ok {rc=0} 18:27:11.667779 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:27:11.992234 run patchelf(pid=1076): Launched 18:27:13.177367 run patchelf(pid=1076): Terminated: ok {rc=0} 18:27:13.315461 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:27:13.641182 run setcap-netadm(pid=1077): Launched 18:27:14.826127 run setcap-netadm(pid=1077): Terminated: ok {rc=0} 18:27:15.165879 run srsepc(pid=1078): Launched 18:27:15.285644 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:27:16.541772 run rm-remote-dir(pid=1079): Launched 18:27:16.780313 run srsepc(pid=1078): ERR: Terminated: ERROR {rc=127} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1078)] 18:27:16.972540 run srsepc(pid=1078): stdout: | (launched: 2022-12-09_18:27:15.107085) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:17.118311 run srsepc(pid=1078): stderr: | (launched: 2022-12-09_18:27:15.155051) | Connection to 10.42.42.116 closed. 18:27:17.264565 run srsepc(pid=1078): stdout: | (launched: 2022-12-09_18:27:15.107085) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:17.405548 run srsepc(pid=1078): stderr: | (launched: 2022-12-09_18:27:15.155051) | Connection to 10.42.42.116 closed. 18:27:17.570055 run rm-remote-dir(pid=1079): Terminating (SIGINT) 18:27:17.758044 run rm-remote-dir(pid=1079): Terminated: ok {rc=0} 18:27:17.894003 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=1078): Process ended prematurely: srsepc(pid=1078) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1078)] [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 18:27:17.904664 tst rrc_idle_mo_ping.py:16: Test FAILED (18.6 sec) 18:27:17.988278 run scp-back-log(pid=1080): Launched 18:27:19.068880 run scp-back-log(pid=1080): ERR: Terminated: ERROR {rc=1} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1080)] 18:27:19.132793 run scp-back-log(pid=1080): stdout: | (launched: 2022-12-09_18:27:17.955759) 18:27:19.198693 run scp-back-log(pid=1080): stderr: | (launched: 2022-12-09_18:27:17.976588) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:27:19.272367 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1080): launch_sync(): local process exited with status 1 [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1080)]') ---------------------------------------------- trial-2362 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 18:27:19.320678 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:27:19.338230 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:27:19.362047 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:27:19.412625 tst rrc_idle_mt_ping.py: using MSISDN 7326 18:27:19.532863 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7326', subscriber_id=0} 18:27:19.645697 run srsepc_10.42.42.118: Starting srsepc 18:27:20.306343 run rm-remote-dir(pid=1082): Launched 18:27:21.495727 run rm-remote-dir(pid=1082): Terminated: ok {rc=0} 18:27:21.849753 run mk-remote-dir(pid=1083): Launched 18:27:23.037268 run mk-remote-dir(pid=1083): Terminated: ok {rc=0} 18:27:23.339453 run scp-inst-to-remote(pid=1084): Launched 18:27:25.524129 run scp-inst-to-remote(pid=1084): Terminated: ok {rc=0} 18:27:25.855073 run rm-remote-dir(pid=1086): Launched 18:27:27.033375 run rm-remote-dir(pid=1086): Terminated: ok {rc=0} 18:27:27.365516 run mk-remote-dir(pid=1087): Launched 18:27:28.544714 run mk-remote-dir(pid=1087): Terminated: ok {rc=0} 18:27:28.827773 run scp-cfg-to-remote(pid=1088): Launched 18:27:30.002955 run scp-cfg-to-remote(pid=1088): Terminated: ok {rc=0} 18:27:30.284036 run scp-db-to-remote(pid=1090): Launched 18:27:31.459392 run scp-db-to-remote(pid=1090): Terminated: ok {rc=0} 18:27:31.592880 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:27:31.909658 run patchelf(pid=1092): Launched 18:27:33.142285 run patchelf(pid=1092): Terminated: ok {rc=0} 18:27:33.272120 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:27:33.576318 run setcap-netadm(pid=1093): Launched 18:27:34.751434 run setcap-netadm(pid=1093): Terminated: ok {rc=0} 18:27:35.070906 run srsepc(pid=1094): Launched 18:27:35.184564 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:27:36.349373 run rm-remote-dir(pid=1101): Launched 18:27:36.535404 run srsepc(pid=1094): ERR: Terminated: ERROR {rc=127} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1094)] 18:27:36.677251 run srsepc(pid=1094): stdout: | (launched: 2022-12-09_18:27:35.015052) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:36.819331 run srsepc(pid=1094): stderr: | (launched: 2022-12-09_18:27:35.060136) | Connection to 10.42.42.116 closed. 18:27:36.961226 run srsepc(pid=1094): stdout: | (launched: 2022-12-09_18:27:35.015052) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:27:37.098237 run srsepc(pid=1094): stderr: | (launched: 2022-12-09_18:27:35.060136) | Connection to 10.42.42.116 closed. 18:27:37.260291 run rm-remote-dir(pid=1101): Terminating (SIGINT) 18:27:37.447578 run rm-remote-dir(pid=1101): Terminated: ok {rc=0} 18:27:37.583392 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=1094): Process ended prematurely: srsepc(pid=1094) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1094)] [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 18:27:37.594032 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 18:27:37.675342 run scp-back-log(pid=1102): Launched 18:27:38.755727 run scp-back-log(pid=1102): ERR: Terminated: ERROR {rc=1} [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1102)] 18:27:38.819794 run scp-back-log(pid=1102): stdout: | (launched: 2022-12-09_18:27:37.643501) 18:27:38.885445 run scp-back-log(pid=1102): stderr: | (launched: 2022-12-09_18:27:37.664297) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:27:38.959105 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1102): launch_sync(): local process exited with status 1 [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1102)]') --------------------------------------------------------------------- trial-2362 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 18:27:39.091138 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:27:39.096521 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 18:27:39.138796 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 18:27:39.165748 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 18:27:39.219951 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 18:27:39.262979 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 18:27:39.289719 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 18:27:39.837093 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 18:27:39.842559 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:27:39.853733 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 18:27:39.892199 tst handover.py: using LAC 22875 18:27:40.019164 tst handover.py: using RAC 180 18:27:40.138206 tst handover.py: using CellId 22875 18:27:40.258016 tst handover.py: using BVCI 22876 18:27:40.368239 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 18:27:40.408092 tst handover.py: using LAC 22876 18:27:40.527595 tst handover.py: using RAC 181 18:27:40.645268 tst handover.py: using CellId 22876 18:27:40.763208 tst handover.py: using BVCI 22877 18:27:40.871460 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:27:40.882403 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:27:40.892938 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:27:40.903558 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:27:40.914294 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:27:40.924822 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 18:27:41.043824 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 18:27:41.157808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:27:41.619537 run create_hlr_db(pid=1107): Launched 18:27:42.794903 run create_hlr_db(pid=1107): Terminated: ok {rc=0} 18:27:43.109085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1109): Launched 18:27:43.405056 run osmo-hlr_10.42.42.2(pid=1110): Launched 18:27:43.518194 run osmo-stp_10.42.42.5: Starting osmo-stp 18:27:44.045049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1112): Launched 18:27:44.341879 run osmo-stp_10.42.42.5(pid=1114): Launched 18:27:44.454569 run osmo-msc_10.42.42.6: Starting osmo-msc 18:27:44.992099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1116): Launched 18:27:45.289942 run osmo-msc_10.42.42.6(pid=1117): Launched 18:27:45.455711 run osmo-stp_10.42.42.5(pid=1114): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1114)] 18:27:45.580755 run osmo-stp_10.42.42.5(pid=1114): stdout: | (launched: 2022-12-09_18:27:44.287095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:45.705935 run osmo-stp_10.42.42.5(pid=1114): stderr: | 20221209182744455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182744455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182744455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182744456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182744458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182744458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182744458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:45.830006 run osmo-stp_10.42.42.5(pid=1114): stdout: | (launched: 2022-12-09_18:27:44.287095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:45.963891 run osmo-stp_10.42.42.5(pid=1114): stderr: | 20221209182744455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182744455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182744455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182744456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182744458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182744458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182744458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:46.107550 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1114): Process ended prematurely: osmo-stp_10.42.42.5(pid=1114) [trial-2362↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1114)] [trial-2362↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 18:27:46.116148 tst handover.py:18: Test FAILED (6.3 sec) 18:27:46.142483 run osmo-hlr_10.42.42.2(pid=1110): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1110)] 18:27:46.190530 run osmo-hlr_10.42.42.2(pid=1110): stdout: | (launched: 2022-12-09_18:27:43.350557) 18:27:46.240330 run osmo-hlr_10.42.42.2(pid=1110): stderr: | 20221209182743526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182743526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182743526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182743526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182743526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182743526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182743538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182743547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182743547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182743547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:27:46.309554 run osmo-msc_10.42.42.6(pid=1117): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1117)] 18:27:46.357914 run osmo-msc_10.42.42.6(pid=1117): stdout: | (launched: 2022-12-09_18:27:45.235422) 18:27:46.408125 run osmo-msc_10.42.42.6(pid=1117): stderr: | 20221209182745506 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182745506 DLGLOBAL DEBUG validating counter group 0x7fe155e36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182745506 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182745507 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182745507 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182745507 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182745509 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182745509 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182745509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182745509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:27:46.458489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1109): Terminating (SIGTERM) 18:27:46.499019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1112): Terminating (SIGTERM) 18:27:46.539745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1116): Terminating (SIGTERM) 18:27:46.582158 --- ParallelTerminationStrategy: PID 1109 died... 18:27:46.601175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1109): Terminated: ok {rc=0} 18:27:46.645418 --- ParallelTerminationStrategy: PID 1112 died... 18:27:46.664111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1112): Terminated: ok {rc=0} 18:27:46.708185 --- ParallelTerminationStrategy: PID 1116 died... 18:27:46.726988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1116): Terminated: ok {rc=0} 18:27:46.812195 bus /sierra_3: Setting Powered False 18:27:47.912284 bus /sierra_3: Setting Powered False 18:27:49.027924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 18:27:50.267365 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:27:50.272560 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 18:27:50.311618 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 18:27:50.337839 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 18:27:50.388409 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 18:27:50.426814 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 18:27:50.452528 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 18:27:51.005445 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 18:27:51.010561 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:27:51.021242 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 18:27:51.061251 tst handover.py: using LAC 22877 18:27:51.177410 tst handover.py: using RAC 182 18:27:51.292427 tst handover.py: using CellId 22877 18:27:51.407268 tst handover.py: using BVCI 22878 18:27:51.514392 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 18:27:51.546551 tst handover.py: using LAC 22878 18:27:51.661926 tst handover.py: using RAC 183 18:27:51.776613 tst handover.py: using CellId 22878 18:27:51.910916 tst handover.py: using BVCI 22879 18:27:52.033922 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:27:52.045226 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:27:52.056278 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:27:52.068238 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:27:52.080184 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:27:52.092013 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 18:27:52.209600 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 18:27:52.328403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:27:52.796082 run create_hlr_db(pid=1128): Launched 18:27:52.917425 bus /sierra_2: Setting Powered False 18:27:53.980059 run create_hlr_db(pid=1128): Terminated: ok {rc=0} 18:27:54.398848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Launched 18:27:54.717685 run osmo-hlr_10.42.42.2(pid=1131): Launched 18:27:54.840136 run osmo-stp_10.42.42.5: Starting osmo-stp 18:27:55.364125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Launched 18:27:55.682393 run osmo-stp_10.42.42.5(pid=1139): Launched 18:27:55.804642 run osmo-msc_10.42.42.6: Starting osmo-msc 18:27:56.354804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1141): Launched 18:27:56.674722 run osmo-msc_10.42.42.6(pid=1142): Launched 18:27:56.852926 run osmo-stp_10.42.42.5(pid=1139): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] 18:27:56.987792 run osmo-stp_10.42.42.5(pid=1139): stdout: | (launched: 2022-12-09_18:27:55.624489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:57.123772 run osmo-stp_10.42.42.5(pid=1139): stderr: | 20221209182755816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182755816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182755816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182755817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182755817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182755817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182755817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:57.258547 run osmo-stp_10.42.42.5(pid=1139): stdout: | (launched: 2022-12-09_18:27:55.624489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:57.386463 run osmo-stp_10.42.42.5(pid=1139): stderr: | 20221209182755816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182755816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182755816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182755817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182755817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182755817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182755817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:57.538920 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1139): Process ended prematurely: osmo-stp_10.42.42.5(pid=1139) [trial-2362↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] [trial-2362↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 18:27:57.547761 tst handover.py:18: Test FAILED (6.5 sec) 18:27:57.575620 run osmo-hlr_10.42.42.2(pid=1131): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1131)] 18:27:57.625660 run osmo-hlr_10.42.42.2(pid=1131): stdout: | (launched: 2022-12-09_18:27:54.659775) 18:27:57.677515 run osmo-hlr_10.42.42.2(pid=1131): stderr: | 20221209182754857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182754857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182754857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182754857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182754857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182754857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182754868 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182754876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182754876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182754876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:27:57.749743 run osmo-msc_10.42.42.6(pid=1142): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1142)] 18:27:57.799745 run osmo-msc_10.42.42.6(pid=1142): stdout: | (launched: 2022-12-09_18:27:56.616468) 18:27:57.851420 run osmo-msc_10.42.42.6(pid=1142): stderr: | 20221209182756935 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182756935 DLGLOBAL DEBUG validating counter group 0x7f3bfae0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182756935 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182756935 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182756935 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182756935 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182756937 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182756938 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182756938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182756938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:27:57.903449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Terminating (SIGTERM) 18:27:57.945428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Terminating (SIGTERM) 18:27:57.987292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1141): Terminating (SIGTERM) 18:27:58.030016 --- ParallelTerminationStrategy: PID 1130 died... 18:27:58.050199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Terminated: ok {rc=0} 18:27:58.096275 --- ParallelTerminationStrategy: PID 1133 died... 18:27:58.115570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Terminated: ok {rc=0} 18:27:58.161597 --- ParallelTerminationStrategy: PID 1141 died... 18:27:58.180814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1141): Terminated: ok {rc=0} 18:27:58.268332 bus /sierra_3: Setting Powered False 18:27:59.366740 bus /sierra_3: Setting Powered False 18:28:00.479237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 18:28:01.761656 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:01.767076 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 18:28:01.820704 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 18:28:01.848582 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 18:28:01.899508 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 18:28:01.954237 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 18:28:01.981681 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 18:28:02.533080 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 18:28:02.538660 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:02.549804 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:28:02.588721 tst handover.py: using LAC 22879 18:28:02.713564 tst handover.py: using RAC 184 18:28:02.832309 tst handover.py: using CellId 22879 18:28:02.948596 tst handover.py: using BVCI 22880 18:28:03.055917 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:28:03.103887 tst handover.py: using LAC 22880 18:28:03.222079 tst handover.py: using RAC 185 18:28:03.338667 tst handover.py: using CellId 22880 18:28:03.455240 tst handover.py: using BVCI 22881 18:28:03.574354 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:03.585784 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:03.597182 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:03.609254 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:03.621332 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:28:03.633280 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:28:03.749651 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:28:03.863080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:04.298608 run create_hlr_db(pid=1148): Launched 18:28:04.421460 bus /sierra_2: Setting Powered False 18:28:05.481106 run create_hlr_db(pid=1148): Terminated: ok {rc=0} 18:28:05.888401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Launched 18:28:06.206461 run osmo-hlr_10.42.42.2(pid=1151): Launched 18:28:06.327978 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:06.849110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Launched 18:28:07.167181 run osmo-stp_10.42.42.5(pid=1154): Launched 18:28:07.288700 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:07.837531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1156): Launched 18:28:08.156448 run osmo-msc_10.42.42.6(pid=1157): Launched 18:28:08.334288 run osmo-stp_10.42.42.5(pid=1154): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] 18:28:08.469647 run osmo-stp_10.42.42.5(pid=1154): stdout: | (launched: 2022-12-09_18:28:07.109141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:08.604799 run osmo-stp_10.42.42.5(pid=1154): stderr: | 20221209182807300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182807300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182807300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182807301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182807301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182807301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182807301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:08.739411 run osmo-stp_10.42.42.5(pid=1154): stdout: | (launched: 2022-12-09_18:28:07.109141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:08.866490 run osmo-stp_10.42.42.5(pid=1154): stderr: | 20221209182807300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182807300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182807300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182807301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182807301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182807301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182807301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:09.018352 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1154): Process ended prematurely: osmo-stp_10.42.42.5(pid=1154) [trial-2362↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] [trial-2362↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 18:28:09.027288 tst handover.py:18: Test FAILED (6.5 sec) 18:28:09.055007 run osmo-hlr_10.42.42.2(pid=1151): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1151)] 18:28:09.104878 run osmo-hlr_10.42.42.2(pid=1151): stdout: | (launched: 2022-12-09_18:28:06.148715) 18:28:09.156534 run osmo-hlr_10.42.42.2(pid=1151): stderr: | 20221209182806344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182806344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182806344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182806344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182806344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182806344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182806356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182806364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182806364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182806365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:09.228467 run osmo-msc_10.42.42.6(pid=1157): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1157)] 18:28:09.278364 run osmo-msc_10.42.42.6(pid=1157): stdout: | (launched: 2022-12-09_18:28:08.098257) 18:28:09.329895 run osmo-msc_10.42.42.6(pid=1157): stderr: | 20221209182808419 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182808419 DLGLOBAL DEBUG validating counter group 0x7fe6e91aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182808419 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182808419 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182808419 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182808419 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182808421 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182808422 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182808422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182808422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:09.382014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Terminating (SIGTERM) 18:28:09.424199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Terminating (SIGTERM) 18:28:09.466146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1156): Terminating (SIGTERM) 18:28:09.508062 --- ParallelTerminationStrategy: PID 1150 died... 18:28:09.527894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Terminated: ok {rc=0} 18:28:09.574713 --- ParallelTerminationStrategy: PID 1153 died... 18:28:09.594246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Terminated: ok {rc=0} 18:28:09.640352 --- ParallelTerminationStrategy: PID 1156 died... 18:28:09.659676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1156): Terminated: ok {rc=0} 18:28:09.746202 bus /sierra_3: Setting Powered False 18:28:10.844536 bus /sierra_3: Setting Powered False 18:28:11.960842 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 18:28:13.220876 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:13.227057 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 18:28:13.278080 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:28:13.305279 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:28:13.359235 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 18:28:13.410263 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:28:13.437201 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:28:13.987686 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 18:28:13.993219 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:28:14.004497 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:28:14.043853 tst handover.py: using LAC 22881 18:28:14.162503 tst handover.py: using RAC 186 18:28:14.281371 tst handover.py: using CellId 22881 18:28:14.398970 tst handover.py: using BVCI 22882 18:28:14.506632 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:28:14.550862 tst handover.py: using LAC 22882 18:28:14.669068 tst handover.py: using RAC 187 18:28:14.785884 tst handover.py: using CellId 22882 18:28:14.904859 tst handover.py: using BVCI 22883 18:28:15.012038 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:28:15.023106 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:28:15.033873 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:28:15.044658 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:28:15.055459 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:28:15.066159 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:28:15.184583 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:28:15.300575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:15.737070 run create_hlr_db(pid=1162): Launched 18:28:15.865996 bus /sierra_2: Setting Powered False 18:28:16.924837 run create_hlr_db(pid=1162): Terminated: ok {rc=0} 18:28:17.335879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1164): Launched 18:28:17.655743 run osmo-hlr_10.42.42.2(pid=1165): Launched 18:28:17.777920 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:18.302878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1167): Launched 18:28:18.622158 run osmo-stp_10.42.42.5(pid=1168): Launched 18:28:18.743927 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:19.296816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1170): Launched 18:28:19.616843 run osmo-msc_10.42.42.6(pid=1171): Launched 18:28:19.795488 run osmo-stp_10.42.42.5(pid=1168): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1168)] 18:28:19.931069 run osmo-stp_10.42.42.5(pid=1168): stdout: | (launched: 2022-12-09_18:28:18.564106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:20.066595 run osmo-stp_10.42.42.5(pid=1168): stderr: | 20221209182818754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182818754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182818755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182818755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182818755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182818755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182818755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:20.201548 run osmo-stp_10.42.42.5(pid=1168): stdout: | (launched: 2022-12-09_18:28:18.564106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:20.328548 run osmo-stp_10.42.42.5(pid=1168): stderr: | 20221209182818754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182818754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182818755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182818755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182818755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182818755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182818755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:20.481592 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1168): Process ended prematurely: osmo-stp_10.42.42.5(pid=1168) [trial-2362↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1168)] [trial-2362↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 18:28:20.490672 tst handover.py:18: Test FAILED (6.5 sec) 18:28:20.518678 run osmo-hlr_10.42.42.2(pid=1165): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1165)] 18:28:20.568575 run osmo-hlr_10.42.42.2(pid=1165): stdout: | (launched: 2022-12-09_18:28:17.597665) 18:28:20.621230 run osmo-hlr_10.42.42.2(pid=1165): stderr: | 20221209182817796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182817797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182817797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182817797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182817797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182817797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182817808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182817817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182817817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182817817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:20.693385 run osmo-msc_10.42.42.6(pid=1171): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1171)] 18:28:20.743535 run osmo-msc_10.42.42.6(pid=1171): stdout: | (launched: 2022-12-09_18:28:19.558646) 18:28:20.795220 run osmo-msc_10.42.42.6(pid=1171): stderr: | 20221209182819877 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182819877 DLGLOBAL DEBUG validating counter group 0x7f24c4401c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182819877 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182819877 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182819877 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182819877 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182819879 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182819879 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182819880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182819880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:20.847315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1164): Terminating (SIGTERM) 18:28:20.889661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1167): Terminating (SIGTERM) 18:28:20.931790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1170): Terminating (SIGTERM) 18:28:20.974279 --- ParallelTerminationStrategy: PID 1164 died... 18:28:20.994237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1164): Terminated: ok {rc=0} 18:28:21.041121 --- ParallelTerminationStrategy: PID 1167 died... 18:28:21.060805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1167): Terminated: ok {rc=0} 18:28:21.107539 --- ParallelTerminationStrategy: PID 1170 died... 18:28:21.127108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1170): Terminated: ok {rc=0} 18:28:21.214490 bus /sierra_3: Setting Powered False 18:28:22.312441 bus /sierra_3: Setting Powered False 18:28:23.428839 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:28:24.684714 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:24.690483 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:28:24.745798 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:28:24.773000 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:28:24.826345 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:28:24.881414 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:28:24.908603 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:28:25.460362 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:28:25.465930 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:28:25.477379 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:28:25.516349 tst handover.py: using LAC 22883 18:28:25.641366 tst handover.py: using RAC 188 18:28:25.768334 tst handover.py: using CellId 22883 18:28:25.886696 tst handover.py: using BVCI 22884 18:28:25.996255 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:28:26.045347 tst handover.py: using LAC 22884 18:28:26.164317 tst handover.py: using RAC 189 18:28:26.283052 tst handover.py: using CellId 22884 18:28:26.410702 tst handover.py: using BVCI 22885 18:28:26.526768 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:28:26.538314 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:28:26.549612 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:28:26.561460 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:28:26.573397 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:28:26.585272 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:28:26.700430 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:28:26.814555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:27.251075 run create_hlr_db(pid=1178): Launched 18:28:27.373955 bus /sierra_2: Setting Powered False 18:28:28.433931 run create_hlr_db(pid=1178): Terminated: ok {rc=0} 18:28:28.825366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1180): Launched 18:28:29.124716 run osmo-hlr_10.42.42.2(pid=1181): Launched 18:28:29.238331 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:29.724340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1183): Launched 18:28:30.021744 run osmo-stp_10.42.42.5(pid=1184): Launched 18:28:30.136041 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:30.649364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1186): Launched 18:28:30.959975 run osmo-msc_10.42.42.6(pid=1187): Launched 18:28:31.317886 run osmo-stp_10.42.42.5(pid=1184): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1184)] 18:28:31.472696 run osmo-stp_10.42.42.5(pid=1184): stdout: | (launched: 2022-12-09_18:28:29.967093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:31.771703 run osmo-stp_10.42.42.5(pid=1184): stderr: | 20221209182830136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182830136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182830136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182830137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182830137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182830137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182830137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:31.922411 run osmo-stp_10.42.42.5(pid=1184): stdout: | (launched: 2022-12-09_18:28:29.967093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:32.045502 run osmo-stp_10.42.42.5(pid=1184): stderr: | 20221209182830136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182830136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182830136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182830137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182830137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182830137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182830137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:32.191283 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1184): Process ended prematurely: osmo-stp_10.42.42.5(pid=1184) [trial-2362↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1184)] [trial-2362↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 18:28:32.199855 tst handover.py:18: Test FAILED (6.7 sec) 18:28:32.226155 run osmo-hlr_10.42.42.2(pid=1181): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1181)] 18:28:32.274343 run osmo-hlr_10.42.42.2(pid=1181): stdout: | (launched: 2022-12-09_18:28:29.069581) 18:28:32.324129 run osmo-hlr_10.42.42.2(pid=1181): stderr: | 20221209182829247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182829247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182829247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182829248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182829248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182829248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182829260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182829269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182829269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182829269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:32.393557 run osmo-msc_10.42.42.6(pid=1187): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1187)] 18:28:32.441542 run osmo-msc_10.42.42.6(pid=1187): stdout: | (launched: 2022-12-09_18:28:30.894188) 18:28:32.490776 run osmo-msc_10.42.42.6(pid=1187): stderr: | 20221209182831355 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182831356 DLGLOBAL DEBUG validating counter group 0x7f29bfc8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182831356 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182831356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182831356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182831356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182831365 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182831365 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182831365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182831366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:32.540104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1180): Terminating (SIGTERM) 18:28:32.579614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1183): Terminating (SIGTERM) 18:28:32.619369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1186): Terminating (SIGTERM) 18:28:32.659422 --- ParallelTerminationStrategy: PID 1180 died... 18:28:32.678555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1180): Terminated: ok {rc=0} 18:28:32.722761 --- ParallelTerminationStrategy: PID 1183 died... 18:28:32.741262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1183): Terminated: ok {rc=0} 18:28:32.785543 --- ParallelTerminationStrategy: PID 1186 died... 18:28:32.804184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1186): Terminated: ok {rc=0} 18:28:32.888071 bus /sierra_3: Setting Powered False 18:28:33.986228 bus /sierra_3: Setting Powered False 18:28:35.106829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 18:28:36.373034 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:36.378642 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:28:36.422221 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:28:36.450223 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:28:36.504095 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:28:36.546939 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:28:36.574315 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:28:37.122118 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 18:28:37.127832 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:28:37.139200 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 18:28:37.178693 tst handover.py: using LAC 22885 18:28:37.307948 tst handover.py: using RAC 190 18:28:37.436228 tst handover.py: using CellId 22885 18:28:37.561384 tst handover.py: using BVCI 22886 18:28:37.678506 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 18:28:37.713137 tst handover.py: using LAC 22886 18:28:37.837636 tst handover.py: using RAC 191 18:28:37.960336 tst handover.py: using CellId 22886 18:28:38.082831 tst handover.py: using BVCI 22887 18:28:38.198208 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:28:38.209523 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:28:38.220628 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:28:38.232199 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:28:38.243926 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:28:38.255593 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 18:28:38.371144 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 18:28:38.484635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:38.920346 run create_hlr_db(pid=1192): Launched 18:28:39.043652 bus /sierra_2: Setting Powered False 18:28:40.103064 run create_hlr_db(pid=1192): Terminated: ok {rc=0} 18:28:40.512121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1194): Launched 18:28:40.830102 run osmo-hlr_10.42.42.2(pid=1195): Launched 18:28:40.951379 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:41.474278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1197): Launched 18:28:41.792109 run osmo-stp_10.42.42.5(pid=1198): Launched 18:28:41.913765 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:42.462562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1200): Launched 18:28:42.782536 run osmo-msc_10.42.42.6(pid=1201): Launched 18:28:42.960295 run osmo-stp_10.42.42.5(pid=1198): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1198)] 18:28:43.094031 run osmo-stp_10.42.42.5(pid=1198): stdout: | (launched: 2022-12-09_18:28:41.734340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:43.228551 run osmo-stp_10.42.42.5(pid=1198): stderr: | 20221209182841925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182841925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182841926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182841926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182841927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182841927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182841927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:43.362382 run osmo-stp_10.42.42.5(pid=1198): stdout: | (launched: 2022-12-09_18:28:41.734340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:43.489884 run osmo-stp_10.42.42.5(pid=1198): stderr: | 20221209182841925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182841925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182841926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182841926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182841927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182841927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182841927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:43.641829 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1198): Process ended prematurely: osmo-stp_10.42.42.5(pid=1198) [trial-2362↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1198)] [trial-2362↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 18:28:43.650952 tst handover.py:18: Test FAILED (6.5 sec) 18:28:43.678953 run osmo-hlr_10.42.42.2(pid=1195): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1195)] 18:28:43.729241 run osmo-hlr_10.42.42.2(pid=1195): stdout: | (launched: 2022-12-09_18:28:40.772583) 18:28:43.781272 run osmo-hlr_10.42.42.2(pid=1195): stderr: | 20221209182840970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182840970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182840970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182840970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182840970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182840970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182840982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182840991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182840992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182840992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:43.853449 run osmo-msc_10.42.42.6(pid=1201): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1201)] 18:28:43.903652 run osmo-msc_10.42.42.6(pid=1201): stdout: | (launched: 2022-12-09_18:28:42.724420) 18:28:43.955079 run osmo-msc_10.42.42.6(pid=1201): stderr: | 20221209182843047 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182843047 DLGLOBAL DEBUG validating counter group 0x7f98f8024c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182843048 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182843048 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182843048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182843048 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182843050 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182843050 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182843050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182843050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:44.007164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1194): Terminating (SIGTERM) 18:28:44.049473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1197): Terminating (SIGTERM) 18:28:44.091673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1200): Terminating (SIGTERM) 18:28:44.133979 --- ParallelTerminationStrategy: PID 1194 died... 18:28:44.153776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1194): Terminated: ok {rc=0} 18:28:44.200659 --- ParallelTerminationStrategy: PID 1197 died... 18:28:44.220130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1197): Terminated: ok {rc=0} 18:28:44.266886 --- ParallelTerminationStrategy: PID 1200 died... 18:28:44.286357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1200): Terminated: ok {rc=0} 18:28:44.373235 bus /sierra_3: Setting Powered False 18:28:45.470751 bus /sierra_3: Setting Powered False 18:28:46.589095 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 18:28:47.841106 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:47.846154 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:28:47.898054 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:28:47.923896 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:28:47.973698 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:28:48.027978 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:28:48.055035 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:28:48.606848 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 18:28:48.612183 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:28:48.623259 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:28:48.662464 tst handover.py: using LAC 22887 18:28:48.786709 tst handover.py: using RAC 192 18:28:48.909728 tst handover.py: using CellId 22887 18:28:49.032072 tst handover.py: using BVCI 22888 18:28:49.147704 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:28:49.195052 tst handover.py: using LAC 22888 18:28:49.317712 tst handover.py: using RAC 193 18:28:49.441436 tst handover.py: using CellId 22888 18:28:49.566260 tst handover.py: using BVCI 22889 18:28:49.681768 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:28:49.692838 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:28:49.703870 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:28:49.715123 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:28:49.726504 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:28:49.737666 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:28:49.852530 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:28:49.968427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:50.404397 run create_hlr_db(pid=1206): Launched 18:28:50.526973 bus /sierra_2: Setting Powered False 18:28:51.587074 run create_hlr_db(pid=1206): Terminated: ok {rc=0} 18:28:51.996421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1208): Launched 18:28:52.315574 run osmo-hlr_10.42.42.2(pid=1209): Launched 18:28:52.438082 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:52.961655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1211): Launched 18:28:53.280564 run osmo-stp_10.42.42.5(pid=1212): Launched 18:28:53.402648 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:53.950464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1214): Launched 18:28:54.269894 run osmo-msc_10.42.42.6(pid=1215): Launched 18:28:54.448568 run osmo-stp_10.42.42.5(pid=1212): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1212)] 18:28:54.582867 run osmo-stp_10.42.42.5(pid=1212): stdout: | (launched: 2022-12-09_18:28:53.222478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:54.717754 run osmo-stp_10.42.42.5(pid=1212): stderr: | 20221209182853412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182853412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182853412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182853413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182853413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182853413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182853413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:54.851566 run osmo-stp_10.42.42.5(pid=1212): stdout: | (launched: 2022-12-09_18:28:53.222478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:54.977988 run osmo-stp_10.42.42.5(pid=1212): stderr: | 20221209182853412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182853412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182853412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182853413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182853413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182853413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182853413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:55.129708 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1212): Process ended prematurely: osmo-stp_10.42.42.5(pid=1212) [trial-2362↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1212)] [trial-2362↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 18:28:55.138592 tst handover.py:18: Test FAILED (6.5 sec) 18:28:55.166553 run osmo-hlr_10.42.42.2(pid=1209): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1209)] 18:28:55.217039 run osmo-hlr_10.42.42.2(pid=1209): stdout: | (launched: 2022-12-09_18:28:52.257268) 18:28:55.268584 run osmo-hlr_10.42.42.2(pid=1209): stderr: | 20221209182852453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182852453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182852453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182852453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182852453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182852453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182852465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182852473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182852474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182852474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:55.340833 run osmo-msc_10.42.42.6(pid=1215): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1215)] 18:28:55.391198 run osmo-msc_10.42.42.6(pid=1215): stdout: | (launched: 2022-12-09_18:28:54.211938) 18:28:55.442861 run osmo-msc_10.42.42.6(pid=1215): stderr: | 20221209182854528 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182854529 DLGLOBAL DEBUG validating counter group 0x7f02462a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182854529 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182854529 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182854529 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182854529 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182854531 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182854531 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182854532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182854532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:55.495355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1208): Terminating (SIGTERM) 18:28:55.537143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1211): Terminating (SIGTERM) 18:28:55.578891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1214): Terminating (SIGTERM) 18:28:55.620889 --- ParallelTerminationStrategy: PID 1208 died... 18:28:55.640705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1208): Terminated: ok {rc=0} 18:28:55.687078 --- ParallelTerminationStrategy: PID 1211 died... 18:28:55.706411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1211): Terminated: ok {rc=0} 18:28:55.752570 --- ParallelTerminationStrategy: PID 1214 died... 18:28:55.771844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1214): Terminated: ok {rc=0} 18:28:55.859167 bus /sierra_3: Setting Powered False 18:28:56.955872 bus /sierra_3: Setting Powered False 18:28:58.071844 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 18:28:59.334449 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:59.340101 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:28:59.394588 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:28:59.421562 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:28:59.474170 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:28:59.527517 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:28:59.554492 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:29:00.105903 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 18:29:00.111203 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:00.122400 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:29:00.160771 tst handover.py: using LAC 22889 18:29:00.284285 tst handover.py: using RAC 194 18:29:00.410221 tst handover.py: using CellId 22889 18:29:00.534785 tst handover.py: using BVCI 22890 18:29:00.651661 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:29:00.700291 tst handover.py: using LAC 22890 18:29:00.819924 tst handover.py: using RAC 195 18:29:00.943302 tst handover.py: using CellId 22890 18:29:01.063814 tst handover.py: using BVCI 22891 18:29:01.210555 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:01.223670 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:01.236808 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:01.248874 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:01.262429 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:29:01.276663 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:29:01.399750 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:29:01.530150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:02.037570 run create_hlr_db(pid=1220): Launched 18:29:02.198816 bus /sierra_2: Setting Powered False 18:29:03.262945 run create_hlr_db(pid=1220): Terminated: ok {rc=0} 18:29:03.680003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1222): Launched 18:29:03.998978 run osmo-hlr_10.42.42.2(pid=1223): Launched 18:29:04.120511 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:04.643988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1225): Launched 18:29:04.960930 run osmo-stp_10.42.42.5(pid=1226): Launched 18:29:05.082600 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:05.630767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1228): Launched 18:29:05.949682 run osmo-msc_10.42.42.6(pid=1229): Launched 18:29:06.127665 run osmo-stp_10.42.42.5(pid=1226): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1226)] 18:29:06.262073 run osmo-stp_10.42.42.5(pid=1226): stdout: | (launched: 2022-12-09_18:29:04.903137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:06.397541 run osmo-stp_10.42.42.5(pid=1226): stderr: | 20221209182905096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182905096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182905096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182905097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182905097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182905097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182905097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:06.531671 run osmo-stp_10.42.42.5(pid=1226): stdout: | (launched: 2022-12-09_18:29:04.903137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:06.658683 run osmo-stp_10.42.42.5(pid=1226): stderr: | 20221209182905096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182905096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182905096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182905097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182905097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182905097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182905097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:06.810906 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1226): Process ended prematurely: osmo-stp_10.42.42.5(pid=1226) [trial-2362↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1226)] [trial-2362↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 18:29:06.819698 tst handover.py:18: Test FAILED (6.7 sec) 18:29:06.846891 run osmo-hlr_10.42.42.2(pid=1223): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1223)] 18:29:06.898452 run osmo-hlr_10.42.42.2(pid=1223): stdout: | (launched: 2022-12-09_18:29:03.940470) 18:29:06.950893 run osmo-hlr_10.42.42.2(pid=1223): stderr: | 20221209182904136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182904136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182904136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182904136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182904136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182904136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182904148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182904156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182904157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182904157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:07.023693 run osmo-msc_10.42.42.6(pid=1229): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1229)] 18:29:07.074313 run osmo-msc_10.42.42.6(pid=1229): stdout: | (launched: 2022-12-09_18:29:05.891914) 18:29:07.126579 run osmo-msc_10.42.42.6(pid=1229): stderr: | 20221209182906213 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182906213 DLGLOBAL DEBUG validating counter group 0x7f6a3000bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182906213 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182906213 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182906213 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182906213 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182906215 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182906215 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182906216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182906216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:07.179217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1222): Terminating (SIGTERM) 18:29:07.221557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1225): Terminating (SIGTERM) 18:29:07.264282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1228): Terminating (SIGTERM) 18:29:07.307050 --- ParallelTerminationStrategy: PID 1222 died... 18:29:07.326892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1222): Terminated: ok {rc=0} 18:29:07.374471 --- ParallelTerminationStrategy: PID 1225 died... 18:29:07.394150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1225): Terminated: ok {rc=0} 18:29:07.441607 --- ParallelTerminationStrategy: PID 1228 died... 18:29:07.460921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1228): Terminated: ok {rc=0} 18:29:07.549577 bus /sierra_3: Setting Powered False 18:29:08.648177 bus /sierra_3: Setting Powered False 18:29:09.763671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 18:29:11.019203 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:11.024235 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 18:29:11.060495 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 18:29:11.086664 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 18:29:11.137770 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 18:29:11.173955 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 18:29:11.200329 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 18:29:11.748700 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 18:29:11.754154 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:29:11.765126 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 18:29:11.799639 tst handover.py: using LAC 22891 18:29:11.916859 tst handover.py: using RAC 196 18:29:12.041787 tst handover.py: using CellId 22891 18:29:12.162900 tst handover.py: using BVCI 22892 18:29:12.271828 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 18:29:12.303785 tst handover.py: using LAC 22892 18:29:12.422000 tst handover.py: using RAC 197 18:29:12.536793 tst handover.py: using CellId 22892 18:29:12.651649 tst handover.py: using BVCI 22893 18:29:12.758877 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:29:12.769790 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:29:12.780392 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:29:12.791198 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:29:12.801816 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:29:12.812459 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 18:29:12.926103 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 18:29:13.046325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:13.513390 run create_hlr_db(pid=1235): Launched 18:29:13.636528 bus /sierra_2: Setting Powered False 18:29:14.699497 run create_hlr_db(pid=1235): Terminated: ok {rc=0} 18:29:15.101360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1237): Launched 18:29:15.400781 run osmo-hlr_10.42.42.2(pid=1238): Launched 18:29:15.514263 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:16.029700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1240): Launched 18:29:16.350800 run osmo-stp_10.42.42.5(pid=1241): Launched 18:29:16.604769 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:17.253656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1243): Launched 18:29:17.558490 run osmo-msc_10.42.42.6(pid=1244): Launched 18:29:17.725220 run osmo-stp_10.42.42.5(pid=1241): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1241)] 18:29:17.850369 run osmo-stp_10.42.42.5(pid=1241): stdout: | (launched: 2022-12-09_18:29:16.284682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:17.975618 run osmo-stp_10.42.42.5(pid=1241): stderr: | 20221209182916579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182916580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182916581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182916582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182916583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182916583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182916584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:18.100072 run osmo-stp_10.42.42.5(pid=1241): stdout: | (launched: 2022-12-09_18:29:16.284682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:18.218771 run osmo-stp_10.42.42.5(pid=1241): stderr: | 20221209182916579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182916580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182916581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182916582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182916583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182916583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182916584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:18.360812 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1241): Process ended prematurely: osmo-stp_10.42.42.5(pid=1241) [trial-2362↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1241)] [trial-2362↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 18:29:18.369310 tst handover.py:18: Test FAILED (6.6 sec) 18:29:18.395331 run osmo-hlr_10.42.42.2(pid=1238): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1238)] 18:29:18.442803 run osmo-hlr_10.42.42.2(pid=1238): stdout: | (launched: 2022-12-09_18:29:15.345896) 18:29:18.492336 run osmo-hlr_10.42.42.2(pid=1238): stderr: | 20221209182915520 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182915520 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182915520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182915520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182915520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182915520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182915533 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182915541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182915542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182915542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:18.561074 run osmo-msc_10.42.42.6(pid=1244): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1244)] 18:29:18.608398 run osmo-msc_10.42.42.6(pid=1244): stdout: | (launched: 2022-12-09_18:29:17.503734) 18:29:18.657504 run osmo-msc_10.42.42.6(pid=1244): stderr: | 20221209182917773 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182917773 DLGLOBAL DEBUG validating counter group 0x7fc9b312fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182917773 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182917773 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182917773 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182917774 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182917776 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182917777 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182917777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182917777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:18.706910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1237): Terminating (SIGTERM) 18:29:18.746273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1240): Terminating (SIGTERM) 18:29:18.785762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1243): Terminating (SIGTERM) 18:29:18.825588 --- ParallelTerminationStrategy: PID 1237 died... 18:29:18.844698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1237): Terminated: ok {rc=0} 18:29:18.889014 --- ParallelTerminationStrategy: PID 1240 died... 18:29:18.907531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1240): Terminated: ok {rc=0} 18:29:18.951635 --- ParallelTerminationStrategy: PID 1243 died... 18:29:18.970441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1243): Terminated: ok {rc=0} 18:29:19.056063 bus /sierra_3: Setting Powered False 18:29:20.156020 bus /sierra_3: Setting Powered False 18:29:21.271515 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 18:29:22.511998 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:22.517275 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 18:29:22.566744 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 18:29:22.593047 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 18:29:22.645724 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 18:29:22.695471 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 18:29:22.721301 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 18:29:23.268614 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 18:29:23.274033 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:29:23.284735 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:29:23.318920 tst handover.py: using LAC 22893 18:29:23.436741 tst handover.py: using RAC 198 18:29:23.553798 tst handover.py: using CellId 22893 18:29:23.672111 tst handover.py: using BVCI 22894 18:29:23.779660 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:29:23.827144 tst handover.py: using LAC 22894 18:29:23.945699 tst handover.py: using RAC 199 18:29:24.062286 tst handover.py: using CellId 22894 18:29:24.180643 tst handover.py: using BVCI 22895 18:29:24.288408 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:29:24.299149 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:29:24.309711 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:29:24.320317 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:29:24.331103 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:29:24.341718 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:29:24.459120 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:29:24.577725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:25.045329 run create_hlr_db(pid=1249): Launched 18:29:25.167825 bus /sierra_2: Setting Powered False 18:29:26.231057 run create_hlr_db(pid=1249): Terminated: ok {rc=0} 18:29:26.650222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1251): Launched 18:29:26.969990 run osmo-hlr_10.42.42.2(pid=1252): Launched 18:29:27.092705 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:27.618788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1254): Launched 18:29:27.938389 run osmo-stp_10.42.42.5(pid=1255): Launched 18:29:28.060462 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:28.609793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1257): Launched 18:29:28.928904 run osmo-msc_10.42.42.6(pid=1258): Launched 18:29:29.107088 run osmo-stp_10.42.42.5(pid=1255): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1255)] 18:29:29.241748 run osmo-stp_10.42.42.5(pid=1255): stdout: | (launched: 2022-12-09_18:29:27.880401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:29.377410 run osmo-stp_10.42.42.5(pid=1255): stderr: | 20221209182928071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182928071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182928072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182928072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182928073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182928073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182928073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:29.512338 run osmo-stp_10.42.42.5(pid=1255): stdout: | (launched: 2022-12-09_18:29:27.880401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:29.638971 run osmo-stp_10.42.42.5(pid=1255): stderr: | 20221209182928071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182928071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182928072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182928072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182928073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182928073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182928073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:29.790512 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1255): Process ended prematurely: osmo-stp_10.42.42.5(pid=1255) [trial-2362↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1255)] [trial-2362↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 18:29:29.799415 tst handover.py:18: Test FAILED (6.5 sec) 18:29:29.827352 run osmo-hlr_10.42.42.2(pid=1252): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1252)] 18:29:29.877558 run osmo-hlr_10.42.42.2(pid=1252): stdout: | (launched: 2022-12-09_18:29:26.912046) 18:29:29.929422 run osmo-hlr_10.42.42.2(pid=1252): stderr: | 20221209182927109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182927109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182927109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182927110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182927110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182927110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182927123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182927133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182927133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182927133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:30.001346 run osmo-msc_10.42.42.6(pid=1258): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1258)] 18:29:30.051134 run osmo-msc_10.42.42.6(pid=1258): stdout: | (launched: 2022-12-09_18:29:28.870538) 18:29:30.102935 run osmo-msc_10.42.42.6(pid=1258): stderr: | 20221209182929190 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182929190 DLGLOBAL DEBUG validating counter group 0x7fb0f1872c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182929191 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182929191 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182929191 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182929191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182929193 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182929193 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182929193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182929193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:30.155218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1251): Terminating (SIGTERM) 18:29:30.197054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1254): Terminating (SIGTERM) 18:29:30.238891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1257): Terminating (SIGTERM) 18:29:30.281042 --- ParallelTerminationStrategy: PID 1251 died... 18:29:30.300824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1251): Terminated: ok {rc=0} 18:29:30.347595 --- ParallelTerminationStrategy: PID 1254 died... 18:29:30.367152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1254): Terminated: ok {rc=0} 18:29:30.414218 --- ParallelTerminationStrategy: PID 1257 died... 18:29:30.433645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1257): Terminated: ok {rc=0} 18:29:30.522979 bus /sierra_3: Setting Powered False 18:29:31.631411 bus /sierra_3: Setting Powered False 18:29:32.763692 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 18:29:34.026349 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:34.033773 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 18:29:34.081888 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:29:34.109083 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:29:34.159099 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 18:29:34.206227 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:29:34.233550 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:29:34.787842 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 18:29:34.793110 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:34.804522 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:29:34.843154 tst handover.py: using LAC 22895 18:29:34.966709 tst handover.py: using RAC 200 18:29:35.090165 tst handover.py: using CellId 22895 18:29:35.213278 tst handover.py: using BVCI 22896 18:29:35.329280 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:29:35.372670 tst handover.py: using LAC 22896 18:29:35.498596 tst handover.py: using RAC 201 18:29:35.623438 tst handover.py: using CellId 22896 18:29:35.745908 tst handover.py: using BVCI 22897 18:29:35.861461 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:35.872724 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:35.883879 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:35.895332 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:35.906835 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:29:35.918167 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:29:36.032822 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:29:36.148454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:36.589119 run create_hlr_db(pid=1263): Launched 18:29:36.712585 bus /sierra_2: Setting Powered False 18:29:37.772327 run create_hlr_db(pid=1263): Terminated: ok {rc=0} 18:29:38.183400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1265): Launched 18:29:38.503948 run osmo-hlr_10.42.42.2(pid=1266): Launched 18:29:38.626873 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:39.153316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1268): Launched 18:29:39.473465 run osmo-stp_10.42.42.5(pid=1269): Launched 18:29:39.596476 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:40.147151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1271): Launched 18:29:40.468717 run osmo-msc_10.42.42.6(pid=1272): Launched 18:29:40.648764 run osmo-stp_10.42.42.5(pid=1269): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1269)] 18:29:40.783667 run osmo-stp_10.42.42.5(pid=1269): stdout: | (launched: 2022-12-09_18:29:39.414934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:40.919219 run osmo-stp_10.42.42.5(pid=1269): stderr: | 20221209182939607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182939607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182939607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182939608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182939608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182939608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182939608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:41.053730 run osmo-stp_10.42.42.5(pid=1269): stdout: | (launched: 2022-12-09_18:29:39.414934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:41.180664 run osmo-stp_10.42.42.5(pid=1269): stderr: | 20221209182939607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182939607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182939607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182939608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182939608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182939608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182939608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:41.332864 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1269): Process ended prematurely: osmo-stp_10.42.42.5(pid=1269) [trial-2362↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1269)] [trial-2362↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 18:29:41.342040 tst handover.py:18: Test FAILED (6.5 sec) 18:29:41.370174 run osmo-hlr_10.42.42.2(pid=1266): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1266)] 18:29:41.421136 run osmo-hlr_10.42.42.2(pid=1266): stdout: | (launched: 2022-12-09_18:29:38.445752) 18:29:41.473574 run osmo-hlr_10.42.42.2(pid=1266): stderr: | 20221209182938642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182938642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182938642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182938642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182938642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182938642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182938655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182938666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182938666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182938666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:41.546381 run osmo-msc_10.42.42.6(pid=1272): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1272)] 18:29:41.596563 run osmo-msc_10.42.42.6(pid=1272): stdout: | (launched: 2022-12-09_18:29:40.409957) 18:29:41.648754 run osmo-msc_10.42.42.6(pid=1272): stderr: | 20221209182940729 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182940729 DLGLOBAL DEBUG validating counter group 0x7f863b12dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182940729 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182940729 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182940729 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182940730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182940731 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182940732 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182940732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182940732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:41.701473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1265): Terminating (SIGTERM) 18:29:41.743266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1268): Terminating (SIGTERM) 18:29:41.785411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1271): Terminating (SIGTERM) 18:29:41.827469 --- ParallelTerminationStrategy: PID 1265 died... 18:29:41.847347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1265): Terminated: ok {rc=0} 18:29:41.894221 --- ParallelTerminationStrategy: PID 1268 died... 18:29:41.913713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1268): Terminated: ok {rc=0} 18:29:41.960267 --- ParallelTerminationStrategy: PID 1271 died... 18:29:41.979846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1271): Terminated: ok {rc=0} 18:29:42.067017 bus /sierra_3: Setting Powered False 18:29:43.166732 bus /sierra_3: Setting Powered False 18:29:44.283733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:29:45.553921 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:45.559600 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:29:45.611865 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:29:45.638044 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:29:45.687591 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:29:45.737589 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:29:45.763589 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:29:46.336545 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:29:46.343704 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:46.358119 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:29:46.405428 tst handover.py: using LAC 22897 18:29:46.559324 tst handover.py: using RAC 202 18:29:46.682868 tst handover.py: using CellId 22897 18:29:46.835963 tst handover.py: using BVCI 22898 18:29:46.945993 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:29:46.993819 tst handover.py: using LAC 22898 18:29:47.122522 tst handover.py: using RAC 203 18:29:47.267531 tst handover.py: using CellId 22898 18:29:47.394398 tst handover.py: using BVCI 22899 18:29:47.513135 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:47.524612 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:47.535929 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:47.548419 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:47.560071 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:29:47.571391 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:29:47.692887 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:29:47.808791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:48.277737 run create_hlr_db(pid=1277): Launched 18:29:48.400210 bus /sierra_2: Setting Powered False 18:29:49.463366 run create_hlr_db(pid=1277): Terminated: ok {rc=0} 18:29:49.881261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1279): Launched 18:29:50.201995 run osmo-hlr_10.42.42.2(pid=1280): Launched 18:29:50.324892 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:50.849956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1282): Launched 18:29:51.168707 run osmo-stp_10.42.42.5(pid=1283): Launched 18:29:51.291085 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:51.840737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1285): Launched 18:29:52.159227 run osmo-msc_10.42.42.6(pid=1286): Launched 18:29:52.337206 run osmo-stp_10.42.42.5(pid=1283): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1283)] 18:29:52.471818 run osmo-stp_10.42.42.5(pid=1283): stdout: | (launched: 2022-12-09_18:29:51.110508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:52.607236 run osmo-stp_10.42.42.5(pid=1283): stderr: | 20221209182951302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182951302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182951302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182951302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182951303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182951303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182951303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:52.741809 run osmo-stp_10.42.42.5(pid=1283): stdout: | (launched: 2022-12-09_18:29:51.110508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:52.868128 run osmo-stp_10.42.42.5(pid=1283): stderr: | 20221209182951302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209182951302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209182951302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209182951302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209182951303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209182951303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209182951303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:53.019842 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1283): Process ended prematurely: osmo-stp_10.42.42.5(pid=1283) [trial-2362↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1283)] [trial-2362↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 18:29:53.029008 tst handover.py:18: Test FAILED (6.7 sec) 18:29:53.056711 run osmo-hlr_10.42.42.2(pid=1280): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1280)] 18:29:53.107139 run osmo-hlr_10.42.42.2(pid=1280): stdout: | (launched: 2022-12-09_18:29:50.142948) 18:29:53.158930 run osmo-hlr_10.42.42.2(pid=1280): stderr: | 20221209182950339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209182950339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209182950339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209182950339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209182950339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209182950339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209182950352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209182950360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209182950360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209182950360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:53.231323 run osmo-msc_10.42.42.6(pid=1286): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1286)] 18:29:53.281936 run osmo-msc_10.42.42.6(pid=1286): stdout: | (launched: 2022-12-09_18:29:52.101267) 18:29:53.333707 run osmo-msc_10.42.42.6(pid=1286): stderr: | 20221209182952420 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209182952420 DLGLOBAL DEBUG validating counter group 0x7f583aeeac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209182952420 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209182952420 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209182952421 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209182952421 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209182952422 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209182952423 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209182952423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209182952423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:53.385816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1279): Terminating (SIGTERM) 18:29:53.427804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1282): Terminating (SIGTERM) 18:29:53.469925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1285): Terminating (SIGTERM) 18:29:53.512026 --- ParallelTerminationStrategy: PID 1279 died... 18:29:53.531880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1279): Terminated: ok {rc=0} 18:29:53.578208 --- ParallelTerminationStrategy: PID 1282 died... 18:29:53.597726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1282): Terminated: ok {rc=0} 18:29:53.644135 --- ParallelTerminationStrategy: PID 1285 died... 18:29:53.663590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1285): Terminated: ok {rc=0} 18:29:53.750249 bus /sierra_3: Setting Powered False 18:29:54.847001 bus /sierra_3: Setting Powered False 18:29:55.961079 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 18:29:57.220534 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:57.226056 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:29:57.265900 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:29:57.292997 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:29:57.347235 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:29:57.386193 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:29:57.413346 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:29:57.961844 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 18:29:57.967142 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:57.978245 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 18:29:58.017942 tst handover.py: using LAC 22899 18:29:58.135599 tst handover.py: using RAC 204 18:29:58.251562 tst handover.py: using CellId 22899 18:29:58.366201 tst handover.py: using BVCI 22900 18:29:58.475339 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 18:29:58.508111 tst handover.py: using LAC 22900 18:29:58.623079 tst handover.py: using RAC 205 18:29:58.737585 tst handover.py: using CellId 22900 18:29:58.852577 tst handover.py: using BVCI 22901 18:29:58.959763 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:58.970378 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:58.980705 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:58.991151 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:59.001616 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:29:59.011958 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 18:29:59.128112 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 18:29:59.247578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:59.714232 run create_hlr_db(pid=1292): Launched 18:29:59.836220 bus /sierra_2: Setting Powered False 18:30:00.906456 run create_hlr_db(pid=1292): Terminated: ok {rc=0} 18:30:01.337761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1294): Launched 18:30:01.654570 run osmo-hlr_10.42.42.2(pid=1295): Launched 18:30:01.831998 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:02.563433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1300): Launched 18:30:02.861684 run osmo-stp_10.42.42.5(pid=1301): Launched 18:30:02.975456 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:03.489043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1303): Launched 18:30:03.787399 run osmo-msc_10.42.42.6(pid=1304): Launched 18:30:03.954599 run osmo-stp_10.42.42.5(pid=1301): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1301)] 18:30:04.080369 run osmo-stp_10.42.42.5(pid=1301): stdout: | (launched: 2022-12-09_18:30:02.806987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:04.206180 run osmo-stp_10.42.42.5(pid=1301): stderr: | 20221209183002973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183002974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183002974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183002974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183002975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183002975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183002975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:04.330189 run osmo-stp_10.42.42.5(pid=1301): stdout: | (launched: 2022-12-09_18:30:02.806987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:04.448658 run osmo-stp_10.42.42.5(pid=1301): stderr: | 20221209183002973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183002974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183002974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183002974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183002975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183002975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183002975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:04.590348 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1301): Process ended prematurely: osmo-stp_10.42.42.5(pid=1301) [trial-2362↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1301)] [trial-2362↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 18:30:04.598506 tst handover.py:18: Test FAILED (6.6 sec) 18:30:04.624326 run osmo-hlr_10.42.42.2(pid=1295): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1295)] 18:30:04.671662 run osmo-hlr_10.42.42.2(pid=1295): stdout: | (launched: 2022-12-09_18:30:01.596474) 18:30:04.720783 run osmo-hlr_10.42.42.2(pid=1295): stderr: | 20221209183001944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183001944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183001944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183001944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183001944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183001944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183001963 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183001979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183001979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183001979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:04.789246 run osmo-msc_10.42.42.6(pid=1304): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1304)] 18:30:04.836442 run osmo-msc_10.42.42.6(pid=1304): stdout: | (launched: 2022-12-09_18:30:03.732379) 18:30:04.885386 run osmo-msc_10.42.42.6(pid=1304): stderr: | 20221209183004003 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183004003 DLGLOBAL DEBUG validating counter group 0x7f8821ce6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183004003 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183004003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183004004 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183004004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183004006 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183004006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183004006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183004006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:04.934839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1294): Terminating (SIGTERM) 18:30:04.974009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1300): Terminating (SIGTERM) 18:30:05.013253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1303): Terminating (SIGTERM) 18:30:05.052547 --- ParallelTerminationStrategy: PID 1294 died... 18:30:05.071596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1294): Terminated: ok {rc=0} 18:30:05.115364 --- ParallelTerminationStrategy: PID 1300 died... 18:30:05.133746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1300): Terminated: ok {rc=0} 18:30:05.177093 --- ParallelTerminationStrategy: PID 1303 died... 18:30:05.195539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1303): Terminated: ok {rc=0} 18:30:05.280318 bus /sierra_3: Setting Powered False 18:30:06.380049 bus /sierra_3: Setting Powered False 18:30:07.492563 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 18:30:08.729991 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:08.734976 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:30:08.784164 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:30:08.810226 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:30:08.861386 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:30:08.910670 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:30:08.936742 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:30:09.489899 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 18:30:09.495358 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:30:09.506200 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:30:09.540059 tst handover.py: using LAC 22901 18:30:09.661428 tst handover.py: using RAC 206 18:30:09.778425 tst handover.py: using CellId 22901 18:30:09.895206 tst handover.py: using BVCI 22902 18:30:10.002509 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:30:10.048657 tst handover.py: using LAC 22902 18:30:10.163651 tst handover.py: using RAC 207 18:30:10.278949 tst handover.py: using CellId 22902 18:30:10.395778 tst handover.py: using BVCI 22903 18:30:10.503161 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:30:10.514034 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:30:10.524655 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:30:10.535260 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:30:10.545812 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:30:10.556224 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:30:10.672601 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:30:10.786488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:11.222552 run create_hlr_db(pid=1309): Launched 18:30:11.345068 bus /sierra_2: Setting Powered False 18:30:12.405182 run create_hlr_db(pid=1309): Terminated: ok {rc=0} 18:30:12.798338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1311): Launched 18:30:13.120099 run osmo-hlr_10.42.42.2(pid=1312): Launched 18:30:13.242484 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:13.767030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1314): Launched 18:30:14.086564 run osmo-stp_10.42.42.5(pid=1315): Launched 18:30:14.208901 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:14.759664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1317): Launched 18:30:15.079658 run osmo-msc_10.42.42.6(pid=1318): Launched 18:30:15.258895 run osmo-stp_10.42.42.5(pid=1315): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1315)] 18:30:15.394329 run osmo-stp_10.42.42.5(pid=1315): stdout: | (launched: 2022-12-09_18:30:14.028392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:15.530355 run osmo-stp_10.42.42.5(pid=1315): stderr: | 20221209183014218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183014218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183014219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183014219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183014219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183014220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183014220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:15.664654 run osmo-stp_10.42.42.5(pid=1315): stdout: | (launched: 2022-12-09_18:30:14.028392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:15.791904 run osmo-stp_10.42.42.5(pid=1315): stderr: | 20221209183014218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183014218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183014219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183014219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183014219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183014220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183014220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:15.969490 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1315): Process ended prematurely: osmo-stp_10.42.42.5(pid=1315) [trial-2362↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1315)] [trial-2362↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 18:30:15.979176 tst handover.py:18: Test FAILED (6.5 sec) 18:30:16.007957 run osmo-hlr_10.42.42.2(pid=1312): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1312)] 18:30:16.058853 run osmo-hlr_10.42.42.2(pid=1312): stdout: | (launched: 2022-12-09_18:30:13.061814) 18:30:16.111585 run osmo-hlr_10.42.42.2(pid=1312): stderr: | 20221209183013259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183013259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183013259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183013259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183013259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183013259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183013271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183013279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183013280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183013280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:16.184827 run osmo-msc_10.42.42.6(pid=1318): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1318)] 18:30:16.237114 run osmo-msc_10.42.42.6(pid=1318): stdout: | (launched: 2022-12-09_18:30:15.021393) 18:30:16.290965 run osmo-msc_10.42.42.6(pid=1318): stderr: | 20221209183015339 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183015339 DLGLOBAL DEBUG validating counter group 0x7f356d3b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183015339 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183015339 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183015339 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183015340 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183015341 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183015342 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183015342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183015342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:16.345658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1311): Terminating (SIGTERM) 18:30:16.389573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1314): Terminating (SIGTERM) 18:30:16.434352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1317): Terminating (SIGTERM) 18:30:16.480586 --- ParallelTerminationStrategy: PID 1311 died... 18:30:16.501447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1311): Terminated: ok {rc=0} 18:30:16.552038 --- ParallelTerminationStrategy: PID 1314 died... 18:30:16.572321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1314): Terminated: ok {rc=0} 18:30:16.621433 --- ParallelTerminationStrategy: PID 1317 died... 18:30:16.641558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1317): Terminated: ok {rc=0} 18:30:16.733306 bus /sierra_3: Setting Powered False 18:30:17.832302 bus /sierra_3: Setting Powered False 18:30:18.947251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 18:30:20.196640 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:20.201862 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:30:20.250593 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:30:20.276623 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:30:20.328086 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:30:20.376552 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:30:20.402532 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:30:20.951834 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 18:30:20.957239 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:30:20.967950 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:30:21.004684 tst handover.py: using LAC 22903 18:30:21.122276 tst handover.py: using RAC 208 18:30:21.238251 tst handover.py: using CellId 22903 18:30:21.353545 tst handover.py: using BVCI 22904 18:30:21.463780 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:30:21.510606 tst handover.py: using LAC 22904 18:30:21.628292 tst handover.py: using RAC 209 18:30:21.743943 tst handover.py: using CellId 22904 18:30:21.859812 tst handover.py: using BVCI 22905 18:30:21.967859 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:30:21.978863 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:30:21.989654 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:30:22.000224 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:30:22.011054 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:30:22.021772 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:30:22.138831 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:30:22.252307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:22.723090 run create_hlr_db(pid=1324): Launched 18:30:22.845657 bus /sierra_2: Setting Powered False 18:30:23.909120 run create_hlr_db(pid=1324): Terminated: ok {rc=0} 18:30:24.313538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1326): Launched 18:30:24.614459 run osmo-hlr_10.42.42.2(pid=1327): Launched 18:30:24.729285 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:25.218734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1329): Launched 18:30:25.518013 run osmo-stp_10.42.42.5(pid=1330): Launched 18:30:25.631670 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:26.148462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1332): Launched 18:30:26.448094 run osmo-msc_10.42.42.6(pid=1333): Launched 18:30:26.616777 run osmo-stp_10.42.42.5(pid=1330): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1330)] 18:30:26.747684 run osmo-stp_10.42.42.5(pid=1330): stdout: | (launched: 2022-12-09_18:30:25.462986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:26.873979 run osmo-stp_10.42.42.5(pid=1330): stderr: | 20221209183025632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183025632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183025633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183025633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183025633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183025634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183025634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:26.998290 run osmo-stp_10.42.42.5(pid=1330): stdout: | (launched: 2022-12-09_18:30:25.462986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:27.117214 run osmo-stp_10.42.42.5(pid=1330): stderr: | 20221209183025632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183025632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183025633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183025633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183025633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183025634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183025634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:27.275210 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1330): Process ended prematurely: osmo-stp_10.42.42.5(pid=1330) [trial-2362↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1330)] [trial-2362↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 18:30:27.284641 tst handover.py:18: Test FAILED (6.3 sec) 18:30:27.317180 run osmo-hlr_10.42.42.2(pid=1327): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1327)] 18:30:27.370394 run osmo-hlr_10.42.42.2(pid=1327): stdout: | (launched: 2022-12-09_18:30:24.559514) 18:30:27.423369 run osmo-hlr_10.42.42.2(pid=1327): stderr: | 20221209183024731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183024731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183024731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183024731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183024731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183024731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183024746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183024756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183024756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183024757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:27.496745 run osmo-msc_10.42.42.6(pid=1333): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1333)] 18:30:27.547705 run osmo-msc_10.42.42.6(pid=1333): stdout: | (launched: 2022-12-09_18:30:26.393488) 18:30:27.600068 run osmo-msc_10.42.42.6(pid=1333): stderr: | 20221209183026661 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183026661 DLGLOBAL DEBUG validating counter group 0x7f7a1f117c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183026661 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183026661 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183026661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183026661 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183026663 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183026663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183026664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183026664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:27.652850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1326): Terminating (SIGTERM) 18:30:27.695512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1329): Terminating (SIGTERM) 18:30:27.737997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1332): Terminating (SIGTERM) 18:30:27.780472 --- ParallelTerminationStrategy: PID 1326 died... 18:30:27.800728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1326): Terminated: ok {rc=0} 18:30:27.848264 --- ParallelTerminationStrategy: PID 1329 died... 18:30:27.868119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1329): Terminated: ok {rc=0} 18:30:27.915380 --- ParallelTerminationStrategy: PID 1332 died... 18:30:27.935144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1332): Terminated: ok {rc=0} 18:30:28.023592 bus /sierra_3: Setting Powered False 18:30:29.123060 bus /sierra_3: Setting Powered False 18:30:30.239201 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 18:30:31.497588 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:31.505295 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 18:30:31.558998 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 18:30:31.588616 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 18:30:31.644900 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 18:30:31.698115 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 18:30:31.727292 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 18:30:32.273799 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 18:30:32.280635 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:32.292780 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:30:32.327871 tst handover.py: using LAC 22905 18:30:32.454102 tst handover.py: using RAC 210 18:30:32.581163 tst handover.py: using CellId 22905 18:30:32.706597 tst handover.py: using BVCI 22906 18:30:32.824162 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:30:32.871862 tst handover.py: using LAC 22906 18:30:33.000288 tst handover.py: using RAC 211 18:30:33.125969 tst handover.py: using CellId 22906 18:30:33.249888 tst handover.py: using BVCI 22907 18:30:33.367716 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:33.379075 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:33.390278 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:33.402051 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:33.413757 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:30:33.425446 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:30:33.541384 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:30:33.658714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:34.128376 run create_hlr_db(pid=1338): Launched 18:30:34.250507 bus /sierra_2: Setting Powered False 18:30:35.314168 run create_hlr_db(pid=1338): Terminated: ok {rc=0} 18:30:35.734335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1340): Launched 18:30:36.055471 run osmo-hlr_10.42.42.2(pid=1341): Launched 18:30:36.178491 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:36.701996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1343): Launched 18:30:37.022599 run osmo-stp_10.42.42.5(pid=1344): Launched 18:30:37.145648 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:37.702306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1346): Launched 18:30:38.024451 run osmo-msc_10.42.42.6(pid=1347): Launched 18:30:38.203313 run osmo-stp_10.42.42.5(pid=1344): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1344)] 18:30:38.338796 run osmo-stp_10.42.42.5(pid=1344): stdout: | (launched: 2022-12-09_18:30:36.963941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:38.475554 run osmo-stp_10.42.42.5(pid=1344): stderr: | 20221209183037154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183037154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183037154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183037154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183037155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183037155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183037155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:38.610434 run osmo-stp_10.42.42.5(pid=1344): stdout: | (launched: 2022-12-09_18:30:36.963941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:38.738269 run osmo-stp_10.42.42.5(pid=1344): stderr: | 20221209183037154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183037154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183037154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183037154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183037155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183037155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183037155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:38.891389 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1344): Process ended prematurely: osmo-stp_10.42.42.5(pid=1344) [trial-2362↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1344)] [trial-2362↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 18:30:38.900421 tst handover.py:18: Test FAILED (6.6 sec) 18:30:38.928851 run osmo-hlr_10.42.42.2(pid=1341): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1341)] 18:30:38.979458 run osmo-hlr_10.42.42.2(pid=1341): stdout: | (launched: 2022-12-09_18:30:35.997245) 18:30:39.031675 run osmo-hlr_10.42.42.2(pid=1341): stderr: | 20221209183036194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183036194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183036194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183036194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183036194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183036194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183036241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183036250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183036250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183036250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:39.104143 run osmo-msc_10.42.42.6(pid=1347): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1347)] 18:30:39.154066 run osmo-msc_10.42.42.6(pid=1347): stdout: | (launched: 2022-12-09_18:30:37.965943) 18:30:39.205717 run osmo-msc_10.42.42.6(pid=1347): stderr: | 20221209183038284 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183038285 DLGLOBAL DEBUG validating counter group 0x7f2f6e9ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183038285 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183038285 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183038285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183038285 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183038287 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183038287 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183038287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183038287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:39.258228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1340): Terminating (SIGTERM) 18:30:39.300358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1343): Terminating (SIGTERM) 18:30:39.342897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1346): Terminating (SIGTERM) 18:30:39.385589 --- ParallelTerminationStrategy: PID 1340 died... 18:30:39.405588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1340): Terminated: ok {rc=0} 18:30:39.453369 --- ParallelTerminationStrategy: PID 1343 died... 18:30:39.473073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1343): Terminated: ok {rc=0} 18:30:39.520187 --- ParallelTerminationStrategy: PID 1346 died... 18:30:39.539807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1346): Terminated: ok {rc=0} 18:30:39.628560 bus /sierra_3: Setting Powered False 18:30:40.727910 bus /sierra_3: Setting Powered False 18:30:41.845142 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 18:30:43.093533 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:43.098754 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 18:30:43.142843 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:30:43.168998 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:30:43.222366 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 18:30:43.269336 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:30:43.297103 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:30:43.842758 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 18:30:43.849105 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:43.860535 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:30:43.894807 tst handover.py: using LAC 22907 18:30:44.013848 tst handover.py: using RAC 212 18:30:44.131133 tst handover.py: using CellId 22907 18:30:44.249141 tst handover.py: using BVCI 22908 18:30:44.357294 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:30:44.401394 tst handover.py: using LAC 22908 18:30:44.519717 tst handover.py: using RAC 213 18:30:44.637056 tst handover.py: using CellId 22908 18:30:44.754504 tst handover.py: using BVCI 22909 18:30:44.864668 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:44.875754 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:44.886506 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:44.897354 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:44.907979 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:30:44.918631 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:30:45.031016 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:30:45.148160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:45.618933 run create_hlr_db(pid=1352): Launched 18:30:45.742519 bus /sierra_2: Setting Powered False 18:30:46.820339 run create_hlr_db(pid=1352): Terminated: ok {rc=0} 18:30:47.244328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1354): Launched 18:30:47.577900 run osmo-hlr_10.42.42.2(pid=1355): Launched 18:30:47.700294 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:48.226520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1357): Launched 18:30:48.547449 run osmo-stp_10.42.42.5(pid=1358): Launched 18:30:48.670304 run osmo-msc_10.42.42.6: Starting osmo-msc 18:30:49.221983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1360): Launched 18:30:49.543861 run osmo-msc_10.42.42.6(pid=1361): Launched 18:30:49.722961 run osmo-stp_10.42.42.5(pid=1358): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1358)] 18:30:49.858217 run osmo-stp_10.42.42.5(pid=1358): stdout: | (launched: 2022-12-09_18:30:48.489190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:49.993883 run osmo-stp_10.42.42.5(pid=1358): stderr: | 20221209183048678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183048678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183048679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183048679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183048679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183048679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183048680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:50.128224 run osmo-stp_10.42.42.5(pid=1358): stdout: | (launched: 2022-12-09_18:30:48.489190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:50.255807 run osmo-stp_10.42.42.5(pid=1358): stderr: | 20221209183048678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183048678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183048679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183048679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183048679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183048679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183048680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:50.408756 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1358): Process ended prematurely: osmo-stp_10.42.42.5(pid=1358) [trial-2362↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1358)] [trial-2362↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 18:30:50.417683 tst handover.py:18: Test FAILED (6.6 sec) 18:30:50.445770 run osmo-hlr_10.42.42.2(pid=1355): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1355)] 18:30:50.495689 run osmo-hlr_10.42.42.2(pid=1355): stdout: | (launched: 2022-12-09_18:30:47.519320) 18:30:50.547049 run osmo-hlr_10.42.42.2(pid=1355): stderr: | 20221209183047715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183047715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183047715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183047715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183047715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183047715 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183047727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183047736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183047736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183047736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:50.618713 run osmo-msc_10.42.42.6(pid=1361): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1361)] 18:30:50.668437 run osmo-msc_10.42.42.6(pid=1361): stdout: | (launched: 2022-12-09_18:30:49.485257) 18:30:50.720081 run osmo-msc_10.42.42.6(pid=1361): stderr: | 20221209183049802 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183049803 DLGLOBAL DEBUG validating counter group 0x7f8ea45d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183049803 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183049803 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183049803 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183049803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183049805 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183049805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183049805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183049805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:30:50.772017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1354): Terminating (SIGTERM) 18:30:50.813844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1357): Terminating (SIGTERM) 18:30:50.855751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1360): Terminating (SIGTERM) 18:30:50.898195 --- ParallelTerminationStrategy: PID 1354 died... 18:30:50.918432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1354): Terminated: ok {rc=0} 18:30:50.964924 --- ParallelTerminationStrategy: PID 1357 died... 18:30:50.984364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1357): Terminated: ok {rc=0} 18:30:51.030933 --- ParallelTerminationStrategy: PID 1360 died... 18:30:51.050311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1360): Terminated: ok {rc=0} 18:30:51.138514 bus /sierra_3: Setting Powered False 18:30:52.237268 bus /sierra_3: Setting Powered False 18:30:53.352203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:30:54.604738 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:30:54.610737 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:30:54.659285 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:30:54.685692 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:30:54.737035 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:30:54.785587 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:30:54.811692 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:30:55.366336 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:30:55.372746 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:55.384236 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:30:55.421303 tst handover.py: using LAC 22909 18:30:55.551710 tst handover.py: using RAC 214 18:30:55.680041 tst handover.py: using CellId 22909 18:30:55.804184 tst handover.py: using BVCI 22910 18:30:55.913960 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:30:55.961757 tst handover.py: using LAC 22910 18:30:56.077535 tst handover.py: using RAC 215 18:30:56.202400 tst handover.py: using CellId 22910 18:30:56.320617 tst handover.py: using BVCI 22911 18:30:56.428718 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:56.439987 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:56.450866 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:56.462011 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:56.472818 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:30:56.483800 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:30:56.598857 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:30:56.714154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:57.153109 run create_hlr_db(pid=1366): Launched 18:30:57.275831 bus /sierra_2: Setting Powered False 18:30:58.338668 run create_hlr_db(pid=1366): Terminated: ok {rc=0} 18:30:58.758004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1368): Launched 18:30:59.077566 run osmo-hlr_10.42.42.2(pid=1369): Launched 18:30:59.199937 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:59.728193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1371): Launched 18:31:00.048517 run osmo-stp_10.42.42.5(pid=1372): Launched 18:31:00.170933 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:00.722335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1374): Launched 18:31:01.053724 run osmo-msc_10.42.42.6(pid=1375): Launched 18:31:01.289456 run osmo-stp_10.42.42.5(pid=1372): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1372)] 18:31:01.478940 run osmo-stp_10.42.42.5(pid=1372): stdout: | (launched: 2022-12-09_18:30:59.990234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:01.829010 run osmo-stp_10.42.42.5(pid=1372): stderr: | 20221209183100181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183100181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183100181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183100182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183100182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183100182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183100182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:02.107803 run osmo-stp_10.42.42.5(pid=1372): stdout: | (launched: 2022-12-09_18:30:59.990234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:02.254226 run osmo-stp_10.42.42.5(pid=1372): stderr: | 20221209183100181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183100181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183100181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183100182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183100182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183100182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183100182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:02.411106 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1372): Process ended prematurely: osmo-stp_10.42.42.5(pid=1372) [trial-2362↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1372)] [trial-2362↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 18:31:02.420931 tst handover.py:18: Test FAILED (7.0 sec) 18:31:02.452126 run osmo-hlr_10.42.42.2(pid=1369): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1369)] 18:31:02.503078 run osmo-hlr_10.42.42.2(pid=1369): stdout: | (launched: 2022-12-09_18:30:59.019504) 18:31:02.555561 run osmo-hlr_10.42.42.2(pid=1369): stderr: | 20221209183059216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183059217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183059217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183059217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183059217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183059217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183059229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183059238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183059238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183059238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:02.628432 run osmo-msc_10.42.42.6(pid=1375): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1375)] 18:31:02.679104 run osmo-msc_10.42.42.6(pid=1375): stdout: | (launched: 2022-12-09_18:31:00.987698) 18:31:02.731519 run osmo-msc_10.42.42.6(pid=1375): stderr: | 20221209183101641 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183101641 DLGLOBAL DEBUG validating counter group 0x7fa869321c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183101641 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183101642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183101642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183101642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183101644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183101645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183101645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183101646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:02.784219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1368): Terminating (SIGTERM) 18:31:02.827089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1371): Terminating (SIGTERM) 18:31:02.869747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1374): Terminating (SIGTERM) 18:31:02.912851 --- ParallelTerminationStrategy: PID 1368 died... 18:31:02.933135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1368): Terminated: ok {rc=0} 18:31:02.981560 --- ParallelTerminationStrategy: PID 1371 died... 18:31:03.001369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1371): Terminated: ok {rc=0} 18:31:03.049396 --- ParallelTerminationStrategy: PID 1374 died... 18:31:03.069210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1374): Terminated: ok {rc=0} 18:31:03.159135 bus /sierra_3: Setting Powered False 18:31:04.258462 bus /sierra_3: Setting Powered False 18:31:05.373934 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 18:31:06.643417 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:06.648748 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:31:06.686790 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:31:06.714140 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:31:06.767303 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:31:06.804552 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:31:06.832021 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:31:07.381508 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 18:31:07.387058 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:31:07.398532 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 18:31:07.438888 tst handover.py: using LAC 22911 18:31:07.565343 tst handover.py: using RAC 216 18:31:07.689986 tst handover.py: using CellId 22911 18:31:07.814903 tst handover.py: using BVCI 22912 18:31:07.931913 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 18:31:07.966206 tst handover.py: using LAC 22912 18:31:08.090988 tst handover.py: using RAC 217 18:31:08.217211 tst handover.py: using CellId 22912 18:31:08.341902 tst handover.py: using BVCI 22913 18:31:08.459171 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:31:08.470370 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:31:08.481314 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:31:08.493184 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:31:08.504831 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:31:08.516749 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 18:31:08.634383 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 18:31:08.748338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:09.187842 run create_hlr_db(pid=1381): Launched 18:31:09.311188 bus /sierra_2: Setting Powered False 18:31:10.371148 run create_hlr_db(pid=1381): Terminated: ok {rc=0} 18:31:10.781870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1383): Launched 18:31:11.103280 run osmo-hlr_10.42.42.2(pid=1384): Launched 18:31:11.225872 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:11.752203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1386): Launched 18:31:12.072707 run osmo-stp_10.42.42.5(pid=1387): Launched 18:31:12.195138 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:12.746207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1389): Launched 18:31:13.066792 run osmo-msc_10.42.42.6(pid=1390): Launched 18:31:13.237778 run osmo-stp_10.42.42.5(pid=1387): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1387)] 18:31:13.365694 run osmo-stp_10.42.42.5(pid=1387): stdout: | (launched: 2022-12-09_18:31:12.014317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:13.493552 run osmo-stp_10.42.42.5(pid=1387): stderr: | 20221209183112205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183112205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183112205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183112206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183112206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183112206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183112206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:13.618913 run osmo-stp_10.42.42.5(pid=1387): stdout: | (launched: 2022-12-09_18:31:12.014317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:13.738092 run osmo-stp_10.42.42.5(pid=1387): stderr: | 20221209183112205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183112205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183112205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183112206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183112206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183112206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183112206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:13.880712 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1387): Process ended prematurely: osmo-stp_10.42.42.5(pid=1387) [trial-2362↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1387)] [trial-2362↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 18:31:13.889289 tst handover.py:18: Test FAILED (6.5 sec) 18:31:13.915801 run osmo-hlr_10.42.42.2(pid=1384): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1384)] 18:31:13.963809 run osmo-hlr_10.42.42.2(pid=1384): stdout: | (launched: 2022-12-09_18:31:11.044685) 18:31:14.013553 run osmo-hlr_10.42.42.2(pid=1384): stderr: | 20221209183111240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183111240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183111240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183111240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183111240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183111240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183111254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183111262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183111262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183111262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:14.082776 run osmo-msc_10.42.42.6(pid=1390): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1390)] 18:31:14.130584 run osmo-msc_10.42.42.6(pid=1390): stdout: | (launched: 2022-12-09_18:31:13.008460) 18:31:14.179862 run osmo-msc_10.42.42.6(pid=1390): stderr: | 20221209183113276 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183113276 DLGLOBAL DEBUG validating counter group 0x7f0530adac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183113276 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183113276 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183113277 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183113277 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183113278 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183113279 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183113279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183113279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:14.229855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1383): Terminating (SIGTERM) 18:31:14.270051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1386): Terminating (SIGTERM) 18:31:14.309979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1389): Terminating (SIGTERM) 18:31:14.350344 --- ParallelTerminationStrategy: PID 1383 died... 18:31:14.369582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1383): Terminated: ok {rc=0} 18:31:14.414061 --- ParallelTerminationStrategy: PID 1386 died... 18:31:14.432748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1386): Terminated: ok {rc=0} 18:31:14.477016 --- ParallelTerminationStrategy: PID 1389 died... 18:31:14.495710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1389): Terminated: ok {rc=0} 18:31:14.582062 bus /sierra_3: Setting Powered False 18:31:15.682814 bus /sierra_3: Setting Powered False 18:31:16.805469 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 18:31:18.044288 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:18.049527 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:31:18.098099 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:31:18.124382 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:31:18.176305 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:31:18.224515 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:31:18.250762 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:31:18.799365 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 18:31:18.804855 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:18.816018 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:31:18.849503 tst handover.py: using LAC 22913 18:31:18.967619 tst handover.py: using RAC 218 18:31:19.087833 tst handover.py: using CellId 22913 18:31:19.205103 tst handover.py: using BVCI 22914 18:31:19.312871 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:31:19.361826 tst handover.py: using LAC 22914 18:31:19.493226 tst handover.py: using RAC 219 18:31:19.620164 tst handover.py: using CellId 22914 18:31:19.743904 tst handover.py: using BVCI 22915 18:31:19.859768 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:19.871066 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:19.882256 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:19.893511 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:19.904770 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:31:19.915870 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:31:20.033255 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:31:20.148454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:20.587206 run create_hlr_db(pid=1395): Launched 18:31:20.710205 bus /sierra_2: Setting Powered False 18:31:21.770303 run create_hlr_db(pid=1395): Terminated: ok {rc=0} 18:31:22.181700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1397): Launched 18:31:22.504081 run osmo-hlr_10.42.42.2(pid=1398): Launched 18:31:22.628149 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:23.155827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1400): Launched 18:31:23.476401 run osmo-stp_10.42.42.5(pid=1401): Launched 18:31:23.599929 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:24.152072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1403): Launched 18:31:24.474548 run osmo-msc_10.42.42.6(pid=1404): Launched 18:31:24.654892 run osmo-stp_10.42.42.5(pid=1401): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1401)] 18:31:24.790277 run osmo-stp_10.42.42.5(pid=1401): stdout: | (launched: 2022-12-09_18:31:23.417563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:24.926167 run osmo-stp_10.42.42.5(pid=1401): stderr: | 20221209183123608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183123609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183123609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183123609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183123610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183123610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183123610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:25.060309 run osmo-stp_10.42.42.5(pid=1401): stdout: | (launched: 2022-12-09_18:31:23.417563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:25.188342 run osmo-stp_10.42.42.5(pid=1401): stderr: | 20221209183123608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183123609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183123609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183123609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183123610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183123610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183123610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:25.341597 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1401): Process ended prematurely: osmo-stp_10.42.42.5(pid=1401) [trial-2362↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1401)] [trial-2362↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 18:31:25.350755 tst handover.py:18: Test FAILED (6.5 sec) 18:31:25.378979 run osmo-hlr_10.42.42.2(pid=1398): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1398)] 18:31:25.429654 run osmo-hlr_10.42.42.2(pid=1398): stdout: | (launched: 2022-12-09_18:31:22.445261) 18:31:25.482271 run osmo-hlr_10.42.42.2(pid=1398): stderr: | 20221209183122641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183122641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183122641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183122641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183122642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183122642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183122655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183122664 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183122664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183122664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:25.555377 run osmo-msc_10.42.42.6(pid=1404): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1404)] 18:31:25.605905 run osmo-msc_10.42.42.6(pid=1404): stdout: | (launched: 2022-12-09_18:31:24.415508) 18:31:25.658258 run osmo-msc_10.42.42.6(pid=1404): stderr: | 20221209183124732 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183124732 DLGLOBAL DEBUG validating counter group 0x7f97ee9a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183124733 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183124733 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183124733 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183124733 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183124735 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183124735 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183124735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183124735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:25.710859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1397): Terminating (SIGTERM) 18:31:25.753334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1400): Terminating (SIGTERM) 18:31:25.795956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1403): Terminating (SIGTERM) 18:31:25.838920 --- ParallelTerminationStrategy: PID 1397 died... 18:31:25.858959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1397): Terminated: ok {rc=0} 18:31:25.906191 --- ParallelTerminationStrategy: PID 1400 died... 18:31:25.926045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1400): Terminated: ok {rc=0} 18:31:25.973098 --- ParallelTerminationStrategy: PID 1403 died... 18:31:25.992807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1403): Terminated: ok {rc=0} 18:31:26.081718 bus /sierra_3: Setting Powered False 18:31:27.181499 bus /sierra_3: Setting Powered False 18:31:28.300513 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 18:31:29.554777 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:29.560312 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:31:29.608872 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:31:29.635268 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:31:29.688630 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:31:29.737192 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:31:29.763334 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:31:30.309987 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 18:31:30.315483 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:30.326472 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:31:30.359837 tst handover.py: using LAC 22915 18:31:30.477990 tst handover.py: using RAC 220 18:31:30.595890 tst handover.py: using CellId 22915 18:31:30.714666 tst handover.py: using BVCI 22916 18:31:30.824487 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:31:30.885951 tst handover.py: using LAC 22916 18:31:31.018394 tst handover.py: using RAC 221 18:31:31.148171 tst handover.py: using CellId 22916 18:31:31.265717 tst handover.py: using BVCI 22917 18:31:31.379653 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:31.391118 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:31.402276 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:31.414454 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:31.425625 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:31:31.436594 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:31:31.575116 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:31:31.702693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:32.157643 run create_hlr_db(pid=1409): Launched 18:31:32.310299 bus /sierra_2: Setting Powered False 18:31:33.374337 run create_hlr_db(pid=1409): Terminated: ok {rc=0} 18:31:33.795658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1411): Launched 18:31:34.118027 run osmo-hlr_10.42.42.2(pid=1412): Launched 18:31:34.240710 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:34.768781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1414): Launched 18:31:35.089722 run osmo-stp_10.42.42.5(pid=1415): Launched 18:31:35.212377 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:35.765674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1417): Launched 18:31:36.089224 run osmo-msc_10.42.42.6(pid=1418): Launched 18:31:36.268694 run osmo-stp_10.42.42.5(pid=1415): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1415)] 18:31:36.405214 run osmo-stp_10.42.42.5(pid=1415): stdout: | (launched: 2022-12-09_18:31:35.031301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:36.542480 run osmo-stp_10.42.42.5(pid=1415): stderr: | 20221209183135223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183135223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183135223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183135223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183135224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183135224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183135224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:36.676886 run osmo-stp_10.42.42.5(pid=1415): stdout: | (launched: 2022-12-09_18:31:35.031301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:36.804894 run osmo-stp_10.42.42.5(pid=1415): stderr: | 20221209183135223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183135223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183135223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183135223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183135224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183135224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183135224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:36.958086 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1415): Process ended prematurely: osmo-stp_10.42.42.5(pid=1415) [trial-2362↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1415)] [trial-2362↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 18:31:36.967213 tst handover.py:18: Test FAILED (6.6 sec) 18:31:36.995965 run osmo-hlr_10.42.42.2(pid=1412): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1412)] 18:31:37.046715 run osmo-hlr_10.42.42.2(pid=1412): stdout: | (launched: 2022-12-09_18:31:34.059409) 18:31:37.099220 run osmo-hlr_10.42.42.2(pid=1412): stderr: | 20221209183134256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183134256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183134256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183134256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183134256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183134256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183134268 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183134276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183134277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183134277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:37.172204 run osmo-msc_10.42.42.6(pid=1418): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1418)] 18:31:37.222949 run osmo-msc_10.42.42.6(pid=1418): stdout: | (launched: 2022-12-09_18:31:36.030588) 18:31:37.275584 run osmo-msc_10.42.42.6(pid=1418): stderr: | 20221209183136356 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183136356 DLGLOBAL DEBUG validating counter group 0x7f81d86f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183136367 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183136367 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183136367 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183136367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183136369 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183136369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183136369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183136370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:37.328402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1411): Terminating (SIGTERM) 18:31:37.371078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1414): Terminating (SIGTERM) 18:31:37.413692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1417): Terminating (SIGTERM) 18:31:37.456860 --- ParallelTerminationStrategy: PID 1411 died... 18:31:37.477057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1411): Terminated: ok {rc=0} 18:31:37.524585 --- ParallelTerminationStrategy: PID 1414 died... 18:31:37.544210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1414): Terminated: ok {rc=0} 18:31:37.591691 --- ParallelTerminationStrategy: PID 1417 died... 18:31:37.611518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1417): Terminated: ok {rc=0} 18:31:37.700176 bus /sierra_3: Setting Powered False 18:31:38.799135 bus /sierra_3: Setting Powered False 18:31:39.916459 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 18:31:41.169981 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:41.175062 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 18:31:41.232788 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:31:41.258873 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:31:41.310481 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 18:31:41.368646 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:31:41.394787 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:31:41.945976 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 18:31:41.952717 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:41.965360 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:31:42.016673 tst handover.py: using LAC 22917 18:31:42.147083 tst handover.py: using RAC 222 18:31:42.272276 tst handover.py: using CellId 22917 18:31:42.396534 tst handover.py: using BVCI 22918 18:31:42.513716 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:31:42.557742 tst handover.py: using LAC 22918 18:31:42.683563 tst handover.py: using RAC 223 18:31:42.808484 tst handover.py: using CellId 22918 18:31:42.931846 tst handover.py: using BVCI 22919 18:31:43.048246 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:43.059734 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:43.071089 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:43.083055 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:43.094915 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:31:43.106594 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:31:43.222765 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:31:43.337241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:43.774209 run create_hlr_db(pid=1423): Launched 18:31:43.896791 bus /sierra_2: Setting Powered False 18:31:44.956757 run create_hlr_db(pid=1423): Terminated: ok {rc=0} 18:31:45.367049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1425): Launched 18:31:45.690271 run osmo-hlr_10.42.42.2(pid=1426): Launched 18:31:45.813601 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:46.511368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1428): Launched 18:31:46.853898 run osmo-stp_10.42.42.5(pid=1429): Launched 18:31:46.992528 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:47.713815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1431): Launched 18:31:48.035953 run osmo-msc_10.42.42.6(pid=1432): Launched 18:31:48.214650 run osmo-stp_10.42.42.5(pid=1429): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1429)] 18:31:48.348737 run osmo-stp_10.42.42.5(pid=1429): stdout: | (launched: 2022-12-09_18:31:46.789819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:48.484429 run osmo-stp_10.42.42.5(pid=1429): stderr: | 20221209183147198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183147198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183147198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183147199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183147199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183147199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183147199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:48.619443 run osmo-stp_10.42.42.5(pid=1429): stdout: | (launched: 2022-12-09_18:31:46.789819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:48.747039 run osmo-stp_10.42.42.5(pid=1429): stderr: | 20221209183147198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183147198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183147198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183147199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183147199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183147199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183147199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:48.899786 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1429): Process ended prematurely: osmo-stp_10.42.42.5(pid=1429) [trial-2362↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1429)] [trial-2362↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 18:31:48.908635 tst handover.py:18: Test FAILED (6.9 sec) 18:31:48.937040 run osmo-hlr_10.42.42.2(pid=1426): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1426)] 18:31:48.987412 run osmo-hlr_10.42.42.2(pid=1426): stdout: | (launched: 2022-12-09_18:31:45.631832) 18:31:49.039486 run osmo-hlr_10.42.42.2(pid=1426): stderr: | 20221209183145842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183145843 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183145843 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183145843 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183145843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183145843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183145866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183145883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183145883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183145883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:49.112196 run osmo-msc_10.42.42.6(pid=1432): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1432)] 18:31:49.162654 run osmo-msc_10.42.42.6(pid=1432): stdout: | (launched: 2022-12-09_18:31:47.977261) 18:31:49.214704 run osmo-msc_10.42.42.6(pid=1432): stderr: | 20221209183148298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183148298 DLGLOBAL DEBUG validating counter group 0x7f6bca7cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183148298 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183148298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183148298 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183148298 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183148300 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183148300 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183148301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183148301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:31:49.267353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1425): Terminating (SIGTERM) 18:31:49.309709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1428): Terminating (SIGTERM) 18:31:49.352060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1431): Terminating (SIGTERM) 18:31:49.394637 --- ParallelTerminationStrategy: PID 1425 died... 18:31:49.414684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1425): Terminated: ok {rc=0} 18:31:49.461821 --- ParallelTerminationStrategy: PID 1428 died... 18:31:49.481822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1428): Terminated: ok {rc=0} 18:31:49.528777 --- ParallelTerminationStrategy: PID 1431 died... 18:31:49.548808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1431): Terminated: ok {rc=0} 18:31:49.638084 bus /sierra_3: Setting Powered False 18:31:50.736686 bus /sierra_3: Setting Powered False 18:31:51.853438 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:31:53.122561 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:53.128383 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:31:53.193353 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:31:53.220227 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:31:53.275487 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:31:53.340692 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:31:53.368024 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:31:53.917192 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:31:53.922491 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:53.933958 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:31:53.988200 tst handover.py: using LAC 22919 18:31:54.114383 tst handover.py: using RAC 224 18:31:54.237863 tst handover.py: using CellId 22919 18:31:54.361956 tst handover.py: using BVCI 22920 18:31:54.479975 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:31:54.528490 tst handover.py: using LAC 22920 18:31:54.652244 tst handover.py: using RAC 225 18:31:54.775707 tst handover.py: using CellId 22920 18:31:54.899243 tst handover.py: using BVCI 22921 18:31:55.015449 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:55.026834 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:55.037930 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:55.049543 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:55.060907 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:31:55.072255 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:31:55.188729 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:31:55.304505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:55.743143 run create_hlr_db(pid=1437): Launched 18:31:55.867224 bus /sierra_2: Setting Powered False 18:31:56.927115 run create_hlr_db(pid=1437): Terminated: ok {rc=0} 18:31:57.337573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1439): Launched 18:31:57.659480 run osmo-hlr_10.42.42.2(pid=1440): Launched 18:31:57.783150 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:58.310656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1442): Launched 18:31:58.631906 run osmo-stp_10.42.42.5(pid=1443): Launched 18:31:58.754584 run osmo-msc_10.42.42.6: Starting osmo-msc 18:31:59.307069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1445): Launched 18:31:59.629274 run osmo-msc_10.42.42.6(pid=1446): Launched 18:31:59.809242 run osmo-stp_10.42.42.5(pid=1443): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1443)] 18:31:59.945308 run osmo-stp_10.42.42.5(pid=1443): stdout: | (launched: 2022-12-09_18:31:58.573231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:00.082101 run osmo-stp_10.42.42.5(pid=1443): stderr: | 20221209183158762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183158762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183158762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183158762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183158763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183158763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183158763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:00.217522 run osmo-stp_10.42.42.5(pid=1443): stdout: | (launched: 2022-12-09_18:31:58.573231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:00.345737 run osmo-stp_10.42.42.5(pid=1443): stderr: | 20221209183158762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183158762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183158762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183158762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183158763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183158763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183158763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:00.499418 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1443): Process ended prematurely: osmo-stp_10.42.42.5(pid=1443) [trial-2362↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1443)] [trial-2362↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 18:32:00.508258 tst handover.py:18: Test FAILED (6.6 sec) 18:32:00.536553 run osmo-hlr_10.42.42.2(pid=1440): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1440)] 18:32:00.587006 run osmo-hlr_10.42.42.2(pid=1440): stdout: | (launched: 2022-12-09_18:31:57.601029) 18:32:00.639445 run osmo-hlr_10.42.42.2(pid=1440): stderr: | 20221209183157796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183157796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183157796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183157796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183157796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183157796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183157811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183157820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183157820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183157820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:00.712250 run osmo-msc_10.42.42.6(pid=1446): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1446)] 18:32:00.762881 run osmo-msc_10.42.42.6(pid=1446): stdout: | (launched: 2022-12-09_18:31:59.570644) 18:32:00.815490 run osmo-msc_10.42.42.6(pid=1446): stderr: | 20221209183159887 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183159887 DLGLOBAL DEBUG validating counter group 0x7f1816d01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183159888 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183159888 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183159888 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183159888 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183159890 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183159890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183159890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183159890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:00.874284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1439): Terminating (SIGTERM) 18:32:00.936204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1442): Terminating (SIGTERM) 18:32:00.979762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1445): Terminating (SIGTERM) 18:32:01.023452 --- ParallelTerminationStrategy: PID 1439 died... 18:32:01.044685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1439): Terminated: ok {rc=0} 18:32:01.094735 --- ParallelTerminationStrategy: PID 1442 died... 18:32:01.114562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1442): Terminated: ok {rc=0} 18:32:01.163900 --- ParallelTerminationStrategy: PID 1445 died... 18:32:01.183841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1445): Terminated: ok {rc=0} 18:32:01.273883 bus /sierra_3: Setting Powered False 18:32:02.375417 bus /sierra_3: Setting Powered False 18:32:03.492871 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 18:32:04.764228 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:04.769493 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:32:04.819368 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:32:04.845744 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:32:04.897352 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:32:04.947297 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:32:04.973412 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:32:05.522645 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 18:32:05.529087 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:05.540903 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 18:32:05.591116 tst handover.py: using LAC 22921 18:32:05.718024 tst handover.py: using RAC 226 18:32:05.842908 tst handover.py: using CellId 22921 18:32:05.969884 tst handover.py: using BVCI 22922 18:32:06.086092 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 18:32:06.121388 tst handover.py: using LAC 22922 18:32:06.246208 tst handover.py: using RAC 227 18:32:06.371619 tst handover.py: using CellId 22922 18:32:06.497133 tst handover.py: using BVCI 22923 18:32:06.613264 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:06.624408 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:06.635429 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:06.646602 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:06.658085 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:06.670084 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 18:32:06.787821 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 18:32:06.905725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:07.375382 run create_hlr_db(pid=1451): Launched 18:32:07.498122 bus /sierra_2: Setting Powered False 18:32:08.562302 run create_hlr_db(pid=1451): Terminated: ok {rc=0} 18:32:08.983577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1453): Launched 18:32:09.305464 run osmo-hlr_10.42.42.2(pid=1454): Launched 18:32:09.429062 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:09.958586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1456): Launched 18:32:10.281117 run osmo-stp_10.42.42.5(pid=1457): Launched 18:32:10.404282 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:10.958487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1459): Launched 18:32:11.279805 run osmo-msc_10.42.42.6(pid=1460): Launched 18:32:11.459855 run osmo-stp_10.42.42.5(pid=1457): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1457)] 18:32:11.596685 run osmo-stp_10.42.42.5(pid=1457): stdout: | (launched: 2022-12-09_18:32:10.222341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:11.733479 run osmo-stp_10.42.42.5(pid=1457): stderr: | 20221209183210412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183210413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183210413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183210413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183210414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183210414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183210414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:11.869241 run osmo-stp_10.42.42.5(pid=1457): stdout: | (launched: 2022-12-09_18:32:10.222341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:11.996908 run osmo-stp_10.42.42.5(pid=1457): stderr: | 20221209183210412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183210413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183210413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183210413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183210414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183210414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183210414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:12.150406 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1457): Process ended prematurely: osmo-stp_10.42.42.5(pid=1457) [trial-2362↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1457)] [trial-2362↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 18:32:12.159442 tst handover.py:18: Test FAILED (6.6 sec) 18:32:12.187544 run osmo-hlr_10.42.42.2(pid=1454): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1454)] 18:32:12.238085 run osmo-hlr_10.42.42.2(pid=1454): stdout: | (launched: 2022-12-09_18:32:09.246686) 18:32:12.290338 run osmo-hlr_10.42.42.2(pid=1454): stderr: | 20221209183209443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183209444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183209444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183209444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183209444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183209444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183209456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183209464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183209464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183209465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:12.363416 run osmo-msc_10.42.42.6(pid=1460): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1460)] 18:32:12.413929 run osmo-msc_10.42.42.6(pid=1460): stdout: | (launched: 2022-12-09_18:32:11.221268) 18:32:12.466122 run osmo-msc_10.42.42.6(pid=1460): stderr: | 20221209183211539 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183211539 DLGLOBAL DEBUG validating counter group 0x7faf2d4b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183211539 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183211539 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183211539 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183211540 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183211541 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183211542 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183211542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183211542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:12.518730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1453): Terminating (SIGTERM) 18:32:12.560926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1456): Terminating (SIGTERM) 18:32:12.603673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1459): Terminating (SIGTERM) 18:32:12.646283 --- ParallelTerminationStrategy: PID 1453 died... 18:32:12.666199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1453): Terminated: ok {rc=0} 18:32:12.712920 --- ParallelTerminationStrategy: PID 1456 died... 18:32:12.732494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1456): Terminated: ok {rc=0} 18:32:12.779152 --- ParallelTerminationStrategy: PID 1459 died... 18:32:12.798652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1459): Terminated: ok {rc=0} 18:32:12.887373 bus /sierra_3: Setting Powered False 18:32:13.986643 bus /sierra_3: Setting Powered False 18:32:15.102751 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 18:32:16.375060 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:16.380865 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:32:16.455092 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:32:16.487451 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:32:16.544787 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:32:16.621913 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:32:16.653625 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:32:17.217492 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 18:32:17.224488 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:17.237147 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:32:17.290802 tst handover.py: using LAC 22923 18:32:17.423009 tst handover.py: using RAC 228 18:32:17.548759 tst handover.py: using CellId 22923 18:32:17.672170 tst handover.py: using BVCI 22924 18:32:17.789916 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:32:17.837437 tst handover.py: using LAC 22924 18:32:17.954493 tst handover.py: using RAC 229 18:32:18.071656 tst handover.py: using CellId 22924 18:32:18.186813 tst handover.py: using BVCI 22925 18:32:18.294614 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:18.305347 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:18.315906 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:18.326553 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:18.337149 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:32:18.347620 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:32:18.465251 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:32:18.586292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:19.056778 run create_hlr_db(pid=1465): Launched 18:32:19.179919 bus /sierra_2: Setting Powered False 18:32:20.244454 run create_hlr_db(pid=1465): Terminated: ok {rc=0} 18:32:20.649553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1467): Launched 18:32:20.950478 run osmo-hlr_10.42.42.2(pid=1468): Launched 18:32:21.064329 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:21.558927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1470): Launched 18:32:21.861431 run osmo-stp_10.42.42.5(pid=1471): Launched 18:32:21.976485 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:22.497653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1473): Launched 18:32:22.798918 run osmo-msc_10.42.42.6(pid=1474): Launched 18:32:22.968155 run osmo-stp_10.42.42.5(pid=1471): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1471)] 18:32:23.099850 run osmo-stp_10.42.42.5(pid=1471): stdout: | (launched: 2022-12-09_18:32:21.805935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:23.227369 run osmo-stp_10.42.42.5(pid=1471): stderr: | 20221209183221974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183221974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183221975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183221975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183221976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183221976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183221976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:23.352176 run osmo-stp_10.42.42.5(pid=1471): stdout: | (launched: 2022-12-09_18:32:21.805935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:23.471508 run osmo-stp_10.42.42.5(pid=1471): stderr: | 20221209183221974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183221974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183221975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183221975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183221976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183221976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183221976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:23.614727 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1471): Process ended prematurely: osmo-stp_10.42.42.5(pid=1471) [trial-2362↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1471)] [trial-2362↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 18:32:23.622709 tst handover.py:18: Test FAILED (6.4 sec) 18:32:23.648651 run osmo-hlr_10.42.42.2(pid=1468): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1468)] 18:32:23.696184 run osmo-hlr_10.42.42.2(pid=1468): stdout: | (launched: 2022-12-09_18:32:20.895411) 18:32:23.745655 run osmo-hlr_10.42.42.2(pid=1468): stderr: | 20221209183221070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183221070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183221070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183221070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183221070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183221070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183221082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183221091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183221091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183221091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:23.814639 run osmo-msc_10.42.42.6(pid=1474): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1474)] 18:32:23.862253 run osmo-msc_10.42.42.6(pid=1474): stdout: | (launched: 2022-12-09_18:32:22.742878) 18:32:23.911615 run osmo-msc_10.42.42.6(pid=1474): stderr: | 20221209183223014 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183223014 DLGLOBAL DEBUG validating counter group 0x7fc1ed83fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183223015 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183223015 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183223015 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183223015 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183223018 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183223018 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183223018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183223018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:23.961165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1467): Terminating (SIGTERM) 18:32:24.000780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1470): Terminating (SIGTERM) 18:32:24.040387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1473): Terminating (SIGTERM) 18:32:24.080194 --- ParallelTerminationStrategy: PID 1467 died... 18:32:24.099211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1467): Terminated: ok {rc=0} 18:32:24.143170 --- ParallelTerminationStrategy: PID 1470 died... 18:32:24.161685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1470): Terminated: ok {rc=0} 18:32:24.205305 --- ParallelTerminationStrategy: PID 1473 died... 18:32:24.223796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1473): Terminated: ok {rc=0} 18:32:24.306985 bus /sierra_3: Setting Powered False 18:32:25.402866 bus /sierra_3: Setting Powered False 18:32:26.518253 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 18:32:27.797979 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:27.804088 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:32:27.865265 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:32:27.891483 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:32:27.942605 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:32:28.006683 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:32:28.034005 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:32:28.583647 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 18:32:28.589537 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:28.600675 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:32:28.649581 tst handover.py: using LAC 22925 18:32:28.767167 tst handover.py: using RAC 230 18:32:28.884481 tst handover.py: using CellId 22925 18:32:29.000787 tst handover.py: using BVCI 22926 18:32:29.109137 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:32:29.159071 tst handover.py: using LAC 22926 18:32:29.275616 tst handover.py: using RAC 231 18:32:29.391442 tst handover.py: using CellId 22926 18:32:29.507091 tst handover.py: using BVCI 22927 18:32:29.615702 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.626593 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.637206 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.647818 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.658448 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:32:29.668876 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:32:29.785623 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:32:29.902487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:30.371590 run create_hlr_db(pid=1479): Launched 18:32:30.495112 bus /sierra_2: Setting Powered False 18:32:31.557844 run create_hlr_db(pid=1479): Terminated: ok {rc=0} 18:32:31.989718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1481): Launched 18:32:32.320663 run osmo-hlr_10.42.42.2(pid=1482): Launched 18:32:32.445489 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:32.972552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1484): Launched 18:32:33.294318 run osmo-stp_10.42.42.5(pid=1485): Launched 18:32:33.416898 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:33.970025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1487): Launched 18:32:34.289968 run osmo-msc_10.42.42.6(pid=1488): Launched 18:32:34.468389 run osmo-stp_10.42.42.5(pid=1485): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1485)] 18:32:34.603904 run osmo-stp_10.42.42.5(pid=1485): stdout: | (launched: 2022-12-09_18:32:33.235596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:34.739635 run osmo-stp_10.42.42.5(pid=1485): stderr: | 20221209183233425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183233426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183233426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183233426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183233427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183233427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183233427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:34.874626 run osmo-stp_10.42.42.5(pid=1485): stdout: | (launched: 2022-12-09_18:32:33.235596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:35.002322 run osmo-stp_10.42.42.5(pid=1485): stderr: | 20221209183233425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183233426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183233426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183233426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183233427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183233427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183233427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:35.155121 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1485): Process ended prematurely: osmo-stp_10.42.42.5(pid=1485) [trial-2362↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1485)] [trial-2362↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 18:32:35.164095 tst handover.py:18: Test FAILED (6.6 sec) 18:32:35.192265 run osmo-hlr_10.42.42.2(pid=1482): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1482)] 18:32:35.242569 run osmo-hlr_10.42.42.2(pid=1482): stdout: | (launched: 2022-12-09_18:32:32.261967) 18:32:35.294340 run osmo-hlr_10.42.42.2(pid=1482): stderr: | 20221209183232458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183232459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183232459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183232459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183232459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183232459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183232471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183232479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183232480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183232480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:35.366310 run osmo-msc_10.42.42.6(pid=1488): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1488)] 18:32:35.416290 run osmo-msc_10.42.42.6(pid=1488): stdout: | (launched: 2022-12-09_18:32:34.231698) 18:32:35.467671 run osmo-msc_10.42.42.6(pid=1488): stderr: | 20221209183234551 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183234551 DLGLOBAL DEBUG validating counter group 0x7f15bbca3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183234551 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183234551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183234552 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183234552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183234554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183234554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183234554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183234554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:35.519857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1481): Terminating (SIGTERM) 18:32:35.561635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1484): Terminating (SIGTERM) 18:32:35.603589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1487): Terminating (SIGTERM) 18:32:35.646020 --- ParallelTerminationStrategy: PID 1481 died... 18:32:35.666187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1481): Terminated: ok {rc=0} 18:32:35.712737 --- ParallelTerminationStrategy: PID 1484 died... 18:32:35.732391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1484): Terminated: ok {rc=0} 18:32:35.778950 --- ParallelTerminationStrategy: PID 1487 died... 18:32:35.798538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1487): Terminated: ok {rc=0} 18:32:35.888718 bus /sierra_3: Setting Powered False 18:32:36.987899 bus /sierra_3: Setting Powered False 18:32:38.105680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 18:32:39.376417 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:39.382627 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 18:32:39.443700 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:32:39.470999 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:32:39.523990 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 18:32:39.584621 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:32:39.611903 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:32:40.165831 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 18:32:40.171208 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:40.182744 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:32:40.227869 tst handover.py: using LAC 22927 18:32:40.354542 tst handover.py: using RAC 232 18:32:40.492302 tst handover.py: using CellId 22927 18:32:40.623132 tst handover.py: using BVCI 22928 18:32:40.739998 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 18:32:40.789877 tst handover.py: using LAC 22928 18:32:40.913383 tst handover.py: using RAC 233 18:32:41.039995 tst handover.py: using CellId 22928 18:32:41.166398 tst handover.py: using BVCI 22929 18:32:41.282166 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:41.293757 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:41.305174 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:41.316766 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:41.328378 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:32:41.340232 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:32:41.456312 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:32:41.570388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:42.010390 run create_hlr_db(pid=1497): Launched 18:32:42.134412 bus /sierra_2: Setting Powered False 18:32:43.194888 run create_hlr_db(pid=1497): Terminated: ok {rc=0} 18:32:43.607278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1499): Launched 18:32:43.929802 run osmo-hlr_10.42.42.2(pid=1500): Launched 18:32:44.052923 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:44.582189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1502): Launched 18:32:44.903888 run osmo-stp_10.42.42.5(pid=1503): Launched 18:32:45.027057 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:45.583015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1505): Launched 18:32:45.922407 run osmo-msc_10.42.42.6(pid=1506): Launched 18:32:46.237788 run osmo-stp_10.42.42.5(pid=1503): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1503)] 18:32:46.552239 run osmo-stp_10.42.42.5(pid=1503): stdout: | (launched: 2022-12-09_18:32:44.845087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:46.762352 run osmo-stp_10.42.42.5(pid=1503): stderr: | 20221209183245035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183245035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183245036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183245036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183245036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183245037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183245037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:46.955711 run osmo-stp_10.42.42.5(pid=1503): stdout: | (launched: 2022-12-09_18:32:44.845087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:47.080397 run osmo-stp_10.42.42.5(pid=1503): stderr: | 20221209183245035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183245035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183245036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183245036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183245036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183245037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183245037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:47.229398 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1503): Process ended prematurely: osmo-stp_10.42.42.5(pid=1503) [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1503)] [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 18:32:47.238198 tst handover.py:18: Test FAILED (7.1 sec) 18:32:47.266534 run osmo-hlr_10.42.42.2(pid=1500): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1500)] 18:32:47.317184 run osmo-hlr_10.42.42.2(pid=1500): stdout: | (launched: 2022-12-09_18:32:43.870935) 18:32:47.368924 run osmo-hlr_10.42.42.2(pid=1500): stderr: | 20221209183244067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183244067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183244067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183244067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183244067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183244067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183244080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183244089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183244089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183244089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:47.439329 run osmo-msc_10.42.42.6(pid=1506): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1506)] 18:32:47.488081 run osmo-msc_10.42.42.6(pid=1506): stdout: | (launched: 2022-12-09_18:32:45.848376) 18:32:47.538728 run osmo-msc_10.42.42.6(pid=1506): stderr: | 20221209183246495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183246495 DLGLOBAL DEBUG validating counter group 0x7f55468c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183246495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183246495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183246495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183246496 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183246497 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183246498 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183246498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183246498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:47.589949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1499): Terminating (SIGTERM) 18:32:47.630553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1502): Terminating (SIGTERM) 18:32:47.671341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1505): Terminating (SIGTERM) 18:32:47.712389 --- ParallelTerminationStrategy: PID 1499 died... 18:32:47.731564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1499): Terminated: ok {rc=0} 18:32:47.777314 --- ParallelTerminationStrategy: PID 1502 died... 18:32:47.796121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1502): Terminated: ok {rc=0} 18:32:47.841540 --- ParallelTerminationStrategy: PID 1505 died... 18:32:47.860232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1505): Terminated: ok {rc=0} 18:32:47.947528 bus /sierra_3: Setting Powered False 18:32:49.047239 bus /sierra_3: Setting Powered False 18:32:50.163761 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 18:32:51.432808 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:51.438329 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:32:51.484309 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:32:51.510492 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:32:51.562664 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:32:51.609193 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:32:51.635189 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:32:52.185618 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 18:32:52.190771 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:52.201812 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 18:32:52.245072 tst handover.py: using LAC 22929 18:32:52.362628 tst handover.py: using RAC 234 18:32:52.480865 tst handover.py: using CellId 22929 18:32:52.598530 tst handover.py: using BVCI 22930 18:32:52.706785 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 18:32:52.744803 tst handover.py: using LAC 22930 18:32:52.861602 tst handover.py: using RAC 235 18:32:52.977167 tst handover.py: using CellId 22930 18:32:53.093574 tst handover.py: using BVCI 22931 18:32:53.212325 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:53.223677 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:53.234866 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:53.246839 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:53.258917 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:32:53.270921 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 18:32:53.386825 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 18:32:53.505113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:53.974680 run create_hlr_db(pid=1511): Launched 18:32:54.096475 bus /sierra_2: Setting Powered False 18:32:55.160334 run create_hlr_db(pid=1511): Terminated: ok {rc=0} 18:32:55.579877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1513): Launched 18:32:55.900911 run osmo-hlr_10.42.42.2(pid=1514): Launched 18:32:56.024378 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:56.548722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1516): Launched 18:32:56.869668 run osmo-stp_10.42.42.5(pid=1517): Launched 18:32:56.992901 run osmo-msc_10.42.42.6: Starting osmo-msc 18:32:57.545281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1519): Launched 18:32:57.866185 run osmo-msc_10.42.42.6(pid=1520): Launched 18:32:58.044866 run osmo-stp_10.42.42.5(pid=1517): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1517)] 18:32:58.179870 run osmo-stp_10.42.42.5(pid=1517): stdout: | (launched: 2022-12-09_18:32:56.810893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:58.315719 run osmo-stp_10.42.42.5(pid=1517): stderr: | 20221209183257000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183257000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183257001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183257001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183257002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183257002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183257002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:58.450711 run osmo-stp_10.42.42.5(pid=1517): stdout: | (launched: 2022-12-09_18:32:56.810893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:58.578673 run osmo-stp_10.42.42.5(pid=1517): stderr: | 20221209183257000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183257000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183257001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183257001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183257002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183257002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183257002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:58.731195 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1517): Process ended prematurely: osmo-stp_10.42.42.5(pid=1517) [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1517)] [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 18:32:58.739975 tst handover.py:18: Test FAILED (6.5 sec) 18:32:58.767830 run osmo-hlr_10.42.42.2(pid=1514): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1514)] 18:32:58.817902 run osmo-hlr_10.42.42.2(pid=1514): stdout: | (launched: 2022-12-09_18:32:55.842351) 18:32:58.869376 run osmo-hlr_10.42.42.2(pid=1514): stderr: | 20221209183256039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183256039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183256039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183256039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183256039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183256039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183256051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183256059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183256059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183256059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:58.941179 run osmo-msc_10.42.42.6(pid=1520): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1520)] 18:32:58.990884 run osmo-msc_10.42.42.6(pid=1520): stdout: | (launched: 2022-12-09_18:32:57.807705) 18:32:59.042326 run osmo-msc_10.42.42.6(pid=1520): stderr: | 20221209183258126 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183258126 DLGLOBAL DEBUG validating counter group 0x7f5fe903fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183258126 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183258126 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183258126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183258127 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183258128 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183258129 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183258129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183258129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:32:59.094471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1513): Terminating (SIGTERM) 18:32:59.135943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1516): Terminating (SIGTERM) 18:32:59.177533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1519): Terminating (SIGTERM) 18:32:59.219388 --- ParallelTerminationStrategy: PID 1513 died... 18:32:59.239251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1513): Terminated: ok {rc=0} 18:32:59.285650 --- ParallelTerminationStrategy: PID 1516 died... 18:32:59.304886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1516): Terminated: ok {rc=0} 18:32:59.351452 --- ParallelTerminationStrategy: PID 1519 died... 18:32:59.370815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1519): Terminated: ok {rc=0} 18:32:59.458334 bus /sierra_3: Setting Powered False 18:33:00.556665 bus /sierra_3: Setting Powered False 18:33:01.682647 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 18:33:02.951410 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:02.957068 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:33:03.016872 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:33:03.044108 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:33:03.097014 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:33:03.156580 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:33:03.183392 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:33:03.732312 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 18:33:03.737474 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:03.748415 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:33:03.793428 tst handover.py: using LAC 22931 18:33:03.911834 tst handover.py: using RAC 236 18:33:04.031364 tst handover.py: using CellId 22931 18:33:04.149829 tst handover.py: using BVCI 22932 18:33:04.260372 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:33:04.309990 tst handover.py: using LAC 22932 18:33:04.428732 tst handover.py: using RAC 237 18:33:04.549412 tst handover.py: using CellId 22932 18:33:04.667215 tst handover.py: using BVCI 22933 18:33:04.775352 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:04.786296 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:04.797026 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:04.808298 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:04.819769 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:04.830994 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:33:04.949356 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:33:05.065704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:05.505410 run create_hlr_db(pid=1527): Launched 18:33:05.629209 bus /sierra_2: Setting Powered False 18:33:06.689541 run create_hlr_db(pid=1527): Terminated: ok {rc=0} 18:33:07.101355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1529): Launched 18:33:07.423564 run osmo-hlr_10.42.42.2(pid=1530): Launched 18:33:07.546697 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:08.070187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1532): Launched 18:33:08.391181 run osmo-stp_10.42.42.5(pid=1533): Launched 18:33:08.514239 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:09.067907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1535): Launched 18:33:09.389575 run osmo-msc_10.42.42.6(pid=1536): Launched 18:33:09.570814 run osmo-stp_10.42.42.5(pid=1533): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1533)] 18:33:09.707331 run osmo-stp_10.42.42.5(pid=1533): stdout: | (launched: 2022-12-09_18:33:08.332626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:09.844290 run osmo-stp_10.42.42.5(pid=1533): stderr: | 20221209183308522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183308522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183308522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183308523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183308523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183308523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183308523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:09.980276 run osmo-stp_10.42.42.5(pid=1533): stdout: | (launched: 2022-12-09_18:33:08.332626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:10.108550 run osmo-stp_10.42.42.5(pid=1533): stderr: | 20221209183308522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183308522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183308522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183308523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183308523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183308523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183308523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:10.262260 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1533): Process ended prematurely: osmo-stp_10.42.42.5(pid=1533) [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1533)] [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 18:33:10.271177 tst handover.py:18: Test FAILED (6.5 sec) 18:33:10.299269 run osmo-hlr_10.42.42.2(pid=1530): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1530)] 18:33:10.349917 run osmo-hlr_10.42.42.2(pid=1530): stdout: | (launched: 2022-12-09_18:33:07.364813) 18:33:10.402073 run osmo-hlr_10.42.42.2(pid=1530): stderr: | 20221209183307561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183307561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183307561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183307561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183307561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183307561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183307574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183307582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183307582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183307582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:10.474705 run osmo-msc_10.42.42.6(pid=1536): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1536)] 18:33:10.525509 run osmo-msc_10.42.42.6(pid=1536): stdout: | (launched: 2022-12-09_18:33:09.330864) 18:33:10.577725 run osmo-msc_10.42.42.6(pid=1536): stderr: | 20221209183309651 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183309651 DLGLOBAL DEBUG validating counter group 0x7f41b2e77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183309651 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183309651 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183309651 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183309651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183309653 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183309653 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183309654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183309654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:10.630216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1529): Terminating (SIGTERM) 18:33:10.672430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1532): Terminating (SIGTERM) 18:33:10.714790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1535): Terminating (SIGTERM) 18:33:10.757420 --- ParallelTerminationStrategy: PID 1529 died... 18:33:10.777621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1529): Terminated: ok {rc=0} 18:33:10.824739 --- ParallelTerminationStrategy: PID 1532 died... 18:33:10.844557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1532): Terminated: ok {rc=0} 18:33:10.891373 --- ParallelTerminationStrategy: PID 1535 died... 18:33:10.910984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1535): Terminated: ok {rc=0} 18:33:10.998711 bus /sierra_3: Setting Powered False 18:33:12.097653 bus /sierra_3: Setting Powered False 18:33:13.213958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 18:33:14.490470 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:14.496132 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:33:14.556120 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:33:14.583488 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:33:14.634897 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:33:14.693938 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:33:14.721174 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:33:15.275988 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 18:33:15.281496 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:15.292797 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:33:15.340869 tst handover.py: using LAC 22933 18:33:15.466639 tst handover.py: using RAC 238 18:33:15.591188 tst handover.py: using CellId 22933 18:33:15.718160 tst handover.py: using BVCI 22934 18:33:15.836875 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:33:15.885949 tst handover.py: using LAC 22934 18:33:16.023143 tst handover.py: using RAC 239 18:33:16.149451 tst handover.py: using CellId 22934 18:33:16.275346 tst handover.py: using BVCI 22935 18:33:16.390665 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:16.402787 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:16.416110 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:16.429671 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:16.442692 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:16.454515 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:33:16.574932 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:33:16.721387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:17.198987 run create_hlr_db(pid=1541): Launched 18:33:17.350710 bus /sierra_2: Setting Powered False 18:33:18.410568 run create_hlr_db(pid=1541): Terminated: ok {rc=0} 18:33:18.823810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1543): Launched 18:33:19.145495 run osmo-hlr_10.42.42.2(pid=1544): Launched 18:33:19.269083 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:19.799146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1546): Launched 18:33:20.120673 run osmo-stp_10.42.42.5(pid=1547): Launched 18:33:20.245491 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:20.799166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1549): Launched 18:33:21.121527 run osmo-msc_10.42.42.6(pid=1550): Launched 18:33:21.301708 run osmo-stp_10.42.42.5(pid=1547): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1547)] 18:33:21.438387 run osmo-stp_10.42.42.5(pid=1547): stdout: | (launched: 2022-12-09_18:33:20.062562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:21.576811 run osmo-stp_10.42.42.5(pid=1547): stderr: | 20221209183320254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183320254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183320254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183320255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183320255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183320255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183320255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:21.712574 run osmo-stp_10.42.42.5(pid=1547): stdout: | (launched: 2022-12-09_18:33:20.062562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:21.840502 run osmo-stp_10.42.42.5(pid=1547): stderr: | 20221209183320254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183320254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183320254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183320255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183320255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183320255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183320255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:21.993992 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1547): Process ended prematurely: osmo-stp_10.42.42.5(pid=1547) [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1547)] [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 18:33:22.002964 tst handover.py:18: Test FAILED (6.7 sec) 18:33:22.031138 run osmo-hlr_10.42.42.2(pid=1544): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1544)] 18:33:22.081384 run osmo-hlr_10.42.42.2(pid=1544): stdout: | (launched: 2022-12-09_18:33:19.086768) 18:33:22.133573 run osmo-hlr_10.42.42.2(pid=1544): stderr: | 20221209183319284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183319284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183319284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183319284 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183319284 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183319285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183319297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183319305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183319305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183319305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:22.206334 run osmo-msc_10.42.42.6(pid=1550): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1550)] 18:33:22.256517 run osmo-msc_10.42.42.6(pid=1550): stdout: | (launched: 2022-12-09_18:33:21.062676) 18:33:22.308413 run osmo-msc_10.42.42.6(pid=1550): stderr: | 20221209183321384 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183321384 DLGLOBAL DEBUG validating counter group 0x7faf5fe67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183321384 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183321384 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183321384 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183321384 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183321386 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183321386 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183321387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183321387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:22.360695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1543): Terminating (SIGTERM) 18:33:22.402554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1546): Terminating (SIGTERM) 18:33:22.444394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1549): Terminating (SIGTERM) 18:33:22.486621 --- ParallelTerminationStrategy: PID 1543 died... 18:33:22.506768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1543): Terminated: ok {rc=0} 18:33:22.553822 --- ParallelTerminationStrategy: PID 1546 died... 18:33:22.573458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1546): Terminated: ok {rc=0} 18:33:22.620296 --- ParallelTerminationStrategy: PID 1549 died... 18:33:22.639906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1549): Terminated: ok {rc=0} 18:33:22.729048 bus /sierra_3: Setting Powered False 18:33:23.828118 bus /sierra_3: Setting Powered False 18:33:24.943982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 18:33:26.205103 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:26.210332 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 18:33:26.260506 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 18:33:26.286656 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 18:33:26.340426 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 18:33:26.392663 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 18:33:26.419947 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 18:33:26.966014 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 18:33:26.971141 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:26.982048 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 18:33:27.029375 tst handover.py: using LAC 22935 18:33:27.147566 tst handover.py: using RAC 240 18:33:27.266201 tst handover.py: using CellId 22935 18:33:27.386785 tst handover.py: using BVCI 22936 18:33:27.496672 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 18:33:27.532713 tst handover.py: using LAC 22936 18:33:27.650350 tst handover.py: using RAC 241 18:33:27.769782 tst handover.py: using CellId 22936 18:33:27.889738 tst handover.py: using BVCI 22937 18:33:27.999502 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:28.010422 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:28.021192 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:28.031869 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:28.042653 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 18:33:28.053279 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 18:33:28.169347 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 18:33:28.282812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:28.724491 run create_hlr_db(pid=1555): Launched 18:33:28.848093 bus /sierra_2: Setting Powered False 18:33:29.911300 run create_hlr_db(pid=1555): Terminated: ok {rc=0} 18:33:30.333096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1557): Launched 18:33:30.657168 run osmo-hlr_10.42.42.2(pid=1558): Launched 18:33:30.780751 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:31.411146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1560): Launched 18:33:31.738480 run osmo-stp_10.42.42.5(pid=1561): Launched 18:33:31.894536 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:32.594278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1563): Launched 18:33:32.897688 run osmo-msc_10.42.42.6(pid=1564): Launched 18:33:33.064042 run osmo-stp_10.42.42.5(pid=1561): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1561)] 18:33:33.189857 run osmo-stp_10.42.42.5(pid=1561): stdout: | (launched: 2022-12-09_18:33:31.677938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:33.316835 run osmo-stp_10.42.42.5(pid=1561): stderr: | 20221209183332027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183332028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183332028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183332028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183332029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183332029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183332029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:33.442304 run osmo-stp_10.42.42.5(pid=1561): stdout: | (launched: 2022-12-09_18:33:31.677938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:33.561670 run osmo-stp_10.42.42.5(pid=1561): stderr: | 20221209183332027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183332028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183332028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183332028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183332029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183332029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183332029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:33.704148 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1561): Process ended prematurely: osmo-stp_10.42.42.5(pid=1561) [trial-2362↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1561)] [trial-2362↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 18:33:33.712456 tst handover.py:18: Test FAILED (6.7 sec) 18:33:33.738680 run osmo-hlr_10.42.42.2(pid=1558): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1558)] 18:33:33.786172 run osmo-hlr_10.42.42.2(pid=1558): stdout: | (launched: 2022-12-09_18:33:30.598060) 18:33:33.835642 run osmo-hlr_10.42.42.2(pid=1558): stderr: | 20221209183330793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183330793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183330794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183330794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183330794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183330794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183330805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183330815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183330815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183330815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:33.904632 run osmo-msc_10.42.42.6(pid=1564): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1564)] 18:33:33.952393 run osmo-msc_10.42.42.6(pid=1564): stdout: | (launched: 2022-12-09_18:33:32.842210) 18:33:34.001582 run osmo-msc_10.42.42.6(pid=1564): stderr: | 20221209183333113 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183333113 DLGLOBAL DEBUG validating counter group 0x7f698e12bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183333114 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183333114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183333114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183333114 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183333116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183333116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183333116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183333116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:34.051149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1557): Terminating (SIGTERM) 18:33:34.090788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1560): Terminating (SIGTERM) 18:33:34.130338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1563): Terminating (SIGTERM) 18:33:34.170258 --- ParallelTerminationStrategy: PID 1557 died... 18:33:34.189406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1557): Terminated: ok {rc=0} 18:33:34.233607 --- ParallelTerminationStrategy: PID 1560 died... 18:33:34.252035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1560): Terminated: ok {rc=0} 18:33:34.295934 --- ParallelTerminationStrategy: PID 1563 died... 18:33:34.314550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1563): Terminated: ok {rc=0} 18:33:34.400024 bus /sierra_3: Setting Powered False 18:33:35.500429 bus /sierra_3: Setting Powered False 18:33:36.615878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 18:33:37.868661 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:37.873772 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:33:37.936037 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:33:37.962360 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:33:38.015565 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:33:38.081160 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:33:38.107076 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:33:38.653563 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 18:33:38.658557 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:38.669492 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:33:38.716611 tst handover.py: using LAC 22937 18:33:38.839378 tst handover.py: using RAC 242 18:33:38.967119 tst handover.py: using CellId 22937 18:33:39.092555 tst handover.py: using BVCI 22938 18:33:39.202537 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:33:39.253174 tst handover.py: using LAC 22938 18:33:39.370203 tst handover.py: using RAC 243 18:33:39.486414 tst handover.py: using CellId 22938 18:33:39.604365 tst handover.py: using BVCI 22939 18:33:39.712598 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:39.723546 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:39.734316 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:39.745138 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:39.755822 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:33:39.766502 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:33:39.881344 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:33:39.998958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:40.470759 run create_hlr_db(pid=1569): Launched 18:33:40.595034 bus /sierra_2: Setting Powered False 18:33:41.659077 run create_hlr_db(pid=1569): Terminated: ok {rc=0} 18:33:42.079902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1571): Launched 18:33:42.402099 run osmo-hlr_10.42.42.2(pid=1572): Launched 18:33:42.526671 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:43.057842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1574): Launched 18:33:43.382109 run osmo-stp_10.42.42.5(pid=1575): Launched 18:33:43.505919 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:44.062455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1577): Launched 18:33:44.384590 run osmo-msc_10.42.42.6(pid=1578): Launched 18:33:44.565141 run osmo-stp_10.42.42.5(pid=1575): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1575)] 18:33:44.700923 run osmo-stp_10.42.42.5(pid=1575): stdout: | (launched: 2022-12-09_18:33:43.323220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:44.837414 run osmo-stp_10.42.42.5(pid=1575): stderr: | 20221209183343514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183343514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183343514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183343514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183343515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183343515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183343515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:44.966770 run osmo-stp_10.42.42.5(pid=1575): stdout: | (launched: 2022-12-09_18:33:43.323220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:45.087207 run osmo-stp_10.42.42.5(pid=1575): stderr: | 20221209183343514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183343514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183343514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183343514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183343515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183343515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183343515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:45.230764 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1575): Process ended prematurely: osmo-stp_10.42.42.5(pid=1575) [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1575)] [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 18:33:45.239006 tst handover.py:18: Test FAILED (6.6 sec) 18:33:45.266194 run osmo-hlr_10.42.42.2(pid=1572): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1572)] 18:33:45.314975 run osmo-hlr_10.42.42.2(pid=1572): stdout: | (launched: 2022-12-09_18:33:42.343259) 18:33:45.365343 run osmo-hlr_10.42.42.2(pid=1572): stderr: | 20221209183342540 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183342540 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183342540 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183342540 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183342540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183342540 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183342552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183342561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183342561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183342561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:45.435959 run osmo-msc_10.42.42.6(pid=1578): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1578)] 18:33:45.484609 run osmo-msc_10.42.42.6(pid=1578): stdout: | (launched: 2022-12-09_18:33:44.325742) 18:33:45.534891 run osmo-msc_10.42.42.6(pid=1578): stderr: | 20221209183344647 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183344647 DLGLOBAL DEBUG validating counter group 0x7f5006dfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183344647 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183344647 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183344647 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183344647 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183344649 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183344649 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183344650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183344650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:45.585545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1571): Terminating (SIGTERM) 18:33:45.625964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1574): Terminating (SIGTERM) 18:33:45.666580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1577): Terminating (SIGTERM) 18:33:45.707445 --- ParallelTerminationStrategy: PID 1571 died... 18:33:45.726733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1571): Terminated: ok {rc=0} 18:33:45.772269 --- ParallelTerminationStrategy: PID 1574 died... 18:33:45.790980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1574): Terminated: ok {rc=0} 18:33:45.836637 --- ParallelTerminationStrategy: PID 1577 died... 18:33:45.865865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1577): Terminated: ok {rc=0} 18:33:45.962123 bus /sierra_3: Setting Powered False 18:33:47.071892 bus /sierra_3: Setting Powered False 18:33:48.200729 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 18:33:49.472160 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:49.477425 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:33:49.539203 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:33:49.565448 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:33:49.616904 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:33:49.678826 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:33:49.704899 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:33:50.255859 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 18:33:50.260867 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:50.272163 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:33:50.324354 tst handover.py: using LAC 22939 18:33:50.450430 tst handover.py: using RAC 244 18:33:50.576482 tst handover.py: using CellId 22939 18:33:50.700578 tst handover.py: using BVCI 22940 18:33:50.817487 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:33:50.864430 tst handover.py: using LAC 22940 18:33:50.990161 tst handover.py: using RAC 245 18:33:51.115305 tst handover.py: using CellId 22940 18:33:51.242963 tst handover.py: using BVCI 22941 18:33:51.361370 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:51.372686 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:51.383916 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:51.395454 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:51.406978 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:33:51.418506 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:33:51.533729 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:33:51.648341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:52.121092 run create_hlr_db(pid=1583): Launched 18:33:52.244626 bus /sierra_2: Setting Powered False 18:33:53.308844 run create_hlr_db(pid=1583): Terminated: ok {rc=0} 18:33:53.729687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Launched 18:33:54.053603 run osmo-hlr_10.42.42.2(pid=1586): Launched 18:33:54.177465 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:54.702497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Launched 18:33:55.026072 run osmo-stp_10.42.42.5(pid=1589): Launched 18:33:55.148773 run osmo-msc_10.42.42.6: Starting osmo-msc 18:33:55.703051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1591): Launched 18:33:56.026003 run osmo-msc_10.42.42.6(pid=1592): Launched 18:33:56.207404 run osmo-stp_10.42.42.5(pid=1589): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] 18:33:56.343670 run osmo-stp_10.42.42.5(pid=1589): stdout: | (launched: 2022-12-09_18:33:54.967167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:56.480239 run osmo-stp_10.42.42.5(pid=1589): stderr: | 20221209183355157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183355157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183355158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183355158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183355158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183355158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183355158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:56.616630 run osmo-stp_10.42.42.5(pid=1589): stdout: | (launched: 2022-12-09_18:33:54.967167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:56.745414 run osmo-stp_10.42.42.5(pid=1589): stderr: | 20221209183355157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183355157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183355158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183355158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183355158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183355158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183355158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:56.898963 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1589): Process ended prematurely: osmo-stp_10.42.42.5(pid=1589) [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 18:33:56.907797 tst handover.py:18: Test FAILED (6.6 sec) 18:33:56.936063 run osmo-hlr_10.42.42.2(pid=1586): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1586)] 18:33:56.986552 run osmo-hlr_10.42.42.2(pid=1586): stdout: | (launched: 2022-12-09_18:33:53.994711) 18:33:57.038734 run osmo-hlr_10.42.42.2(pid=1586): stderr: | 20221209183354191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183354191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183354191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183354191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183354191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183354191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183354203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183354213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183354213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183354213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:57.111589 run osmo-msc_10.42.42.6(pid=1592): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1592)] 18:33:57.161858 run osmo-msc_10.42.42.6(pid=1592): stdout: | (launched: 2022-12-09_18:33:55.967552) 18:33:57.213833 run osmo-msc_10.42.42.6(pid=1592): stderr: | 20221209183356287 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183356288 DLGLOBAL DEBUG validating counter group 0x7fe8efc9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183356288 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183356288 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183356288 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183356288 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183356290 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183356290 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183356290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183356291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:33:57.266250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Terminating (SIGTERM) 18:33:57.308336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Terminating (SIGTERM) 18:33:57.350698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1591): Terminating (SIGTERM) 18:33:57.392929 --- ParallelTerminationStrategy: PID 1585 died... 18:33:57.413071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Terminated: ok {rc=0} 18:33:57.460496 --- ParallelTerminationStrategy: PID 1588 died... 18:33:57.480114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Terminated: ok {rc=0} 18:33:57.527213 --- ParallelTerminationStrategy: PID 1591 died... 18:33:57.546861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1591): Terminated: ok {rc=0} 18:33:57.634520 bus /sierra_3: Setting Powered False 18:33:58.732500 bus /sierra_3: Setting Powered False 18:33:59.847888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 18:34:01.136621 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:01.143607 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 18:34:01.208550 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 18:34:01.243546 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 18:34:01.314077 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 18:34:01.379609 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 18:34:01.416899 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 18:34:01.966445 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 18:34:01.972739 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:01.987946 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:34:02.028539 tst handover.py: using LAC 22941 18:34:02.151098 tst handover.py: using RAC 246 18:34:02.275911 tst handover.py: using CellId 22941 18:34:02.402715 tst handover.py: using BVCI 22942 18:34:02.521038 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 18:34:02.570708 tst handover.py: using LAC 22942 18:34:02.696247 tst handover.py: using RAC 247 18:34:02.821581 tst handover.py: using CellId 22942 18:34:02.946092 tst handover.py: using BVCI 22943 18:34:03.062352 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.073560 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.084550 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.095887 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.107218 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 18:34:03.118606 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:34:03.232859 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 18:34:03.352010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:03.824335 run create_hlr_db(pid=1597): Launched 18:34:03.946547 bus /sierra_2: Setting Powered False 18:34:05.010936 run create_hlr_db(pid=1597): Terminated: ok {rc=0} 18:34:05.432845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1599): Launched 18:34:05.756392 run osmo-hlr_10.42.42.2(pid=1600): Launched 18:34:05.880103 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:06.409378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1602): Launched 18:34:06.731828 run osmo-stp_10.42.42.5(pid=1603): Launched 18:34:06.855190 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:07.410791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1605): Launched 18:34:07.734553 run osmo-msc_10.42.42.6(pid=1606): Launched 18:34:07.914839 run osmo-stp_10.42.42.5(pid=1603): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1603)] 18:34:08.051566 run osmo-stp_10.42.42.5(pid=1603): stdout: | (launched: 2022-12-09_18:34:06.673524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:08.188544 run osmo-stp_10.42.42.5(pid=1603): stderr: | 20221209183406865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183406865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183406865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183406866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183406866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183406866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183406866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:08.324105 run osmo-stp_10.42.42.5(pid=1603): stdout: | (launched: 2022-12-09_18:34:06.673524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:08.452922 run osmo-stp_10.42.42.5(pid=1603): stderr: | 20221209183406865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183406865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183406865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183406866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183406866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183406866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183406866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:08.607541 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1603): Process ended prematurely: osmo-stp_10.42.42.5(pid=1603) [trial-2362↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1603)] [trial-2362↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 18:34:08.616775 tst handover.py:18: Test FAILED (6.6 sec) 18:34:08.645086 run osmo-hlr_10.42.42.2(pid=1600): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1600)] 18:34:08.695586 run osmo-hlr_10.42.42.2(pid=1600): stdout: | (launched: 2022-12-09_18:34:05.697540) 18:34:08.747857 run osmo-hlr_10.42.42.2(pid=1600): stderr: | 20221209183405894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183405894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183405894 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183405894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183405894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183405894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183405906 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183405914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183405914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183405914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:08.820809 run osmo-msc_10.42.42.6(pid=1606): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1606)] 18:34:08.870997 run osmo-msc_10.42.42.6(pid=1606): stdout: | (launched: 2022-12-09_18:34:07.675869) 18:34:08.922757 run osmo-msc_10.42.42.6(pid=1606): stderr: | 20221209183407994 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183407994 DLGLOBAL DEBUG validating counter group 0x7fd2aa738c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183407994 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183407994 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183407994 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183407994 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183407996 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183407997 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183407997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183407997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:08.974913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1599): Terminating (SIGTERM) 18:34:09.017193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1602): Terminating (SIGTERM) 18:34:09.059196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1605): Terminating (SIGTERM) 18:34:09.101730 --- ParallelTerminationStrategy: PID 1599 died... 18:34:09.121786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1599): Terminated: ok {rc=0} 18:34:09.168690 --- ParallelTerminationStrategy: PID 1602 died... 18:34:09.188292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1602): Terminated: ok {rc=0} 18:34:09.235015 --- ParallelTerminationStrategy: PID 1605 died... 18:34:09.254575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1605): Terminated: ok {rc=0} 18:34:09.343450 bus /sierra_3: Setting Powered False 18:34:10.441894 bus /sierra_3: Setting Powered False 18:34:11.558119 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 18:34:12.819003 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:12.824503 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:34:12.876738 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:34:12.904183 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:34:12.955451 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:34:13.006245 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:34:13.033540 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:34:13.586995 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 18:34:13.592304 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:13.603549 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:34:13.637645 tst handover.py: using LAC 22943 18:34:13.764849 tst handover.py: using RAC 248 18:34:13.890494 tst handover.py: using CellId 22943 18:34:14.014322 tst handover.py: using BVCI 22944 18:34:14.130858 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:34:14.177377 tst handover.py: using LAC 22944 18:34:14.301118 tst handover.py: using RAC 249 18:34:14.425089 tst handover.py: using CellId 22944 18:34:14.549261 tst handover.py: using BVCI 22945 18:34:14.666079 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:14.677269 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:14.688214 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:14.699480 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:14.711519 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:14.722980 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:34:14.840436 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:34:14.958424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:15.430460 run create_hlr_db(pid=1611): Launched 18:34:15.553659 bus /sierra_2: Setting Powered False 18:34:16.634550 run create_hlr_db(pid=1611): Terminated: ok {rc=0} 18:34:17.144841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1613): Launched 18:34:17.463195 run osmo-hlr_10.42.42.2(pid=1614): Launched 18:34:17.580471 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:18.075136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1616): Launched 18:34:18.376503 run osmo-stp_10.42.42.5(pid=1617): Launched 18:34:18.490862 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:19.011956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1619): Launched 18:34:19.314463 run osmo-msc_10.42.42.6(pid=1620): Launched 18:34:19.483110 run osmo-stp_10.42.42.5(pid=1617): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1617)] 18:34:19.611169 run osmo-stp_10.42.42.5(pid=1617): stdout: | (launched: 2022-12-09_18:34:18.320901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:19.738634 run osmo-stp_10.42.42.5(pid=1617): stderr: | 20221209183418492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183418492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183418492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183418492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183418493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183418493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183418493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:19.863574 run osmo-stp_10.42.42.5(pid=1617): stdout: | (launched: 2022-12-09_18:34:18.320901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:19.983117 run osmo-stp_10.42.42.5(pid=1617): stderr: | 20221209183418492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183418492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183418492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183418492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183418493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183418493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183418493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:20.126324 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1617): Process ended prematurely: osmo-stp_10.42.42.5(pid=1617) [trial-2362↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1617)] [trial-2362↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 18:34:20.134580 tst handover.py:18: Test FAILED (6.5 sec) 18:34:20.160658 run osmo-hlr_10.42.42.2(pid=1614): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1614)] 18:34:20.208489 run osmo-hlr_10.42.42.2(pid=1614): stdout: | (launched: 2022-12-09_18:34:17.407433) 18:34:20.258290 run osmo-hlr_10.42.42.2(pid=1614): stderr: | 20221209183417581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183417581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183417581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183417581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183417581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183417581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183417596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183417607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183417607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183417609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:20.327523 run osmo-msc_10.42.42.6(pid=1620): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1620)] 18:34:20.375632 run osmo-msc_10.42.42.6(pid=1620): stdout: | (launched: 2022-12-09_18:34:19.258618) 18:34:20.425238 run osmo-msc_10.42.42.6(pid=1620): stderr: | 20221209183419527 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183419528 DLGLOBAL DEBUG validating counter group 0x7fe8cd51cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183419528 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183419528 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183419528 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183419528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183419530 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183419530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183419531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183419531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:20.475007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1613): Terminating (SIGTERM) 18:34:20.514696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1616): Terminating (SIGTERM) 18:34:20.554500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1619): Terminating (SIGTERM) 18:34:20.594554 --- ParallelTerminationStrategy: PID 1613 died... 18:34:20.613758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1613): Terminated: ok {rc=0} 18:34:20.657819 --- ParallelTerminationStrategy: PID 1616 died... 18:34:20.676494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1616): Terminated: ok {rc=0} 18:34:20.720618 --- ParallelTerminationStrategy: PID 1619 died... 18:34:20.739532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1619): Terminated: ok {rc=0} 18:34:20.825103 bus /sierra_3: Setting Powered False 18:34:21.925144 bus /sierra_3: Setting Powered False 18:34:23.038864 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2362 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 18:34:24.296124 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:24.302084 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 18:34:24.366432 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:34:24.394423 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 18:34:24.447541 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 18:34:24.511223 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:34:24.539019 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 18:34:25.090023 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2362 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 18:34:25.095693 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:25.107273 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:34:25.156292 tst handover.py: using LAC 22945 18:34:25.283546 tst handover.py: using RAC 250 18:34:25.411546 tst handover.py: using CellId 22945 18:34:25.537499 tst handover.py: using BVCI 22946 18:34:25.656567 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 18:34:25.705866 tst handover.py: using LAC 22946 18:34:25.833345 tst handover.py: using RAC 251 18:34:25.958962 tst handover.py: using CellId 22946 18:34:26.086313 tst handover.py: using BVCI 22947 18:34:26.205064 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:26.216509 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:26.228010 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:26.239403 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:26.251076 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 18:34:26.262329 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:34:26.378064 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 18:34:26.499724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:26.971708 run create_hlr_db(pid=1625): Launched 18:34:27.095257 bus /sierra_2: Setting Powered False 18:34:28.158689 run create_hlr_db(pid=1625): Terminated: ok {rc=0} 18:34:28.580050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1627): Launched 18:34:28.905219 run osmo-hlr_10.42.42.2(pid=1628): Launched 18:34:29.028926 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:29.558901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1630): Launched 18:34:29.882206 run osmo-stp_10.42.42.5(pid=1631): Launched 18:34:30.005140 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:30.560089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1633): Launched 18:34:30.906418 run osmo-msc_10.42.42.6(pid=1634): Launched 18:34:31.120819 run osmo-stp_10.42.42.5(pid=1631): ERR: Terminated: ERROR {rc=1} [trial-2362↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1631)] 18:34:31.307696 run osmo-stp_10.42.42.5(pid=1631): stdout: | (launched: 2022-12-09_18:34:29.823477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:31.635462 run osmo-stp_10.42.42.5(pid=1631): stderr: | 20221209183430014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183430014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183430014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183430015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183430015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183430015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183430015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:31.848460 run osmo-stp_10.42.42.5(pid=1631): stdout: | (launched: 2022-12-09_18:34:29.823477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:31.972711 run osmo-stp_10.42.42.5(pid=1631): stderr: | 20221209183430014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209183430014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209183430014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209183430015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209183430015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209183430015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209183430015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:32.123090 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1631): Process ended prematurely: osmo-stp_10.42.42.5(pid=1631) [trial-2362↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1631)] [trial-2362↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 18:34:32.131859 tst handover.py:18: Test FAILED (7.0 sec) 18:34:32.159763 run osmo-hlr_10.42.42.2(pid=1628): ERR: Terminated: ERROR {rc=237} [trial-2362↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1628)] 18:34:32.210601 run osmo-hlr_10.42.42.2(pid=1628): stdout: | (launched: 2022-12-09_18:34:28.846299) 18:34:32.262354 run osmo-hlr_10.42.42.2(pid=1628): stderr: | 20221209183429042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209183429042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209183429042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209183429042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209183429042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209183429042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209183429054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209183429062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209183429062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209183429062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:32.332759 run osmo-msc_10.42.42.6(pid=1634): ERR: Terminated: ERROR {rc=2} [trial-2362↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1634)] 18:34:32.381748 run osmo-msc_10.42.42.6(pid=1634): stdout: | (launched: 2022-12-09_18:34:30.834150) 18:34:32.431392 run osmo-msc_10.42.42.6(pid=1634): stderr: | 20221209183431424 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209183431425 DLGLOBAL DEBUG validating counter group 0x7f2b08ff1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209183431425 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209183431425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209183431425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209183431425 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209183431427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209183431427 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209183431427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209183431428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:32.481517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1627): Terminating (SIGTERM) 18:34:32.521486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1630): Terminating (SIGTERM) 18:34:32.561976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1633): Terminating (SIGTERM) 18:34:32.602328 --- ParallelTerminationStrategy: PID 1627 died... 18:34:32.621825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1627): Terminated: ok {rc=0} 18:34:32.666284 --- ParallelTerminationStrategy: PID 1630 died... 18:34:32.684803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1630): Terminated: ok {rc=0} 18:34:32.729288 --- ParallelTerminationStrategy: PID 1633 died... 18:34:32.747981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1633): Terminated: ok {rc=0} 18:34:32.832700 bus /sierra_3: Setting Powered False 18:34:33.927460 bus /sierra_3: Setting Powered False 18:34:35.043135 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2362 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 18:34:36.314112 tst trial-2362: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362/run.2022-12-09_17-10-07/trial-2362.xml -------------------------------------------------------------------------------------------- trial-2362 FAIL -------------------------------------------------------------------------------------------- 18:34:38.248834 tst trial-2362: trial-2362: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=25798): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25798) [trial-2362↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25798)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.1 sec) Error: osmo-stp_10.42.42.5(pid=25808): Process ended prematurely: osmo-stp_10.42.42.5(pid=25808) [trial-2362↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25808)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=25820): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25820) [trial-2362↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25820)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25830): Process ended prematurely: osmo-stp_10.42.42.5(pid=25830) [trial-2362↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25830)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25844): Process ended prematurely: osmo-stp_10.42.42.5(pid=25844) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25844)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25855): Process ended prematurely: osmo-stp_10.42.42.5(pid=25855) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25855)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25869): Process ended prematurely: osmo-stp_10.42.42.5(pid=25869) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25869)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25880): Process ended prematurely: osmo-stp_10.42.42.5(pid=25880) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25880)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25895): Process ended prematurely: osmo-stp_10.42.42.5(pid=25895) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25895)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25906): Process ended prematurely: osmo-stp_10.42.42.5(pid=25906) [trial-2362↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25906)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25920): Process ended prematurely: osmo-stp_10.42.42.5(pid=25920) [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25920)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25931): Process ended prematurely: osmo-stp_10.42.42.5(pid=25931) [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25931)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25945): Process ended prematurely: osmo-stp_10.42.42.5(pid=25945) [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25945)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25956): Process ended prematurely: osmo-stp_10.42.42.5(pid=25956) [trial-2362↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25956)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25970): Process ended prematurely: osmo-stp_10.42.42.5(pid=25970) [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25970)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25985): Process ended prematurely: osmo-stp_10.42.42.5(pid=25985) [trial-2362↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25999): Process ended prematurely: osmo-stp_10.42.42.5(pid=25999) [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25999)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26010): Process ended prematurely: osmo-stp_10.42.42.5(pid=26010) [trial-2362↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26010)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26025): Process ended prematurely: osmo-stp_10.42.42.5(pid=26025) [trial-2362↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26025)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26036): Process ended prematurely: osmo-stp_10.42.42.5(pid=26036) [trial-2362↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26036)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.5 sec) Error: osmo-stp_10.42.42.5(pid=26054): Process ended prematurely: osmo-stp_10.42.42.5(pid=26054) [trial-2362↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26054)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=26066): Process ended prematurely: osmo-stp_10.42.42.5(pid=26066) [trial-2362↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26066)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=26084): Process ended prematurely: osmo-stp_10.42.42.5(pid=26084) [trial-2362↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26084)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26094): Process ended prematurely: osmo-stp_10.42.42.5(pid=26094) [trial-2362↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26094)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26104): Process ended prematurely: osmo-stp_10.42.42.5(pid=26104) [trial-2362↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26104)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26124): Process ended prematurely: osmo-stp_10.42.42.5(pid=26124) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26124)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26136): Process ended prematurely: osmo-stp_10.42.42.5(pid=26136) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26136)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=26154): Process ended prematurely: osmo-stp_10.42.42.5(pid=26154) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26154)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26164): Process ended prematurely: osmo-stp_10.42.42.5(pid=26164) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26164)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26174): Process ended prematurely: osmo-stp_10.42.42.5(pid=26174) [trial-2362↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26174)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26191): Process ended prematurely: osmo-stp_10.42.42.5(pid=26191) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26191)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26203): Process ended prematurely: osmo-stp_10.42.42.5(pid=26203) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26203)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=26221): Process ended prematurely: osmo-stp_10.42.42.5(pid=26221) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26221)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26231): Process ended prematurely: osmo-stp_10.42.42.5(pid=26231) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26231)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26241): Process ended prematurely: osmo-stp_10.42.42.5(pid=26241) [trial-2362↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26241)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26258): Process ended prematurely: osmo-stp_10.42.42.5(pid=26258) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26258)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=26270): Process ended prematurely: osmo-stp_10.42.42.5(pid=26270) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26270)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26288): Process ended prematurely: osmo-stp_10.42.42.5(pid=26288) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26288)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26298): Process ended prematurely: osmo-stp_10.42.42.5(pid=26298) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26298)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26308): Process ended prematurely: osmo-stp_10.42.42.5(pid=26308) [trial-2362↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26308)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26325): Process ended prematurely: osmo-stp_10.42.42.5(pid=26325) [trial-2362↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26325)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26339): Process ended prematurely: osmo-stp_10.42.42.5(pid=26339) [trial-2362↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26339)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=26347): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26347) [trial-2362↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26347)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26359): Process ended prematurely: osmo-stp_10.42.42.5(pid=26359) [trial-2362↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26359)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=26368): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26368) [trial-2362↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26368)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26380): Process ended prematurely: osmo-stp_10.42.42.5(pid=26380) [trial-2362↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26380)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26394): Process ended prematurely: osmo-stp_10.42.42.5(pid=26394) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26394)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26405): Process ended prematurely: osmo-stp_10.42.42.5(pid=26405) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26405)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26419): Process ended prematurely: osmo-stp_10.42.42.5(pid=26419) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26419)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26430): Process ended prematurely: osmo-stp_10.42.42.5(pid=26430) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26430)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26444): Process ended prematurely: osmo-stp_10.42.42.5(pid=26444) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26444)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26455): Process ended prematurely: osmo-stp_10.42.42.5(pid=26455) [trial-2362↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26455)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26469): Process ended prematurely: osmo-stp_10.42.42.5(pid=26469) [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26469)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26480): Process ended prematurely: osmo-stp_10.42.42.5(pid=26480) [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26480)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26494): Process ended prematurely: osmo-stp_10.42.42.5(pid=26494) [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26494)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26510): Process ended prematurely: osmo-stp_10.42.42.5(pid=26510) [trial-2362↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26510)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26524): Process ended prematurely: osmo-stp_10.42.42.5(pid=26524) [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26524)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26535): Process ended prematurely: osmo-stp_10.42.42.5(pid=26535) [trial-2362↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26535)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=26820): Process ended prematurely: osmo-stp_10.42.42.5(pid=26820) [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26820)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26831): Process ended prematurely: osmo-stp_10.42.42.5(pid=26831) [trial-2362↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26831)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26845): Process ended prematurely: osmo-stp_10.42.42.5(pid=26845) [trial-2362↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26845)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26856): Process ended prematurely: osmo-stp_10.42.42.5(pid=26856) [trial-2362↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26856)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26874): Process ended prematurely: osmo-stp_10.42.42.5(pid=26874) [trial-2362↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26874)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26886): Process ended prematurely: osmo-stp_10.42.42.5(pid=26886) [trial-2362↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26886)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=26904): Process ended prematurely: osmo-stp_10.42.42.5(pid=26904) [trial-2362↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26904)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26914): Process ended prematurely: osmo-stp_10.42.42.5(pid=26914) [trial-2362↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26914)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26924): Process ended prematurely: osmo-stp_10.42.42.5(pid=26924) [trial-2362↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26924)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26951): Process ended prematurely: osmo-stp_10.42.42.5(pid=26951) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26951)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27314): Process ended prematurely: osmo-stp_10.42.42.5(pid=27314) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27314)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=27508): Process ended prematurely: osmo-stp_10.42.42.5(pid=27508) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27508)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27519): Process ended prematurely: osmo-stp_10.42.42.5(pid=27519) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27519)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27529): Process ended prematurely: osmo-stp_10.42.42.5(pid=27529) [trial-2362↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27529)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=27550): Process ended prematurely: osmo-stp_10.42.42.5(pid=27550) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27550)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27562): Process ended prematurely: osmo-stp_10.42.42.5(pid=27562) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27562)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=27580): Process ended prematurely: osmo-stp_10.42.42.5(pid=27580) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27580)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27590): Process ended prematurely: osmo-stp_10.42.42.5(pid=27590) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27590)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27600): Process ended prematurely: osmo-stp_10.42.42.5(pid=27600) [trial-2362↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27600)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=27617): Process ended prematurely: osmo-stp_10.42.42.5(pid=27617) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27617)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27629): Process ended prematurely: osmo-stp_10.42.42.5(pid=27629) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27629)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=27647): Process ended prematurely: osmo-stp_10.42.42.5(pid=27647) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27647)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27659): Process ended prematurely: osmo-stp_10.42.42.5(pid=27659) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27659)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27669): Process ended prematurely: osmo-stp_10.42.42.5(pid=27669) [trial-2362↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27669)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=27682): Process ended prematurely: osmo-stp_10.42.42.5(pid=27682) [trial-2362↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27682)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27696): Process ended prematurely: osmo-stp_10.42.42.5(pid=27696) [trial-2362↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27696)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27704): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27704) [trial-2362↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27704)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27714): Process ended prematurely: osmo-stp_10.42.42.5(pid=27714) [trial-2362↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27714)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27723): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27723) [trial-2362↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27723)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27733): Process ended prematurely: osmo-stp_10.42.42.5(pid=27733) [trial-2362↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27733)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27747): Process ended prematurely: osmo-stp_10.42.42.5(pid=27747) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27747)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27758): Process ended prematurely: osmo-stp_10.42.42.5(pid=27758) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27758)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27772): Process ended prematurely: osmo-stp_10.42.42.5(pid=27772) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27772)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27783): Process ended prematurely: osmo-stp_10.42.42.5(pid=27783) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27783)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27797): Process ended prematurely: osmo-stp_10.42.42.5(pid=27797) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27797)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27808): Process ended prematurely: osmo-stp_10.42.42.5(pid=27808) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27808)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27822): Process ended prematurely: osmo-stp_10.42.42.5(pid=27822) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27822)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27836): Process ended prematurely: osmo-stp_10.42.42.5(pid=27836) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27836)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27851): Process ended prematurely: osmo-stp_10.42.42.5(pid=27851) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27851)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27862): Process ended prematurely: osmo-stp_10.42.42.5(pid=27862) [trial-2362↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27862)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27877): Process ended prematurely: osmo-stp_10.42.42.5(pid=27877) [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27877)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27888): Process ended prematurely: osmo-stp_10.42.42.5(pid=27888) [trial-2362↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27888)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27902): Process ended prematurely: osmo-stp_10.42.42.5(pid=27902) [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27902)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27913): Process ended prematurely: osmo-stp_10.42.42.5(pid=27913) [trial-2362↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27913)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27927): Process ended prematurely: osmo-stp_10.42.42.5(pid=27927) [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27927)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27938): Process ended prematurely: osmo-stp_10.42.42.5(pid=27938) [trial-2362↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27938)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27952): Process ended prematurely: osmo-stp_10.42.42.5(pid=27952) [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27952)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27963): Process ended prematurely: osmo-stp_10.42.42.5(pid=27963) [trial-2362↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27963)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27978): Process ended prematurely: osmo-stp_10.42.42.5(pid=27978) [trial-2362↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27978)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27989): Process ended prematurely: osmo-stp_10.42.42.5(pid=27989) [trial-2362↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27989)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28011): Process ended prematurely: osmo-stp_10.42.42.5(pid=28011) [trial-2362↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28011)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28023): Process ended prematurely: osmo-stp_10.42.42.5(pid=28023) [trial-2362↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28023)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=28042): Process ended prematurely: osmo-stp_10.42.42.5(pid=28042) [trial-2362↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28042)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28052): Process ended prematurely: osmo-stp_10.42.42.5(pid=28052) [trial-2362↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28052)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28062): Process ended prematurely: osmo-stp_10.42.42.5(pid=28062) [trial-2362↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28062)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28079): Process ended prematurely: osmo-stp_10.42.42.5(pid=28079) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28079)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=28091): Process ended prematurely: osmo-stp_10.42.42.5(pid=28091) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28091)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=28109): Process ended prematurely: osmo-stp_10.42.42.5(pid=28109) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28109)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28119): Process ended prematurely: osmo-stp_10.42.42.5(pid=28119) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28119)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28129): Process ended prematurely: osmo-stp_10.42.42.5(pid=28129) [trial-2362↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28129)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28146): Process ended prematurely: osmo-stp_10.42.42.5(pid=28146) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28146)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=28158): Process ended prematurely: osmo-stp_10.42.42.5(pid=28158) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28158)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=28180): Process ended prematurely: osmo-stp_10.42.42.5(pid=28180) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28180)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28192): Process ended prematurely: osmo-stp_10.42.42.5(pid=28192) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28192)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28202): Process ended prematurely: osmo-stp_10.42.42.5(pid=28202) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28202)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28219): Process ended prematurely: osmo-stp_10.42.42.5(pid=28219) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28219)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28232): Process ended prematurely: osmo-stp_10.42.42.5(pid=28232) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28250): Process ended prematurely: osmo-stp_10.42.42.5(pid=28250) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28250)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28260): Process ended prematurely: osmo-stp_10.42.42.5(pid=28260) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28270): Process ended prematurely: osmo-stp_10.42.42.5(pid=28270) [trial-2362↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28270)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28287): Process ended prematurely: osmo-stp_10.42.42.5(pid=28287) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28287)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=28300): Process ended prematurely: osmo-stp_10.42.42.5(pid=28300) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28300)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=28318): Process ended prematurely: osmo-stp_10.42.42.5(pid=28318) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28318)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28329): Process ended prematurely: osmo-stp_10.42.42.5(pid=28329) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28329)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28339): Process ended prematurely: osmo-stp_10.42.42.5(pid=28339) [trial-2362↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28339)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28353): Process ended prematurely: osmo-stp_10.42.42.5(pid=28353) [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28353)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28366): Process ended prematurely: osmo-stp_10.42.42.5(pid=28366) [trial-2362↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28366)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=28375): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28375) [trial-2362↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28375)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=28656): Process ended prematurely: osmo-stp_10.42.42.5(pid=28656) [trial-2362↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28656)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.7 sec) Error: osmo-nitb_10.42.42.2(pid=28665): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28665) [trial-2362↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28665)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28675): Process ended prematurely: osmo-stp_10.42.42.5(pid=28675) [trial-2362↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28675)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28690): Process ended prematurely: osmo-stp_10.42.42.5(pid=28690) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28690)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28701): Process ended prematurely: osmo-stp_10.42.42.5(pid=28701) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28701)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28715): Process ended prematurely: osmo-stp_10.42.42.5(pid=28715) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28715)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28726): Process ended prematurely: osmo-stp_10.42.42.5(pid=28726) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28726)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28740): Process ended prematurely: osmo-stp_10.42.42.5(pid=28740) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28740)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28751): Process ended prematurely: osmo-stp_10.42.42.5(pid=28751) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28751)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28765): Process ended prematurely: osmo-stp_10.42.42.5(pid=28765) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28765)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28824): Process ended prematurely: osmo-stp_10.42.42.5(pid=28824) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28824)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28840): Process ended prematurely: osmo-stp_10.42.42.5(pid=28840) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28840)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28852): Process ended prematurely: osmo-stp_10.42.42.5(pid=28852) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28852)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28868): Process ended prematurely: osmo-stp_10.42.42.5(pid=28868) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28868)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28879): Process ended prematurely: osmo-stp_10.42.42.5(pid=28879) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28879)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28894): Process ended prematurely: osmo-stp_10.42.42.5(pid=28894) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28894)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28905): Process ended prematurely: osmo-stp_10.42.42.5(pid=28905) [trial-2362↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28905)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28919): Process ended prematurely: osmo-stp_10.42.42.5(pid=28919) [trial-2362↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28919)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28930): Process ended prematurely: osmo-stp_10.42.42.5(pid=28930) [trial-2362↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28930)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28948): Process ended prematurely: osmo-stp_10.42.42.5(pid=28948) [trial-2362↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28948)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=28960): Process ended prematurely: osmo-stp_10.42.42.5(pid=28960) [trial-2362↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28960)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=28978): Process ended prematurely: osmo-stp_10.42.42.5(pid=28978) [trial-2362↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28978)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28998): Process ended prematurely: osmo-stp_10.42.42.5(pid=28998) [trial-2362↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28998)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29008): Process ended prematurely: osmo-stp_10.42.42.5(pid=29008) [trial-2362↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29008)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=29025): Process ended prematurely: osmo-stp_10.42.42.5(pid=29025) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29025)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=29037): Process ended prematurely: osmo-stp_10.42.42.5(pid=29037) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29037)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=29055): Process ended prematurely: osmo-stp_10.42.42.5(pid=29055) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29055)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29065): Process ended prematurely: osmo-stp_10.42.42.5(pid=29065) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29065)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29076): Process ended prematurely: osmo-stp_10.42.42.5(pid=29076) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29076)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=29093): Process ended prematurely: osmo-stp_10.42.42.5(pid=29093) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29093)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=29106): Process ended prematurely: osmo-stp_10.42.42.5(pid=29106) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29106)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29124): Process ended prematurely: osmo-stp_10.42.42.5(pid=29124) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29124)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29134): Process ended prematurely: osmo-stp_10.42.42.5(pid=29134) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29161): Process ended prematurely: osmo-stp_10.42.42.5(pid=29161) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29161)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29173): Process ended prematurely: osmo-stp_10.42.42.5(pid=29173) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29173)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29191): Process ended prematurely: osmo-stp_10.42.42.5(pid=29191) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29191)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29562): Process ended prematurely: osmo-stp_10.42.42.5(pid=29562) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29562)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=29747): Process ended prematurely: osmo-stp_10.42.42.5(pid=29747) [trial-2362↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29747)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29761): Process ended prematurely: osmo-stp_10.42.42.5(pid=29761) [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29761)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29777): Process ended prematurely: osmo-stp_10.42.42.5(pid=29777) [trial-2362↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29777)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29785): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29785) [trial-2362↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29785)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29796): Process ended prematurely: osmo-stp_10.42.42.5(pid=29796) [trial-2362↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29796)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=29805): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29805) [trial-2362↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29805)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29815): Process ended prematurely: osmo-stp_10.42.42.5(pid=29815) [trial-2362↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29815)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29829): Process ended prematurely: osmo-stp_10.42.42.5(pid=29829) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29829)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29840): Process ended prematurely: osmo-stp_10.42.42.5(pid=29840) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29840)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29854): Process ended prematurely: osmo-stp_10.42.42.5(pid=29854) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29854)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29865): Process ended prematurely: osmo-stp_10.42.42.5(pid=29865) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29865)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29879): Process ended prematurely: osmo-stp_10.42.42.5(pid=29879) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29879)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29890): Process ended prematurely: osmo-stp_10.42.42.5(pid=29890) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29890)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29906): Process ended prematurely: osmo-stp_10.42.42.5(pid=29906) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29906)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29917): Process ended prematurely: osmo-stp_10.42.42.5(pid=29917) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29917)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29931): Process ended prematurely: osmo-stp_10.42.42.5(pid=29931) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29931)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29942): Process ended prematurely: osmo-stp_10.42.42.5(pid=29942) [trial-2362↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29942)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29956): Process ended prematurely: osmo-stp_10.42.42.5(pid=29956) [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29956)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29967): Process ended prematurely: osmo-stp_10.42.42.5(pid=29967) [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29967)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29982): Process ended prematurely: osmo-stp_10.42.42.5(pid=29982) [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29982)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29993): Process ended prematurely: osmo-stp_10.42.42.5(pid=29993) [trial-2362↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29993)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30007): Process ended prematurely: osmo-stp_10.42.42.5(pid=30007) [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30007)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30018): Process ended prematurely: osmo-stp_10.42.42.5(pid=30018) [trial-2362↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30018)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30032): Process ended prematurely: osmo-stp_10.42.42.5(pid=30032) [trial-2362↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30032)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30043): Process ended prematurely: osmo-stp_10.42.42.5(pid=30043) [trial-2362↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30043)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30061): Process ended prematurely: osmo-stp_10.42.42.5(pid=30061) [trial-2362↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30061)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=30077): Process ended prematurely: osmo-stp_10.42.42.5(pid=30077) [trial-2362↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30077)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30095): Process ended prematurely: osmo-stp_10.42.42.5(pid=30095) [trial-2362↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30095)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30105): Process ended prematurely: osmo-stp_10.42.42.5(pid=30105) [trial-2362↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30105)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30115): Process ended prematurely: osmo-stp_10.42.42.5(pid=30115) [trial-2362↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30115)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=30132): Process ended prematurely: osmo-stp_10.42.42.5(pid=30132) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30132)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30144): Process ended prematurely: osmo-stp_10.42.42.5(pid=30144) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30144)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=30162): Process ended prematurely: osmo-stp_10.42.42.5(pid=30162) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30162)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30172): Process ended prematurely: osmo-stp_10.42.42.5(pid=30172) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30172)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30182): Process ended prematurely: osmo-stp_10.42.42.5(pid=30182) [trial-2362↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30182)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30200): Process ended prematurely: osmo-stp_10.42.42.5(pid=30200) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30200)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=30212): Process ended prematurely: osmo-stp_10.42.42.5(pid=30212) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30212)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=30236): Process ended prematurely: osmo-stp_10.42.42.5(pid=30236) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30236)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30246): Process ended prematurely: osmo-stp_10.42.42.5(pid=30246) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30246)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30256): Process ended prematurely: osmo-stp_10.42.42.5(pid=30256) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30256)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=30273): Process ended prematurely: osmo-stp_10.42.42.5(pid=30273) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30273)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30511): Process ended prematurely: osmo-stp_10.42.42.5(pid=30511) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30511)] FAIL: iperf3m4.py (11.8 sec) Error: osmo-stp_10.42.42.5(pid=30576): Process ended prematurely: osmo-stp_10.42.42.5(pid=30576) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30576)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30586): Process ended prematurely: osmo-stp_10.42.42.5(pid=30586) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30586)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30597): Process ended prematurely: osmo-stp_10.42.42.5(pid=30597) [trial-2362↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30597)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=30614): Process ended prematurely: osmo-stp_10.42.42.5(pid=30614) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30614)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=30626): Process ended prematurely: osmo-stp_10.42.42.5(pid=30626) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30626)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=30645): Process ended prematurely: osmo-stp_10.42.42.5(pid=30645) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30645)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30656): Process ended prematurely: osmo-stp_10.42.42.5(pid=30656) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30666): Process ended prematurely: osmo-stp_10.42.42.5(pid=30666) [trial-2362↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30666)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30680): Process ended prematurely: osmo-stp_10.42.42.5(pid=30680) [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30680)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30696): Process ended prematurely: osmo-stp_10.42.42.5(pid=30696) [trial-2362↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30696)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=30704): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30704) [trial-2362↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30704)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30715): Process ended prematurely: osmo-stp_10.42.42.5(pid=30715) [trial-2362↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30715)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30724) [trial-2362↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30724)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30734): Process ended prematurely: osmo-stp_10.42.42.5(pid=30734) [trial-2362↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30734)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30748): Process ended prematurely: osmo-stp_10.42.42.5(pid=30748) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30748)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30759): Process ended prematurely: osmo-stp_10.42.42.5(pid=30759) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30759)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30773): Process ended prematurely: osmo-stp_10.42.42.5(pid=30773) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30773)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30784): Process ended prematurely: osmo-stp_10.42.42.5(pid=30784) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30784)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30798): Process ended prematurely: osmo-stp_10.42.42.5(pid=30798) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30798)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30809): Process ended prematurely: osmo-stp_10.42.42.5(pid=30809) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30809)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30823): Process ended prematurely: osmo-stp_10.42.42.5(pid=30823) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30823)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30834): Process ended prematurely: osmo-stp_10.42.42.5(pid=30834) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30834)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30848): Process ended prematurely: osmo-stp_10.42.42.5(pid=30848) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30848)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30859): Process ended prematurely: osmo-stp_10.42.42.5(pid=30859) [trial-2362↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30859)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30874): Process ended prematurely: osmo-stp_10.42.42.5(pid=30874) [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30874)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30885): Process ended prematurely: osmo-stp_10.42.42.5(pid=30885) [trial-2362↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30885)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30899): Process ended prematurely: osmo-stp_10.42.42.5(pid=30899) [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30899)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30910): Process ended prematurely: osmo-stp_10.42.42.5(pid=30910) [trial-2362↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30910)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30924): Process ended prematurely: osmo-stp_10.42.42.5(pid=30924) [trial-2362↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30924)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30936): Process ended prematurely: osmo-stp_10.42.42.5(pid=30936) [trial-2362↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30936)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=30954): Process ended prematurely: osmo-stp_10.42.42.5(pid=30954) [trial-2362↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30954)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=30967): Process ended prematurely: osmo-stp_10.42.42.5(pid=30967) [trial-2362↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30967)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30985): Process ended prematurely: osmo-stp_10.42.42.5(pid=30985) [trial-2362↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30985)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30995): Process ended prematurely: osmo-stp_10.42.42.5(pid=30995) [trial-2362↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30995)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31005): Process ended prematurely: osmo-stp_10.42.42.5(pid=31005) [trial-2362↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31005)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=31024): Process ended prematurely: osmo-stp_10.42.42.5(pid=31024) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31024)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=31036): Process ended prematurely: osmo-stp_10.42.42.5(pid=31036) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31036)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=31098): Process ended prematurely: osmo-stp_10.42.42.5(pid=31098) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31098)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31109): Process ended prematurely: osmo-stp_10.42.42.5(pid=31109) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31109)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31119): Process ended prematurely: osmo-stp_10.42.42.5(pid=31119) [trial-2362↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31119)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=31138): Process ended prematurely: osmo-stp_10.42.42.5(pid=31138) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31138)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31150): Process ended prematurely: osmo-stp_10.42.42.5(pid=31150) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31150)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=31168): Process ended prematurely: osmo-stp_10.42.42.5(pid=31168) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31168)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31179): Process ended prematurely: osmo-stp_10.42.42.5(pid=31179) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31179)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31189): Process ended prematurely: osmo-stp_10.42.42.5(pid=31189) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31189)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=31207): Process ended prematurely: osmo-stp_10.42.42.5(pid=31207) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31207)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31219): Process ended prematurely: osmo-stp_10.42.42.5(pid=31219) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31219)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=31237): Process ended prematurely: osmo-stp_10.42.42.5(pid=31237) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31237)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31247): Process ended prematurely: osmo-stp_10.42.42.5(pid=31247) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31247)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31258): Process ended prematurely: osmo-stp_10.42.42.5(pid=31258) [trial-2362↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31258)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31271): Process ended prematurely: osmo-stp_10.42.42.5(pid=31271) [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31271)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31284): Process ended prematurely: osmo-stp_10.42.42.5(pid=31284) [trial-2362↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31284)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=31293): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31293) [trial-2362↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31293)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2362↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=31312): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31312) [trial-2362↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31312)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31322): Process ended prematurely: osmo-stp_10.42.42.5(pid=31322) [trial-2362↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31322)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31336): Process ended prematurely: osmo-stp_10.42.42.5(pid=31336) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31336)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31347): Process ended prematurely: osmo-stp_10.42.42.5(pid=31347) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31347)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31361): Process ended prematurely: osmo-stp_10.42.42.5(pid=31361) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31361)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31373): Process ended prematurely: osmo-stp_10.42.42.5(pid=31373) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31373)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31387): Process ended prematurely: osmo-stp_10.42.42.5(pid=31387) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31387)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31398): Process ended prematurely: osmo-stp_10.42.42.5(pid=31398) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31398)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31412): Process ended prematurely: osmo-stp_10.42.42.5(pid=31412) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31412)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31423): Process ended prematurely: osmo-stp_10.42.42.5(pid=31423) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31423)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31441): Process ended prematurely: osmo-stp_10.42.42.5(pid=31441) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31441)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31452): Process ended prematurely: osmo-stp_10.42.42.5(pid=31452) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31452)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31466): Process ended prematurely: osmo-stp_10.42.42.5(pid=31466) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31466)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31491): Process ended prematurely: osmo-stp_10.42.42.5(pid=31491) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31491)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31502): Process ended prematurely: osmo-stp_10.42.42.5(pid=31502) [trial-2362↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31502)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31516): Process ended prematurely: osmo-stp_10.42.42.5(pid=31516) [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31516)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31527): Process ended prematurely: osmo-stp_10.42.42.5(pid=31527) [trial-2362↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31527)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=31546): Process ended prematurely: osmo-stp_10.42.42.5(pid=31546) [trial-2362↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31546)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31559): Process ended prematurely: osmo-stp_10.42.42.5(pid=31559) [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31559)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=31577): Process ended prematurely: osmo-stp_10.42.42.5(pid=31577) [trial-2362↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31577)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31587): Process ended prematurely: osmo-stp_10.42.42.5(pid=31587) [trial-2362↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31587)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31597): Process ended prematurely: osmo-stp_10.42.42.5(pid=31597) [trial-2362↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31597)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=31614): Process ended prematurely: osmo-stp_10.42.42.5(pid=31614) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31614)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=31626): Process ended prematurely: osmo-stp_10.42.42.5(pid=31626) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31626)] FAIL: iperf3m4.py (11.6 sec) Error: osmo-stp_10.42.42.5(pid=31915): Process ended prematurely: osmo-stp_10.42.42.5(pid=31915) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31915)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31925): Process ended prematurely: osmo-stp_10.42.42.5(pid=31925) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31925)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31936): Process ended prematurely: osmo-stp_10.42.42.5(pid=31936) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31936)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31954): Process ended prematurely: osmo-stp_10.42.42.5(pid=31954) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31954)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=31966): Process ended prematurely: osmo-stp_10.42.42.5(pid=31966) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31966)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=31984): Process ended prematurely: osmo-stp_10.42.42.5(pid=31984) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31984)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31995): Process ended prematurely: osmo-stp_10.42.42.5(pid=31995) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31995)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32005): Process ended prematurely: osmo-stp_10.42.42.5(pid=32005) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32005)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32022): Process ended prematurely: osmo-stp_10.42.42.5(pid=32022) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=32034): Process ended prematurely: osmo-stp_10.42.42.5(pid=32034) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32034)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=32055): Process ended prematurely: osmo-stp_10.42.42.5(pid=32055) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32055)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32066): Process ended prematurely: osmo-stp_10.42.42.5(pid=32066) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32066)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32076): Process ended prematurely: osmo-stp_10.42.42.5(pid=32076) [trial-2362↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32076)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32090): Process ended prematurely: osmo-stp_10.42.42.5(pid=32090) [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32090)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32103): Process ended prematurely: osmo-stp_10.42.42.5(pid=32103) [trial-2362↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32103)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=32111): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32111) [trial-2362↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32111)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=32121): Process ended prematurely: osmo-stp_10.42.42.5(pid=32121) [trial-2362↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32121)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=32130): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32130) [trial-2362↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32130)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=32140): Process ended prematurely: osmo-stp_10.42.42.5(pid=32140) [trial-2362↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32140)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32154): Process ended prematurely: osmo-stp_10.42.42.5(pid=32154) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32154)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32165): Process ended prematurely: osmo-stp_10.42.42.5(pid=32165) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32165)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32179): Process ended prematurely: osmo-stp_10.42.42.5(pid=32179) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32179)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32190): Process ended prematurely: osmo-stp_10.42.42.5(pid=32190) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32190)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32205): Process ended prematurely: osmo-stp_10.42.42.5(pid=32205) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32205)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32216): Process ended prematurely: osmo-stp_10.42.42.5(pid=32216) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32216)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32231): Process ended prematurely: osmo-stp_10.42.42.5(pid=32231) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32231)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32242): Process ended prematurely: osmo-stp_10.42.42.5(pid=32242) [trial-2362↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32242)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32257): Process ended prematurely: osmo-stp_10.42.42.5(pid=32257) [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32257)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32268): Process ended prematurely: osmo-stp_10.42.42.5(pid=32268) [trial-2362↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32268)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32282): Process ended prematurely: osmo-stp_10.42.42.5(pid=32282) [trial-2362↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32282)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32293): Process ended prematurely: osmo-stp_10.42.42.5(pid=32293) [trial-2362↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32293)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32311): Process ended prematurely: osmo-stp_10.42.42.5(pid=32311) [trial-2362↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32311)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=32323): Process ended prematurely: osmo-stp_10.42.42.5(pid=32323) [trial-2362↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32323)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=32341): Process ended prematurely: osmo-stp_10.42.42.5(pid=32341) [trial-2362↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32341)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32352): Process ended prematurely: osmo-stp_10.42.42.5(pid=32352) [trial-2362↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32352)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32362): Process ended prematurely: osmo-stp_10.42.42.5(pid=32362) [trial-2362↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32362)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32379): Process ended prematurely: osmo-stp_10.42.42.5(pid=32379) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32379)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=32391): Process ended prematurely: osmo-stp_10.42.42.5(pid=32391) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32391)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=32412): Process ended prematurely: osmo-stp_10.42.42.5(pid=32412) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32412)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32422): Process ended prematurely: osmo-stp_10.42.42.5(pid=32422) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32422)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32432): Process ended prematurely: osmo-stp_10.42.42.5(pid=32432) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32432)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32449): Process ended prematurely: osmo-stp_10.42.42.5(pid=32449) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32449)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=32461): Process ended prematurely: osmo-stp_10.42.42.5(pid=32461) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32461)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=32479): Process ended prematurely: osmo-stp_10.42.42.5(pid=32479) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32479)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32489): Process ended prematurely: osmo-stp_10.42.42.5(pid=32489) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32489)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32499): Process ended prematurely: osmo-stp_10.42.42.5(pid=32499) [trial-2362↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32499)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32513): Process ended prematurely: osmo-stp_10.42.42.5(pid=32513) [trial-2362↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32513)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32528): Process ended prematurely: osmo-stp_10.42.42.5(pid=32528) [trial-2362↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32528)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32540): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32540) [trial-2362↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32540)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=32550): Process ended prematurely: osmo-stp_10.42.42.5(pid=32550) [trial-2362↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32550)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32564): Process ended prematurely: osmo-stp_10.42.42.5(pid=32564) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32564)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32575): Process ended prematurely: osmo-stp_10.42.42.5(pid=32575) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32575)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32589): Process ended prematurely: osmo-stp_10.42.42.5(pid=32589) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32589)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32603): Process ended prematurely: osmo-stp_10.42.42.5(pid=32603) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32603)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32617): Process ended prematurely: osmo-stp_10.42.42.5(pid=32617) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32617)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32628): Process ended prematurely: osmo-stp_10.42.42.5(pid=32628) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32628)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32642): Process ended prematurely: osmo-stp_10.42.42.5(pid=32642) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32642)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32653): Process ended prematurely: osmo-stp_10.42.42.5(pid=32653) [trial-2362↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32653)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32667): Process ended prematurely: osmo-stp_10.42.42.5(pid=32667) [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32667)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32678): Process ended prematurely: osmo-stp_10.42.42.5(pid=32678) [trial-2362↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32678)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32692): Process ended prematurely: osmo-stp_10.42.42.5(pid=32692) [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32692)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32703): Process ended prematurely: osmo-stp_10.42.42.5(pid=32703) [trial-2362↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32703)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32717): Process ended prematurely: osmo-stp_10.42.42.5(pid=32717) [trial-2362↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32717)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32729): Process ended prematurely: osmo-stp_10.42.42.5(pid=32729) [trial-2362↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32729)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=32747): Process ended prematurely: osmo-stp_10.42.42.5(pid=32747) [trial-2362↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32747)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=32762): Process ended prematurely: osmo-stp_10.42.42.5(pid=32762) [trial-2362↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32762)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=312): Process ended prematurely: osmo-stp_10.42.42.5(pid=312) [trial-2362↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=312)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=322): Process ended prematurely: osmo-stp_10.42.42.5(pid=322) [trial-2362↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=322)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=332): Process ended prematurely: osmo-stp_10.42.42.5(pid=332) [trial-2362↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=332)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=356): Process ended prematurely: osmo-stp_10.42.42.5(pid=356) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=356)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=374): Process ended prematurely: osmo-stp_10.42.42.5(pid=374) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=374)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=392): Process ended prematurely: osmo-stp_10.42.42.5(pid=392) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=392)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=403): Process ended prematurely: osmo-stp_10.42.42.5(pid=403) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=403)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=413): Process ended prematurely: osmo-stp_10.42.42.5(pid=413) [trial-2362↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=413)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=430): Process ended prematurely: osmo-stp_10.42.42.5(pid=430) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=430)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=442): Process ended prematurely: osmo-stp_10.42.42.5(pid=442) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=442)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=460): Process ended prematurely: osmo-stp_10.42.42.5(pid=460) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=460)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=470): Process ended prematurely: osmo-stp_10.42.42.5(pid=470) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=470)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=486): Process ended prematurely: osmo-stp_10.42.42.5(pid=486) [trial-2362↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=486)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=504): Process ended prematurely: osmo-stp_10.42.42.5(pid=504) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=504)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=787): Process ended prematurely: osmo-stp_10.42.42.5(pid=787) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=787)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=805): Process ended prematurely: osmo-stp_10.42.42.5(pid=805) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=805)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=816): Process ended prematurely: osmo-stp_10.42.42.5(pid=816) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=816)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=828): Process ended prematurely: osmo-stp_10.42.42.5(pid=828) [trial-2362↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=828)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=846): Process ended prematurely: osmo-stp_10.42.42.5(pid=846) [trial-2362↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=846)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=854): Process ended prematurely: osmo-nitb_10.42.42.2(pid=854) [trial-2362↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=854)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=856): Process ended prematurely: osmo-nitb_10.42.42.2(pid=856) [trial-2362↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=856)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=858): Process ended prematurely: osmo-nitb_10.42.42.2(pid=858) [trial-2362↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=858)] FAIL: esme_ms_sms_transaction.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=860): Process ended prematurely: osmo-nitb_10.42.42.2(pid=860) [trial-2362↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=860)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.5 sec) Error: osmo-hlr_10.42.42.2(pid=871): Process ended prematurely: osmo-hlr_10.42.42.2(pid=871) [trial-2362↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=871)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=896): Process ended prematurely: osmo-hlr_10.42.42.2(pid=896) [trial-2362↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=896)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=908): Process ended prematurely: osmo-stp_10.42.42.5(pid=908) [trial-2362↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=908)] FAIL: esme_ms_sms_transaction.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=919): Process ended prematurely: osmo-stp_10.42.42.5(pid=919) [trial-2362↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=919)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=933): Process ended prematurely: osmo-stp_10.42.42.5(pid=933) [trial-2362↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=933)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=945): Process ended prematurely: osmo-stp_10.42.42.5(pid=945) [trial-2362↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=945)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=962): Process ended prematurely: osmo-stp_10.42.42.5(pid=962) [trial-2362↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=962)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=973): Process ended prematurely: osmo-stp_10.42.42.5(pid=973) [trial-2362↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=973)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.6 sec) Error: srsepc(pid=998): Process ended prematurely: srsepc(pid=998) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=998)] FAIL: iperf3_bidir.py (18.5 sec) Error: srsepc(pid=1014): Process ended prematurely: srsepc(pid=1014) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1014)] FAIL: iperf3_dl.py (19.1 sec) Error: srsepc(pid=1030): Process ended prematurely: srsepc(pid=1030) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1030)] FAIL: iperf3_ul.py (18.9 sec) Error: srsepc(pid=1046): Process ended prematurely: srsepc(pid=1046) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1046)] FAIL: ping.py (18.1 sec) Error: srsepc(pid=1062): Process ended prematurely: srsepc(pid=1062) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1062)] FAIL: rrc_idle_mo_ping.py (18.6 sec) Error: srsepc(pid=1078): Process ended prematurely: srsepc(pid=1078) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1078)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=1094): Process ended prematurely: srsepc(pid=1094) [trial-2362↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1094)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1114): Process ended prematurely: osmo-stp_10.42.42.5(pid=1114) [trial-2362↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1114)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1139): Process ended prematurely: osmo-stp_10.42.42.5(pid=1139) [trial-2362↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1154): Process ended prematurely: osmo-stp_10.42.42.5(pid=1154) [trial-2362↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1168): Process ended prematurely: osmo-stp_10.42.42.5(pid=1168) [trial-2362↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1168)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1184): Process ended prematurely: osmo-stp_10.42.42.5(pid=1184) [trial-2362↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1184)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1198): Process ended prematurely: osmo-stp_10.42.42.5(pid=1198) [trial-2362↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1198)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1212): Process ended prematurely: osmo-stp_10.42.42.5(pid=1212) [trial-2362↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1212)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1226): Process ended prematurely: osmo-stp_10.42.42.5(pid=1226) [trial-2362↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1226)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1241): Process ended prematurely: osmo-stp_10.42.42.5(pid=1241) [trial-2362↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1241)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1255): Process ended prematurely: osmo-stp_10.42.42.5(pid=1255) [trial-2362↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1255)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1269): Process ended prematurely: osmo-stp_10.42.42.5(pid=1269) [trial-2362↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1269)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1283): Process ended prematurely: osmo-stp_10.42.42.5(pid=1283) [trial-2362↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1283)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1301): Process ended prematurely: osmo-stp_10.42.42.5(pid=1301) [trial-2362↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1301)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1315): Process ended prematurely: osmo-stp_10.42.42.5(pid=1315) [trial-2362↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1315)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1330): Process ended prematurely: osmo-stp_10.42.42.5(pid=1330) [trial-2362↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1330)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1344): Process ended prematurely: osmo-stp_10.42.42.5(pid=1344) [trial-2362↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1344)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1358): Process ended prematurely: osmo-stp_10.42.42.5(pid=1358) [trial-2362↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1358)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=1372): Process ended prematurely: osmo-stp_10.42.42.5(pid=1372) [trial-2362↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1372)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1387): Process ended prematurely: osmo-stp_10.42.42.5(pid=1387) [trial-2362↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1387)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1401): Process ended prematurely: osmo-stp_10.42.42.5(pid=1401) [trial-2362↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1401)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1415): Process ended prematurely: osmo-stp_10.42.42.5(pid=1415) [trial-2362↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1415)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1429): Process ended prematurely: osmo-stp_10.42.42.5(pid=1429) [trial-2362↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1429)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1443): Process ended prematurely: osmo-stp_10.42.42.5(pid=1443) [trial-2362↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1443)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1457): Process ended prematurely: osmo-stp_10.42.42.5(pid=1457) [trial-2362↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1457)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1471): Process ended prematurely: osmo-stp_10.42.42.5(pid=1471) [trial-2362↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1471)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1485): Process ended prematurely: osmo-stp_10.42.42.5(pid=1485) [trial-2362↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1485)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=1503): Process ended prematurely: osmo-stp_10.42.42.5(pid=1503) [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1503)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1517): Process ended prematurely: osmo-stp_10.42.42.5(pid=1517) [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1517)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1533): Process ended prematurely: osmo-stp_10.42.42.5(pid=1533) [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1533)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1547): Process ended prematurely: osmo-stp_10.42.42.5(pid=1547) [trial-2362↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1547)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1561): Process ended prematurely: osmo-stp_10.42.42.5(pid=1561) [trial-2362↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1561)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1575): Process ended prematurely: osmo-stp_10.42.42.5(pid=1575) [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1575)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1589): Process ended prematurely: osmo-stp_10.42.42.5(pid=1589) [trial-2362↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1603): Process ended prematurely: osmo-stp_10.42.42.5(pid=1603) [trial-2362↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1603)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1617): Process ended prematurely: osmo-stp_10.42.42.5(pid=1617) [trial-2362↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1617)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=1631): Process ended prematurely: osmo-stp_10.42.42.5(pid=1631) [trial-2362↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1631)] + rm -rf trial-2362/inst + cd trial-2362 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 17:09:56 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362-run.tgz run.2022-12-09_17-10-07 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2362-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2948.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29260.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30036.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE